Jake Moshenko
d8149295ab
Update the GC code to do everything with subqueries, making each GC run a bounded finite number of queries with a fixed length.
2014-10-17 14:33:04 -04:00
Jake Moshenko
380eb49e58
Split out the GC code into smaller transactions. Remove from the actual storage component after the fact, outside of the transactions.
2014-10-17 11:42:09 -04:00
Joseph Schorr
ddab067ebf
jQuery requires a string to make this an update call
2014-10-17 11:33:33 -04:00
Joseph Schorr
28e31150b9
Fix small possible NPE
2014-10-17 11:33:03 -04:00
Joseph Schorr
a423032e80
- Make sure we log when an exception occurs in the squashing code
...
- Have queue file always try to return any remaining data in the buffer
- Remove the raise of the exception when we get an empty tar file
2014-10-16 12:54:16 -04:00
Joseph Schorr
53349e313e
Merge branch 'master' of https://bitbucket.org/yackob03/quay
2014-10-15 17:24:31 -04:00
Joseph Schorr
ee99e68a67
Fix gzip wrap to keep reading from the buffer once the inner loop has completed
2014-10-15 17:24:17 -04:00
Jake Moshenko
23bf74fd34
Merge branch 'master' of bitbucket.org:yackob03/quay
2014-10-15 16:30:15 -04:00
Joseph Schorr
e4d9bacccb
Fix other typo
2014-10-15 16:18:34 -04:00
Joseph Schorr
642ebed084
Fix typo
2014-10-15 16:05:51 -04:00
Joseph Schorr
007efb1143
Switch to using our branch of docker-py
2014-10-15 16:03:16 -04:00
Joseph Schorr
daa194aef7
Re-add removed testdb
2014-10-15 15:52:12 -04:00
Joseph Schorr
d43109d7cb
- Merge branch 'master' into sha-lom
...
- Extract out the tar handling from streamlayerformat into tarlayerformat
- Add a new tarfileappender class to make it easy to append data to gzipped tars
- Fix the gzipwrap to properly close
- Have the .git injection use the new appender
2014-10-15 15:51:34 -04:00
Jake Moshenko
d85bd1cb66
Update the dockerfiles to remove build time dependencies.
2014-10-15 12:03:52 -04:00
Joseph Schorr
dba75a08af
Make sure to handle deleted prefixes properly
2014-10-15 11:57:54 -04:00
Joseph Schorr
da28bc4ce9
- Handle missing images properly
...
- Add support for deleting directories
- Add a slew of tests for deletion of directories and other kinds of deletion and layering
2014-10-14 21:40:02 -04:00
Joseph Schorr
eef7edab49
Fix file deletion skipping
2014-10-14 18:48:26 -04:00
Joseph Schorr
6cac237075
Make the curl command for pulling follow redirects
2014-10-14 16:46:11 -04:00
Joseph Schorr
b234019a02
Fix tests
2014-10-14 16:23:01 -04:00
Joseph Schorr
efb3c6c494
Make sure we send the extra zeros in chunks
2014-10-14 15:58:52 -04:00
Joseph Schorr
3b88ba7373
Merge branch 'master' of https://bitbucket.org/yackob03/quay
2014-10-14 15:46:42 -04:00
Joseph Schorr
c3171a2690
Redo the UI for the trigger setup dialog and add the ability for github triggers to be filtered using a regex on their branch name.
2014-10-14 15:46:35 -04:00
Jake Moshenko
fa6a06502d
Change the default redis host to localhost. Fix some whitespace issues in the userevents module.
2014-10-14 14:37:02 -04:00
Jake Moshenko
44637dad96
Merge branch 'master' of bitbucket.org:yackob03/quay
2014-10-14 13:58:14 -04:00
Jake Moshenko
328db8b660
Split the app into separate backends, which can use different worker types and different timeouts.
2014-10-14 13:58:08 -04:00
Joseph Schorr
37aa70c28e
Notifications must check for the user OR an organization with the namespace name
2014-10-10 19:05:20 -04:00
Joseph Schorr
07f3bd6f8c
Add a synthetic .git directory containing the commit sha so that 'git rev-parse HEAD' works from inside builds
2014-10-10 17:20:07 -04:00
Joseph Schorr
49f8629566
Make the default mail sender use the Flask mail config value
2014-10-10 13:14:33 -04:00
Joseph Schorr
adc915a5eb
Fix the subprocesses to also use their own storage classes; this fixes a socket error when talking to S3
2014-10-08 16:54:03 -04:00
Joseph Schorr
7ef3be5842
Add the exception's message to the traceback
2014-10-08 14:20:57 -04:00
Joseph Schorr
6007789480
Send the full traceback with any exceptions in the queue process
2014-10-08 14:18:41 -04:00
Joseph Schorr
bb9502ee77
Make sure to raise the exception for WSGI and make the delete method's intent more clear
2014-10-08 13:51:50 -04:00
Joseph Schorr
d16fdde528
Fix bug in dockerloadformat and make sure we handle exceptions properly in the verb call
2014-10-08 13:43:12 -04:00
Jake Moshenko
c34a8b6727
Fix the squashed image migration to insert the proper image transformation type.
2014-10-08 11:47:02 -04:00
Jake Moshenko
1a8287af55
Missed a table import.
2014-10-07 17:33:20 -04:00
Jake Moshenko
6ddd4b5570
Refresh the base image and the python requirements.
2014-10-07 17:10:46 -04:00
Jake Moshenko
8a37d63e35
Update the test db to use unique uuds for images storages.
2014-10-07 16:40:44 -04:00
Jake Moshenko
626d984fb2
Fixes to the migration generator script.
2014-10-07 16:09:30 -04:00
Jake Moshenko
fe59ad4fb5
Rectify our prod database, previous migrations, and database definition files.
2014-10-07 16:03:57 -04:00
Joseph Schorr
f4daa5e97b
- Update the migrations tool to verify migrations work up and down for both MySQL and PostgresSQL.
...
- Add migrations for the squashed image tables and for backfilling the uncompressed sizes
- Make sure gzip stream uses a max length when determining the uncompressed size
2014-10-07 15:29:56 -04:00
Joseph Schorr
f38ce51943
Merge master into laffa
2014-10-07 14:03:17 -04:00
Jake Moshenko
1850a187d5
Skip images with memory errors on the backfill.
2014-10-07 13:13:03 -04:00
Jake Moshenko
55460cdcba
Better error handling in the uncompressedsize script.
2014-10-07 10:22:02 -04:00
Jake Moshenko
4ad592e7ce
Add an index to the image storage uuid to improve performance.
2014-10-06 18:44:37 -04:00
Jake Moshenko
987eb4f9fa
Merge branch 'master' of bitbucket.org:yackob03/quay
2014-10-06 17:15:53 -04:00
Jake Moshenko
153dbc3f92
Select random records to use for the backfill script for uncompressed sizes, can now be parallelized.
2014-10-06 17:15:45 -04:00
Joseph Schorr
773c9ac0ee
Clarify the language around default permissions
2014-10-06 16:56:43 -04:00
Jake Moshenko
c4266140e2
Fix all of the upgrades and downgrades to work on both mysql and postgres.
2014-10-06 16:41:49 -04:00
Joseph Schorr
9d898bca65
Make Hipchat token messaging more clear
2014-10-06 12:17:05 -04:00
Jake Moshenko
962062fb08
Fix a 512mb chunk size to 5mb
2014-10-06 11:26:23 -04:00
