8868 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Joseph Schorr	70df10dade	Change manifest backfill to lookup missing content checksums in the repository ... After discussion, we decided the best solution for the missing content checksum problem was to lookup the proper blobs in the repository and, if not present, mark the manifest as broken, as this would reflect the actual issue the user faces if they pull the repository tag today via V2	2018-08-14 14:36:19 -04:00
Joseph Schorr	c30214c7a8	Start on a basic registry_model interface and change a single module to use it. This will allow us to completely abstract out how we deal with registry-related tables and ensure that transitioning to the new OCI-like model will be easier to do.	2018-08-14 13:48:59 -04:00
Joseph Schorr	c0d25d3149	Merge pull request #3202 from quay/fix-backfill-manifest-for-non-checksum-images ... Fix manifest backfill for manifests pointing to V1 images	2018-08-13 18:19:02 -04:00
Joseph Schorr	96e0fc4ad6	Fix manifest backfill for manifests pointing to V1 images ... V1 images don't have checksums, so we just always use the full storage set for the manifest, rather than a checksum map	2018-08-13 15:51:18 -04:00
Joseph Schorr	73e585df49	Merge pull request #3194 from quay/joseph.schorr/QUAY-1013-1015/backfill-worker ... Add worker to backfill the new manifest tables from the tagmanifest table	2018-08-13 14:59:03 -04:00
Joseph Schorr	f2d50b3f8e	Add run commands for backfill worker	2018-08-13 14:56:32 -04:00
Joseph Schorr	03ea3a3250	Add worker to backfill the new manifest tables from the tagmanifest table	2018-08-13 14:56:31 -04:00
Joseph Schorr	805e928dff	Merge pull request #3199 from quay/fix-registry-tests ... Fix registry tests to not terminate prematurely when looking for errors	2018-08-10 18:06:22 -04:00
Sam Chow	d387ba171f	Adds ability to upload config dir to k8s in config	2018-08-10 17:43:30 -04:00
Sam Chow	3d4e43c8d1	Add fetching of qe deployments in config tool	2018-08-10 17:42:41 -04:00
Joseph Schorr	b39f53ee38	Merge pull request #3198 from quay/batch-blob-inserts ... Change ManifestBlob row creation to be a single batch operation	2018-08-10 15:11:26 -04:00
Joseph Schorr	701eac5466	Fix registry tests to not terminate prematurely when looking for errors ... Also reorders a check in the V1 protocol to have better error messaging for the users	2018-08-10 13:36:20 -04:00
Joseph Schorr	2ab7ca30d0	Change ManifestBlob row creation to be a single batch operation ... Should reduce DB roundtrip times and the overall time we spend under the transaction	2018-08-09 17:04:16 -04:00
Joseph Schorr	1f04b3ea03	Merge pull request #3197 from quay/remove-transaction ... Remove the transaction around creating the tag and the tag manifest	2018-08-09 16:34:31 -04:00
Joseph Schorr	ad03404d31	Merge pull request #3196 from quay/joseph.schorr/QUAY-1021/manifest-links ... Allow lookup of "dead" manifests so manifest links can be clicked in the tag history	2018-08-09 16:32:25 -04:00
Joseph Schorr	8cdddd365b	Remove the transaction around creating the tag and the tag manifest ... The tag manifest creation operation is now quite a bit heavier (because it is populating a bunch of new-model tables as well), and it is not necessary for the transaction to include this operation, because tags are valid without manifests currently.	2018-08-09 16:32:07 -04:00
Joseph Schorr	590f8f65a3	Allow lookup of "dead" manifests so manifest links can be clicked in the tag history ... Fixes https://jira.coreos.com/browse/QUAY-1021	2018-08-09 16:05:10 -04:00
Joseph Schorr	f6902f8096	Merge pull request #3193 from quay/ipresolver-perf ... Make IP resolver performance a bit better by skipping an unnecessary set	2018-08-08 17:28:47 -04:00
Sida Chen	549b286650	Merge pull request #3190 from KeyboardNerd/sidchen/boto_change ... Changes boto2 pip source to point to the fixed	2018-08-08 14:51:37 -04:00
Sida Chen	bccff26e69	Changes boto2 pip source ... Changes requirements file to point boto2 to devtable repo, which contains the fix for SigV4 connection problem.	2018-08-08 14:49:57 -04:00
Joseph Schorr	b7d8bb227e	Make IP resolver performance a bit better by skipping an unnecessary set ... This will still hang for a second or two on first call	2018-08-08 14:40:26 -04:00
Joseph Schorr	c7baf6cf58	Merge pull request #3192 from quay/fix-blobs-stored-for-manifest ... Fix blobs stored for manifest	2018-08-08 12:53:16 -04:00
Joseph Schorr	56222f95dc	Change manifest creation to take in the map of blobs that form the manifest ... We need to lookup the blobs *specific to the images in that manifest*, so we now pass them in from the locations in which we know that information	2018-08-07 16:28:50 -04:00
Joseph Schorr	e3da522d26	Rename store_tag_manifest to indicate clearly it is only to be used for testing	2018-08-07 14:52:59 -04:00
Joseph Schorr	e33ccff8cb	Fix query count in test	2018-08-07 14:52:33 -04:00
Joseph Schorr	fc57f09ac7	Merge pull request #3191 from quay/fix-shared-blobs-under-manifest ... Fix pushing of manifests whose layers share blobs	2018-08-07 13:27:41 -04:00
Joseph Schorr	9669320df2	Fix pushing of manifests whose layers share blobs ... If a blob was repeated previously, we would get a constraint error from the ManifestBlob table	2018-08-07 13:06:30 -04:00
Joseph Schorr	92743ca57b	Merge pull request #3189 from quay/fix-v22-phase1-migration ... Fix the V22 phase 1 migrations to use new tables for mapping rather than editing existing tables	2018-08-07 11:38:00 -04:00
Joseph Schorr	89582438cd	Fix the V22 phase 1 migrations to use new tables for mapping rather than editing existing tables ... The ALTER TABLE operations previously used were causing the DB to die when run on the production TagManifest table which has 7 million rows. We instead now use new mapping tables, which is less nice, but these are temporary anyway, so hopefully we only have to deal with their ugliness for a short duration.	2018-08-06 16:58:27 -04:00
Joseph Schorr	7068010751	Merge pull request #3186 from quay/joseph.schorr/QUAY-1013-1015/manifest-migration ... First phase of V2_2 data model migrations	2018-08-06 13:56:14 -04:00
Joseph Schorr	a46660a06f	Add new Manifest, ManifestLabel, ManifestLegacyImage and ManifestBlob tables and start writing and GCing to/from them ... This change also starts passing in the manifest interface, rather than the raw data, to the model for writing. Note that this change does *not* backfill the existing rows in to the new tables; that will occur in a followup PR. The new columns in `tagmanifest` and `tagmanifestlabel` will be used to track the backfill, as it will occur in a worker.	2018-08-06 13:01:11 -04:00
Joseph Schorr	36c7482385	Define a formal manifest interface and implement in the schema1 and schema2 manifests ... This will allow us to pass arbitrary manifests to the model	2018-08-06 13:01:11 -04:00
Joseph Schorr	cf5a6e1adc	Remove old audit manifests tool	2018-08-06 13:01:11 -04:00
Sida Chen	6efe262217	Merge pull request #3188 from KeyboardNerd/sidchen/notification_datetime_bug ... Fixes empty "created" field in notification	2018-08-06 12:58:38 -04:00
Joseph Schorr	2c61c87712	Merge pull request #3184 from quay/joseph.schorr/QUAY-970/logentry ... Change id column in LogEntry to a BigInt and migrate back to using that table	2018-08-02 11:02:21 -04:00
Sida Chen	415631153a	Fixes empty "created" field in notification ... Fixes https://jira.coreos.com/browse/QUAY-1022	2018-08-01 17:17:47 -04:00
Sida Chen	6c7a4215ac	Merge pull request #3185 from KeyboardNerd/sidchen/html-noti ... Removes HTML tags shown in Browser Notification	2018-07-31 20:23:11 -04:00
Sida Chen	fbf5134b2e	updated according to comment	2018-07-31 17:10:50 -04:00
Joseph Schorr	41b6240945	Merge pull request #3187 from quay/update-roadmap ... Update the Quay roadmap	2018-07-31 16:37:49 -04:00
Joseph Schorr	9f556ce50c	Update the Quay roadmap	2018-07-31 16:33:54 -04:00
Sida Chen	bf4cef4870	Removes HTML tags shown in Browser Notification ... Fixes https://jira.coreos.com/browse/QUAY-956	2018-07-31 11:48:14 -04:00
Joseph Schorr	7325b22c90	Change id column in LogEntry to a BigInt and migrate back to using that table	2018-07-30 12:42:56 -04:00
Joseph Schorr	5e4d52f1fd	Merge pull request #3183 from quay/fix-repo-api ... Fix issue accessing a null tagmanifest under a tag in a repository	2018-07-25 17:10:26 -04:00
Joseph Schorr	c34eacb4fa	Fix issue accessing a null tagmanifest under a tag in a repository	2018-07-25 16:14:20 -04:00
Brad Ison	cf8e71f1e8	Merge pull request #3182 from bison/nginx-vts ... Add vhost-traffic-status module to Nginx	2018-07-25 20:15:11 +02:00
Brad Ison	662daf1351	Add config for nginx vhost-traffic-status module	2018-07-25 12:57:13 -04:00
Joseph Schorr	e6a35157ec	Merge pull request #3129 from quay/peewee-three-july ... Upgrade Peewee to latest 3.x	2018-07-25 12:49:12 -04:00
Joseph Schorr	65c1594a81	Remove ACI tests because they are brittle	2018-07-24 17:47:52 -04:00
Joseph Schorr	3ce8a0279a	Increase liveserver timeout on older registry tests	2018-07-24 15:51:21 -04:00
Joseph Schorr	57b5f4b363	Increase MySQL timeouts	2018-07-24 13:36:33 -04:00