Commit graph

8753 commits

Author SHA1 Message Date
Joseph Schorr
8cdddd365b Remove the transaction around creating the tag and the tag manifest
The tag manifest creation operation is now quite a bit heavier (because it is populating a bunch of new-model tables as well), and it is not necessary for the transaction to include this operation, because tags are valid without manifests currently.
2018-08-09 16:32:07 -04:00
Joseph Schorr
590f8f65a3 Allow lookup of "dead" manifests so manifest links can be clicked in the tag history
Fixes https://jira.coreos.com/browse/QUAY-1021
2018-08-09 16:05:10 -04:00
Joseph Schorr
f6902f8096
Merge pull request #3193 from quay/ipresolver-perf
Make IP resolver performance a bit better by skipping an unnecessary set
2018-08-08 17:28:47 -04:00
Sida Chen
549b286650
Merge pull request #3190 from KeyboardNerd/sidchen/boto_change
Changes boto2 pip source to point to the fixed
2018-08-08 14:51:37 -04:00
Sida Chen
bccff26e69 Changes boto2 pip source
Changes requirements file to point boto2 to devtable repo, which
contains the fix for SigV4 connection problem.
2018-08-08 14:49:57 -04:00
Joseph Schorr
b7d8bb227e Make IP resolver performance a bit better by skipping an unnecessary set
This will still hang for a second or two on first call
2018-08-08 14:40:26 -04:00
Joseph Schorr
c7baf6cf58
Merge pull request #3192 from quay/fix-blobs-stored-for-manifest
Fix blobs stored for manifest
2018-08-08 12:53:16 -04:00
Joseph Schorr
56222f95dc Change manifest creation to take in the map of blobs that form the manifest
We need to lookup the blobs *specific to the images in that manifest*, so we now pass them in from the locations in which we know that information
2018-08-07 16:28:50 -04:00
Joseph Schorr
e3da522d26 Rename store_tag_manifest to indicate clearly it is only to be used for testing 2018-08-07 14:52:59 -04:00
Joseph Schorr
e33ccff8cb Fix query count in test 2018-08-07 14:52:33 -04:00
Joseph Schorr
fc57f09ac7
Merge pull request #3191 from quay/fix-shared-blobs-under-manifest
Fix pushing of manifests whose layers share blobs
2018-08-07 13:27:41 -04:00
Joseph Schorr
9669320df2 Fix pushing of manifests whose layers share blobs
If a blob was repeated previously, we would get a constraint error from the ManifestBlob table
2018-08-07 13:06:30 -04:00
Joseph Schorr
92743ca57b
Merge pull request #3189 from quay/fix-v22-phase1-migration
Fix the V22 phase 1 migrations to use new tables for mapping rather than editing existing tables
2018-08-07 11:38:00 -04:00
Joseph Schorr
89582438cd Fix the V22 phase 1 migrations to use new tables for mapping rather than editing existing tables
The ALTER TABLE operations previously used were causing the DB to die when run on the production TagManifest table which has 7 million rows. We instead now use new mapping tables, which is less nice, but these are temporary anyway, so hopefully we only have to deal with their ugliness for a short duration.
2018-08-06 16:58:27 -04:00
Joseph Schorr
7068010751
Merge pull request #3186 from quay/joseph.schorr/QUAY-1013-1015/manifest-migration
First phase of V2_2 data model migrations
2018-08-06 13:56:14 -04:00
Joseph Schorr
a46660a06f Add new Manifest, ManifestLabel, ManifestLegacyImage and ManifestBlob tables and start writing and GCing to/from them
This change also starts passing in the manifest interface, rather than the raw data, to the model for writing.

Note that this change does *not* backfill the existing rows in to the new tables; that will occur in a followup PR. The new columns in `tagmanifest` and `tagmanifestlabel` will be used to track the backfill, as it will occur in a worker.
2018-08-06 13:01:11 -04:00
Joseph Schorr
36c7482385 Define a formal manifest interface and implement in the schema1 and schema2 manifests
This will allow us to pass arbitrary manifests to the model
2018-08-06 13:01:11 -04:00
Joseph Schorr
cf5a6e1adc Remove old audit manifests tool 2018-08-06 13:01:11 -04:00
Sida Chen
6efe262217
Merge pull request #3188 from KeyboardNerd/sidchen/notification_datetime_bug
Fixes empty "created" field in notification
2018-08-06 12:58:38 -04:00
Joseph Schorr
2c61c87712
Merge pull request #3184 from quay/joseph.schorr/QUAY-970/logentry
Change id column in LogEntry to a BigInt and migrate back to using that table
2018-08-02 11:02:21 -04:00
Sida Chen
415631153a Fixes empty "created" field in notification
Fixes https://jira.coreos.com/browse/QUAY-1022
2018-08-01 17:17:47 -04:00
Sida Chen
6c7a4215ac
Merge pull request #3185 from KeyboardNerd/sidchen/html-noti
Removes HTML tags shown in Browser Notification
2018-07-31 20:23:11 -04:00
Sida Chen
fbf5134b2e updated according to comment 2018-07-31 17:10:50 -04:00
Joseph Schorr
41b6240945
Merge pull request #3187 from quay/update-roadmap
Update the Quay roadmap
2018-07-31 16:37:49 -04:00
Joseph Schorr
9f556ce50c Update the Quay roadmap 2018-07-31 16:33:54 -04:00
Sida Chen
bf4cef4870 Removes HTML tags shown in Browser Notification
Fixes https://jira.coreos.com/browse/QUAY-956
2018-07-31 11:48:14 -04:00
Joseph Schorr
7325b22c90 Change id column in LogEntry to a BigInt and migrate back to using that table 2018-07-30 12:42:56 -04:00
Joseph Schorr
5e4d52f1fd
Merge pull request #3183 from quay/fix-repo-api
Fix issue accessing a null tagmanifest under a tag in a repository
2018-07-25 17:10:26 -04:00
Joseph Schorr
c34eacb4fa Fix issue accessing a null tagmanifest under a tag in a repository 2018-07-25 16:14:20 -04:00
Brad Ison
cf8e71f1e8
Merge pull request #3182 from bison/nginx-vts
Add vhost-traffic-status module to Nginx
2018-07-25 20:15:11 +02:00
Brad Ison
662daf1351
Add config for nginx vhost-traffic-status module 2018-07-25 12:57:13 -04:00
Joseph Schorr
e6a35157ec
Merge pull request #3129 from quay/peewee-three-july
Upgrade Peewee to latest 3.x
2018-07-25 12:49:12 -04:00
Joseph Schorr
65c1594a81 Remove ACI tests because they are brittle 2018-07-24 17:47:52 -04:00
Joseph Schorr
3ce8a0279a Increase liveserver timeout on older registry tests 2018-07-24 15:51:21 -04:00
Joseph Schorr
57b5f4b363 Increase MySQL timeouts 2018-07-24 13:36:33 -04:00
Joseph Schorr
c599aa5e87 Update peewee 3 to latest version 2018-07-24 12:52:01 -04:00
Joseph Schorr
601ef416cb Fix transaction over savepoint in initdb 2018-07-24 11:37:06 -04:00
Brad Ison
083ba2bc78
Build nginx-vts module for nginx stats 2018-07-23 16:44:19 -04:00
Brad Ison
643a06e73a
Update test.db 2018-07-23 16:44:17 -04:00
Joseph Schorr
8e425ee559 Fix for merge 2018-07-23 12:43:23 -04:00
Joseph Schorr
9a40e99a8f Enhancements for validation of DB urls
We now turn off retries and DB pooling, and make sure to always close the connection
2018-07-23 12:43:23 -04:00
Joseph Schorr
d15dcae505 Reenable retry wrapper on database operations 2018-07-23 12:43:23 -04:00
Brad Ison
d3d9cca182 Upgrade Peewee to latest 3.x
This requires a number of small changes in the data model code, as well as additional testing.
2018-07-23 12:43:23 -04:00
Joseph Schorr
70b7ee4654
Merge pull request #3180 from quay/fix-copy-for-empty
Fix copy table for empty table
2018-07-21 16:34:34 -04:00
Joseph Schorr
b5a1dd8f70 Fix copy table for empty table 2018-07-21 16:20:38 -04:00
Joseph Schorr
0346cb651e
Merge pull request #3148 from quay/joseph.schorr/QUAY-950/appr-step-3
Phase 3 of Appr migration
2018-07-21 15:46:54 -04:00
Joseph Schorr
487edf0ba1 Phase 3 of Appr migration
Deletes the old models and their code
2018-07-21 15:43:00 -04:00
Joseph Schorr
223077ef53 Phase 2 of Appr migration
Backfills the new tables from the old ones, and switches all code to read and write from the new tables
2018-07-21 15:43:00 -04:00
Joseph Schorr
a3c3c0abc7 Phase 1 of migrating APPR-specific tables to tables with the Appr prefix
Fixes https://jira.coreos.com/browse/QUAY-950
2018-07-21 15:43:00 -04:00
Joseph Schorr
11eaab5756
Merge pull request #3134 from quay/joseph.schorr/QUAY-950/appr-step-2
Phase 2 of Appr migration
2018-07-21 15:27:53 -04:00