Commit graph

9052 commits

Author SHA1 Message Date
Joseph Schorr
396ce21020
Merge pull request #3325 from quay/four-byte-utf8-fix
Fix handling of four byte utf8 manifests
2019-01-11 11:31:08 -05:00
Joseph Schorr
eb9ca8e8a8 Fix handling of four byte utf8 manifests
- Adds the charset: utf-8 to all the manifest responses
- Makes sure we connect to MySQL in utf8mb4 mode, to ensure we can properly read and write 4-byte utf8 strings
- Adds tests for all of the above
2019-01-10 16:34:56 -05:00
Joseph Schorr
62609fce3e
Merge pull request #3324 from quay/v1-pull-npe-fix
Fix V1 tag endpoint to properly return the fallback image or a 404 for tags without legacy images
2019-01-10 14:38:45 -05:00
Joseph Schorr
b1dd053b02 Fix an NPE when trying to pull a manifest without a legacy image via V1 2019-01-10 13:59:35 -05:00
Joseph Schorr
d9da838df1
Merge pull request #3322 from quay/further-unicode-fixes
Further fixes for unicode handling in manifests
2019-01-10 13:09:12 -05:00
Joseph Schorr
171c7e5238 Further fixes for unicode handling in manifests
We were occasionally trying to compute schema 2 version 1 signatures on the *unicode* representation, which was failing the signature check. This PR adds a new wrapper type called `Bytes`, which all manifests must take in, and which handles the unicodes vs encoded utf-8 stuff in a central location. This PR also adds a test for the manifest that was breaking in production.
2019-01-09 15:14:41 -05:00
Joseph Schorr
05fa2bcbe0
Merge pull request #3321 from quay/temp-disable-validate
Disable verification of schemas temporarily while we determine why some older schemas don't validate
2019-01-08 14:27:44 -05:00
Joseph Schorr
b7b64d84d3 Disable verification of schemas temporarily while we determine why some older schemas don't validate 2019-01-08 14:25:35 -05:00
Joseph Schorr
a156c91962
Merge pull request #3318 from quay/prod-fire-cleanup
Prod fire cleanup fixes
2019-01-07 14:11:42 -05:00
Joseph Schorr
636f65cb81 Disable flaky test on MySQL 2019-01-04 16:37:02 -05:00
Joseph Schorr
c510759df3 Remove the foreign key constraint from the kind field on the logentry3 table 2019-01-04 13:35:14 -05:00
Joseph Schorr
e309508776 Change lookup of blobs to not use a subquery, which is murder on MySQL 2019-01-03 15:41:21 -05:00
Joseph Schorr
cdb49dbfd3 Add LogEntry3 table without the extra indexes and switch to writing to it 2019-01-03 13:50:43 -05:00
Joseph Schorr
b6db002729 Fix references to LogEntry model used and add support for a maximum page of results on the logs API 2019-01-02 16:04:15 -05:00
Joseph Schorr
204eb74c4f Put aggregated log query and log exports behind feature flags 2019-01-02 16:04:15 -05:00
Joseph Schorr
4ba4d9141b Put user last accessed updating behind a feature flag 2019-01-02 16:04:15 -05:00
Joseph Schorr
a6b5b4d6e3 Switch to writing logs to LogEntry2 table 2019-01-02 16:04:15 -05:00
Joseph Schorr
58d7dd07b9 Revert the changes to drop LogEntry2 table definition 2019-01-02 13:29:35 -05:00
Joseph Schorr
442312402f
Merge pull request #3299 from quay/joseph.schorr/QUAY-1233/batch-logs-download
Batch download of logs
2018-12-19 15:38:22 -05:00
Joseph Schorr
0d20ab6042
Merge pull request #3313 from quay/fix-unicode-error
Make sure to decode manifests into utf-8 when necessary
2018-12-19 14:08:05 -05:00
Joseph Schorr
a898d31016
Merge pull request #3314 from quay/joseph.schorr/QUAY-1268/remove-sitemap
Remove unusable sitemap endpoint
2018-12-19 13:27:51 -05:00
Joseph Schorr
9190c046c7 Remove unusable sitemap endpoint
It calls a data model method which is extremely slow and heavy, and it isn't even used anyway
2018-12-18 16:37:09 -05:00
Joseph Schorr
8a212728a3 Implement a worker for batch exporting of usage logs
This will allow customers to request their usage logs for a repository or an entire namespace, and we can export the logs in a manner that doesn't absolutely destroy the database, with every step along the way timed.
2018-12-18 15:33:03 -05:00
Joseph Schorr
b8d2e1be9c Remove infinite scroll from logs page and fix multiple loading bug
This should make viewing logs significantly less janky
2018-12-18 15:21:26 -05:00
Joseph Schorr
9e2c5417b8
Merge pull request #3310 from quay/joseph.schorr/QUAY-1235/drop-logentry2
Remove all references to LogEntry2 from the code
2018-12-18 15:18:22 -05:00
Joseph Schorr
feee49be9e Ensure we encode the config in manifest schema 2 via the canonical JSON format 2018-12-18 14:52:19 -05:00
Joseph Schorr
48e584905a Make sure to decode manifests into utf-8 when necessary
This fixes a decoding error
2018-12-17 16:31:24 -05:00
Joseph Schorr
6cc7102ec8
Merge pull request #3312 from quay/fix-repo-panel-tags
Fix the image track offsets in the repo tags UI
2018-12-12 12:12:59 -05:00
Joseph Schorr
b4ee3578d7 Fix the image track offsets in the repo tags UI
We were missing the `Features` injected into the scope, so the calculation was already returning false
2018-12-12 11:48:33 -05:00
Joseph Schorr
1d57e1eb9f
Merge pull request #3311 from quay/loosen-schema-requirements
Make command optional in schema 2 manifests (as per OCI spec) and pull out additional information
2018-12-12 10:16:30 -05:00
Joseph Schorr
71b7a2b3a2 Make command optional in schema 2 manifests (as per OCI spec) and pull out additional information
Also updates the manifest view page to show the comment or digest if there is no command defined
2018-12-11 17:23:39 -05:00
Joseph Schorr
fc691cefb4
Merge pull request #3306 from quay/fix-manifest-ui
Fix manifest UI page to properly show the layers of manifests and show manifest lists
2018-12-11 16:53:36 -05:00
Joseph Schorr
d7918cb231 Fix indentation 2018-12-11 15:55:01 -05:00
Joseph Schorr
6a94eba1a2 Remove all references to LogEntry2 from the code
The migration to actually drop the table will go in after this code has been pushed to production
2018-12-11 15:54:16 -05:00
Joseph Schorr
bf3fe2bfd6
Merge pull request #3309 from quay/less-flaky-tests
Add automatic retry to the registry test suite to make it less flaky
2018-12-11 15:52:43 -05:00
Joseph Schorr
c1bdae395c Fix column offsets for when security scanning is disabled 2018-12-11 14:20:21 -05:00
Joseph Schorr
be2cece7b0
Merge pull request #3302 from quay/joseph.schorr/QUAY-1017/tag-backfill
Tag backfill worker
2018-12-11 13:31:35 -05:00
Joseph Schorr
d49eec18a3 Add automatic retry to the registry test suite to make it less flaky 2018-12-11 13:30:30 -05:00
Kenny Lee Sin Cheong
c6b2e5a54b
Add AppToken to schema (#3308) 2018-12-11 13:17:09 -05:00
Joseph Schorr
a9b8586423 Make sure list_manifest_layers is not callable for manifest lists 2018-12-11 13:10:24 -05:00
Joseph Schorr
7fa60d5802 Fix manifest UI display for manifests with empty layers
Also fixes the command for schema 2 manifests
2018-12-10 17:10:54 -05:00
Joseph Schorr
d734adb8c3 Add missing method 2018-12-10 16:56:19 -05:00
Joseph Schorr
6963107ec6 Fix after merge 2018-12-10 15:37:26 -05:00
Joseph Schorr
eb7591183d Add a tag backfill worker to fully backfill the new-style Tag's in the background 2018-12-10 15:36:25 -05:00
Joseph Schorr
57e93a82c9 Remove manifest backfill worker 2018-12-10 15:36:25 -05:00
Joseph Schorr
4106f5ce51 Fix manifest UI page to properly show the layers of manifests and show manifest lists 2018-12-10 15:33:59 -05:00
Joseph Schorr
cb7369c2ca
Merge pull request #3305 from quay/ipresolver-test
Add test for breakage in ipresolver
2018-12-10 13:19:25 -05:00
Joseph Schorr
d15ed05933 Add test for breakage in ipresolver 2018-12-10 13:13:01 -05:00
Joseph Schorr
8cd3740c69
Merge pull request #3304 from quay/geoip-fix
Fix geoip resolution for AWS-based pulls
2018-12-09 20:47:37 -05:00
Joseph Schorr
7d525a7670 Fix geoip resolution for AWS-based pulls
Typo resulted in an error being raised: https://sentry.io/coreos/backend-staging/issues/801171785/?referrer=slack
2018-12-09 20:46:07 -05:00