9047 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Joseph Schorr	171c7e5238	Further fixes for unicode handling in manifests ... We were occasionally trying to compute schema 2 version 1 signatures on the *unicode* representation, which was failing the signature check. This PR adds a new wrapper type called `Bytes`, which all manifests must take in, and which handles the unicodes vs encoded utf-8 stuff in a central location. This PR also adds a test for the manifest that was breaking in production.	2019-01-09 15:14:41 -05:00
Joseph Schorr	05fa2bcbe0	Merge pull request #3321 from quay/temp-disable-validate ... Disable verification of schemas temporarily while we determine why some older schemas don't validate	2019-01-08 14:27:44 -05:00
Joseph Schorr	b7b64d84d3	Disable verification of schemas temporarily while we determine why some older schemas don't validate	2019-01-08 14:25:35 -05:00
Joseph Schorr	a156c91962	Merge pull request #3318 from quay/prod-fire-cleanup ... Prod fire cleanup fixes	2019-01-07 14:11:42 -05:00
Joseph Schorr	636f65cb81	Disable flaky test on MySQL	2019-01-04 16:37:02 -05:00
Joseph Schorr	c510759df3	Remove the foreign key constraint from the kind field on the logentry3 table	2019-01-04 13:35:14 -05:00
Joseph Schorr	e309508776	Change lookup of blobs to not use a subquery, which is murder on MySQL	2019-01-03 15:41:21 -05:00
Joseph Schorr	cdb49dbfd3	Add LogEntry3 table without the extra indexes and switch to writing to it	2019-01-03 13:50:43 -05:00
Joseph Schorr	b6db002729	Fix references to LogEntry model used and add support for a maximum page of results on the logs API	2019-01-02 16:04:15 -05:00
Joseph Schorr	204eb74c4f	Put aggregated log query and log exports behind feature flags	2019-01-02 16:04:15 -05:00
Joseph Schorr	4ba4d9141b	Put user last accessed updating behind a feature flag	2019-01-02 16:04:15 -05:00
Joseph Schorr	a6b5b4d6e3	Switch to writing logs to LogEntry2 table	2019-01-02 16:04:15 -05:00
Joseph Schorr	58d7dd07b9	Revert the changes to drop LogEntry2 table definition	2019-01-02 13:29:35 -05:00
Joseph Schorr	442312402f	Merge pull request #3299 from quay/joseph.schorr/QUAY-1233/batch-logs-download ... Batch download of logs	2018-12-19 15:38:22 -05:00
Joseph Schorr	0d20ab6042	Merge pull request #3313 from quay/fix-unicode-error ... Make sure to decode manifests into utf-8 when necessary	2018-12-19 14:08:05 -05:00
Joseph Schorr	a898d31016	Merge pull request #3314 from quay/joseph.schorr/QUAY-1268/remove-sitemap ... Remove unusable sitemap endpoint	2018-12-19 13:27:51 -05:00
Joseph Schorr	9190c046c7	Remove unusable sitemap endpoint ... It calls a data model method which is extremely slow and heavy, and it isn't even used anyway	2018-12-18 16:37:09 -05:00
Joseph Schorr	8a212728a3	Implement a worker for batch exporting of usage logs ... This will allow customers to request their usage logs for a repository or an entire namespace, and we can export the logs in a manner that doesn't absolutely destroy the database, with every step along the way timed.	2018-12-18 15:33:03 -05:00
Joseph Schorr	b8d2e1be9c	Remove infinite scroll from logs page and fix multiple loading bug ... This should make viewing logs significantly less janky	2018-12-18 15:21:26 -05:00
Joseph Schorr	9e2c5417b8	Merge pull request #3310 from quay/joseph.schorr/QUAY-1235/drop-logentry2 ... Remove all references to LogEntry2 from the code	2018-12-18 15:18:22 -05:00
Joseph Schorr	feee49be9e	Ensure we encode the config in manifest schema 2 via the canonical JSON format	2018-12-18 14:52:19 -05:00
Joseph Schorr	48e584905a	Make sure to decode manifests into utf-8 when necessary ... This fixes a decoding error	2018-12-17 16:31:24 -05:00
Joseph Schorr	6cc7102ec8	Merge pull request #3312 from quay/fix-repo-panel-tags ... Fix the image track offsets in the repo tags UI	2018-12-12 12:12:59 -05:00
Joseph Schorr	b4ee3578d7	Fix the image track offsets in the repo tags UI ... We were missing the `Features` injected into the scope, so the calculation was already returning false	2018-12-12 11:48:33 -05:00
Joseph Schorr	1d57e1eb9f	Merge pull request #3311 from quay/loosen-schema-requirements ... Make command optional in schema 2 manifests (as per OCI spec) and pull out additional information	2018-12-12 10:16:30 -05:00
Joseph Schorr	71b7a2b3a2	Make command optional in schema 2 manifests (as per OCI spec) and pull out additional information ... Also updates the manifest view page to show the comment or digest if there is no command defined	2018-12-11 17:23:39 -05:00
Joseph Schorr	fc691cefb4	Merge pull request #3306 from quay/fix-manifest-ui ... Fix manifest UI page to properly show the layers of manifests and show manifest lists	2018-12-11 16:53:36 -05:00
Joseph Schorr	d7918cb231	Fix indentation	2018-12-11 15:55:01 -05:00
Joseph Schorr	6a94eba1a2	Remove all references to LogEntry2 from the code ... The migration to actually drop the table will go in after this code has been pushed to production	2018-12-11 15:54:16 -05:00
Joseph Schorr	bf3fe2bfd6	Merge pull request #3309 from quay/less-flaky-tests ... Add automatic retry to the registry test suite to make it less flaky	2018-12-11 15:52:43 -05:00
Joseph Schorr	c1bdae395c	Fix column offsets for when security scanning is disabled	2018-12-11 14:20:21 -05:00
Joseph Schorr	be2cece7b0	Merge pull request #3302 from quay/joseph.schorr/QUAY-1017/tag-backfill ... Tag backfill worker	2018-12-11 13:31:35 -05:00
Joseph Schorr	d49eec18a3	Add automatic retry to the registry test suite to make it less flaky	2018-12-11 13:30:30 -05:00
Kenny Lee Sin Cheong	c6b2e5a54b	Add AppToken to schema (#3308)	2018-12-11 13:17:09 -05:00
Joseph Schorr	a9b8586423	Make sure list_manifest_layers is not callable for manifest lists	2018-12-11 13:10:24 -05:00
Joseph Schorr	7fa60d5802	Fix manifest UI display for manifests with empty layers ... Also fixes the command for schema 2 manifests	2018-12-10 17:10:54 -05:00
Joseph Schorr	d734adb8c3	Add missing method	2018-12-10 16:56:19 -05:00
Joseph Schorr	6963107ec6	Fix after merge	2018-12-10 15:37:26 -05:00
Joseph Schorr	eb7591183d	Add a tag backfill worker to fully backfill the new-style Tag's in the background	2018-12-10 15:36:25 -05:00
Joseph Schorr	57e93a82c9	Remove manifest backfill worker	2018-12-10 15:36:25 -05:00
Joseph Schorr	4106f5ce51	Fix manifest UI page to properly show the layers of manifests and show manifest lists	2018-12-10 15:33:59 -05:00
Joseph Schorr	cb7369c2ca	Merge pull request #3305 from quay/ipresolver-test ... Add test for breakage in ipresolver	2018-12-10 13:19:25 -05:00
Joseph Schorr	d15ed05933	Add test for breakage in ipresolver	2018-12-10 13:13:01 -05:00
Joseph Schorr	8cd3740c69	Merge pull request #3304 from quay/geoip-fix ... Fix geoip resolution for AWS-based pulls	2018-12-09 20:47:37 -05:00
Joseph Schorr	7d525a7670	Fix geoip resolution for AWS-based pulls ... Typo resulted in an error being raised: https://sentry.io/coreos/backend-staging/issues/801171785/?referrer=slack	2018-12-09 20:46:07 -05:00
Joseph Schorr	ef42250392	Merge pull request #3303 from quay/joseph.schorr/QUAY-1249/unicode-auth-header ... Catch unicode decode errors in auth decode	2018-12-07 16:18:23 -05:00
Joseph Schorr	c3f2901ec0	Catch unicode decode errors in auth decode ... Fixes https://jira.coreos.com/browse/QUAY-1249	2018-12-07 16:16:32 -05:00
Joseph Schorr	72ad0e9789	Merge pull request #3301 from quay/joseph.schorr/QUAY-1243/pull-schema2-only ... Support pulling of schema2 manifests directly via a manifest list tag	2018-12-07 15:56:24 -05:00
Joseph Schorr	3c2e050593	Support pulling of schema2 manifests directly via a manifest list tag ... This change ensures that if a manifest list is requested with an accepts header for a *schema 2* manifest, the legacy manifest (if any) is returned as schema 2 if it was pushed as a schema 2 manifest (rather than being auto-converted to schema 1)	2018-12-07 11:57:13 -05:00
Joseph Schorr	a35982f2be	Merge pull request #3300 from quay/joseph.schorr/QUAY-1221/basic-ip-geoblock ... Add ability for specific geographic regions to be blocked from pulling images within a namespace	2018-12-07 11:55:10 -05:00