Commit graph

9040 commits

Author SHA1 Message Date
Joseph Schorr
cdb49dbfd3 Add LogEntry3 table without the extra indexes and switch to writing to it 2019-01-03 13:50:43 -05:00
Joseph Schorr
b6db002729 Fix references to LogEntry model used and add support for a maximum page of results on the logs API 2019-01-02 16:04:15 -05:00
Joseph Schorr
204eb74c4f Put aggregated log query and log exports behind feature flags 2019-01-02 16:04:15 -05:00
Joseph Schorr
4ba4d9141b Put user last accessed updating behind a feature flag 2019-01-02 16:04:15 -05:00
Joseph Schorr
a6b5b4d6e3 Switch to writing logs to LogEntry2 table 2019-01-02 16:04:15 -05:00
Joseph Schorr
58d7dd07b9 Revert the changes to drop LogEntry2 table definition 2019-01-02 13:29:35 -05:00
Joseph Schorr
442312402f
Merge pull request #3299 from quay/joseph.schorr/QUAY-1233/batch-logs-download
Batch download of logs
2018-12-19 15:38:22 -05:00
Joseph Schorr
0d20ab6042
Merge pull request #3313 from quay/fix-unicode-error
Make sure to decode manifests into utf-8 when necessary
2018-12-19 14:08:05 -05:00
Joseph Schorr
a898d31016
Merge pull request #3314 from quay/joseph.schorr/QUAY-1268/remove-sitemap
Remove unusable sitemap endpoint
2018-12-19 13:27:51 -05:00
Joseph Schorr
9190c046c7 Remove unusable sitemap endpoint
It calls a data model method which is extremely slow and heavy, and it isn't even used anyway
2018-12-18 16:37:09 -05:00
Joseph Schorr
8a212728a3 Implement a worker for batch exporting of usage logs
This will allow customers to request their usage logs for a repository or an entire namespace, and we can export the logs in a manner that doesn't absolutely destroy the database, with every step along the way timed.
2018-12-18 15:33:03 -05:00
Joseph Schorr
b8d2e1be9c Remove infinite scroll from logs page and fix multiple loading bug
This should make viewing logs significantly less janky
2018-12-18 15:21:26 -05:00
Joseph Schorr
9e2c5417b8
Merge pull request #3310 from quay/joseph.schorr/QUAY-1235/drop-logentry2
Remove all references to LogEntry2 from the code
2018-12-18 15:18:22 -05:00
Joseph Schorr
feee49be9e Ensure we encode the config in manifest schema 2 via the canonical JSON format 2018-12-18 14:52:19 -05:00
Joseph Schorr
48e584905a Make sure to decode manifests into utf-8 when necessary
This fixes a decoding error
2018-12-17 16:31:24 -05:00
Joseph Schorr
6cc7102ec8
Merge pull request #3312 from quay/fix-repo-panel-tags
Fix the image track offsets in the repo tags UI
2018-12-12 12:12:59 -05:00
Joseph Schorr
b4ee3578d7 Fix the image track offsets in the repo tags UI
We were missing the `Features` injected into the scope, so the calculation was already returning false
2018-12-12 11:48:33 -05:00
Joseph Schorr
1d57e1eb9f
Merge pull request #3311 from quay/loosen-schema-requirements
Make command optional in schema 2 manifests (as per OCI spec) and pull out additional information
2018-12-12 10:16:30 -05:00
Joseph Schorr
71b7a2b3a2 Make command optional in schema 2 manifests (as per OCI spec) and pull out additional information
Also updates the manifest view page to show the comment or digest if there is no command defined
2018-12-11 17:23:39 -05:00
Joseph Schorr
fc691cefb4
Merge pull request #3306 from quay/fix-manifest-ui
Fix manifest UI page to properly show the layers of manifests and show manifest lists
2018-12-11 16:53:36 -05:00
Joseph Schorr
d7918cb231 Fix indentation 2018-12-11 15:55:01 -05:00
Joseph Schorr
6a94eba1a2 Remove all references to LogEntry2 from the code
The migration to actually drop the table will go in after this code has been pushed to production
2018-12-11 15:54:16 -05:00
Joseph Schorr
bf3fe2bfd6
Merge pull request #3309 from quay/less-flaky-tests
Add automatic retry to the registry test suite to make it less flaky
2018-12-11 15:52:43 -05:00
Joseph Schorr
c1bdae395c Fix column offsets for when security scanning is disabled 2018-12-11 14:20:21 -05:00
Joseph Schorr
be2cece7b0
Merge pull request #3302 from quay/joseph.schorr/QUAY-1017/tag-backfill
Tag backfill worker
2018-12-11 13:31:35 -05:00
Joseph Schorr
d49eec18a3 Add automatic retry to the registry test suite to make it less flaky 2018-12-11 13:30:30 -05:00
Kenny Lee Sin Cheong
c6b2e5a54b
Add AppToken to schema (#3308) 2018-12-11 13:17:09 -05:00
Joseph Schorr
a9b8586423 Make sure list_manifest_layers is not callable for manifest lists 2018-12-11 13:10:24 -05:00
Joseph Schorr
7fa60d5802 Fix manifest UI display for manifests with empty layers
Also fixes the command for schema 2 manifests
2018-12-10 17:10:54 -05:00
Joseph Schorr
d734adb8c3 Add missing method 2018-12-10 16:56:19 -05:00
Joseph Schorr
6963107ec6 Fix after merge 2018-12-10 15:37:26 -05:00
Joseph Schorr
eb7591183d Add a tag backfill worker to fully backfill the new-style Tag's in the background 2018-12-10 15:36:25 -05:00
Joseph Schorr
57e93a82c9 Remove manifest backfill worker 2018-12-10 15:36:25 -05:00
Joseph Schorr
4106f5ce51 Fix manifest UI page to properly show the layers of manifests and show manifest lists 2018-12-10 15:33:59 -05:00
Joseph Schorr
cb7369c2ca
Merge pull request #3305 from quay/ipresolver-test
Add test for breakage in ipresolver
2018-12-10 13:19:25 -05:00
Joseph Schorr
d15ed05933 Add test for breakage in ipresolver 2018-12-10 13:13:01 -05:00
Joseph Schorr
8cd3740c69
Merge pull request #3304 from quay/geoip-fix
Fix geoip resolution for AWS-based pulls
2018-12-09 20:47:37 -05:00
Joseph Schorr
7d525a7670 Fix geoip resolution for AWS-based pulls
Typo resulted in an error being raised: https://sentry.io/coreos/backend-staging/issues/801171785/?referrer=slack
2018-12-09 20:46:07 -05:00
Joseph Schorr
ef42250392
Merge pull request #3303 from quay/joseph.schorr/QUAY-1249/unicode-auth-header
Catch unicode decode errors in auth decode
2018-12-07 16:18:23 -05:00
Joseph Schorr
c3f2901ec0 Catch unicode decode errors in auth decode
Fixes https://jira.coreos.com/browse/QUAY-1249
2018-12-07 16:16:32 -05:00
Joseph Schorr
72ad0e9789
Merge pull request #3301 from quay/joseph.schorr/QUAY-1243/pull-schema2-only
Support pulling of schema2 manifests directly via a manifest list tag
2018-12-07 15:56:24 -05:00
Joseph Schorr
3c2e050593 Support pulling of schema2 manifests directly via a manifest list tag
This change ensures that if a manifest list is requested with an accepts header for a *schema 2* manifest, the legacy manifest (if any) is returned as schema 2 if it was pushed as a schema 2 manifest (rather than being auto-converted to schema 1)
2018-12-07 11:57:13 -05:00
Joseph Schorr
a35982f2be
Merge pull request #3300 from quay/joseph.schorr/QUAY-1221/basic-ip-geoblock
Add ability for specific geographic regions to be blocked from pulling images within a namespace
2018-12-07 11:55:10 -05:00
Joseph Schorr
c3710a6a5e Add ability for specific geographic regions to be blocked from pulling images within a namespace 2018-12-06 17:14:45 -05:00
Joseph Schorr
c71a43a06c
Merge pull request #3298 from quay/fix-manifest-security-view
Fix TS error in manifest security view
2018-12-04 13:21:33 -05:00
Joseph Schorr
68bcacda25 Fix TS error in manifest security view 2018-12-04 13:18:55 -05:00
Joseph Schorr
cbe151c21d
Merge pull request #3297 from quay/joseph.schorr/QUAY-1241/secscan-v22-fix
Fix loading of security scan results for OCI-style manifests
2018-12-04 13:04:48 -05:00
Joseph Schorr
23e6279ef5 Fix loading of security scan results for OCI-style manifests
Fixes https://jira.coreos.com/browse/QUAY-1241
2018-12-04 11:56:06 -05:00
Joseph Schorr
4c9e331bfa
Merge pull request #3296 from quay/joseph.schorr/v22-access-list
Enable a configurable whitelist of namespaces for V22
2018-12-03 22:58:38 -05:00
Joseph Schorr
d59bea3569 Enable a configurable whitelist of namespaces for V22
If a namespace is present in the whitelist, all calls are sent to the OCI model instead of the Pre OCI model

Note that this does increase overhead for registry calls (since we need to lookup the namespace for every single call), but it should only be temporary until we've migrated all users over to the OCI data model
2018-12-03 17:37:28 -05:00