Commit graph

902 commits

Author SHA1 Message Date
Joseph Schorr
8a212728a3 Implement a worker for batch exporting of usage logs
This will allow customers to request their usage logs for a repository or an entire namespace, and we can export the logs in a manner that doesn't absolutely destroy the database, with every step along the way timed.
2018-12-18 15:33:03 -05:00
Kenny Lee Sin Cheong
c6b2e5a54b
Add AppToken to schema (#3308) 2018-12-11 13:17:09 -05:00
Joseph Schorr
d15ed05933 Add test for breakage in ipresolver 2018-12-10 13:13:01 -05:00
Joseph Schorr
7d525a7670 Fix geoip resolution for AWS-based pulls
Typo resulted in an error being raised: https://sentry.io/coreos/backend-staging/issues/801171785/?referrer=slack
2018-12-09 20:46:07 -05:00
Joseph Schorr
c3710a6a5e Add ability for specific geographic regions to be blocked from pulling images within a namespace 2018-12-06 17:14:45 -05:00
Joseph Schorr
23e6279ef5 Fix loading of security scan results for OCI-style manifests
Fixes https://jira.coreos.com/browse/QUAY-1241
2018-12-04 11:56:06 -05:00
Joseph Schorr
6c29baf3fc
Merge pull request #3281 from quay/georep-fix
Fixes for georeplication
2018-11-01 17:58:32 -04:00
Joseph Schorr
ebc57da843 Tiny fixes found in review 2018-11-01 17:45:39 -04:00
Joseph Schorr
0fb3d6847e Add a script for verifying the placements of blobs in storage. If a blob is not present in storage, its placement will be removed. 2018-11-01 11:44:49 -04:00
Joseph Schorr
4868f17832 Implement a basic test suite for jwtutil and add extra checks to the decode method 2018-10-30 16:45:30 -04:00
Kenny Lee Sin Cheong
bb01e08d44
Fix ipresolver test_thread_missing_file (#3268)
There is no guarantee that the assertion would happen AFTER "sleep" is
called.

Block the caller for an amount of time to give "update_ip_thread" time to call "sleep" and raise LoopInterruptionForTest exception to terminate the thread.
2018-10-15 17:18:11 -04:00
Kenny Lee Sin Cheong
fc67bbd0a6
IPResolver: fix unreachable code (#3267)
* Fix unreachable code

_get_aws_ip_ranges handles missing file exceptions and returns None,
so the excepttion handling block in the UpdateIPRange thread is never reached.

* Test for missing range file in resolver thread
2018-10-12 10:24:28 -04:00
Joseph Schorr
a4f1475de4
Merge pull request #3234 from quay/joseph.schorr/QUAY-1030/interfacing-part-8
Change verbs endpoint to use the new registry data model interface
2018-09-13 12:50:02 -04:00
Joseph Schorr
b19443c4e1
Merge pull request #3244 from kleesc/IPResolver-fix
Fix: Should not break from ipresolver thread
2018-09-07 15:48:08 -04:00
Kenny Lee Sin Cheong
4834c281cb nit: styling 2018-09-07 13:50:56 -04:00
Kenny Lee Sin Cheong
105a7c0ea6 Worker started flag 2018-09-07 13:40:20 -04:00
Kenny Lee Sin Cheong
7743cc44fa Handle exceptions when trying to start resolver thread 2018-09-07 13:26:49 -04:00
Kenny Lee Sin Cheong
7563d97be4 Fix: Should not break from ipresolver thread 2018-09-07 09:55:09 -04:00
Kenny Lee Sin Cheong
56809ef125
Merge pull request #3239 from kleesc/IPResolver-fix
UpdateIPRange thread start on the 1st call to _get_location_function
2018-09-05 13:45:50 -04:00
Kenny Lee Sin Cheong
bff91c0fb9 UpdateIPRange thread start on the 1st call to _get_location_function
Thread will start on first call to _get_location_function as opposed
to IPResolver's new instance.
2018-09-05 13:35:55 -04:00
Joseph Schorr
1953cfcd6e
Merge pull request #3236 from quay/small-fixes
Setup reroutes when complete, fix gunicorn healthcheck
2018-09-04 16:35:57 -04:00
Kenny Lee Sin Cheong
b39051c142
Merge pull request #3223 from kleesc/UpdateIPRange
Create UpdateIPRange class
2018-08-31 17:09:17 -04:00
Sam Chow
dbce986af6 Setup reroutes when complete, fix gunicorn check 2018-08-31 15:17:48 -04:00
Kenny Lee Sin Cheong
b6336393de Make IPResolver run the update in a separate thread
A separate thread will cache the results of parsing the range
file, and the IPResolver will hit the cache instead of blocking while recomputing the
ranges everytime. The thread updates every 600s, and retry every 60s on
failures.
2018-08-31 14:00:53 -04:00
Joseph Schorr
f252b0b16f Move verbs endpoint to use new registry data model 2018-08-29 16:38:54 -04:00
Sam Chow
a40e1e939a Merge branch 'master' into delete-setup-page 2018-08-27 11:26:51 -04:00
Joseph Schorr
f9f47e68c3 Remove unused imagetree class 2018-08-24 13:16:05 -04:00
Joseph Schorr
46edebe6b0 Change secscan API endpoints to use new registry model interface 2018-08-23 16:36:04 -04:00
Sam Chow
cd6b0a6f46 Merge branch 'master' into delete-setup-page 2018-08-23 12:46:08 -04:00
Sam Chow
d44aa8f566 Add error message to app if secret missing in quay 2018-08-20 17:14:52 -04:00
Sam Chow
5b400f4c22 Add one-action transplant of kube secret 2018-08-17 11:00:04 -04:00
Sam Chow
cc9bedbeb9 refactor approval service key to not need approver 2018-08-15 17:18:41 -04:00
Joseph Schorr
b7d8bb227e Make IP resolver performance a bit better by skipping an unnecessary set
This will still hang for a second or two on first call
2018-08-08 14:40:26 -04:00
Joseph Schorr
b5a1dd8f70 Fix copy table for empty table 2018-07-21 16:20:38 -04:00
Joseph Schorr
acb7d626a4 Phase 2 of Appr migration
Backfills the new tables from the old ones, and switches all code to read and write from the new tables
2018-07-21 15:25:04 -04:00
Joseph Schorr
113bb96f29 Phase 1 of migrating APPR-specific tables to tables with the Appr prefix
Fixes https://jira.coreos.com/browse/QUAY-950
2018-07-20 13:19:01 -04:00
Joseph Schorr
6622f27c93 Rename oci_model to appr_model 2018-07-20 12:46:19 -04:00
Joseph Schorr
f4b05df179 Fix SSL test import 2018-07-19 11:59:14 -04:00
Joseph Schorr
69406c6aec Move remaining util tests into pytest 2018-07-19 11:40:40 -04:00
Joseph Schorr
b69af403d4 Move label validation tests into pytest 2018-07-19 11:20:00 -04:00
Joseph Schorr
a5dc885fc6
Merge pull request #3170 from quay/move-streamlayerformat-tests
Move stream layer format tests into pytest
2018-07-19 10:58:53 -04:00
Joseph Schorr
f6d914619b Move stream layer format tests into pytest 2018-07-19 10:57:08 -04:00
Joseph Schorr
963e35251e Move queuefile tests to pytest 2018-07-19 10:49:53 -04:00
Joseph Schorr
b2981947c3
Merge pull request #3167 from quay/move-ssl-util-tests
Move SSL util tests to pytest
2018-07-18 17:33:35 -04:00
Joseph Schorr
894b754121 Move SSL util tests to pytest 2018-07-18 17:26:24 -04:00
Sam Chow
860703c2b2 Override config directory in certs install script in config app 2018-07-18 14:21:25 -04:00
Joseph Schorr
8be5c66e14 Move names test to pytest 2018-07-18 11:10:44 -04:00
Sam Chow
4ed64b0956
Merge pull request #3151 from quay/project/remove-logins
Remove password confirmation in config app
2018-07-18 10:35:25 -04:00
Joseph Schorr
78317c0e93
Merge pull request #3149 from quay/joseph.schorr/QUAY-1000/remove-chatlio
Remove chatlio support chat
2018-07-18 02:54:27 +03:00
Joseph Schorr
e00f2d5865
Merge pull request #3156 from quay/move-morecollections-test
Move morecollections tests to pytest
2018-07-18 00:01:15 +03:00