Jimmy Zelinskie
606ad21bec
Apply reviewed changes.
...
Adds a length to the UUID field, renames QuayDeferredPermissionUser
parameter id->uuid, adds transactions to backfill script.
2014-11-19 13:28:16 -05:00
Jimmy Zelinskie
9d677b8eb3
Add UUID to User model and use in cookie.
2014-11-19 13:28:16 -05:00
Jake Moshenko
17fc72d262
Switch postgres to a non-transactional DDL to allow us to use peewee to modify data in migrations: enterprise customers are running postgres migrations offline already. Move the image backfill script back to a migration since it will now work. Unify the interface to sending a DB URI to env.py for the migration script.
2014-11-18 14:07:33 -05:00
Jake Moshenko
f4681f2c18
Merge branch 'master' into nomenclature
...
Conflicts:
test/data/test.db
2014-11-17 17:59:59 -05:00
Joseph Schorr
178c5a7ac0
Add an index to the docker_image_id for faster lookup
2014-11-13 12:51:50 -05:00
Joseph Schorr
29c30b336e
Move the uncompressed image size migration call outside of alembic, since it will sometimes deadlock with certain kinds of DBs (because alembic is running things inside a transaction)
2014-11-03 21:01:41 -05:00
Joseph Schorr
9aa72c5cc2
Fix migration issues:
...
- MySQL 5.5 doesn't support the now() call as a default
- Postgres migration isn't auto-committed, so we have to check if the table exists first
2014-11-03 15:25:55 -05:00
Joseph Schorr
c1398c6d2b
- Add a log entry for repo verb handling and make the container usage calculation take it into account
...
- Move all the repo push/pull/verb logging into a central track_and_log method
- Readd images accidentally deleted in the last CL
- Make the uncompressed size migration script better handle exceptions
2014-10-29 15:42:44 -04:00
Jake Moshenko
1461310ab8
Merge remote-tracking branch 'origin/master' into nomenclature
...
Conflicts:
endpoints/common.py
endpoints/notificationhelper.py
test/data/test.db
workers/dockerfilebuild.py
2014-10-23 13:25:37 -04:00
Jake Moshenko
c34a8b6727
Fix the squashed image migration to insert the proper image transformation type.
2014-10-08 11:47:02 -04:00
Jake Moshenko
bbcdf18fdd
Update the migration to reflect the state of the database.
2014-10-07 16:19:05 -04:00
Jake Moshenko
1968c67cba
Merge remote-tracking branch 'origin/laffa' into nomenclature
2014-10-07 16:09:45 -04:00
Jake Moshenko
626d984fb2
Fixes to the migration generator script.
2014-10-07 16:09:30 -04:00
Jake Moshenko
fe59ad4fb5
Rectify our prod database, previous migrations, and database definition files.
2014-10-07 16:03:57 -04:00
Jake Moshenko
c77a3dc6ea
Update the migration for translating queue names to take into account previous migrations.
2014-10-07 15:57:17 -04:00
Jake Moshenko
a0d94f9d59
Merge remote-tracking branch 'origin/laffa' into nomenclature
...
Conflicts:
test/data/test.db
2014-10-07 15:56:28 -04:00
Jake Moshenko
ee9973a395
Merge remote-tracking branch 'origin/master' into nomenclature
2014-10-07 15:43:59 -04:00
Joseph Schorr
f4daa5e97b
- Update the migrations tool to verify migrations work up and down for both MySQL and PostgresSQL.
...
- Add migrations for the squashed image tables and for backfilling the uncompressed sizes
- Make sure gzip stream uses a max length when determining the uncompressed size
2014-10-07 15:29:56 -04:00
Joseph Schorr
f38ce51943
Merge master into laffa
2014-10-07 14:03:17 -04:00
Jake Moshenko
4ad592e7ce
Add an index to the image storage uuid to improve performance.
2014-10-06 18:44:37 -04:00
Jake Moshenko
c4266140e2
Fix all of the upgrades and downgrades to work on both mysql and postgres.
2014-10-06 16:41:49 -04:00
Jake Moshenko
ed8bcff39e
Merge remote-tracking branch 'origin/master' into nomenclature
...
Conflicts:
test/data/test.db
workers/dockerfilebuild.py
2014-10-06 10:29:39 -04:00
Jake Moshenko
5c18ffe67d
Allow the namespace column to be null, and also non-unique. Fix the uncompressed size clobbering the size on the wire field. Add metadata constraints so that foreign key constraints get predictable names. Fix all downgrade migrations.
2014-10-02 10:46:20 -04:00
Jake Moshenko
e8b3d1cc4a
Phase 4 of the namespace to user migration: actually remove the column from the db and remove the dependence on serialized namespaces in the workers and queues
2014-10-01 14:23:46 -04:00
Jake Moshenko
ae9026ee91
MySQL will not allow us to revoke the possibility for the namespace_user column to be nullable.
2014-09-26 14:50:26 -04:00
Jake Moshenko
21d8c41320
Add the existing types to the alter column to make MySQL happy.
2014-09-26 12:58:03 -04:00
Jake Moshenko
e9745dbc96
Fix the SQL migration.
2014-09-26 11:17:42 -04:00
Jake Moshenko
03190efde3
Phase 2 of migrating repo namespaces to referencing user objects, backfilling the rows without a value for namespace_user, and changing all accesses to go through the namespace_user object. All tests are passing, manual testing still required.
2014-09-24 18:01:35 -04:00
Jake Moshenko
798c13aec8
Fix the migration to use the proper column name that peewee expects.
2014-09-23 14:20:15 -04:00
Jake Moshenko
b6d635b648
Fix the migration to use the proper base.
2014-09-23 14:04:20 -04:00
Joseph Schorr
86dfca2e3e
Add uncompressed size field to the image storage and add a backfill script (which is not yet automatically called)
2014-09-23 14:01:27 -04:00
Jake Moshenko
3259cda000
The new strategy is to do a three phase migration. This is the first phase: getting the namespace user in the db and written for all new repositories.
2014-09-22 17:27:02 -04:00
Joseph Schorr
297c8ad29c
Add migration to backfill uncompressed image sizes on the storage
2014-09-22 15:04:28 -04:00
Joseph Schorr
1658475ac1
Previous revision should not have the image storage col in it
2014-09-22 14:39:44 -04:00
Joseph Schorr
f16878cce9
Add migration for synthetic image tables
2014-09-22 14:38:42 -04:00
Joseph Schorr
70e0aba257
Add a script for generating schema migrations. Should be run from the root quay directory.
2014-09-22 14:36:52 -04:00
Jake Moshenko
8626d1cd70
Initial changes to move repositories from using a namespace string to referencing a user object. Also stores the user id in the cookie rather than the username, to allow users to be renamed. This commit must not be used unmodified because the database migration is too aggressive for live migration.
2014-09-19 10:17:23 -04:00
Jake Moshenko
8b5e7621d2
Add the required notification kind for team invites to the migration that was previously run.
2014-09-16 10:11:18 -04:00
Jake Moshenko
e13c027631
Add a migration for team member invites.
2014-09-15 23:57:05 -04:00
Jake Moshenko
75d2ef377e
Merge remote-tracking branch 'origin/master' into comewithmeifyouwanttowork
...
Conflicts:
data/model/legacy.py
2014-09-15 17:52:17 -04:00
Jake Moshenko
353da13b16
Set up the service monitoring for the log migration script. Add a database migration to add the logs_archived column.
2014-09-12 11:57:47 -04:00
Jake Moshenko
c5ca46a14b
Merge remote-tracking branch 'origin/master' into comewithmeifyouwanttowork
...
Conflicts:
data/model/legacy.py
static/js/app.js
2014-09-12 11:03:30 -04:00
Joseph Schorr
7c45aca405
Code review changes
2014-09-08 17:20:01 -04:00
Jake Moshenko
54fbb2a4c0
Rename collections to morecollections to avoid a conflict with the built in module.
2014-09-08 16:42:43 -04:00
Jake Moshenko
64480fd4ed
Merge remote-tracking branch 'origin/master' into yellowalert
...
Conflicts:
data/migrations/versions/82297d834ad_add_us_west_location.py
test/data/test.db
2014-09-05 11:30:30 -04:00
Jake Moshenko
c7e873366d
Inject the tables metadata into the upgrade and downgrade functions. Fix a bunch of the downgrades to actually work.
2014-09-04 20:58:29 -04:00
Joseph Schorr
6fa5a365b3
Add loginservice for Google
2014-09-04 18:45:23 -04:00
Joseph Schorr
b9a4d2835f
Add migration for the new DB field
2014-09-04 18:18:19 -04:00
Jake Moshenko
8910c6ff01
Add a migration to remove the webhooks table.
2014-09-03 13:44:05 -04:00
Jake Moshenko
21f7acf7ca
Fix the default value for the migration to use a string
2014-09-03 13:34:36 -04:00
Jake Moshenko
0bd9ba523e
Add a migration for the brute force prevention fields to the user table.
2014-09-03 13:07:53 -04:00
Joseph Schorr
3b72b26836
Merge branch 'master' into comewithmeifyouwanttowork
2014-08-28 20:50:13 -04:00
Joseph Schorr
85ab7a8c8d
Fix migration downgrade for the regenerating robot kind
2014-08-28 18:40:33 -04:00
Joseph Schorr
9142ff69a3
Add migration for new notification kinds
2014-08-28 18:39:35 -04:00
Joseph Schorr
a129aac94b
Add ability to regenerate robot account credentials
2014-08-25 17:19:23 -04:00
Joseph Schorr
d2880807b2
- Further fixes for license stuff
...
- Small fixes to ensure Quay works for Postgres
2014-08-21 19:21:20 -04:00
Joseph Schorr
d5027d2383
Add a migration script for the new table and log entry kinds
2014-08-18 20:45:48 -04:00
Joseph Schorr
f6f857eec2
Add US West region
2014-08-15 15:02:26 -04:00
Joseph Schorr
bd4bbe0bdb
Add missing image location for enterprise
2014-08-12 22:29:17 -04:00
yackob03
420d02cd71
Fix the migration script to add and remove the logentrykinds for notifications.
2014-08-05 14:21:29 -07:00
yackob03
b07eff41f6
Switch the table names to use lower case.
2014-08-05 13:44:18 -07:00
yackob03
cd5af72ba8
Temporarily prevent the deletion of the webhooks table to allow a migration path which keeps prod working.
2014-08-04 13:44:22 -07:00
Joseph Schorr
2c3fe2e60f
Switch web hook migration script to fully use the alembic context and connection
2014-08-01 13:37:27 -04:00
Joseph Schorr
a44345338d
Add bidirectional migration code of webhooks to/from repo-push webhook notifications.
2014-07-31 16:02:14 -04:00
Jake Moshenko
3f6466fccd
Add a migration to move the existing webhooks over and another migration to remove the legacy webhooks table.
2014-07-31 14:01:03 -04:00
Jake Moshenko
53a1f62614
Create a migration to prepare the database for the new notification types.
2014-07-31 13:27:05 -04:00
Jake Moshenko
4e5e8a08de
Add a maintenance notification kind and make it of the level warning.
2014-06-27 19:18:27 -04:00
Jake Moshenko
6e3a545c7f
Add a migration to upgrade to the version of the database supporting placements.
2014-06-18 17:46:20 -04:00
Jake Moshenko
6d07cf94d2
Add a migration to remove the image fields that were migrated to image storage, and add some uniqueness constraints to some indexes.
2014-06-12 19:51:57 -04:00
Jake Moshenko
0ba4201020
Add a module which will create notifications for all users when the license is at its expiration period, and terminate the process when the license expires.
2014-05-29 11:24:10 -04:00
Jake Moshenko
f049f738da
Run the db migrations on container start unless we're running against Sqlite.
2014-05-13 15:20:17 -04:00
Jake Moshenko
5fdccfe3e6
Add an alembic migration for the full initial database with the data. Switch LDAP to using bind and creating a federated login entry. Add LDAP support to the registry and index endpoints. Add a username transliteration and suggestion mechanism. Switch the database and model to require a manual initialization call.
2014-05-13 12:17:26 -04:00
jakedt
fc7756a3c2
Add alembic plumbing for database schema migrations.
2014-04-09 19:11:33 -04:00