29 commits

Author	SHA1	Message	Date
Joseph Schorr	3872d29de9	Add a transaction around the extend_processing call	2015-01-29 18:40:41 -05:00
Jake Moshenko	cc70225043	Generalize the ephemeral build managers so that any manager may manage a builder spawned by any other manager.	2014-12-31 11:33:56 -05:00
Joseph Schorr	dbac8c7e3d	Fix build code: ... - Fix issue with the queue_item in extend processing - Add the new compiled docker binary with the lxc volume fix	2014-12-04 17:49:39 +01:00
Joseph Schorr	72d613614d	Merge branch 'bagger'	2014-12-01 12:48:59 -05:00
Jimmy Zelinskie	716d7a737b	Strip whitespace from ALL the things.	2014-11-24 16:07:38 -05:00
Joseph Schorr	b8e873b00b	Add support to the build system for tracking if/when the build manager crashes and make sure builds are restarted within a few minutes	2014-11-21 14:27:06 -05:00
Jake Moshenko	f4681f2c18	Merge branch 'master' into nomenclature ... Conflicts: test/data/test.db	2014-11-17 17:59:59 -05:00
Joseph Schorr	c06f57a6e7	Make sure builders close the db handle when no work comes in and make the metrics transaction smaller in scope	2014-10-24 11:40:02 -04:00
Jake Moshenko	e8b3d1cc4a	Phase 4 of the namespace to user migration: actually remove the column from the db and remove the dependence on serialized namespaces in the workers and queues	2014-10-01 14:23:46 -04:00
Joseph Schorr	f23038c6ee	Update the worker code to better handle exceptions, fix the utcdate issue and make sure we send the proper retry. Also updates notification workers to send JobExceptions rather than returning true or false	2014-09-22 12:52:57 -04:00
Jake Moshenko	0b6552d6cc	Fix the metrics so they are usable for scaling the workers down and up. Switch all datetimes which touch the database from now to utcnow. Fix the worker Dockerfile.	2014-05-23 14:16:26 -04:00
Jake Moshenko	f4c488f9b6	Fix the queue query for old jobs which won't run.	2014-05-22 13:50:06 -04:00
Jake Moshenko	f6726bd0a4	Merge branch 'ldapper' ... Conflicts: Dockerfile app.py data/database.py endpoints/index.py test/data/test.db	2014-05-22 12:13:41 -04:00
Jake Moshenko	d14798de1d	Add a queue capacity reporter plugin to the queue. Move the queue definitions to app. Add a cloudwatch reporter to the dockerfile build queue.	2014-05-21 19:50:37 -04:00
Jake Moshenko	8a3af93b8c	Improve the builder response to being terminated or dying.	2014-05-06 18:46:19 -04:00
jakedt	4b8217d4ad	Add config to allow for setting the queue names at runtime. Fix a bug in the data model.	2014-04-11 19:23:57 -04:00
jakedt	61a6db236f	Finish the implementation of local userfiles. Strip charsets from mimetypes in the build worker. Add canonical name ordering to the build queue. Port all queues to the canonical naming version.	2014-04-11 18:34:47 -04:00
jakedt	13dea98499	Prepare the build worker to support multiple tags and subdirectories. Change the build database config to accept a job config object instead of breaking out the parameters into independent blocks.	2014-02-24 16:11:23 -05:00
jakedt	e7064f1191	Fix the tests and the one bug that it highlighted.	2014-02-16 18:59:24 -05:00
yackob03	e1a4efe35c	Change the build queue identifier to disambiguate between old and new build jobs.	2014-02-12 12:51:30 -05:00
yackob03	e787d8b2d8	Make the worker post json. Add a retry timeout after an incompletel queue item is processed. Submit webhook jobs to the queue on a successful push.	2013-11-16 15:05:26 -05:00
yackob03	7a071fa731	Query for and take a queue item in a transaction.	2013-11-15 16:44:33 -05:00
yackob03	f07690956d	Add a fixed number of retries to each item that gets put in the work queue.:	2013-11-15 15:49:26 -05:00
yackob03	6f105326aa	Return unfinished items to the queue when they can be retried.	2013-10-29 15:42:19 -04:00
yackob03	847e91b696	Add the first part of the build worker that runs on quay.	2013-10-24 16:37:03 -04:00
yackob03	f80c9255e8	Fix a bug in the queue query.	2013-10-20 03:06:11 -04:00
yackob03	2fcd8df42b	Get the worker and the registry playing nice together.	2013-10-18 17:27:09 -04:00
yackob03	4514f5a969	Fix some typos and bugs in the worker.	2013-10-18 15:28:16 -04:00
yackob03	93b856bdb3	First few changes for the image diffs feature.	2013-10-17 18:25:19 -04:00