248 commits

Author	SHA1	Message	Date
Jake Moshenko	d6f1ea36d4	Upgrade the worker docker to the patched version of 0.9.	2014-03-27 20:39:29 +00:00
jakedt	536a91cbb8	Handle messages with the word message in them.	2014-03-07 12:27:30 -05:00
jakedt	4566d76e45	Add a mime type for x-zip-compressed. Report unknown mime types as errors.	2014-03-06 23:40:21 -05:00
jakedt	9a733a7320	Sometimes status messages have an extra level of wrapping for some reason.	2014-03-05 17:44:22 -05:00
jakedt	270a62b8c1	Fix the build worker to use the latest docker-py.	2014-03-05 10:32:24 -05:00
jakedt	c13f7cd9df	Add the resource_key back to the repository build.	2014-02-25 18:22:02 -05:00
jakedt	13dea98499	Prepare the build worker to support multiple tags and subdirectories. Change the build database config to accept a job config object instead of breaking out the parameters into independent blocks.	2014-02-24 16:11:23 -05:00
yackob03	91da26e317	Improve the instructions for starting the worker on the build node.	2014-02-13 12:46:51 -05:00
yackob03	1e8ec634e2	Some small fixes to the dockerfile build worker.	2014-02-13 11:44:39 -05:00
yackob03	b920a0cb1f	Really try to emulate the logs format with the test logs. Switch to a simplified flat logs format.	2014-02-12 18:58:40 -05:00
yackob03	83fb806e51	Apparently gdebi doesn't support multiple packages in one command? lame.	2014-02-12 10:07:10 -05:00
yackob03	d8df243a0a	Add the binary dependencies for the build worker and some instructions on how to get it running on a host.	2014-02-11 19:55:22 -05:00
yackob03	6fd343741b	Change to the new paging format with the commands available at the top.	2014-02-10 19:12:43 -05:00
yackob03	52d2be7953	Identify build commands separately from their output.	2014-02-10 15:03:55 -05:00
yackob03	fab699530c	Check for errors before delegating to the cleanup function.	2014-02-05 19:59:26 -05:00
yackob03	67e0736fc6	Separate out the dockerfile build stuff to a separate class. Add a dependency on docker-py master.	2014-02-05 11:07:54 -05:00
yackob03	5270066d6d	Switch to the redis backed build logs and status.	2014-02-03 19:08:37 -05:00
yackob03	aa58b840a5	Fix the dockerfile build login to work on http and https registries.	2014-01-24 16:25:25 -05:00
yackob03	72559fb948	First stab at the new builder.	2014-01-24 14:40:36 -05:00
yackob03	8981f576fc	Fixes to the build server.	2013-12-31 16:22:58 -05:00
yackob03	bf60862d8e	Switch to the new Digital Ocean Docker image.	2013-12-23 15:07:10 -05:00
yackob03	e787d8b2d8	Make the worker post json. Add a retry timeout after an incompletel queue item is processed. Submit webhook jobs to the queue on a successful push.	2013-11-16 15:05:26 -05:00
yackob03	c1ea6263e1	Flesh out the webworkers a bit.	2013-11-15 16:45:02 -05:00
yackob03	14263de7f8	Extract some boilerplate from the worker and create a base class. Port the diffs worker over to the base.	2013-11-15 15:50:20 -05:00
yackob03	0f3d942b5e	Re-add the missing method for getting repository builds. Add more logging to try to see why some builds are not getting removed from the queue.	2013-11-13 17:29:26 -05:00
yackob03	d7592fd133	Update the diffs worker to not fail if the repository is removed before diffs are computed.	2013-11-13 14:41:20 -05:00
yackob03	2cd98fc58e	Make the app config more powerful in terms of injecting fake dependencies. Refactor the tests to use metaclasses and to actually all run.	2013-11-06 23:21:12 -05:00
yackob03	f8f4c55f89	Close the db connections on the workers occasionally.	2013-10-30 13:22:00 -04:00
yackob03	1bbcd91ae0	Make sure the daemon starts up in the right directory to access the certs file.	2013-10-29 19:59:29 -04:00
yackob03	7adf37e6b5	Move the parmiko import to work around a bug with python daemonization and paramiko.	2013-10-29 18:56:57 -04:00
yackob03	5e81f999d1	Make the build server and build worker slightly more robust to errors.	2013-10-29 18:15:12 -04:00
yackob03	6f105326aa	Return unfinished items to the queue when they can be retried.	2013-10-29 15:42:19 -04:00
yackob03	798cf78172	Re-add cleaning up the DO node.	2013-10-29 15:39:44 -04:00
yackob03	c91b40f356	Switch to using environment variables to pass information to the build node, this closes down a security loophole with the admin endpoint of the server.	2013-10-29 13:42:26 -04:00
yackob03	1c7398e920	Allow build node logs to flow to docker. Clean up the pull key before executing user code. Actually clean up the DO node when we are done. Run the status server threaded just in case.	2013-10-28 14:49:23 -04:00
yackob03	d7f51fb764	Bug fixes and associated changes involved with spinning up build nodes and sending jobs to them.	2013-10-27 19:06:20 -04:00
yackob03	78d2d6cad0	Add a test endpoint that allows us to manually create builds. Add access tokens to the build data.	2013-10-25 18:17:43 -04:00
yackob03	684ce83058	Add a test api to test repositories which are currenlty building.	2013-10-25 15:47:34 -04:00
yackob03	ffc33e454c	Fixes and refinements to the dockerfile build system.	2013-10-25 15:13:11 -04:00
yackob03	9b9a29c310	Flesh out the create API and wire everything up together. Next up, testing.	2013-10-25 01:14:38 -04:00
yackob03	32ccc599fb	Revert some fabric changes to the build worker.	2013-10-24 16:39:25 -04:00
yackob03	847e91b696	Add the first part of the build worker that runs on quay.	2013-10-24 16:37:03 -04:00
yackob03	0c979cd79f	Fix the diffsworker to run as a daemon.	2013-10-20 14:52:56 -04:00
yackob03	abb6efda40	Process as many jobs as the queue will give us in a row, sleep for longer in between checks.	2013-10-20 03:26:06 -04:00
yackob03	607bf3ecc4	Daemonize the worker.	2013-10-18 17:52:55 -04:00
yackob03	2fcd8df42b	Get the worker and the registry playing nice together.	2013-10-18 17:27:09 -04:00
yackob03	4514f5a969	Fix some typos and bugs in the worker.	2013-10-18 15:28:16 -04:00
yackob03	93b856bdb3	First few changes for the image diffs feature.	2013-10-17 18:25:19 -04:00