Jake Moshenko
|
857c3e2959
|
Start catching etcd key errors as well.
|
2015-02-27 17:10:15 -05:00 |
|
Joseph Schorr
|
4551b3a957
|
Remove the boto timeout set (doesn't work anyway) and add some better logging to the scheduler
|
2015-02-25 16:00:14 -05:00 |
|
Joseph Schorr
|
5dd78f76c7
|
Add additional logging, timeouts, and exception checks
|
2015-02-25 15:15:22 -05:00 |
|
Joseph Schorr
|
2eaec092f0
|
Handle the case where we cannot write the tags on the build nodes
|
2015-02-25 13:47:36 -05:00 |
|
Joseph Schorr
|
afe7e14254
|
Add better exception handling and logging to the ephemeral build manager
|
2015-02-25 12:09:14 -05:00 |
|
Joseph Schorr
|
524705b88c
|
Get dashboard working and upgrade bootstrap. Note: the bootstrap fixes will be coming in the followup CL
|
2015-02-17 19:15:54 -05:00 |
|
Joseph Schorr
|
98b4f62ef7
|
Switch to using a squashed image for the build workers
|
2015-02-10 15:43:01 -05:00 |
|
Jake Moshenko
|
5b8d65991e
|
Update the space on the builder nodes because its cheap.
|
2015-02-04 11:58:58 -05:00 |
|
Joseph Schorr
|
361fb33574
|
- Add a small build script
- Take in the build worker branch name from config
- Add additional logging (to be removed after we figure out the problem)
|
2015-02-03 12:48:41 -05:00 |
|
Jake Moshenko
|
2215ec6669
|
Associate a public IP with the network interfaces on our VPC instances.
|
2015-02-02 15:28:40 -05:00 |
|
Jake Moshenko
|
db8493f254
|
update the executor template to use VPC instances.
|
2015-02-02 14:55:34 -05:00 |
|
Jake Moshenko
|
a4b0c8698d
|
Allow the key prefixes in etcd to be configurable.
|
2015-02-02 12:00:19 -05:00 |
|
Jake Moshenko
|
c308794063
|
Fix the enterprise manager to use the new coroutine based interface.
|
2015-01-29 10:56:18 -05:00 |
|
Jake Moshenko
|
ef0806bd9d
|
Make the logs for the build manager more bearable.
|
2015-01-26 15:27:39 -05:00 |
|
Jake Moshenko
|
86852da4ba
|
Catch exceptions when ELB times out a connection to etcd.
|
2015-01-23 11:29:38 -05:00 |
|
Jake Moshenko
|
265aeabf60
|
We need to tell the etcd client which protocol to use.
|
2015-01-22 16:59:04 -05:00 |
|
Jake Moshenko
|
f2471a86f6
|
Fix the python requirements. Add the ability to map in etcd client certs and ca.
|
2015-01-22 10:53:23 -05:00 |
|
Jake Moshenko
|
fc757fecad
|
Tag the EC2 instances with the build uuid.
|
2015-01-05 15:35:14 -05:00 |
|
Jake Moshenko
|
8037962716
|
Change the severity of a log message which is actually expected in the happy case.
|
2015-01-05 14:44:54 -05:00 |
|
Jake Moshenko
|
f58b09a064
|
Remove the loop argument from the call to build_component_ready.
|
2015-01-05 13:08:25 -05:00 |
|
Jake Moshenko
|
320ae63ccd
|
Handle the case where there are no realms registered.
|
2015-01-05 12:23:54 -05:00 |
|
Jake Moshenko
|
b33ee1a474
|
Register existing builders to watch their expirations.
|
2015-01-05 11:21:36 -05:00 |
|
Jake Moshenko
|
a9839021af
|
When the etcd key tracking realms is first created the action is create, not set.
|
2014-12-31 11:46:02 -05:00 |
|
Jake Moshenko
|
cc70225043
|
Generalize the ephemeral build managers so that any manager may manage a builder spawned by any other manager.
|
2014-12-31 11:33:56 -05:00 |
|
Jake Moshenko
|
ec87e37d8c
|
EC2 terminate_instances does not take a force flag.
|
2014-12-23 17:17:53 -05:00 |
|
Jake Moshenko
|
cece94e1da
|
We want to terminate instances, not stop them.
|
2014-12-23 16:20:42 -05:00 |
|
Jake Moshenko
|
3ce64b4a7f
|
We must yield from stop_builder.
|
2014-12-23 16:12:10 -05:00 |
|
Jake Moshenko
|
8e16fbf59b
|
The root device on CoreOS is /dev/xvda.
|
2014-12-23 15:41:58 -05:00 |
|
Jake Moshenko
|
2f2a88825d
|
Try using SSD for root volumes.
|
2014-12-23 15:35:21 -05:00 |
|
Jake Moshenko
|
723fb27671
|
Calls to the ec2 service must be async, and responses must be wrapped as well.
|
2014-12-23 14:54:58 -05:00 |
|
Jake Moshenko
|
2ed9b3d243
|
Disable the etcd timeout on watch calls to prevent them from disconnecting the client.
|
2014-12-23 14:54:34 -05:00 |
|
Jake Moshenko
|
4e22e22ba1
|
We have to serialize our build data before sending it to etc.
|
2014-12-23 14:09:04 -05:00 |
|
Jake Moshenko
|
709e571b78
|
Handle read timeouts from etcd when watching a key.
|
2014-12-23 12:13:49 -05:00 |
|
Jake Moshenko
|
055a6b0c37
|
Add a total maximum time that a machine is allowed to stick around before we terminate it more forcefully.
|
2014-12-23 11:18:10 -05:00 |
|
Jake Moshenko
|
34bf92673b
|
Add support for adjusting etcd ttl on job_heartbeat. Switch the heartbeat method to a coroutine.
|
2014-12-22 17:24:44 -05:00 |
|
Jake Moshenko
|
2b6c2a2a50
|
Improve tests for the ephemeral build manager.
|
2014-12-22 16:22:07 -05:00 |
|
Jake Moshenko
|
e53b6b0e21
|
Merge remote-tracking branch 'origin/master' into ephemeral
|
2014-12-22 12:14:59 -05:00 |
|
Jake Moshenko
|
12ee8e0fc0
|
Switch a few of the buildman methods to coroutines in order to support network calls in methods. Add a test for the ephemeral build manager.
|
2014-12-22 12:14:16 -05:00 |
|
Jake Moshenko
|
a280bbcb6d
|
Add tag metadata to the instances.
|
2014-12-16 15:17:39 -05:00 |
|
Jake Moshenko
|
1d68594dc2
|
Extract instance ids from the instance objects returned by boto.
|
2014-12-16 15:10:50 -05:00 |
|
Jake Moshenko
|
2d7e844753
|
First implementation of ephemeral build lifecycle manager.
|
2014-12-16 13:41:30 -05:00 |
|
Jimmy Zelinskie
|
33f12c58ba
|
Add active worker count to buildmanager logs.
|
2014-12-16 13:37:40 -05:00 |
|
Jimmy Zelinskie
|
09cc4ba4c1
|
LOGGER -> logger.
While logger may be a global variable, it is not constant. Let the
linters complain!
|
2014-11-30 17:48:38 -05:00 |
|
Joseph Schorr
|
660a640de6
|
Better organize the source file structure of the build manager and change it to choose a lifecycle manager based on the config
|
2014-11-25 16:14:44 -05:00 |
|
Joseph Schorr
|
b8e873b00b
|
Add support to the build system for tracking if/when the build manager crashes and make sure builds are restarted within a few minutes
|
2014-11-21 14:27:06 -05:00 |
|
Jimmy Zelinskie
|
d0763862b1
|
Simple code review changes.
I sneakily also added local-test.sh and renamed run-local to
local-run.sh.
|
2014-11-20 14:36:22 -05:00 |
|
Jimmy Zelinskie
|
6df6f28edf
|
Lint BuildManager
|
2014-11-18 15:45:56 -05:00 |
|
Joseph Schorr
|
4322b5f81c
|
Get the new build system working for enterprise
|
2014-11-13 19:41:17 -05:00 |
|
Joseph Schorr
|
f93c0a46e8
|
WIP: Get everything working except logging and job completion
|
2014-11-12 14:03:07 -05:00 |
|
Joseph Schorr
|
eacf3f01d2
|
WIP: Start implementation of the build manager/controller. This code is not yet working completely.
|
2014-11-11 18:23:15 -05:00 |
|