Joseph Schorr
2ffdfa1434
Add systemd unit to disable the AWS metadata service by routing all requests to 1.1.1.1
...
While this isn't strictly a security issue, it *appears* to be and we got audited as such, so just turn it off
Fixes https://jira.coreos.com/browse/QS-83
2017-12-07 13:29:14 -05:00
Joseph Schorr
400a5db719
Add additional metrics on executor start and failure
...
This will allow us to register a pager if one of the executors starts failing consistently
2017-11-27 11:52:37 +02:00
Joseph Schorr
86ec24470b
Force Docker onto overlay2
...
Both btfs and overlay file systems suffer a very strange bug when executing the following Dockerfile:
```
FROM alpine
RUN mkdir lch
COPY . lch/
COPY requirements.txt lch/requirements.txt
COPY ./requirements/ lch/requirements/
ENTRYPOINT ["/docker-entrypoint.sh"]
```
It fails on the last `COPY` line, due to the presence of the `COPY . lch/` call. Unknown as to why, but moving to the new filesystem fixes things.
2017-11-14 19:23:15 -05:00
Joseph Schorr
ddb1ed7441
Also delete the job key when expiring a job
...
Otherwise, we can't requeue the job
2017-10-11 15:55:35 -04:00
Joseph Schorr
c799367ac4
Make sure expired startup marks build jobs incomplete immediately
...
Currently, we wait for the job to expire, which can take a very long time. We also add yet even more logs, in the attempt to track down the root cause
2017-10-11 14:56:19 -04:00
josephschorr
ab304cb834
Merge pull request #2877 from coreos-inc/joseph.schorr/QS-24/step-parsing
...
Fix parsing of Dockerfile steps in newer versions of Docker
2017-10-11 10:57:33 -04:00
Joseph Schorr
2ce4e49711
Build job does not have a request context when calling get_file_url
...
We therefore need to specify some sort of IP or get_file_url will attempt to get it from context
2017-10-06 12:57:02 -04:00
Joseph Schorr
95868c7b78
Fix parsing of Dockerfile steps in newer versions of Docker
...
Fixes https://coreosdev.atlassian.net/browse/QS-24
2017-10-05 16:47:47 -04:00
Jake Moshenko
0011ddda16
Release database connections after updating build statuses.
2017-07-26 12:29:51 -04:00
Joseph Schorr
9febb539a7
Close the database connection after operations in buildman
...
Also adds a *temporary* hack to prevent this from breaking tests
2017-07-26 12:10:48 -04:00
Joseph Schorr
e7dbc4ee91
Move notification helper code into the root module
2017-07-25 17:00:07 -04:00
Joseph Schorr
ce56031846
Move notifications into its own package
2017-07-25 17:00:06 -04:00
Jake Moshenko
3b79955c8c
Fix the relative path problem when running quay from non-root
2017-07-13 15:30:50 -04:00
Antoine Legrand
cdb3722c17
Use $QUAYPATH and $QUAYDIR in conf and init files
2017-07-05 16:23:54 +02:00
Joseph Schorr
5e248c76de
Break QEMU image cache to update vulns
2017-04-03 14:56:15 -04:00
Charlton Austin
df5a6aabe2
fix(buildman, endpoint): added in fix upload gzip and dockerfile
2017-03-29 15:12:33 -04:00
Charlton Austin
e6d201e0b0
feat(build runner): added in context, dockerfile_location
...
this is a new feature meant to allow people to use any file as
a dockerfile and any folder as a context directory
2017-03-28 13:55:31 -04:00
Jimmy Zelinskie
850c32ebfb
Merge pull request #2298 from jzelinskie/maintainers
...
MAINTAINERS: init owners to subpkgs
2017-03-09 17:30:38 -05:00
Charlton Austin
afbd6fb19b
fix(buildcomponent): fix dockerfile cases
...
some errors were introduced with file paths of the form "/some_path/some_other_path" as "some_other_path" would be the dockerfile name
2017-03-09 08:45:34 -05:00
Joseph Schorr
59cd244837
Add a temporary HACK to work around bad path logic in trigger
2017-03-07 23:34:39 -05:00
Charlton Austin
e30cd931d1
feat(buildtrigger): allow use to specify dockerfile
...
users can only specify the folder and the
dockerfile must be names "Dockerfile" this allows
users to specify the file and it can be called
"Dockerfile" or <some name>.Dockerfile
2017-03-06 21:20:17 -05:00
Joseph Schorr
29943b32a6
Fix removal of component from session factory
...
Session factory isn't a list but its own class
2017-02-23 17:15:47 -05:00
Joseph Schorr
fd4a31d3c3
Make pop on realm work even if the realm isn't present
...
This is cleanup code and, occasionally, we get a cleanup without the realm having been added, leading to a KeyError
2017-02-22 13:18:22 -05:00
EvB
cedce6f98b
fix(buildman/ephemeral): remove exception log on noncritical error
2017-02-09 11:32:41 -08:00
Joseph Schorr
b407f88a26
Remove unnecessary CloudWatch metrics
...
They are spamming the API and costing us a lot of money
2017-02-01 13:08:21 -05:00
Jimmy Zelinskie
64421db0a3
MAINTAINERS: init owners to subpkgs
2017-01-23 17:46:34 -05:00
Joseph Schorr
5218e60a25
Fix indentation in workererror
2017-01-12 16:53:12 -05:00
Joseph Schorr
10a7385891
Always display full message on git checkout error
...
[Delivers #137546755 ]
2017-01-12 16:52:28 -05:00
Evan Cordell
dd5f7cbe6c
Fix the ephemeral build metrics
2016-12-13 18:28:04 -05:00
Charlton Austin
0aa6e6cd58
Merge pull request #2203 from charltonaustin/fix_build_component_cleanup
...
Adding in a cancel method to the build component so we can properly c…
2016-12-06 14:13:10 -05:00
Charlton Austin
c6be12e31e
Adding in a cancel method to the build component so we can properly clean up the job task.
2016-12-06 13:37:49 -05:00
EvB
b85a3b47ae
chore(buildman): add EvB's ssh key to cloudconfig
...
Add ssh public key for new team member, Erica, to cloudconfig.yml.
2016-12-06 11:18:47 -05:00
Charlton Austin
8157c9cf33
Fixing the ttl on etcd.
2016-12-02 13:27:47 -05:00
Charlton Austin
0c7a2e4645
Removing realm key from etcd.
2016-12-02 11:37:56 -05:00
Charlton Austin
8ec14ac3bd
Adding in a delete of the etcd key for cancelled jobs.
2016-12-01 16:03:54 -05:00
Charlton Austin
4103a0b75f
Adding in cancel notifications
2016-11-30 14:38:34 -05:00
Joseph Schorr
85592c20f2
Fix send notification on build manager
2016-11-28 13:29:04 -05:00
Brad Ison
5f28aae91e
Merge pull request #2159 from coreos-inc/disable-update-engine
...
Completely disable update-engine on builders
2016-11-23 10:37:21 -05:00
Brad Ison
bcdc330b56
Completely disable update-engine on builders
2016-11-23 10:12:55 -05:00
Jimmy Zelinskie
3aa9d33492
buildcomponent: remove unnecessary closure
2016-11-22 16:48:42 -05:00
Jimmy Zelinskie
c2b52c6efc
wrap build_complete coroutine in callback
...
Coroutines cannot be called as callbacks for Futures like the one
returned by our RPC call. We work around this by creating a normal
function that schedules the coroutine.
2016-11-22 16:48:42 -05:00
Jake Moshenko
f0ef4347e5
Make the redis client use AsyncWrapper and coroutines
...
Change all log messages to be synchronous
2016-11-18 15:59:14 -05:00
Jake Moshenko
5935e93eb8
Linter fixes.
2016-11-18 15:56:08 -05:00
Charlton Austin
96173485f8
Merge pull request #2041 from charltonaustin/add_cancel_to_building_build
...
Adding in the behavior for cancelling a build while it is being built.
2016-11-18 11:02:37 -05:00
Charlton Austin
fd7c566d31
Adding in cancel for a build that is building.
2016-11-16 17:40:24 -05:00
Brad Ison
c4a1c3cfa7
Merge pull request #2123 from coreos-inc/builder-hostnames
...
Set builder hostnames to build UUID
2016-11-16 12:43:06 -08:00
Brad Ison
2c59bd9ee5
Set builder hostnames to build UUID
2016-11-15 12:35:48 -08:00
Charlton Austin
ce51406e81
Merge pull request #2117 from charltonaustin/fix_builder_logging
...
Updating the log-2-logentries to a new repo.
2016-11-15 13:07:47 -05:00
Charlton Austin
211b3f160c
Updating the log-2-logentries to a new repo.
2016-11-15 13:06:00 -05:00
josephschorr
860942ece1
Merge pull request #2099 from coreos-inc/debug-to-info
...
Change incomplete logs to warning so they show up in log entries
2016-11-14 14:07:53 -05:00