vbatts/quay
Archived
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
8713 commits 2 branches 62 tags 205 MiB
Commit graph

380 commits

Author SHA1 Message Date
Joseph Schorr
c30214c7a8 Start on a basic registry_model interface and change a single module to use it. This will allow us to completely abstract out how we deal with registry-related tables and ensure that transitioning to the new OCI-like model will be easier to do. 2018-08-14 13:48:59 -04:00
Brad Ison
d3d9cca182 Upgrade Peewee to latest 3.x 
This requires a number of small changes in the data model code, as well as additional testing.
 2018-07-23 12:43:23 -04:00
Joseph Schorr
2d6a6a1f6c Add a timeout to various operations against etcd in the build manager when it cannot connect to etcd 
This will ensure that the build managers don't simply sit there thrashing against a non-existing cluster, thus driving the CPU up on our production nodes, and thus taking them out of service

Addresses https://jira.coreos.com/browse/QUAY-990
 2018-07-08 12:25:33 +03:00
Brad Ison
c2ad6c5060
Check for null model objects 
As of v2.8.2, peewee will not create model objects with all null
fields when an FK reference is null.  We have to check the model
instances for None.  See:

  https://github.com/coleifer/peewee/issues/1012
 2018-04-04 14:19:45 -04:00
Joseph Schorr
93d79e777e Automatically disable build triggers with successive failures or internal errors 
We allow users to reenable them manually once disabled
 2018-03-01 16:49:51 -05:00
Joseph Schorr
d323758d95 Fix permissions on disable-aws-metadata script 2018-01-05 13:26:59 -05:00
Joseph Schorr
d2476c9187 Have builder follow the logging configuration 
Also fixes a few lint errors
 2018-01-04 13:09:26 -05:00
Joseph Schorr
a1a6df7914 Fix log level on build manager logs 2018-01-04 13:03:45 -05:00
Joseph Schorr
2ffdfa1434 Add systemd unit to disable the AWS metadata service by routing all requests to 1.1.1.1 
While this isn't strictly a security issue, it *appears* to be and we got audited as such, so just turn it off

Fixes https://jira.coreos.com/browse/QS-83
 2017-12-07 13:29:14 -05:00
Joseph Schorr
400a5db719 Add additional metrics on executor start and failure 
This will allow us to register a pager if one of the executors starts failing consistently
 2017-11-27 11:52:37 +02:00
Joseph Schorr
86ec24470b Force Docker onto overlay2 
Both btfs and overlay file systems suffer a very strange bug when executing the following Dockerfile:

```
FROM alpine

RUN mkdir lch

COPY . lch/
COPY requirements.txt lch/requirements.txt
COPY ./requirements/ lch/requirements/

ENTRYPOINT ["/docker-entrypoint.sh"]
```

It fails on the last `COPY` line, due to the presence of the `COPY . lch/` call. Unknown as to why, but moving to the new filesystem fixes things.
 2017-11-14 19:23:15 -05:00
Joseph Schorr
ddb1ed7441 Also delete the job key when expiring a job 
Otherwise, we can't requeue the job
 2017-10-11 15:55:35 -04:00
Joseph Schorr
c799367ac4 Make sure expired startup marks build jobs incomplete immediately 
Currently, we wait for the job to expire, which can take a very long time. We also add yet even more logs, in the attempt to track down the root cause
 2017-10-11 14:56:19 -04:00
josephschorr
ab304cb834 Merge pull request #2877 from coreos-inc/joseph.schorr/QS-24/step-parsing 
Fix parsing of Dockerfile steps in newer versions of Docker
 2017-10-11 10:57:33 -04:00
Joseph Schorr
2ce4e49711 Build job does not have a request context when calling get_file_url 
We therefore need to specify some sort of IP or get_file_url will attempt to get it from context
 2017-10-06 12:57:02 -04:00
Joseph Schorr
95868c7b78 Fix parsing of Dockerfile steps in newer versions of Docker 
Fixes https://coreosdev.atlassian.net/browse/QS-24
 2017-10-05 16:47:47 -04:00
Jake Moshenko
0011ddda16 Release database connections after updating build statuses. 2017-07-26 12:29:51 -04:00
Joseph Schorr
9febb539a7 Close the database connection after operations in buildman 
Also adds a *temporary* hack to prevent this from breaking tests
 2017-07-26 12:10:48 -04:00
Joseph Schorr
e7dbc4ee91 Move notification helper code into the root module 2017-07-25 17:00:07 -04:00
Joseph Schorr
ce56031846 Move notifications into its own package 2017-07-25 17:00:06 -04:00
Jake Moshenko
3b79955c8c Fix the relative path problem when running quay from non-root 2017-07-13 15:30:50 -04:00
Antoine Legrand
cdb3722c17 Use $QUAYPATH and $QUAYDIR in conf and init files 2017-07-05 16:23:54 +02:00
Joseph Schorr
5e248c76de Break QEMU image cache to update vulns 2017-04-03 14:56:15 -04:00
Charlton Austin
df5a6aabe2 fix(buildman, endpoint): added in fix upload gzip and dockerfile 2017-03-29 15:12:33 -04:00
Charlton Austin
e6d201e0b0 feat(build runner): added in context, dockerfile_location 
this is a new feature meant to allow people to use any file as
  a dockerfile and any folder as a context directory
 2017-03-28 13:55:31 -04:00
Jimmy Zelinskie
850c32ebfb Merge pull request #2298 from jzelinskie/maintainers 
MAINTAINERS: init owners to subpkgs
 2017-03-09 17:30:38 -05:00
Charlton Austin
afbd6fb19b fix(buildcomponent): fix dockerfile cases 
some errors were introduced with file paths of the form "/some_path/some_other_path" as "some_other_path" would be the dockerfile name
 2017-03-09 08:45:34 -05:00
Joseph Schorr
59cd244837 Add a temporary HACK to work around bad path logic in trigger 2017-03-07 23:34:39 -05:00
Charlton Austin
e30cd931d1 feat(buildtrigger): allow use to specify dockerfile 
users can only specify the folder and the
  dockerfile must be names "Dockerfile" this allows
  users to specify the file and it can be called
  "Dockerfile" or <some name>.Dockerfile
 2017-03-06 21:20:17 -05:00
Joseph Schorr
29943b32a6 Fix removal of component from session factory 
Session factory isn't a list but its own class
 2017-02-23 17:15:47 -05:00
Joseph Schorr
fd4a31d3c3 Make pop on realm work even if the realm isn't present 
This is cleanup code and, occasionally, we get a cleanup without the realm having been added, leading to a KeyError
 2017-02-22 13:18:22 -05:00
EvB
cedce6f98b fix(buildman/ephemeral): remove exception log on noncritical error 2017-02-09 11:32:41 -08:00
Joseph Schorr
b407f88a26 Remove unnecessary CloudWatch metrics 
They are spamming the API and costing us a lot of money
 2017-02-01 13:08:21 -05:00
Jimmy Zelinskie
64421db0a3 MAINTAINERS: init owners to subpkgs 2017-01-23 17:46:34 -05:00
Joseph Schorr
5218e60a25 Fix indentation in workererror 2017-01-12 16:53:12 -05:00
Joseph Schorr
10a7385891 Always display full message on git checkout error 
[Delivers #137546755]
 2017-01-12 16:52:28 -05:00
Evan Cordell
dd5f7cbe6c Fix the ephemeral build metrics 2016-12-13 18:28:04 -05:00
Charlton Austin
0aa6e6cd58 Merge pull request #2203 from charltonaustin/fix_build_component_cleanup 
Adding in a cancel method to the build component so we can properly c…
 2016-12-06 14:13:10 -05:00
Charlton Austin
c6be12e31e Adding in a cancel method to the build component so we can properly clean up the job task. 2016-12-06 13:37:49 -05:00
EvB
b85a3b47ae chore(buildman): add EvB's ssh key to cloudconfig 
Add ssh public key for new team member, Erica, to cloudconfig.yml.
 2016-12-06 11:18:47 -05:00
Charlton Austin
8157c9cf33 Fixing the ttl on etcd. 2016-12-02 13:27:47 -05:00
Charlton Austin
0c7a2e4645 Removing realm key from etcd. 2016-12-02 11:37:56 -05:00
Charlton Austin
8ec14ac3bd Adding in a delete of the etcd key for cancelled jobs. 2016-12-01 16:03:54 -05:00
Charlton Austin
4103a0b75f Adding in cancel notifications 2016-11-30 14:38:34 -05:00
Joseph Schorr
85592c20f2 Fix send notification on build manager 2016-11-28 13:29:04 -05:00
Brad Ison
5f28aae91e Merge pull request #2159 from coreos-inc/disable-update-engine 
Completely disable update-engine on builders
 2016-11-23 10:37:21 -05:00
Brad Ison
bcdc330b56 Completely disable update-engine on builders 2016-11-23 10:12:55 -05:00
Jimmy Zelinskie
3aa9d33492 buildcomponent: remove unnecessary closure 2016-11-22 16:48:42 -05:00
Jimmy Zelinskie
c2b52c6efc wrap build_complete coroutine in callback 
Coroutines cannot be called as callbacks for Futures like the one
returned by our RPC call. We work around this by creating a normal
function that schedules the coroutine.
 2016-11-22 16:48:42 -05:00
Jake Moshenko
f0ef4347e5 Make the redis client use AsyncWrapper and coroutines 
Change all log messages to be synchronous
 2016-11-18 15:59:14 -05:00