vbatts/quay
Archived
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
No description
This repository has been archived on 2020-03-24. You can view files and clone it, but cannot push or open issues or pull requests.
1016 commits 2 branches 62 tags 205 MiB
Python 67%
HTML 11.8%
JavaScript 11.8%
TypeScript 4.2%
CSS 4.1%
Other 1%
Find a file
yackob03 5511c9c4cf Remove some unnecessary logging from the test script.
2014-02-12 19:01:04 -05:00
art Add a logo for quay. Make the navbar a little friendlier to smaller devices. 2013-10-13 16:13:50 -04:00
auth Allow a request with invalid basic auth to still be considered anonymous, rather than throwing a 401. 2013-12-19 15:18:14 -05:00
binary_dependencies Add the binary dependencies for the build worker and some instructions on how to get it running on a host. 2014-02-11 19:55:22 -05:00
conf Add a mostly working cloud init script and a bitbucket deploy key. The docker run of logstash isn't working for some reason and still must be done manually. 2014-02-04 19:01:04 -05:00
data Really try to emulate the logs format with the test logs. Switch to a simplified flat logs format. 2014-02-12 18:58:40 -05:00
endpoints Really try to emulate the logs format with the test logs. Switch to a simplified flat logs format. 2014-02-12 18:58:40 -05:00
screenshots Update the screenshots. Add a screenshot and some marketing copy for logging. Change the branding on the screenshot tabs to Quay.io. 2014-01-10 12:40:14 -05:00
static Add a build display name, set it from the etag reported by s3 for file uploads. 2014-02-12 13:52:12 -05:00
storage Actually delete the image data when deleting the tag. 2014-01-09 17:13:26 -05:00
templates Get full build interface working 2014-02-10 22:43:48 -05:00
test Remove some unnecessary logging from the test script. 2014-02-12 19:01:04 -05:00
tools Add a tool for manually resending a confirmation email 2014-02-03 21:18:39 -05:00
util Send everything in production through the gunicorn logger (allows rotation using USR1). Add a gunicorn logger that emits the logstash format. Move the gunicorn config to the conf subdir. Update the postrotate script to hopefully work. 2014-02-04 15:08:49 -05:00
workers Really try to emulate the logs format with the test logs. Switch to a simplified flat logs format. 2014-02-12 18:58:40 -05:00
.gitignore Remove left over config from running on elastic beanstalk. 2013-10-16 17:52:19 -04:00
app.py Make the app config more powerful in terms of injecting fake dependencies. Refactor the tests to use metaclasses and to actually all run. 2013-11-06 23:21:12 -05:00
application.py Get the testlogs to correlate properly. 2014-02-11 12:09:59 -05:00
config.py Get the testlogs to correlate properly. 2014-02-11 12:09:59 -05:00
initdb.py Add a build display name, set it from the etag reported by s3 for file uploads. 2014-02-12 13:52:12 -05:00
README.md Send everything in production through the gunicorn logger (allows rotation using USR1). Add a gunicorn logger that emits the logstash format. Move the gunicorn config to the conf subdir. Update the postrotate script to hopefully work. 2014-02-04 15:08:49 -05:00
requirements-nover.txt Fix up the test endpoints with better fake data. Install them at a known location. Update the building test repository to point to the new fakes. 2014-02-05 20:01:23 -05:00
requirements.txt Fix up the test endpoints with better fake data. Install them at a known location. Update the building test repository to point to the new fakes. 2014-02-05 20:01:23 -05:00

README.md

to prepare a new host:

sudo apt-get update
sudo apt-get install -y git python-virtualenv python-dev phantomjs libjpeg8 libjpeg62-dev libfreetype6 libfreetype6-dev libevent-dev gdebi-core

check out the code:

git clone https://bitbucket.org/yackob03/quay.git
cd quay
virtualenv --distribute venv
source venv/bin/activate
pip install -r requirements.txt
sudo gdebi --n binary_dependencies/*.deb
sudo cp conf/logrotate/* /etc/logrotate.d/

running:

sudo mkdir -p /mnt/logs/ && sudo chown $USER /mnt/logs/ && sudo /usr/local/nginx/sbin/nginx -c `pwd`/conf/nginx.conf
sudo mkdir -p /mnt/logs/ && sudo chown $USER /mnt/logs/ && STACK=prod gunicorn -c conf/gunicorn_config.py application:application

start the log shipper:

curl -s https://get.docker.io/ubuntu/ | sudo sh
sudo docker pull quay.io/quay/logstash
sudo docker run -d -e REDIS_PORT_6379_TCP_ADDR=logs.quay.io -v /mnt/logs:/mnt/logs quay.io/quay/logstash quay.conf

start the workers:

STACK=prod python -m workers.diffsworker -D
STACK=prod python -m workers.dockerfilebuild -D
STACK=prod python -m workers.webhookworker -D

bouncing the servers:

sudo kill -HUP `cat /mnt/logs/nginx.pid`
kill -HUP `cat /mnt/logs/gunicorn.pid`

kill <pids of worker daemons>
restart daemons

running the tests:

STACK=test python -m unittest discover

generating screenshots:

cd screenshots
casperjs screenshots.js --d