quay/conf/init/service/chunkcleanupworker/run

#! /bin/bash

echo 'Starting chunk cleanup worker'

QUAYPATH=${QUAYPATH:-"."}
cd ${QUAYDIR:-"/"}
PYTHONPATH=$QUAYPATH venv/bin/python -m workers.chunkcleanupworker 2>&1

echo 'Chunk cleanup worker exited'
Add a chunk cleanup queue for async GC of empty chunks Instead of having the Swift storage engine try to delete the empty chunk(s) synchronously, we simply queue them and have a worker come along after 30s to delete the empty chunks. This has a few key benefits: it is async (doesn't slow down the push code), helps deal with Swift's eventual consistency (less retries necessary) and is generic for other storage engines if/when they need this as well 2016-11-10 18:54:04 +00:00			`#! /bin/bash`

			`echo 'Starting chunk cleanup worker'`

Use $QUAYPATH and $QUAYDIR in conf and init files 2017-02-01 23:17:25 +00:00			`QUAYPATH=${QUAYPATH:-"."}`
			`cd ${QUAYDIR:-"/"}`
			`PYTHONPATH=$QUAYPATH venv/bin/python -m workers.chunkcleanupworker 2>&1`
Add a chunk cleanup queue for async GC of empty chunks Instead of having the Swift storage engine try to delete the empty chunk(s) synchronously, we simply queue them and have a worker come along after 30s to delete the empty chunks. This has a few key benefits: it is async (doesn't slow down the push code), helps deal with Swift's eventual consistency (less retries necessary) and is generic for other storage engines if/when they need this as well 2016-11-10 18:54:04 +00:00
			`echo 'Chunk cleanup worker exited'`