5f99448adc
Instead of having the Swift storage engine try to delete the empty chunk(s) synchronously, we simply queue them and have a worker come along after 30s to delete the empty chunks. This has a few key benefits: it is async (doesn't slow down the push code), helps deal with Swift's eventual consistency (less retries necessary) and is generic for other storage engines if/when they need this as well
8 lines
No EOL
143 B
Bash
Executable file
8 lines
No EOL
143 B
Bash
Executable file
#! /bin/bash
|
|
|
|
echo 'Starting chunk cleanup worker'
|
|
|
|
cd /
|
|
venv/bin/python -m workers.chunkcleanupworker 2>&1
|
|
|
|
echo 'Chunk cleanup worker exited' |