From Greg:
it looks like thecombine maintenance pod was using 14gb of node local ephemeral storage
[...]
I'm trying to evaluate if I need to change the thresholds, but at the moment, the node has 21GB free, and the limit is about 5GB free.
[...]
Is it a database dump?
[...]
ideally it wouldn't use so much space on the node, because when other jobs overlap with this one, that's when it becomes an issue. So it doesn't happen all the time, but it's happened several times.
[...]
I don't want to create a huge project for you, but if there's something easy like using compression then that would sure be worth it.
This is probably the job in question:
https://github.com/sillsdev/TheCombine/blob/master/deploy/helm/thecombine/charts/maintenance/templates/cronjob-daily-backup.yaml
From Greg:
This is probably the job in question:
https://github.com/sillsdev/TheCombine/blob/master/deploy/helm/thecombine/charts/maintenance/templates/cronjob-daily-backup.yaml