browsertrix/chart/app-templates
Ilya Kreymer 3438133fcb
Crawler pod memory padding + auto scaling (#1631)
- set memory limit to 1.2x memory request to provide extra padding and
avoid OOM
- attempt to resize crawler pods by 1.2x when exceeding 90% of available
memory
- do a 'soft OOM' (send extra SIGTERM) to pod when reaching 100% of
requested memory, resulting in faster graceful restart, but avoiding a
system-instant OOM Kill
- Fixes #1632

---------
Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
2024-03-28 16:39:00 -07:00
..
crawl_cron_job.yaml
crawl_job.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
crawler.yaml Crawler pod memory padding + auto scaling (#1631) 2024-03-28 16:39:00 -07:00
profile_job.yaml Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
profilebrowser.yaml profile browser fixes: better resource usage + load retry (main) (#1604) 2024-03-16 15:07:04 -07:00
qa_configmap.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
redis.yaml
replica_job.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00