browsertrix/chart/templates
Ilya Kreymer 90197b2a85
Backend mem usage fix - use fixed MOTOR_MAX_WORKERS + switch to gunicorn (#1468)
Refactors backend deployment to:
- Use MOTOR_MAX_WORKERS (defaulting to 1) to reduce threads used by
mongodb connections
- Also sets backend workers to 1 by default to reduce default memory
usage
- Switches to gunicorn with uvloop worker for production use instead of
uvicorn (as recommended by uvicorn)

Lower thread count should address memory leak/increased usage, which
resulted in 5x thread x cpus x workers, eg. potentially 20 or 40 threads
just for mongodb connections. Lower default number of workers should
make it easier to scale backend with HPA if additional capacity.

Fixes #1467
2024-01-16 15:32:42 -08:00
..
backend.yaml Backend mem usage fix - use fixed MOTOR_MAX_WORKERS + switch to gunicorn (#1468) 2024-01-16 15:32:42 -08:00
configmap.yaml Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
frontend.yaml supports overriding the replayweb.page version without having to be r… (#1122) 2023-09-05 20:10:21 -04:00
ingress.yaml Allow User to specify custom cluster-issuer (#1332) 2023-11-04 13:29:17 -07:00
minio.yaml Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
mongo.yaml Resource Constraints Cleanup: (fixes #895) (#1019) 2023-08-01 00:11:16 -07:00
namespaces.yaml
operators.yaml Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
priorities.yaml Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
role.yaml Track pod resource usage, detect OOM crashes, handle auto-scaling (#1235) 2023-10-05 20:41:18 -07:00
secrets.yaml Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
service.yaml Use Shared Services for Crawling, Redis, Profile Browsers (#1088) 2023-08-24 20:08:53 -07:00
signer.yaml charts cleanup: (#1360) 2023-11-08 19:24:00 -08:00