Ilya Kreymer 19879fe349 Storage + Data Model Refactor (fixes #3): ... - Add default vs custom (s3) storage - K8S: All storages correspond to secrets - K8S: Default storages inited via helm - K8S: Custom storage results in custom secret (per archive) - K8S: Don't add secret per crawl config - API for changing storage per archive - Docker: default storage just hard-coded from env vars (only one for now) - Validate custom storage via aiobotocore before confirming - Data Model: remove usage from users - Data Model: support adding multiple files per crawl for parallel crawls - Data Model: track completions for parallel crawls - Data Model: initial support for tags per crawl, add collection as 'coll' tag README fixes		2021-10-09 18:58:40 -07:00
..
archives.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
crawlconfigs.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
crawls.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
db.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
Dockerfile
dockerman.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
emailsender.py	new features:	2021-08-20 11:02:29 -07:00
k8sman.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
main.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
requirements.txt	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
scheduler.py	add missing scheduler!	2021-08-25 16:18:53 -07:00
storages.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00
users.py	Storage + Data Model Refactor (fixes #3):	2021-10-09 18:58:40 -07:00