19879fe349
- Add default vs custom (s3) storage - K8S: All storages correspond to secrets - K8S: Default storages inited via helm - K8S: Custom storage results in custom secret (per archive) - K8S: Don't add secret per crawl config - API for changing storage per archive - Docker: default storage just hard-coded from env vars (only one for now) - Validate custom storage via aiobotocore before confirming - Data Model: remove usage from users - Data Model: support adding multiple files per crawl for parallel crawls - Data Model: track completions for parallel crawls - Data Model: initial support for tags per crawl, add collection as 'coll' tag README fixes
11 lines
130 B
Plaintext
11 lines
130 B
Plaintext
uvicorn
|
|
fastapi-users[mongodb]==6.0.0
|
|
loguru
|
|
aiofiles
|
|
kubernetes-asyncio
|
|
aiodocker
|
|
apscheduler
|
|
aioprocessing
|
|
aiobotocore
|
|
aioredis
|