* Track collections in Crawl rather than crawls in Collection * Add delete collection API endpoint and tests * Precompute collection crawlCount, pageCount, and tags and add them to GET collection responses * Add modified field to Collection * Update collection replay.json method * Make add and remove crawls accept list of crawl ids * Auto-add new workflow crawls to collections when they successfully complete via CrawlConfig.autoAddCollections field * Move long-running post-crawl operator tasks into asyncio task * Make CrawlConfig.autoAddCollections updatable via /update API endpoint |
||
|---|---|---|
| .. | ||
| migrations | ||
| templates | ||
| __init__.py | ||
| colls.py | ||
| crawlconfigs.py | ||
| crawlmanager.py | ||
| crawls.py | ||
| db.py | ||
| emailsender.py | ||
| invites.py | ||
| k8sapi.py | ||
| main_op.py | ||
| main_scheduled_job.py | ||
| main.py | ||
| operator.py | ||
| orgs.py | ||
| pagination.py | ||
| profiles.py | ||
| storages.py | ||
| users.py | ||
| utils.py | ||
| version.py | ||
| zip.py | ||