* Move all pydantic models to models.py to avoid circular dependencies * Include automated crawl details in all-crawls GET endpoints - ensure /all-crawls endpoint resolves names / firstSeed data same as /crawls endpoint for crawls to ensure consistent frontend display. fields added in get and list all-crawl endpoints for automated crawls only: - cid - name - description - firstSeed - seedCount - profileName * Add automated crawl fields to list all-crawls test * Uncomment mongo readinessProbe * cleanup CrawlOutWithResources: - remove 'files' from output model, only resources should be returned - add _files_to_resources() to simplify computing presigned 'resources' from raw 'files' - update upload tests to be more consistent, 'files' never present, 'errors' always none --------- Co-authored-by: Ilya Kreymer <ikreymer@gmail.com> |
||
---|---|---|
.. | ||
__init__.py | ||
migration_0001_archives_to_orgs.py | ||
migration_0002_crawlconfig_crawlstats.py | ||
migration_0003_mutable_crawl_configs.py | ||
migration_0004_config_seeds.py | ||
migration_0005_operator_scheduled_jobs.py | ||
migration_0006_precompute_crawl_stats.py | ||
migration_0007_colls_and_config_update.py | ||
migration_0008_precompute_crawl_file_stats.py | ||
migration_0009_crawl_types.py |