Ilya Kreymer 6dc452ebad Storage Refactor: Replication + Custom Storage Support (#1296) ... - Refactors storage to support replicas + custom storages on the Org. - There is a default primary + replica storage, while an Org can also have primary and replica storages. - StorageRef object is used to store references to default and custom storage. - CrawlFile has been updated to contain a StorageRef instead of a def_storage_name, which references either a default storage (in StorageOps) or custom storage (in Organization) - There is also a 'replicas' Optional[List[StorageRef]] which contains replicas, if any. - CrawlFileOut contain a numReplicas for how many replicas exist for a given file. - Migration: migration 0020 added to migrate existing Orgs, CrawlFile and ProfileFile objects to new storage system (CrawlFile and ProfileFile now extend BaseFile) Part of #1262 --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>		2023-10-26 21:44:09 -07:00
..
data
__init__.py
conftest.py	Add slugs to org backend (#1250)	2023-10-10 18:30:09 -07:00
echo_server.py
test_collections.py	Fix: Make Collections Public on Creation (#1213)	2023-09-29 12:08:10 -07:00
test_crawl_config_search_values.py
test_crawl_config_tags.py
test_crawlconfigs.py	Separate seeds into a new endpoints (#1217)	2023-10-02 10:56:12 -07:00
test_filter_sort_results.py	Separate seeds into a new endpoints (#1217)	2023-10-02 10:56:12 -07:00
test_invites.py
test_login.py	User refactor + remove fastapi_users dependency + update fastapi (#1290)	2023-10-18 10:49:23 -07:00
test_org.py	Storage Refactor: Replication + Custom Storage Support (#1296)	2023-10-26 21:44:09 -07:00
test_permissions.py
test_run_crawl.py	avoid exception if 'errors' key doesn't exist (#1301)	2023-10-19 14:39:54 -07:00
test_settings.py
test_stop_cancel_crawl.py
test_uploads.py	avoid exception if 'errors' key doesn't exist (#1301)	2023-10-19 14:39:54 -07:00
test_users.py	Prevent user from logging in after 5 consecutive failed login attempts until pw is reset (#1281)	2023-10-20 14:10:56 -07:00
test_utils.py	Add slugs to org backend (#1250)	2023-10-10 18:30:09 -07:00
test_webhooks.py	Provide full resources in archived items finished webhooks (#1308)	2023-10-23 19:01:58 -07:00
test_workflow_auto_add_to_collection.py
utils.py