browsertrix/backend/btrixcloud
Ilya Kreymer 94e985ae13
optimize org quota lookups (#1973)
- instead of looking up storage and exec min quotas from oid, and
loading an org each time, load org once and then check quotas on the org
object - many times the org was already available, and was looked up
again
- storage and exec quota checks become sync
- rename can_run_crawl() to more generic can_write_data(), optionally
also checks exec minutes
- typing: get_org_by_id() always returns org, or throws, adjust methods
accordingly (don't check for none, catch exception)
- typing: fix typo in BaseOperator, catch type errors in operator
'org_ops'
- operator quota check: use up-to-date 'status.size' for current job,
ignore current job in all jobs list to avoid double-counting
- follow up to #1969
2024-07-25 14:00:16 -07:00
..
migrations Standardize handling of storage and execution time quotas (#1969) 2024-07-25 12:49:11 -07:00
operator optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
__init__.py
auth.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
background_jobs.py api docs cleanup + readd webhooks: (#1949) 2024-07-22 09:00:59 -07:00
basecrawls.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
colls.py Document all API endpoints with response models (#1928) 2024-07-16 12:48:38 -07:00
crawlconfigs.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
crawlmanager.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
crawls.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
db.py Standardize handling of storage and execution time quotas (#1969) 2024-07-25 12:49:11 -07:00
emailsender.py Additional typing cleanup (#1938) 2024-07-17 10:49:22 -07:00
invites.py Add created date to Organization and fix datetimes across backend (#1921) 2024-07-15 19:46:32 -07:00
k8sapi.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
main_op.py Add superuser API endpoints to export and import org data (#1394) 2024-07-02 17:14:34 -04:00
main.py Add support e-mail to settings (#1960) 2024-07-23 20:58:12 -04:00
models.py Standardize handling of storage and execution time quotas (#1969) 2024-07-25 12:49:11 -07:00
orgs.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
pages.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
pagination.py
profiles.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
storages.py Implement downloading archived item + QA runs as multi-WACZ (#1933) 2024-07-25 10:28:57 -07:00
subs.py Add API endpoint to import subscription for existing org (#1930) 2024-07-16 16:17:02 -07:00
uploads.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
users.py Document all API endpoints with response models (#1928) 2024-07-16 12:48:38 -07:00
utils.py Additional typing cleanup (#1938) 2024-07-17 10:49:22 -07:00
version.py version: bump to 1.11.0-beta.1 2024-07-17 10:06:49 -07:00
webhooks.py Document all API endpoints with response models (#1928) 2024-07-16 12:48:38 -07:00