tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
104ea097c4
browsertrix/backend/btrixcloud
History
Ilya Kreymer 104ea097c4
switch to simpler streaming download + multiwacz metadata improvements: (#1982) 
- download via presigned URLs via requests instead of boto APIs, remove boto
- follow-up to #1933 for streaming download improvements
- fixes datapackage.json in multi-wacz to contain the same resources
objects with: `name`, `path`, `hash`, `bytes` to match single WACZ.
- Add additional metadata to multi-wacz datapackage.json, including `type`
(`crawl`, `upload`, `collection`, `qaRun`), `id` (unique id for the
object), `title` / `description` if available (for
crawl/upload/collection), and `crawlId` for `qaRun`
2024-10-03 16:13:31 -07:00
..
migrations fix resetting of invalid logins: (#2002) 2024-08-07 12:36:06 -07:00
operator Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
__init__.py
auth.py Include user and user org info in login response (#2014) 2024-08-12 18:51:42 -07:00
background_jobs.py api docs cleanup + readd webhooks: (#1949) 2024-07-22 09:00:59 -07:00
basecrawls.py switch to simpler streaming download + multiwacz metadata improvements: (#1982) 2024-10-03 16:13:31 -07:00
colls.py switch to simpler streaming download + multiwacz metadata improvements: (#1982) 2024-10-03 16:13:31 -07:00
crawlconfigs.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
crawlmanager.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
crawls.py switch to simpler streaming download + multiwacz metadata improvements: (#1982) 2024-10-03 16:13:31 -07:00
db.py Serialize datetimes with Z suffix (#2058) 2024-09-12 16:16:13 -07:00
emailsender.py Subscription Update Quotas (#1988) 2024-08-05 15:59:47 -07:00
invites.py security: tweak get /invite endpoints / InviteOut to: (#2087) 2024-09-20 11:52:56 -07:00
k8sapi.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
main_op.py Add superuser API endpoints to export and import org data (#1394) 2024-07-02 17:14:34 -04:00
main.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
models.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
orgs.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
pages.py Serialize datetimes with Z suffix (#2058) 2024-09-12 16:16:13 -07:00
pagination.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
profiles.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
storages.py switch to simpler streaming download + multiwacz metadata improvements: (#1982) 2024-10-03 16:13:31 -07:00
subs.py Subscription Update Quotas (#1988) 2024-08-05 15:59:47 -07:00
uploads.py optimize org quota lookups (#1973) 2024-07-25 14:00:16 -07:00
users.py Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
utils.py Serialize datetimes with Z suffix (#2058) 2024-09-12 16:16:13 -07:00
version.py version: bump to 1.12.0-beta.0 2024-09-12 14:30:15 -07:00
webhooks.py Add webhooks for qaAnalysisStarted, qaAnalysisFinished, and crawlReviewed (#1974) 2024-07-25 16:53:49 -07:00