Fixes #1412 ## Changes ### Backend - Adds `all-crawls`, `crawls`, and `uploads` API endpoints to download archived item as multi-WACZ - Download QA runs as multi-WACZ - Adds backend tests for new endpoints - Update to new version of stream-zip library which does not require crc-32 to be present for ZIP members, computes after streaming, fixing invalid crc-32 issues as previously computed crc-32s from crawler may be invalid. ### Frontend Adds ability to download archived item from: - Button in archived item detail Files tab - Archived item details actions menu - Archived items list menu --------- Co-authored-by: Henry Wilkinson <henry@wilkinson.graphics> Co-authored-by: sua yoo <sua@webrecorder.org> Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
32 lines
475 B
Plaintext
32 lines
475 B
Plaintext
gunicorn
|
|
uvicorn[standard]
|
|
fastapi==0.103.2
|
|
motor==3.3.1
|
|
passlib
|
|
PyJWT==2.8.0
|
|
pydantic==2.8.2
|
|
email-validator
|
|
loguru
|
|
aiofiles
|
|
kubernetes-asyncio==29.0.0
|
|
kubernetes
|
|
aiobotocore
|
|
redis>=5.0.0
|
|
pyyaml
|
|
jinja2
|
|
humanize
|
|
python-multipart
|
|
pathvalidate
|
|
https://github.com/ikreymer/stream-zip/archive/refs/heads/crc32-optional.zip
|
|
boto3
|
|
backoff>=2.2.1
|
|
python-slugify>=8.0.1
|
|
mypy_boto3_s3
|
|
types_aiobotocore_s3
|
|
types-redis
|
|
types-python-slugify
|
|
types-pyYAML
|
|
remotezip
|
|
json-stream
|
|
aiostream
|