browsertrix/backend/btrixcloud/operator
Ilya Kreymer 5c08c9679c
fix issue with incorrect number of total pages if any of the seeds is a redirect (#1649)
Following changes in webrecorder/browsertrix-crawler#475,
webrecorder/browsertrix-crawler#509, the crawler adds a redirected seed
to the seen list. To account for this, it needs to be subtracted to get
the total page count.
2024-04-04 15:55:44 -07:00
..
__init__.py Refactor operator class into module (#1564) 2024-02-29 14:40:12 -08:00
baseoperator.py Crawler pod memory padding + auto scaling (#1631) 2024-03-28 16:39:00 -07:00
bgjobs.py Refactor operator class into module (#1564) 2024-02-29 14:40:12 -08:00
crawls.py fix issue with incorrect number of total pages if any of the seeds is a redirect (#1649) 2024-04-04 15:55:44 -07:00
cronjobs.py QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
models.py operator state fixes (follow up fomr #1639) (#1640) 2024-03-29 15:12:16 -07:00
profiles.py Refactor operator class into module (#1564) 2024-02-29 14:40:12 -08:00