Following changes in webrecorder/browsertrix-crawler#475, webrecorder/browsertrix-crawler#509, the crawler adds a redirected seed to the seen list. To account for this, it needs to be subtracted to get the total page count. |
||
---|---|---|
.. | ||
__init__.py | ||
baseoperator.py | ||
bgjobs.py | ||
crawls.py | ||
cronjobs.py | ||
models.py | ||
profiles.py |