Following changes in webrecorder/browsertrix-crawler#475, webrecorder/browsertrix-crawler#509, the crawler adds a redirected seed to the seen list. To account for this, it needs to be subtracted to get the total page count. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| baseoperator.py | ||
| bgjobs.py | ||
| crawls.py | ||
| cronjobs.py | ||
| models.py | ||
| profiles.py | ||