For single page crawls: - Always force 1 browser to be used, ignoring browser windows/scale setting - Don't use custom PVC volumes in crawler / redis, just use emptyDir - no chance of crawler being interrupted and restarted on different machine for a single page. Adds a 'is_single_page' check to CrawlConfig, checking for either limit or scopeType / no extra hops. Fixes #2655 |
||
---|---|---|
.. | ||
background_job.yaml | ||
crawl_configmap.yaml | ||
crawl_cron_job.yaml | ||
crawl_job.yaml | ||
crawler.yaml | ||
profile_job.yaml | ||
profilebrowser.yaml | ||
qa_configmap.yaml | ||
redis.yaml | ||
replica_deletion_cron_job.yaml | ||
replica_job.yaml |