8a507f0473
- consolidate list_pages() and list_replay_query_pages() into list_pages() - to keep backwards compatibility, add <crawl>/pagesSearch that does not include page totals, keep <crawl>/pages with page total (slower) - qa frontend: add default 'Crawl Order' sort order, to better show pages in QA view - bgjob: account for parallelism in bgjobs, add logging if succeeded mismatches parallelism - QA sorting: default to 'crawl order' by default to get better results. - Optimize pages job: also cover crawls that may not have any pages but have pages listed in done stats - Bgjobs: give custom op jobs more memory |
||
|---|---|---|
| .. | ||
| background_job.yaml | ||
| crawl_configmap.yaml | ||
| crawl_cron_job.yaml | ||
| crawl_job.yaml | ||
| crawler.yaml | ||
| profile_job.yaml | ||
| profilebrowser.yaml | ||
| qa_configmap.yaml | ||
| redis.yaml | ||
| replica_deletion_cron_job.yaml | ||
| replica_job.yaml | ||