tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

QA stats aggregation: exclude isFile / isError pages from stats (#1879)

Browse Source 
Follow-up to: #1868, exclude pages that have isFile or isError set to
true from the stats aggregation.
This commit is contained in:
Ilya Kreymer 2024-06-25 08:54:42 -07:00 committed by GitHub
parent 7af3980323
commit 3bd714ea9d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
backend/btrixcloud/pages.py
View File

@ -577,7 +577,13 @@ class PageOps:
boundaries.append(1.1) boundaries.append(1.1)
aggregate = [ aggregate = [
{"$match": {"crawl_id": crawl_id}}, {
"$match": {
"crawl_id": crawl_id,
"isFile": {"$ne": True},
"isError": {"$ne": True},
}
},
{ {
"$bucket": { "$bucket": {
"groupBy": f"$qa.{qa_run_id}.{key}", "groupBy": f"$qa.{qa_run_id}.{key}",