browsertrix/frontend
Tessa Walsh 6797b41de0
Add pageCount to crawls and uploads and use in frontend for page counts (#2315)
Fixes #2257 

This is a follow-up to the public collections work, which adds pages to
the database for uploads. All crawls and uploads now have a `pageCount`
field which is populated when the item is successfully added. A new
migration is also added to populate the field for existing archived
items that don't have it set yet.

OrgMetrics have also been modified to include `crawlPageCount` and
`uploadPageCount`, and to include the total of both in `pageCount`, and
all three included in the frontend org dashboard.

The frontend has been updated to use `pageCount` rather than
`stats.done` wherever appropriate, meaning that in archived item lists
and details we now have a consistent page count for both crawls and
uploads.

### New functionality

- Deploy this branch
- Create new crawls and uploads and verify that page count appears
correctly throughout the frontend for all new crawls and uploads

### Migration

- Deploy from latest main
- Create some crawls and uploads
- Change to this branch and re-deploy
- Verify migration ran without errors in backend logs
- Verify that page count has been populated successfully by checking
archived items lists, crawl and upload detail pages, and dashboard to
ensure there are no longer any missing page counts.

---------

Co-authored-by: emma <hi@emma.cafe>
2025-01-16 14:41:14 -08:00
..
.husky
config Remove ANALYTICS_NAMESPACE, as it's only usable at build time (#2293) 2025-01-13 20:13:30 -08:00
docs feat: Add slug to collections and use it in public collection URLs (#2301) 2025-01-15 22:44:32 -08:00
lib
patches
scripts deps: Improve Webpack build performance (#2288) 2025-01-14 12:55:12 -08:00
src Add pageCount to crawls and uploads and use in frontend for page counts (#2315) 2025-01-16 14:41:14 -08:00
tests
xliff Add pageCount to crawls and uploads and use in frontend for page counts (#2315) 2025-01-16 14:41:14 -08:00
.dockerignore
.editorconfig
.eslintrc.js
.gitignore
.prettierignore
.vscode
.yarnrc
00-browsertrix-nginx-init.sh feat: Track collection events (#2256) 2025-01-13 15:15:49 -08:00
Dockerfile
frontend.conf.template
index.d.ts
lit-localize.json
minio.conf
package.json deps: Improve Webpack build performance (#2288) 2025-01-14 12:55:12 -08:00
playwright.config.ts
postcss.config.js
prettier.config.js
README.md
sample.env.local Remove ANALYTICS_NAMESPACE, as it's only usable at build time (#2293) 2025-01-13 20:13:30 -08:00
tailwind.config.js
tsconfig.eslint.json
tsconfig.json
vendor.webpack.config.js deps: Improve Webpack build performance (#2288) 2025-01-14 12:55:12 -08:00
web-test-runner.config.mjs feat: Track collection events (#2256) 2025-01-13 15:15:49 -08:00
webpack.config.js Add pageCount to crawls and uploads and use in frontend for page counts (#2315) 2025-01-16 14:41:14 -08:00
webpack.dev.js deps: Improve Webpack build performance (#2288) 2025-01-14 12:55:12 -08:00
webpack.prod.js
yarn.lock deps: Improve Webpack build performance (#2288) 2025-01-14 12:55:12 -08:00