tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs: Update new feature of upload seed URL list as file (#2792)

Browse Source 
Closes #2653

Updated docs to reflect the uploading seed URL list as file

RE: #2646

---------

Co-authored-by: Emma Segal-Grossman <hi@emma.cafe>
This commit is contained in:
DaleLore 2025-08-06 21:26:51 -04:00 committed by GitHub
parent 72d1529993
commit ebfe36a03f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
frontend/docs/docs/user-guide/workflow-setup.md
View File

@ -39,7 +39,11 @@ _Site Crawl_
: Crawls a single URL and does not include any linked pages.
`List of Pages`
: Crawls only specified URLs and does not include any linked pages.
: Crawls only specified URLs and does not include any linked pages (unless [_Include Any Linked Page_](#include-any-linked-page) is enabled). Each URL must be entered on its own line. URLs can be entered directly into the designated text area or uploaded as a text file. These options cannot be combined in a single workflow.
Up to 100 URLs can be entered into the text area. If you paste a list of over 100 URLs, Browsertrix will automatically convert the list into a text file and attach it to the workflow. Text files can be viewed and deleted from within the workflow, but cannot be edited in place.
Ensure each URL is on its own line so the crawler can queue all provided URLs for crawling. It will continue queuing until it reaches either the organization's pages per crawl limit or the crawl workflow's page limit. Once one of these limits is hit, it will stop queuing additional URLs. Duplicate URLs will be queued only once, while invalid URLs will be skipped and not queued at all. The crawl will fail if the list contains no valid URLs or if there is a file formatting error.
`In-Page Links`
: Crawls only the specified URL and treats linked sections of the page as distinct pages.