Add note on checking browser profiles for scheduled crawls (#1763)

This commit is contained in:
Henry Wilkinson 2024-04-30 06:25:42 +02:00 committed by GitHub
parent bf4fc93d5a
commit 9c7fdb4fac
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -176,6 +176,11 @@ Sets the browser's language setting. Useful for crawling websites that detect th
## Scheduling
!!! tip "Tip: Scheduling crawl workflows with logged-in browser profiles"
Some websites will log users out after a set period of time. When crawling with a custom [browser profile](browser-profiles.md) that is logged into a website, we recommend checking the profile before crawling to ensure it is still logged in.
This can cause issues with scheduled crawl workflows — which will run even if the selected browser profile has been logged out.
### Crawl Schedule Type
`Run Immediately on Save`