browsertrix/backend
Ilya Kreymer 2f63c7dcf8
Profiles: Backend API + Nginx Devtools Proxy Support (#212)
* add profile creation, list endpoints at /archives/<aid>/profiles
* add profile browser creation, get, ping, commit, delete endpoints at /archives/<aid>/profiles/browser
* support creation of profile browser using browsertrix-crawler 'create-login-profile' in docker and k8s
* ensure profile browser expires after set time, k8s job or docker container automatically deleted on exit
* profile browser creation returns temporary browser id, or `{"detail": "waiting_for_browser"}` while waiting for browser container init
* nginx frontend: proxy /loadbrowser/ to port 9223 in browsertrix-crawler, connecting directly to chrome devtools
* profile api auth: use redis for auth
- store browserid->archiveid and browserid->browser ip mapping in redis
- browser apis: ensure profile browser is associated with specified archive
- browser ws: pass arcchiveid and browserid to ws query args, browserid is part of archive, and browserid corresponds to specified ip
* store profiles in /profiles/ directory in default storage, include profileid in profile tar.gz filename

* support profile in crawlconfig:
- add profileid to CrawlConfig, and profileName to CrawlConfigOut
- support resolving profile path via profileid, setting '--profile @{path/to/profile.tar.gz}' for crawler (assuming same storage for profile as output for now) in both docker and k8s setups
- docker: support out_filename, custom wacz output filename missing functionality
2022-04-13 19:36:06 -07:00
..
archives.py Support for Admin interface for viewing web archives (#198) 2022-04-06 12:42:04 -07:00
colls.py Refactor backend data model to support UUID (fixes #118) (#119) 2022-01-29 19:00:11 -08:00
crawlconfigs.py Profiles: Backend API + Nginx Devtools Proxy Support (#212) 2022-04-13 19:36:06 -07:00
crawls.py Support for Admin interface for viewing web archives (#198) 2022-04-06 12:42:04 -07:00
db.py Mongo auth fix (#190) 2022-03-04 15:04:33 -08:00
Dockerfile backend prod settings: 2022-02-28 18:09:13 -08:00
dockerman.py Profiles: Backend API + Nginx Devtools Proxy Support (#212) 2022-04-13 19:36:06 -07:00
emailsender.py
invites.py Refactor backend data model to support UUID (fixes #118) (#119) 2022-01-29 19:00:11 -08:00
k8sman.py Profiles: Backend API + Nginx Devtools Proxy Support (#212) 2022-04-13 19:36:06 -07:00
main.py Profiles: Backend API + Nginx Devtools Proxy Support (#212) 2022-04-13 19:36:06 -07:00
profiles.py Profiles: Backend API + Nginx Devtools Proxy Support (#212) 2022-04-13 19:36:06 -07:00
requirements.txt Watch Stream Directly from Browsertrix Crawler (#189) 2022-03-04 14:55:11 -08:00
scheduler.py Misc backend fixes (#133) 2022-01-31 19:41:04 -08:00
storages.py support signing in docker deployment: (#166) 2022-02-28 14:32:19 -08:00
users.py backend work: 2022-03-15 18:20:25 -07:00