tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
372 Commits 2 Branches 0 Tags 15 MiB
2e3b3cb228
Commit Graph

372 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tessa Walsh
2e3b3cb228
Add API endpoint to update crawl tags (#545) 
* Add API endpoint to update crawls (tags only for now)
* Allow setting tags to empty list in crawlconfig updates
 2023-02-01 22:24:36 -05:00
Tessa Walsh
23022193fb
Reformat backend for black 23.1.0 (#548) 2023-02-01 20:01:09 -05:00
Tessa Walsh
58aafc4191
Make API updates for member updates (#541) 
* Add API endpoint that lists pending invites for all orgs (superuser-only)
* Add API endpoint that lists pending invites for org
* Add user emails to /api/orgs/<oid> response
 2023-02-01 16:44:00 -05:00
Ilya Kreymer
9048d46c6c backend: add extraHops to support #543 2023-02-01 13:21:26 -08:00
Ilya Kreymer
e8b90b7c3e
Deploy to Dev Cluster Fixes (#542) 
fix typos for on-demand k8s cluster deployment via github action trigger
 2023-01-31 16:33:56 -08:00
Ilya Kreymer
e98df10dad
CI: Setup manual workflow for dev deployment (#540) 
* deployment: add initial manual workflow for deploying to dev cluster, addresses #428
* opt: only run k3d-log-ci tests on backend or chart changes
 2023-01-31 15:42:50 -08:00
sua yoo
f94be79364
Fix browser profile origins sidebar overlap (#530) 2023-01-31 13:44:17 -08:00
Tessa Walsh
7d25565ef4
Add org role to /users/me-with-orgs (#536) 
* Add org role to /users/me-with-orgs
* Add SUPERADMIN role and return in /me-with-orgs for superusers
 2023-01-31 16:27:13 -05:00
Tessa Walsh
6cb79b580a
Fix issue where users are added to default org as admin (#534) 
Users should only be added as to the default org with Owner permissions
if they are not specifically being invited to another org. This commit
fixes the logic in the post-registration callback to make this the case.
 2023-01-31 12:55:31 -08:00
D. Lee
5fac103e10
[FIX] Add ingress class for admin logging (#532) 
* add ingress class, support changing ingress class for microk8s
* update dependency
 2023-01-31 12:52:57 -08:00
Ilya Kreymer
6df31e13ab
backend: profile api: return additional data in profile /browser/<id> endpoint (#537) 
supports #533 , switching to client side rendering from VNC websocket
 2023-01-31 11:58:50 -08:00
Tessa Walsh
2e6bf7535d
Add support for tags to update_crawl_config API endpoint (#521) 
* Add test for updating crawlconfigs
 2023-01-30 21:46:54 -08:00
sua yoo
05ce32d898
Update org settings & org invite UI (#528) 2023-01-29 11:38:22 -08:00
Henry Wilkinson
3c199419a2
Merge pull request #526 from webrecorder/config-copy-updates 2023-01-27 13:17:29 -05:00
Sara Tavares
bc69d6f0d4
chore(typos): fix typos (#524) 
Co-authored-by: stavares843 <stavares843@users.noreply.github.com>
 2023-01-26 16:34:47 -08:00
sua yoo
8957eda966
Improve org routing & performance (#520) 2023-01-26 15:02:27 -08:00
Henry Wilkinson
796565c0ad Minor Updates to Seeded Crawl control descriptions & names 
- Renames the first step as `Crawl Scope` from `Crawl Setup`.  Technically this whole process is setting up crawls, `Crawl Scope` should be more descriptive.
- Changes the help text regarding crawler instances to mention rate limiting instead of the amount of resources it takes up on our end which isn't terribly relevant to users.
 2023-01-26 18:01:01 -05:00
Henry Wilkinson
e021184c27 Updates crawl type descriptions 
Improvements based on Nicholas' feedback.
 2023-01-26 17:41:18 -05:00
Tessa Walsh
231c37108c
Handle DuplicateKeyError on org rename requests (#514) 
* Handle DuplicateKeyError on org rename requests
 2023-01-25 17:46:35 -08:00
Tessa Walsh
9f0abd6a28
Only drop indexes if migrations are run (#515) 2023-01-25 17:46:10 -08:00
sua yoo
7dc85cc33c
Allow admin users to change org name (#506) 2023-01-25 10:55:45 -08:00
Tessa Walsh
0486d50fe9
Add new /users/me-with-orgs API endpoint (#510) 2023-01-24 10:23:30 -05:00
Tessa Walsh
31e7939cba
Add new API user management endpoints (#511) 
- Remove user from org
- Delete user invite
 2023-01-23 17:03:07 -08:00
Tessa Walsh
c0e2ec6155
Fix logic for creating pidfile parent dir (#512) 2023-01-23 17:02:25 -08:00
D. Lee
be4f918149
Merge pull request #442 from webrecorder/admin-logging-service 
Add logging service
 2023-01-19 22:15:16 -08:00
sua yoo
f780cb534b
Improve new config navigation UX (#508) 
* add job type to url

* add back to choose crawl type

* update for duplicate

* enable jumping into section
 2023-01-19 09:39:45 -08:00
Ilya Kreymer
ccd87e0dff
Rename api / nginx settings -> backend / frontend, set pull policy job images (#504) 
* rename config values
- api -> backend
- nginx -> frontend

* job pods:
- set job_pull_policy from api_pull_policy (same as backend image)
- default to Always, but can be overridden for local deployment (same as backend image)

typo fix: CRAWL_NAMESPACE -> CRAWLER_NAMESPACE (part of #491)
ansible: set default label to :latest instead of :dev for
 2023-01-18 20:21:36 -08:00
sua yoo
5b6c53b48e
Rename remaining crawl templates -> crawl configs (#509) 2023-01-18 20:18:08 -08:00
sua yoo
c0fdf738e4
Autocomplete tag options (#505) 2023-01-18 20:15:42 -08:00
sua yoo
be10ea5239
Improve Page Time Limit UX (#503) 2023-01-18 20:13:27 -08:00
sua yoo
24a7b14d63
Add path filter to GH workflows (#500) 
* update docs path

* update lint check

* cluster runs only on backend changes
 2023-01-18 15:02:21 -08:00
Ilya Kreymer
1dfa494210
backend: add default behavior time to /api/settings (part of #321) (#499) 2023-01-18 14:52:15 -08:00
Tessa Walsh
0fa60ebc45
Rename archives/teams -> orgs in codebase + add db migration (#486) 
* Rename archives to orgs and aid to oid on backend

* Rename archive to org and aid to oid in frontend

* Remove translation artifact

* Rename team -> organization

* Add database migrations and run once on startup

* This commit also applies the new by_one_worker decorator to other
asyncio tasks to prevent heavy tasks from being run in each worker.

* Run black, pylint, and husky via pre-commit

* Set db version and use in migrations

* Update and prepare database in single task

* Migrate k8s configmaps
 2023-01-18 14:51:04 -08:00
sua yoo
241f485780
Add all localization files to source control (#502) 
fixes build issues
 2023-01-18 14:49:38 -08:00
sua yoo
7030e784e9
Add locale codes to version control (#501) 
fixes frontend build issue
 2023-01-18 14:28:21 -08:00
sua yoo
f7892d7f2f
Add frontend build check (#498) 2023-01-18 13:06:33 -08:00
sua yoo
7a476e31ed
hotfix: localize msg string throwing error 
Created https://github.com/webrecorder/browsertrix-cloud/issues/495 to catch issues before merge
 2023-01-17 16:54:45 -08:00
sua yoo
b0745a63f7
Improve "Show Only Mine" switch visibility (#494) 2023-01-17 16:28:06 -08:00
sua yoo
ebb634a20d
Crawl config form panel UX enhancement & fix (#489) 2023-01-17 16:20:35 -08:00
sua yoo
c67af660ab
Fix localization build (#488) 
* fix localization issues
* don't track translation files
 2023-01-17 17:51:03 -05:00
sua yoo
d32428134a
Crawl config frontend fixes (#482) 
* fix current time limit (#480)
* fix browser profile name not shown (#474)
* fix finish setup button label (#473)
* fix paginated exclusion, border and page size (#475)
 2023-01-16 19:19:42 -08:00
Henry Wilkinson
c6b0936b08
Merge pull request #477 from webrecorder/config-control-namefixes 
Allowed URL Prefixes → Extra URLs In Scope
 2023-01-16 13:22:54 -05:00
sua yoo
6a30660728
Apply suggestions from code review 2023-01-16 10:08:45 -08:00
Ilya Kreymer
d028b93412
backend: password related fixes: (#479) 
- mongodb: support passwords with '@' by escaping mongo username and password
- superadmin: update superadmin email and password after initial creation if updated in helm values
 2023-01-13 18:22:50 -08:00
Henry Wilkinson
7e93ec57e0 Updates name (again) to actually reflect what this is 
Because they _aren't_ additional seed URLs!
 2023-01-13 17:13:42 -05:00
Henry Wilkinson
77a46aa2d9 Allowed URL Prefixes → Extra Start URLs 
Changes name, hopefully people have an easier time understanding this now!

Will close #476
 2023-01-13 16:50:00 -05:00
Ilya Kreymer
bc67cc8443
backend: registration: (#472) 
- if registration is enabled, newly registred users get added to the default org, instead of getting their own org/archive
 2023-01-13 00:03:37 -08:00
Ilya Kreymer
827b643262
backend: add 'allow_dupe_invites' option to allow re-inviting users. if not set (default), duplicate invites will result in errors (#471) 2023-01-12 23:25:48 -08:00
Ilya Kreymer
4dbca8c421
email sending tweaks: (#470) 
- support 'reply-to' email field in values, and in ansible-based values
- set 'subject' for different types of messages
 2023-01-12 23:25:23 -08:00
Ilya Kreymer
a916322c30
ansible: digitalocean tweaks: (#469) 
* ansible: digitalocean tweaks:
- add org_name to template
- better check for db existence
- simplify domain, fix default_org

chart:
- make job images pull IfNotPresent
 2023-01-12 23:11:20 -08:00