- Add default vs custom (s3) storage - K8S: All storages correspond to secrets - K8S: Default storages inited via helm - K8S: Custom storage results in custom secret (per archive) - K8S: Don't add secret per crawl config - API for changing storage per archive - Docker: default storage just hard-coded from env vars (only one for now) - Validate custom storage via aiobotocore before confirming - Data Model: remove usage from users - Data Model: support adding multiple files per crawl for parallel crawls - Data Model: track completions for parallel crawls - Data Model: initial support for tags per crawl, add collection as 'coll' tag README fixes
31 lines
791 B
YAML
31 lines
791 B
YAML
---
|
|
kind: Role
|
|
apiVersion: rbac.authorization.k8s.io/v1
|
|
metadata:
|
|
namespace: {{ .Values.crawler_namespace }}
|
|
name: crawler-run
|
|
rules:
|
|
- apiGroups: [""]
|
|
resources: ["pods", "services", "configmaps", "secrets", "events"]
|
|
verbs: ["get", "list", "watch", "create", "update", "patch", "delete", "deletecollection"]
|
|
|
|
- apiGroups: ["batch", "extensions"]
|
|
resources: ["jobs", "cronjobs"]
|
|
verbs: ["get", "list", "watch", "create", "update", "patch", "delete", "deletecollection"]
|
|
|
|
---
|
|
kind: RoleBinding
|
|
apiVersion: rbac.authorization.k8s.io/v1
|
|
metadata:
|
|
name: crawler-role
|
|
namespace: {{ .Values.crawler_namespace }}
|
|
subjects:
|
|
- kind: ServiceAccount
|
|
name: default
|
|
namespace: {{ .Release.Namespace }}
|
|
|
|
roleRef:
|
|
kind: Role
|
|
name: crawler-run
|
|
apiGroup: rbac.authorization.k8s.io
|