6dc452ebad
- Refactors storage to support replicas + custom storages on the Org. - There is a default primary + replica storage, while an Org can also have primary and replica storages. - StorageRef object is used to store references to default and custom storage. - CrawlFile has been updated to contain a StorageRef instead of a def_storage_name, which references either a default storage (in StorageOps) or custom storage (in Organization) - There is also a 'replicas' Optional[List[StorageRef]] which contains replicas, if any. - CrawlFileOut contain a numReplicas for how many replicas exist for a given file. - Migration: migration 0020 added to migrate existing Orgs, CrawlFile and ProfileFile objects to new storage system (CrawlFile and ProfileFile now extend BaseFile) Part of #1262 --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
33 lines
652 B
YAML
33 lines
652 B
YAML
apiVersion: btrix.cloud/v1
|
|
kind: ProfileJob
|
|
metadata:
|
|
name: profilejob-{{ id }}
|
|
labels:
|
|
browser: "{{ id }}"
|
|
role: "job"
|
|
btrix.org: {{ oid }}
|
|
btrix.user: {{ userid }}
|
|
{%- if base_profile %}
|
|
btrix.baseprofile: "{{ base_profile }}"
|
|
{%- endif %}
|
|
btrix.storage: "{{ storage_name }}"
|
|
|
|
spec:
|
|
selector:
|
|
matchLabels:
|
|
browser: "{{ id }}"
|
|
|
|
id: "{{ id }}"
|
|
userid: "{{ userid }}"
|
|
oid: "{{ oid }}"
|
|
|
|
storageName: "{{ storage_name }}"
|
|
|
|
startUrl: "{{ url }}"
|
|
profileFilename: "{{ profile_filename }}"
|
|
vncPassword: "{{ vnc_password }}"
|
|
|
|
{% if expire_time %}
|
|
expireTime: "{{ expire_time }}"
|
|
{% endif %}
|