0c8a5a49b4
- use python-on-whale to use docker cli api directly, creating docker stack for each crawl or profile browser - configure storages via storages.yaml secret - add crawl_job, profile_job, splitting into base and k8s/swarm implementations - split manager into base crawlmanager and k8s/swarm implementations - swarm: load initial scale from db to avoid modifying fixed configs, in k8s, load from configmap - swarm: support scheduled jobs via swarm-cronjob service - remove docker dependencies (aiodocker, apscheduler, scheduling) - swarm: when using local minio, expose via /data/ route in nginx via extra include (in k8s, include dir is empty and routing handled via ingress) - k8s: cleanup minio chart: move init containers to minio.yaml - swarm: stateful set implementation to be consistent with k8s scaling: - don't use service replicas, - create a unique service with '-N' appended and allocate unique volume for each replica - allows crawl containers to be restarted w/o losing data - add volume pruning background service, as volumes can be deleted only after service shuts down fully - watch: fully simplify routing, route via replica index instead of ip for both k8s and swarm - rename network btrix-cloud-net -> btrix-net to avoid conflict with compose network
46 lines
1.0 KiB
Docker
46 lines
1.0 KiB
Docker
# central place to configure the production replayweb.page loading prefix
|
|
ARG RWP_BASE_URL=https://cdn.jsdelivr.net/npm/replaywebpage@1.5.8/
|
|
|
|
FROM node:16 as build
|
|
ARG RWP_BASE_URL
|
|
|
|
WORKDIR /app
|
|
COPY package.json .
|
|
COPY yarn.lock .
|
|
RUN yarn --frozen-lockfile
|
|
|
|
COPY lit-localize.json ./
|
|
COPY postcss.config.js ./
|
|
COPY tailwind.config.js ./
|
|
COPY tsconfig.json ./
|
|
COPY webpack.config.js ./
|
|
COPY webpack.prod.js ./
|
|
COPY src ./src/
|
|
|
|
ARG GIT_COMMIT_HASH
|
|
ENV GIT_COMMIT_HASH=${GIT_COMMIT_HASH}
|
|
|
|
ARG GIT_BRANCH_NAME
|
|
ENV GIT_BRANCH_NAME=${GIT_BRANCH_NAME}
|
|
|
|
RUN yarn build
|
|
|
|
FROM nginx
|
|
|
|
ARG RWP_BASE_URL
|
|
ENV RWP_BASE_URL=${RWP_BASE_URL}
|
|
|
|
COPY --from=build /app/dist /usr/share/nginx/html
|
|
|
|
COPY ./nginx.conf /etc/nginx/nginx.conf
|
|
COPY ./frontend.conf.template /etc/nginx/templates/
|
|
|
|
RUN mkdir -p /etc/nginx/includes/
|
|
COPY ./locations.conf /etc/nginx/includes/
|
|
|
|
RUN rm /etc/nginx/conf.d/*
|
|
|
|
# default docker resolver, overridden in k8s
|
|
RUN mkdir -p /etc/nginx/resolvers; echo "resolver 127.0.0.11;" > /etc/nginx/resolvers/resolvers.conf
|
|
|