mirror of
https://github.com/simstudioai/sim.git
synced 2026-04-28 03:00:29 -04:00
5f0f0edd63
* improvement(repo): restructuring to make realtime image narrower scoped * improvements * chore(repo): rebase fixes and quality improvements for realtime split Addresses merge-time issues and gaps from the realtime app split: - Retarget stale vi.mock paths to @sim/workflow-persistence/subblocks - Restore README branding, fix AGENTS.md script reference - Restore TSDoc on workflow-persistence subblocks helpers - Use toError() from @sim/utils/errors in save.ts - Add vitest config + local mocks so @sim/audit tests run standalone - Move socket.io-client to devDependencies in apps/realtime - Add missing package COPY steps to docker/app.Dockerfile - Add check:boundaries/check:realtime-prune scripts and wire into CI Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * refactor(security): consolidate crypto primitives into @sim/security Move general-purpose crypto primitives out of apps/sim into the @sim/security package so both apps/sim and apps/realtime can share them. @sim/security exports (all pure, dependency-free): ./compare safeCompare (constant-time HMAC-wrapped equality) ./encryption encrypt/decrypt (AES-256-GCM, iv:cipher:tag format) ./hash sha256Hex ./tokens generateSecureToken (base64url) Migrate apps/sim call sites to use these + @sim/utils helpers: crypto.randomUUID() -> generateId() from @sim/utils/id createHash('sha256').digest -> sha256Hex timingSafeEqual on hashed hex -> safeCompare new Promise(setTimeout) -> sleep from @sim/utils/helpers No behavior change: encryption format, digest output, and token length are preserved exactly. * refactor(copilot): use toError in remaining otel/finalize sites Replace the last two `error instanceof Error ? error : new Error(String(error))` patterns with toError from @sim/utils/errors. Completes the sweep of clean candidates — no behavior change. * refactor(security): consolidate HMAC-SHA256 primitives into @sim/security Adds hmacSha256Hex and hmacSha256Base64 to @sim/security/hmac and migrates 15 webhook providers plus 5 other hot paths (deployment token signing, outbound webhook requests, workspace notification delivery, notification test route, Shopify OAuth callback) off bare `createHmac` calls. Secret parameter accepts `string | Buffer` to cover base64-decoded Svix-style secrets (Resend) and MS Teams' HMAC scheme. AWS SigV4 signing in S3 and Textract tools intentionally retains direct `createHmac` usage — its multi-step key derivation chain doesn't fit a generic helper. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * chore(packages): post-audit test + packaging polish - Add safeCompare unit tests (identity, length mismatch, hex-nibble diff). - Add Buffer-secret cases to hmac tests to lock in Svix/MS-Teams contract. - Declare `reactflow` as a peerDependency on @sim/workflow-types — only used for type imports. - Add a barrel export to @sim/workflow-persistence for consumers that prefer package-level imports; subpath exports retained. - Document the data-field invariant in load.ts for loop/parallel subflow patching. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * chore(realtime): address PR review feedback - Remove redundant SOCKET_PORT=3002 env from Dockerfile runner stage (env.PORT already defaults to 3002 via zod schema). - Reorder PORT fallback so an explicitly-set SOCKET_PORT wins over the schema default for PORT; keeps SOCKET_PORT functional as an override instead of dead code. - Add dedicated type-check CI step for @sim/realtime so TS errors surface pre-deploy (the Dockerfile runs source TS via Bun and has no implicit build-time type check). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * chore(realtime): remove unused SOCKET_PORT env var SOCKET_PORT has lived in the socket server since the June 2025 refactor but was never actually set in any deploy config — docker-compose.prod, helm values/templates, .env.example, and docs all use PORT or the 3002 default exclusively. No self-hoster was ever pointed at SOCKET_PORT, so removing it is safe. Simplifies realtime port resolution to `env.PORT` (zod-validated with a 3002 default) and drops the orphaned sim-side schema entry. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> --------- Co-authored-by: Waleed Latif <walif6@gmail.com> Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
169 lines
7.2 KiB
Docker
169 lines
7.2 KiB
Docker
# ========================================
|
|
# Base Stage: Debian-based Bun with Node.js 22
|
|
# ========================================
|
|
FROM oven/bun:1.3.11-slim AS base
|
|
|
|
# Install Node.js 22 and common dependencies once in base stage
|
|
RUN --mount=type=cache,target=/var/cache/apt,sharing=locked \
|
|
--mount=type=cache,target=/var/lib/apt,sharing=locked \
|
|
apt-get update && apt-get install -y --no-install-recommends \
|
|
python3 python3-pip python3-venv make g++ curl ca-certificates bash ffmpeg \
|
|
&& curl -fsSL https://deb.nodesource.com/setup_22.x | bash - \
|
|
&& apt-get install -y nodejs
|
|
|
|
# ========================================
|
|
# Dependencies Stage: Install Dependencies
|
|
# ========================================
|
|
FROM base AS deps
|
|
WORKDIR /app
|
|
|
|
COPY package.json bun.lock turbo.json ./
|
|
RUN mkdir -p apps \
|
|
packages/audit \
|
|
packages/db \
|
|
packages/logger \
|
|
packages/realtime-protocol \
|
|
packages/security \
|
|
packages/testing \
|
|
packages/tsconfig \
|
|
packages/utils \
|
|
packages/workflow-authz \
|
|
packages/workflow-persistence \
|
|
packages/workflow-types
|
|
COPY apps/sim/package.json ./apps/sim/package.json
|
|
COPY packages/audit/package.json ./packages/audit/package.json
|
|
COPY packages/db/package.json ./packages/db/package.json
|
|
COPY packages/logger/package.json ./packages/logger/package.json
|
|
COPY packages/realtime-protocol/package.json ./packages/realtime-protocol/package.json
|
|
COPY packages/security/package.json ./packages/security/package.json
|
|
COPY packages/testing/package.json ./packages/testing/package.json
|
|
COPY packages/tsconfig/package.json ./packages/tsconfig/package.json
|
|
COPY packages/utils/package.json ./packages/utils/package.json
|
|
COPY packages/workflow-authz/package.json ./packages/workflow-authz/package.json
|
|
COPY packages/workflow-persistence/package.json ./packages/workflow-persistence/package.json
|
|
COPY packages/workflow-types/package.json ./packages/workflow-types/package.json
|
|
|
|
# Install dependencies, then rebuild isolated-vm for Node.js
|
|
# Use --linker=hoisted for flat node_modules layout (required for Docker multi-stage builds)
|
|
RUN --mount=type=cache,id=bun-cache,target=/root/.bun/install/cache \
|
|
--mount=type=cache,id=npm-cache,target=/root/.npm \
|
|
HUSKY=0 bun install --omit=dev --ignore-scripts --linker=hoisted && \
|
|
cd node_modules/isolated-vm && npx node-gyp rebuild --release
|
|
|
|
# ========================================
|
|
# Builder Stage: Build the Application
|
|
# ========================================
|
|
FROM base AS builder
|
|
WORKDIR /app
|
|
|
|
# Install turbo globally (cached for fast reinstall)
|
|
RUN --mount=type=cache,id=bun-cache,target=/root/.bun/install/cache \
|
|
bun install -g turbo
|
|
|
|
# Copy node_modules from deps stage (cached if dependencies don't change)
|
|
COPY --from=deps /app/node_modules ./node_modules
|
|
|
|
# Copy package configuration files (needed for build)
|
|
COPY package.json bun.lock turbo.json ./
|
|
COPY apps/sim/package.json ./apps/sim/package.json
|
|
COPY packages/audit/package.json ./packages/audit/package.json
|
|
COPY packages/db/package.json ./packages/db/package.json
|
|
COPY packages/logger/package.json ./packages/logger/package.json
|
|
COPY packages/realtime-protocol/package.json ./packages/realtime-protocol/package.json
|
|
COPY packages/security/package.json ./packages/security/package.json
|
|
COPY packages/testing/package.json ./packages/testing/package.json
|
|
COPY packages/tsconfig/package.json ./packages/tsconfig/package.json
|
|
COPY packages/utils/package.json ./packages/utils/package.json
|
|
COPY packages/workflow-authz/package.json ./packages/workflow-authz/package.json
|
|
COPY packages/workflow-persistence/package.json ./packages/workflow-persistence/package.json
|
|
COPY packages/workflow-types/package.json ./packages/workflow-types/package.json
|
|
|
|
# Copy workspace configuration files (needed for turbo)
|
|
COPY apps/sim/next.config.ts ./apps/sim/next.config.ts
|
|
COPY apps/sim/tsconfig.json ./apps/sim/tsconfig.json
|
|
COPY apps/sim/tailwind.config.ts ./apps/sim/tailwind.config.ts
|
|
COPY apps/sim/postcss.config.mjs ./apps/sim/postcss.config.mjs
|
|
|
|
# Copy source code (changes most frequently - placed last to maximize cache hits)
|
|
COPY apps/sim ./apps/sim
|
|
COPY packages ./packages
|
|
|
|
# Required for standalone nextjs build
|
|
WORKDIR /app/apps/sim
|
|
RUN --mount=type=cache,id=bun-cache,target=/root/.bun/install/cache \
|
|
HUSKY=0 bun install sharp --linker=hoisted
|
|
|
|
ENV NEXT_TELEMETRY_DISABLED=1 \
|
|
VERCEL_TELEMETRY_DISABLED=1 \
|
|
DOCKER_BUILD=1
|
|
|
|
WORKDIR /app
|
|
|
|
# Provide dummy database URLs during image build so server code that imports @sim/db
|
|
# can be evaluated without crashing. Runtime environments should override these.
|
|
ARG DATABASE_URL="postgresql://user:pass@localhost:5432/dummy"
|
|
ENV DATABASE_URL=${DATABASE_URL}
|
|
|
|
# Provide dummy NEXT_PUBLIC_APP_URL for build-time evaluation
|
|
# Runtime environments should override this with the actual URL
|
|
ARG NEXT_PUBLIC_APP_URL="http://localhost:3000"
|
|
ENV NEXT_PUBLIC_APP_URL=${NEXT_PUBLIC_APP_URL}
|
|
|
|
RUN bun run build
|
|
|
|
# ========================================
|
|
# Runner Stage: Run the actual app
|
|
# ========================================
|
|
|
|
FROM base AS runner
|
|
WORKDIR /app
|
|
|
|
# Node.js 22, Python, ffmpeg, etc. are already installed in base stage
|
|
ENV NODE_ENV=production
|
|
|
|
# Create non-root user and group
|
|
RUN groupadd -g 1001 nodejs && \
|
|
useradd -u 1001 -g nodejs nextjs
|
|
|
|
# Copy application artifacts from builder
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/public ./apps/sim/public
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/.next/standalone ./
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/.next/static ./apps/sim/.next/static
|
|
|
|
# Copy blog/author content for runtime filesystem reads (not part of the JS bundle)
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/content ./apps/sim/content
|
|
|
|
# Copy isolated-vm native module (compiled for Node.js in deps stage)
|
|
COPY --from=deps --chown=nextjs:nodejs /app/node_modules/isolated-vm ./node_modules/isolated-vm
|
|
|
|
# Copy the isolated-vm worker script
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/lib/execution/isolated-vm-worker.cjs ./apps/sim/lib/execution/isolated-vm-worker.cjs
|
|
|
|
# Copy the pre-built sandbox library bundles (pptxgenjs, docx, pdf-lib) that
|
|
# run inside the V8 isolate. Committed into the repo; see
|
|
# apps/sim/lib/execution/sandbox/bundles/build.ts to regenerate.
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/lib/execution/sandbox/bundles ./apps/sim/lib/execution/sandbox/bundles
|
|
|
|
# Guardrails setup with pip caching
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/lib/guardrails/requirements.txt ./apps/sim/lib/guardrails/requirements.txt
|
|
COPY --from=builder --chown=nextjs:nodejs /app/apps/sim/lib/guardrails/validate_pii.py ./apps/sim/lib/guardrails/validate_pii.py
|
|
|
|
# Install Python dependencies with pip cache mount for faster rebuilds
|
|
RUN --mount=type=cache,target=/root/.cache/pip \
|
|
python3 -m venv ./apps/sim/lib/guardrails/venv && \
|
|
./apps/sim/lib/guardrails/venv/bin/pip install --upgrade pip && \
|
|
./apps/sim/lib/guardrails/venv/bin/pip install -r ./apps/sim/lib/guardrails/requirements.txt && \
|
|
chown -R nextjs:nodejs /app/apps/sim/lib/guardrails
|
|
|
|
# Create .next/cache directory with correct ownership
|
|
RUN mkdir -p apps/sim/.next/cache && \
|
|
chown -R nextjs:nodejs apps/sim/.next/cache
|
|
|
|
# Switch to non-root user
|
|
USER nextjs
|
|
|
|
EXPOSE 3000
|
|
ENV PORT=3000 \
|
|
HOSTNAME="0.0.0.0"
|
|
|
|
CMD ["bun", "apps/sim/server.js"] |