Docker Compose Deployment¶

The docker-compose.yml at the repository root defines the complete Verity development environment. It orchestrates all infrastructure dependencies and application services with health checks, shared configuration, and proper startup ordering.

Service Architecture¶

graph TB
    subgraph Infrastructure
        PG["PostgreSQL<br/>(TimescaleDB)<br/>:5432"]
        CH["ClickHouse<br/>:8123 / :9000"]
        KAFKA["Apache Kafka<br/>:9092"]
        REDIS["Redis<br/>:6379"]
        TEMPORAL["Temporal Server<br/>:7233"]
        TEMPORAL_UI["Temporal UI<br/>:8233"]
    end

    subgraph Init
        INIT_DB["init-db"]
        SEED["seed-data<br/><i>(tools profile)</i>"]
    end

    subgraph Connectors["Connectors (connectors profile)"]
        C_AAD["connector-aad"]
        C_FABRIC["connector-fabric"]
        C_SYNAPSE["connector-synapse"]
        C_DATABRICKS["connector-databricks"]
        C_POSTGRES["connector-postgres"]
        C_HR["connector-hr"]
    end

    subgraph Ingestion
        ID_RESOLVER["identity-resolver<br/>:8001"]
        ASSET_CLASS["asset-classifier<br/>:8002"]
        ENRICHER["event-enricher"]
    end

    subgraph Analytics
        DECAY["decay-engine"]
        PEER["peer-analyser"]
        ANOMALY["anomaly-detector"]
    end

    subgraph Decision
        REVIEW_GEN["review-generator"]
        WORKFLOW["workflow-engine"]
    end

    subgraph Remediation
        REMEDIATION_EXEC["remediation-executor<br/>:8005"]
    end

    subgraph Audit
        AUDIT_WRITER["audit-writer"]
        COMPLIANCE["compliance-reporter<br/>:8006"]
    end

    subgraph Frontend
        API["api-gateway<br/>:8000"]
        UI["frontend<br/>:3000"]
    end

    INIT_DB --> PG
    INIT_DB --> CH
    C_AAD & C_FABRIC --> KAFKA
    C_AAD & C_FABRIC --> PG
    ENRICHER --> KAFKA
    ENRICHER --> ID_RESOLVER
    ENRICHER --> ASSET_CLASS
    DECAY --> PG & KAFKA & REDIS
    REVIEW_GEN --> PG & TEMPORAL & KAFKA
    WORKFLOW --> PG & TEMPORAL & KAFKA
    REMEDIATION_EXEC --> PG & KAFKA
    AUDIT_WRITER --> KAFKA & CH
    COMPLIANCE --> CH
    API --> PG & REDIS & TEMPORAL & CH
    UI --> API

Containers¶

The compose file defines the following containers across infrastructure, init, and application layers:

Infrastructure Services¶

Init / Seed Services¶

Application Services¶

Shared Configuration¶

All application services share environment variables through a YAML anchor:

x-app-env: &app-env
  VERITY_PG_HOST: postgres
  VERITY_PG_PORT: "5432"
  VERITY_PG_USER: verity
  VERITY_PG_PASSWORD: verity_dev
  VERITY_PG_DATABASE: verity
  DB_HOST: postgres
  DB_PORT: "5432"
  DB_USER: verity
  DB_PASSWORD: verity_dev
  DB_DATABASE: verity
  KAFKA_BOOTSTRAP_SERVERS: kafka:9092
  REDIS_URL: redis://redis:6379
  TEMPORAL_HOST: temporal:7233
  CLICKHOUSE_HOST: clickhouse
  CLICKHOUSE_PORT: "8123"

Services reference this anchor with <<: *app-env and override as needed:

api-gateway:
  environment:
    <<: *app-env
    API_DEV_MODE: "true"

Health Checks¶

Every infrastructure service defines a health check for reliable startup ordering:

Application services use depends_on with condition: service_healthy to ensure infrastructure is ready before starting.

Volumes¶

Persistent data volumes:

Port Summary¶

Docker Compose Profiles¶

Some services are gated behind profiles to keep the default startup lightweight:

Quick Start¶

# Start core infrastructure and services
docker compose up -d

# Wait for health checks
docker compose up -d --wait

# Initialise database schemas (runs automatically via init-db)
# To load seed data:
docker compose --profile tools run --rm seed-data

# Start connectors (requires Azure credentials in .env)
docker compose --profile connectors up -d

# View logs
docker compose logs -f api-gateway

# Tear down
docker compose down

# Tear down and remove volumes
docker compose down -v

Seed Data¶

To load sample data for development and demo purposes:

docker compose --profile tools run --rm seed-data

This runs db/seed.py which populates PostgreSQL with sample principals, assets, access grants, and review packets.