Fluid Forge
Get Started
See it run
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
Demos
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
GitHub
Get Started
See it run
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
Demos
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
GitHub
  • Introduction

    • Home
    • Getting Started
    • Snowflake Quickstart
    • See it run
    • Forge Data Model
    • Vision & Roadmap
    • Playground
    • FAQ
  • Concepts

    • Concepts
    • Builds, Exposes, Bindings
    • What is a contract?
    • Quality, SLAs & Lineage
    • Governance & Policy
    • Agent Policy (LLM/AI governance)
    • Providers vs Platforms
    • Fluid Forge vs alternatives
  • Data Products

    • Product Types — SDP, ADP, CDP
  • Walkthroughs

    • Walkthrough: Local Development
    • Source-Aligned: Postgres → DuckDB → Parquet
    • AI Forge And Data-Model Journeys
    • Walkthrough: Deploy to Google Cloud Platform
    • Walkthrough: Snowflake Team Collaboration
    • Declarative Airflow DAG Generation - The FLUID Way
    • Generating Orchestration Code from Contracts
    • Jenkins CI/CD for FLUID Data Products
    • Universal Pipeline
    • The 11-Stage Pipeline
    • End-to-End Walkthrough: Catalog → Contract → Transformation
  • CLI Reference

    • CLI Reference
    • fluid init
    • fluid demo
    • fluid forge
    • fluid skills
    • fluid status
    • fluid validate
    • fluid plan
    • fluid apply
    • fluid generate
    • fluid generate artifacts
    • fluid validate-artifacts
    • fluid verify-signature
    • fluid generate-airflow
    • fluid generate-pipeline
    • fluid viz-graph
    • fluid odps
    • fluid odps-bitol
    • fluid odcs
    • fluid export
    • fluid export-opds
    • fluid publish
    • fluid datamesh-manager
    • fluid market
    • fluid import
    • fluid policy
    • fluid policy check
    • fluid policy compile
    • fluid policy apply
    • fluid contract-tests
    • fluid contract-validation
    • fluid diff
    • fluid test
    • fluid verify
    • fluid product-new
    • fluid product-add
    • fluid workspace
    • fluid ide
    • fluid ai
    • fluid memory
    • fluid mcp
    • fluid scaffold-ci
    • fluid scaffold-composer
    • fluid scaffold-ide
    • fluid docs
    • fluid config
    • fluid split
    • fluid bundle
    • fluid auth
    • fluid doctor
    • fluid providers
    • fluid provider-init
    • fluid roadmap
    • fluid version
    • fluid runs
    • fluid retention
    • fluid secrets
    • fluid stats
    • fluid contract
    • fluid ship
    • fluid rollback
    • fluid schedule-sync
    • Catalog adapters

      • Source Catalog Integration (V1.5)
      • BigQuery Catalog
      • Snowflake Horizon Catalog
      • Databricks Unity Catalog
      • Google Dataplex Catalog
      • AWS Glue Data Catalog
      • DataHub Catalog
      • Data Mesh Manager Catalog
    • CLI by task

      • CLI by task
      • Add quality rules
      • Add agent governance
      • Debug a failed pipeline run
      • Switch clouds with one line
  • Recipes

    • Recipes
    • Recipe — add a quality rule
    • Recipe — switch clouds with one line
    • Recipe — tag PII in your schema
  • SDK & Plugins

    • SDK & Plugins
    • Quickstart — your first plugin
    • Examples

      • Runnable examples
      • Example: hello-scaffold — the minimal viable plugin
      • Example: gitlab-ci-scaffold — generate a complete CI project
      • Example: steward-validator — a custom governance rule
      • Example: prod-key-guard — apply-time invariant check
    • Journeys

      • Journeys
      • Your own CI/CD

        • You have your own CI/CD setup, no problem
        • GitLab CI — the bundle template
        • GitHub Actions — the bundle template
        • Jenkins — the bundle template
        • CircleCI — the bundle template
      • You have a strict project layout, no problem
      • You have governance rules, no problem
      • You want a check at apply time, no problem
    • Reference

      • Reference
      • Roles reference
      • Entry points reference
      • Trust model
      • Packaging
      • Companion packages
  • Providers

    • Providers
    • Provider Architecture
    • GCP Provider
    • AWS Provider
    • Snowflake Provider
    • Local Provider
    • Creating Custom Providers
    • Provider Roadmap
  • Advanced

    • Blueprints
    • Governance & Compliance
    • Airflow Integration
    • Built-in And Custom Forge Guidance
    • FLUID Forge Contract GPT Packet
    • Forge Discovery Guide
    • Forge Memory Guide
    • LLM Providers
    • Capability Warnings
    • LiteLLM Backend (opt-in)
    • MCP Server
    • Credential Resolver — Security Model
    • Cost Tracking
    • Agentic Primitives
    • Typed Errors
    • Typed CLI Errors
    • Authoring Forge Tools
    • Source-Aligned Acquisition
    • API Stability — fluid_build.api
    • Guided fluid forge UX
    • V1.5 Catalog Integration — Architecture Deep-Dive
    • V1.5 + V2 Hardening — Release Notes
  • Project

    • Contributing to Fluid Forge
    • Fluid Forge Docs Baseline: CLI 0.8.3
    • Fluid Forge Docs Baseline: CLI 0.8.0
    • Fluid Forge Docs Baseline: CLI 0.7.11
    • Fluid Forge Docs Baseline: CLI 0.7.9
    • Fluid Forge v0.7.1 - Multi-Provider Export Release

fluid runs

Day-2 introspection for acquisition (and other) runs. fluid runs is the umbrella for inspecting the state files Forge writes under .fluid/runs/<product>/<build>/runs/. Distinct from fluid status (workspace overview), fluid doctor (system diagnostic), and fluid auth (cloud credentials) — those serve different purposes.

3am Slack ping: pipeline broke. Ninety seconds later, you've shipped the fix. The reel above walks runs status → runs logs --component dlq → runs diff → policy fix → fluid ship. Pairs with fluid retention, fluid secrets, and fluid stats.

Available in 0.8.3

fluid runs ships with the source-aligned acquisition stack in 0.8.3 (schema 0.7.3). Earlier releases don't include it.

Syntax

fluid runs <subcommand> <product-id> [options]

Subcommands

fluid runs status

Show the last N run records for a product, with freshness, error rate over the last 24h, last state, and per-stream record counts.

fluid runs status bronze.crm_orders
fluid runs status bronze.crm_orders --build ingest_orders --last 10
fluid runs status bronze.crm_orders --json
OptionDescription
<product-id>Required. The data product ID.
--build <id>Specific build to inspect. Auto-discovered if omitted.
--last <n>How many recent runs to show. Default 5.
--state-root <path>Override the state directory. Default ./.fluid.
--jsonEmit JSON instead of the human table.

fluid runs logs

Component-scoped log fetch with optional regex filtering.

fluid runs logs bronze.crm_orders --component build
fluid runs logs bronze.crm_orders --component dlq --grep "schema_drift"
fluid runs logs bronze.crm_orders --run-id 2026-04-30T12-34-56 --json
OptionDescription
<product-id>Required. The data product ID.
--component {build|infra|server|worker|dlq}Which component's logs. Default build.
--run-id <id>Specific run. Otherwise the most recent run for the build.
--grep <pattern>Regex filter applied to log lines.
--limit <n>Maximum lines returned. Default 1000.
--jsonEmit each log line as a JSON record (timestamp, level, component, message).

fluid runs diff

Compare two runs of the same build — added/removed columns and row-count delta.

fluid runs diff bronze.crm_orders \
  --build ingest_orders \
  --run-a 2026-04-29T12-00-00 \
  --run-b 2026-04-30T12-00-00
OptionDescription
<product-id>Required. The data product ID.
--build <id>Required. The build to diff within.
--run-a <id>Required. Baseline run.
--run-b <id>Required. Comparison run.
--jsonStructured diff output (added, removed, row_delta).

Output shape (JSON)

fluid runs status --json returns the StatusReport shape (keys are snake_case; the emitter sorts keys alphabetically):

{
  "product_id": "bronze.crm_orders",
  "build_id": "ingest_orders",
  "runs": [
    {
      "run_id": "2026-04-30T12-34-56",
      "state": "succeeded",
      "started_at": "2026-04-30T12:34:56Z",
      "finished_at": "2026-04-30T12:34:58Z",
      "records_total": 8,
      "duration_seconds": 2.3,
      "error": null,
      "streams": []
    }
  ],
  "freshness_seconds": 145.0,
  "error_rate_24h": 0.0,
  "last_state": "succeeded",
  "facets": { "total_runs_seen": 1 }
}

Field notes:

  • runs[] — each entry has run_id, state, started_at, finished_at, records_total, duration_seconds, error (null on success), and streams (per-stream record counts on that run).
  • state — one of succeeded, failed, partial, or running.
  • freshness_seconds — age of the most recent succeeded run; null if none succeeded.
  • error_rate_24h — fraction (0–1) of runs in the last 24h that failed or were partial.
  • last_state — state of the newest run record.

Exit codes

CodeMeaning
0Subcommand succeeded
1User error (missing args, invalid product ID)
2Partial result (some runs unreadable; the rest are reported)
3Transient — state directory unavailable; retry later
4Internal — log this with state-root path and traceback

See also

  • Source-Aligned Acquisition — what produces these run records
  • fluid retention — sweep run records past their horizon
  • fluid stats — aggregate cost across runs
  • Typed CLI Errors — error catalog (PartialFailureError, StaleReplayError, etc.)
Edit this page on GitHub
Last Updated: 5/17/26, 6:51 PM
Contributors: fas89, Claude Opus 4.7 (1M context)
Prev
fluid version
Next
fluid retention