Fluid Forge
Why Forge
Concepts
Get Started
  • Consume a Data Product
  • See it run
  • Demos
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • MCP Output Port — Serve to AI Agents
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Agent Policy (concept)
  • MCP Output Port — Serve to Agents
  • MCP deep-dive
  • AI-assisted authoring
  • LLM providers & backends
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
Why Forge
Concepts
Get Started
  • Consume a Data Product
  • See it run
  • Demos
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • MCP Output Port — Serve to AI Agents
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Agent Policy (concept)
  • MCP Output Port — Serve to Agents
  • MCP deep-dive
  • AI-assisted authoring
  • LLM providers & backends
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
  • Introduction

    • Home
    • Why Fluid Forge
    • Getting Started
    • Snowflake Quickstart
    • See it run
    • Forge Data Model
    • Vision & Roadmap
    • Playground
    • FAQ
  • Concepts

    • Concepts
    • Builds, Exposes, Bindings
    • What is a contract?
    • Quality, SLAs & Lineage
    • Governance & Policy
    • Agent Policy (LLM/AI governance)
    • Providers vs Platforms
    • Fluid Forge vs alternatives
  • Data Products

    • Consume a Data Product
    • Product Types — SDP, ADP, CDP
  • Walkthroughs

    • Walkthrough: Local Development
    • Source-Aligned: Postgres → DuckDB → Parquet
    • AI Forge And Data-Model Journeys
    • Walkthrough: MCP Output Port
    • Walkthrough: Deploy to Google Cloud Platform
    • Walkthrough: Snowflake Team Collaboration
    • Declarative Airflow DAG Generation - The FLUID Way
    • Generating Orchestration Code from Contracts
    • Jenkins CI/CD for FLUID Data Products
    • Universal Pipeline
    • The 11-Stage Pipeline
    • End-to-End Walkthrough: Catalog → Contract → Transformation
  • CLI Reference

    • CLI Reference
    • Core workflow

      • fluid init
      • fluid demo
      • fluid forge
      • fluid validate
      • fluid plan
      • fluid apply
      • fluid diff
      • fluid status
    • Build & ship

      • fluid bundle
      • fluid generate
      • fluid generate artifacts
      • fluid validate-artifacts
      • fluid verify-signature
      • fluid generate iac
      • fluid generate-airflow
      • fluid generate-pipeline
      • fluid viz-graph
      • fluid publish
      • fluid ship
      • fluid rollback
      • fluid schedule-sync
    • AI & Agents

      • fluid ai
      • fluid agents
      • fluid mcp
      • fluid memory
      • fluid stats
      • fluid skills
    • Quality & governance

      • fluid test
      • fluid verify
      • fluid contract-tests
      • fluid contract-validation
      • fluid policy
      • fluid policy check
      • fluid policy compile
      • fluid policy apply
    • Standards & interoperability

      • fluid odps
      • fluid odps-bitol
      • fluid odcs
      • fluid export
      • fluid export-odps
      • fluid exporters
      • fluid import
      • fluid market
      • fluid datamesh-manager
    • Project & workspace

      • fluid product-new
      • fluid product-add
      • fluid workspace
      • fluid contract
      • fluid split
      • fluid config
      • fluid providers
      • fluid plugins
      • fluid provider-init
      • fluid auth
      • fluid secrets
      • fluid ide
      • fluid scaffold-ci
      • fluid scaffold-composer
      • fluid scaffold-ide
      • fluid docs
      • fluid runs
      • fluid retention
      • fluid describe
      • fluid doctor
      • fluid roadmap
      • fluid version
    • Catalog adapters

      • Source Catalog Integration (V1.5)
      • Publishing to a Catalog — Overview
      • BigQuery Catalog
      • Snowflake Horizon Catalog
      • Databricks Unity Catalog
      • Google Dataplex Catalog
      • AWS Glue Data Catalog
      • DataHub Catalog
      • Data Mesh Manager Catalog
      • OpenMetadata Catalog
    • CLI by task

      • CLI by task
      • Add quality rules
      • Add agent governance
      • Debug a failed pipeline run
      • Switch clouds with one line
  • Recipes

    • Recipes
    • Recipe — add a quality rule
    • Recipe — switch clouds with one line
    • Recipe — tag PII in your schema
    • Write a contract that consumes another contract
    • Generate per-environment overlays
  • SDK & Plugins

    • SDK & Plugins
    • Quickstart — your first plugin
    • Examples

      • Runnable examples
      • Example: hello-scaffold — the minimal viable plugin
      • Example: gitlab-ci-scaffold — generate a complete CI project
      • Example: steward-validator — a custom governance rule
      • Example: prod-key-guard — apply-time invariant check
    • Journeys

      • Journeys
      • Your own CI/CD

        • You have your own CI/CD setup, no problem
        • GitLab CI — the bundle template
        • GitHub Actions — the bundle template
        • Jenkins — the bundle template
        • CircleCI — the bundle template
      • You have a strict project layout, no problem
      • You have governance rules, no problem
      • You want a check at apply time, no problem
    • Reference

      • Reference
      • Roles reference
      • Entry points reference
      • Trust model
      • Packaging
      • Companion packages
  • Providers

    • Providers
    • Provider Architecture
    • GCP Provider
    • AWS Provider
    • Snowflake Provider
    • Local Provider
    • Creating Custom Providers
    • Provider Roadmap
  • AI & Agents

    • MCP Server
    • Built-in And Custom Forge Guidance
    • Forge Discovery Guide
    • Forge Memory Guide
    • Authoring Forge Tools
    • Guided fluid forge UX
    • LLM Providers
    • LiteLLM Backend
    • Capability Warnings
    • Cost Tracking
    • FLUID Forge Contract GPT Packet
    • Agentic Primitives
  • Operate & Deploy

    • Airflow Integration
    • Blueprints
    • Source-Aligned Acquisition
  • Govern & Secure

    • Governance, Compliance & the Business Case
    • Governance & Compliance
    • Network Safety
    • Credential Resolver — Security Model
  • Configuration & Reference

    • Environment Variables
    • Typed Errors
    • Typed CLI Errors
    • API Stability — fluid_build.api
  • Architecture & Releases

    • V1.5 Catalog Integration — Architecture Deep-Dive
    • V1.5 + V2 Hardening — Release Notes
  • Project

    • Contributing to Fluid Forge
    • Fluid Forge Docs Baseline: CLI 0.9.0
    • Fluid Forge Docs Baseline: CLI 0.8.11
    • Fluid Forge Docs Baseline: CLI 0.8.10
    • Fluid Forge Docs Baseline: CLI 0.8.9
    • Fluid Forge Docs Baseline: CLI 0.8.8
    • Fluid Forge Docs Baseline: CLI 0.8.7
    • Fluid Forge Docs Baseline: CLI 0.8.6
    • Fluid Forge Docs Baseline: CLI 0.8.5
    • Fluid Forge Docs Baseline: CLI 0.8.4
    • Fluid Forge Docs Baseline: CLI 0.8.3
    • Fluid Forge Docs Baseline: CLI 0.8.0
    • Fluid Forge Docs Baseline: CLI 0.7.11
    • Fluid Forge Docs Baseline: CLI 0.7.9
    • Fluid Forge v0.7.1 - Multi-Provider Export Release

Environment Variables

Canonical index of FLUID_* environment variables on v0.10.0. Grouped by category. Where a cluster has its own dedicated page, the cluster header links out to the page rather than duplicating its content.

Convention: truthy values are 1 / true / yes (case-insensitive); falsy values are 0 / false / no / empty. Numeric vars accept plain integers unless noted otherwise.

CLI behaviour

VariablePurpose
FLUID_LOG_LEVELLogging level — DEBUG / INFO / WARNING / ERROR.
FLUID_LOG_FILEWrite structured logs to this file in addition to stderr.
FLUID_LOG_FORMATtext (default) or json.
FLUID_QUIETSuppress non-essential output. Set by --quiet.
FLUID_NONINTERACTIVESkip prompts; use defaults. Set by --non-interactive.
FLUID_NO_TUIDisable rich TUI overlays in long-running commands.
FLUID_AUTO_CONFIRMSkip the destructive-apply confirmation prompt. Equivalent to --yes.
FLUID_DEBUGEnable verbose debug output.
FLUID_DRY_RUNInhibit side-effects globally where supported.
FLUID_BANNER / FLUID_BANNER_TODAYSuppress / override the daily banner.
FLUID_RICH_OUTPUTForce rich-coloured output (default: auto-detect from TTY).
FLUID_TRACEEmit per-call timing traces.

Project & workspace

VariablePurpose
FLUID_HOMEOverride the on-disk home directory (default ~/.fluid).
FLUID_PROJECTCloud project / account identifier (BigQuery project, Snowflake account, etc.).
FLUID_PROVIDERDefault infrastructure provider (aws / gcp / snowflake / local).
FLUID_REGION / FLUID_DEFAULT_REGIONDefault cloud region.
FLUID_CONFIG / FLUID_CONFIG_PATHOverride the project config file location.
FLUID_ENVDefault environment overlay name (dev / staging / prod).
FLUID_DOMAINDefault --domain hint for fluid forge.
FLUID_BUILD_PROFILEexperimental (all commands) or stable (curated set).
FLUID_RUN_IDOverride the auto-generated run ID.
FLUID_TIME_GRAINSDefault grain enum for time-windowed tests (hour,day,week,…).
FLUID_DIAG_OUT_DIRWhere fluid doctor writes its diagnostic bundle.

LLM provider & routing

See the LiteLLM backend page for the full picture; the canonical names below are honoured by every LLM-driven command.

VariablePurpose
FLUID_LLM_PROVIDERDefault provider (openai / anthropic / gemini / bedrock / vertex / ollama, etc.).
FLUID_LLM_MODELDefault model name (uses LiteLLM's model-name conventions).
FLUID_LLM_API_KEYFallback API key when a provider-specific env var is not set.
FLUID_LLM_ENDPOINTOverride the model endpoint URL.
FLUID_LLM_STREAMINGToggle streaming responses (default on for capable models).
FLUID_LLM_STRUCTURED_OUTPUTSToggle structured-output mode where the provider supports it.
FLUID_LLM_TEMPERATUREDefault sampling temperature.
FLUID_LLM_TIMEOUT_SECONDSPer-call LLM timeout.
FLUID_LLM_ROUTING_ENDPOINT / FLUID_LLM_ROUTING_MODELOptional routing-proxy endpoint and model alias.
FLUID_LITELLM_MODEL_PREFIXOverride the LiteLLM prefix for niche providers (e.g. bedrock/, azure/).
FLUID_LLM_MODEL_PREFLIGHTRun a model-availability check before the first call.
FLUID_OPENAI_STRICT_SCHEMAForce strict JSON-schema mode on OpenAI structured outputs.
FLUID_GEMINI_RESPONSE_SCHEMAOverride Gemini's response schema for structured outputs.
FLUID_TIEREDUse provider-local model tiers (small / medium / large) instead of explicit model names.
FLUID_PRICES_JSONPath to a custom price table used when LiteLLM can't report a usage.cost.
FLUID_TOKEN_COUNTEROverride the token-counter implementation (tiktoken / litellm / heuristic).

Provider-specific keys (OPENAI_API_KEY, ANTHROPIC_API_KEY, GEMINI_API_KEY, AWS_* for Bedrock, GOOGLE_APPLICATION_CREDENTIALS / VERTEX_PROJECT / VERTEX_LOCATION for Vertex) follow the underlying SDK conventions and are read directly by LiteLLM.

Forge copilot

VariablePurpose
FLUID_FORGE_NO_PICKERSkip the 5-mode menu and land straight in the legacy single-shot interview.
FLUID_FORGE_NO_PREVIEWSkip the pre-write preview panel.
FLUID_FORGE_NO_STREAMING_PREVIEWDisable live streaming of the contract preview.
FLUID_FORGE_NO_WELCOMESuppress the welcome scan.
FLUID_FORGE_AUTO_CIAuto-emit the CI scaffold after a forge run.
FLUID_FORGE_LEGACY_COPILOTFall back to the pre-0.8.3 copilot path.
FLUID_FORGE_STAGED_COPILOTUse the staged-copilot experimental loop.
FLUID_FORGE_STAGED_TOOL_LOOPUse the staged tool-loop experimental loop.
FLUID_COPILOT_AGENT_LOOPOverride the copilot agent-loop driver.
FLUID_COPILOT_EPISODIC_MEMORY / FLUID_COPILOT_SEMANTIC_MEMORYToggle memory backends.
FLUID_COPILOT_FORCE_INTERVIEWForce the interactive interview even when --non-interactive would otherwise skip it.
FLUID_COPILOT_PARALLEL_PHYSICALRun physical-modeling agents in parallel.
FLUID_COPILOT_SELF_EVALEnable the copilot's self-evaluation pass.
FLUID_AGENT_COMPACT_AFTERCompact agent context after N turns.
FLUID_COMPACTION_STRATEGYtruncate / summarize / hybrid.

Catalog publish-side registrars

See catalog overview.

VariablePurpose
FLUID_CATALOG_DATAHUB_URLDataHub GMS endpoint. Falls back to DATAHUB_GMS_URL.
FLUID_CATALOG_DATAHUB_TOKENDataHub PAT. Falls back to DATAHUB_GMS_TOKEN.
FLUID_CATALOG_DATAHUB_SPEC_BASE_URLBase URL for spec source documents.
FLUID_CATALOG_DMM_URLData Mesh Manager endpoint. Default https://api.datamesh-manager.com. Falls back to DMM_API_URL.
FLUID_CATALOG_DMM_TOKENDMM API key. Falls back to DMM_API_KEY.
FLUID_CATALOG_OPENMETADATA_URLOpenMetadata REST endpoint.
FLUID_CATALOG_OPENMETADATA_TOKENOpenMetadata bearer token.
FLUID_LAYER_PROPERTY_IDDataHub structured-property URN for metadata.layer.
FLUID_PRODUCT_TYPE_PROPERTY_IDDataHub structured-property URN for metadata.productType.

FLUID Command Center

VariablePurpose
FLUID_COMMAND_CENTER_URLCommand Center base URL.
FLUID_COMMAND_CENTER_API_KEYCommand Center API key.
FLUID_COMMAND_CENTER_ENABLEDMaster enable / disable toggle.
FLUID_COMMAND_CENTER_HOST_ALLOWLISTComma-separated host suffixes for the publish-side SSRF allowlist.
FLUID_COMMAND_CENTER_TIMEOUTPer-request timeout (seconds).
FLUID_CC_ENDPOINTLegacy alias for FLUID_COMMAND_CENTER_URL.
FLUID_DISABLE_CC_DETECTIONSkip the auto-detection probe at CLI start.
FLUID_API_KEY / FLUID_API_URL / FLUID_BEARER_TOKEN / FLUID_OIDC_TOKENGeneric auth fallbacks.

Cost & budget gates

See cost tracking.

VariablePurpose
FLUID_COST_LIMIT_USDGlobal cost cap across a CLI invocation.
FLUID_COST_LIMIT_USD_PER_PRODUCTPer-product cap.
FLUID_COST_LIMIT_USD_PER_RUNPer-run cap.
FLUID_STAGE_BUDGET_<STAGE>Per-stage budget (FLUID_STAGE_BUDGET_PLAN, FLUID_STAGE_BUDGET_APPLY, etc.).

Store, secrets, encryption

VariablePurpose
FLUID_STORE_BACKENDfile (default) / sqlite / postgres.
FLUID_STORE_DSNConnection string when `FLUID_STORE_BACKEND=sqlite
FLUID_STORE_PATH / FLUID_STORE_ROOTOverride the file-store path.
FLUID_STORE_VECTOR_BACKINGVector-store backend (duckdb / lancedb).
FLUID_SECRETS_FILEPath to an encrypted secrets file.
FLUID_SECRETS_INMEMORYUse the in-memory secrets store (tests only).
FLUID_ENCRYPTION_KEY / FLUID_ENCRYPTION_PASSPHRASEFernet key / passphrase for the encrypted credential store.
FLUID_ALLOW_PLAINTEXT_AI_SECRETSLegacy plaintext fallback for AI provider secrets (chmod 600 enforced).
FLUID_ALLOW_PLAINTEXT_SOURCE_SECRETSLegacy plaintext fallback for catalog-source secrets. Disables the OS-keyring default.

Network safety / SSRF

See network safety.

VariablePurpose
FLUID_WEBHOOK_HOST_ALLOWLISTComma-separated host suffixes the webhook alerter is allowed to call.
FLUID_FEDERATION_HOST_ALLOWLISTSame, for the federation digests fetcher.
FLUID_COMMAND_CENTER_HOST_ALLOWLISTSame, for Command Center publish.
FLUID_ALLOW_METADATA_SERVICEAllow outbound calls to cloud metadata services (169.254.169.254). Off by default.
FLUID_SAFE_MODEMaster kill-switch for outbound network operations.

Source-aligned acquisition & build runners

VariablePurpose
FLUID_RUNNER_HOST_OVERRIDEOverride the runner host (wins over TESTCONTAINERS_HOST_OVERRIDE).
FLUID_DBT_FORWARD_ENVExtra env-var keys / prefixes the dbt runner forwards.
FLUID_PII_TOKENIZATION_KEYHMAC key for PII tokenization (production-only).
FLUID_PARALLEL_OPERATIONSMax parallelism for runner operations.
FLUID_UPSTREAM_CONTRACTSSearch path for upstream contract.fluid.yaml references.
FLUID_ROLLBACK_KEEP_LAST_NRetention window for the rollback store.

OpenTofu / IaC

See fluid generate iac.

VariablePurpose
FLUID_TOFU_TIMEOUT_SECONDSPer-tofu subprocess timeout. Default 1800.
FLUID_OPENTOFU_VERSION(since 0.8.8) Pin the OpenTofu version that fluid apply --ensure-opentofu provisions when tofu is missing. Defaults to a recent stable build at/above the engine's version floor.

Marketplace

VariablePurpose
FLUID_PUBLIC_REGISTRYOverride the public marketplace registry URL.
FLUID_MARKET_CACHE_TTLLocal cache TTL (seconds).
FLUID_MARKET_DEFAULT_LIMITDefault page size for fluid market list.
FLUID_MARKET_MIN_QUALITYFilter listed products by minimum quality score.
FLUID_MARKET_TIMEOUTPer-request timeout.
FLUID_MARKETPLACE_FALLBACKFallback registry URL when the primary is unreachable.

Caching

VariablePurpose
FLUID_CACHE_ENABLEDMaster cache toggle.
FLUID_CACHE_TTL_SECONDSDefault cache TTL.
FLUID_DISCOVERY_CACHEOverride the discovery cache path.

Install / package management

VariablePurpose
FLUID_ALLOW_PRERELEASEAllow pip install --pre-style upgrades during in-CLI bootstraps.
FLUID_PACKAGE_SPECOverride the data-product-forge install spec for bootstrap scripts.
FLUID_EXTRA_PIP_SPECSExtra packages installed alongside the CLI.
FLUID_PIP_INDEX_URL / FLUID_PIP_EXTRA_INDEX_URLCustom PyPI indexes.
FLUID_MAJORSPin the major-version line during bootstraps.
FLUID_MAX_FILE_SIZE_MBReject contract / artifact files larger than this.

See also

  • LiteLLM backend — LLM env vars in context
  • Cost tracking — cost-budget gates in context
  • Network safety — SSRF allowlists in context
  • Catalog overview — publish-side catalog env vars in context
  • fluid generate iac — IaC engine env vars in context
Edit this page on GitHub
Last Updated: 6/27/26, 4:58 PM
Contributors: fas89, Claude Opus 4.7 (1M context)
Next
Typed Errors