Fluid Forge
Get Started
See it run
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
Demos
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
GitHub
Get Started
See it run
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
Demos
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
GitHub
  • Introduction

    • Home
    • Getting Started
    • Snowflake Quickstart
    • See it run
    • Forge Data Model
    • Vision & Roadmap
    • Playground
    • FAQ
  • Concepts

    • Concepts
    • Builds, Exposes, Bindings
    • What is a contract?
    • Quality, SLAs & Lineage
    • Governance & Policy
    • Agent Policy (LLM/AI governance)
    • Providers vs Platforms
    • Fluid Forge vs alternatives
  • Data Products

    • Product Types — SDP, ADP, CDP
  • Walkthroughs

    • Walkthrough: Local Development
    • Source-Aligned: Postgres → DuckDB → Parquet
    • AI Forge And Data-Model Journeys
    • Walkthrough: Deploy to Google Cloud Platform
    • Walkthrough: Snowflake Team Collaboration
    • Declarative Airflow DAG Generation - The FLUID Way
    • Generating Orchestration Code from Contracts
    • Jenkins CI/CD for FLUID Data Products
    • Universal Pipeline
    • The 11-Stage Pipeline
    • End-to-End Walkthrough: Catalog → Contract → Transformation
  • CLI Reference

    • CLI Reference
    • fluid init
    • fluid demo
    • fluid forge
    • fluid skills
    • fluid status
    • fluid validate
    • fluid plan
    • fluid apply
    • fluid generate
    • fluid generate artifacts
    • fluid validate-artifacts
    • fluid verify-signature
    • fluid generate-airflow
    • fluid generate-pipeline
    • fluid viz-graph
    • fluid odps
    • fluid odps-bitol
    • fluid odcs
    • fluid export
    • fluid export-opds
    • fluid publish
    • fluid datamesh-manager
    • fluid market
    • fluid import
    • fluid policy
    • fluid policy check
    • fluid policy compile
    • fluid policy apply
    • fluid contract-tests
    • fluid contract-validation
    • fluid diff
    • fluid test
    • fluid verify
    • fluid product-new
    • fluid product-add
    • fluid workspace
    • fluid ide
    • fluid ai
    • fluid memory
    • fluid mcp
    • fluid scaffold-ci
    • fluid scaffold-composer
    • fluid scaffold-ide
    • fluid docs
    • fluid config
    • fluid split
    • fluid bundle
    • fluid auth
    • fluid doctor
    • fluid providers
    • fluid provider-init
    • fluid roadmap
    • fluid version
    • fluid runs
    • fluid retention
    • fluid secrets
    • fluid stats
    • fluid contract
    • fluid ship
    • fluid rollback
    • fluid schedule-sync
    • Catalog adapters

      • Source Catalog Integration (V1.5)
      • BigQuery Catalog
      • Snowflake Horizon Catalog
      • Databricks Unity Catalog
      • Google Dataplex Catalog
      • AWS Glue Data Catalog
      • DataHub Catalog
      • Data Mesh Manager Catalog
    • CLI by task

      • CLI by task
      • Add quality rules
      • Add agent governance
      • Debug a failed pipeline run
      • Switch clouds with one line
  • Recipes

    • Recipes
    • Recipe — add a quality rule
    • Recipe — switch clouds with one line
    • Recipe — tag PII in your schema
  • SDK & Plugins

    • SDK & Plugins
    • Quickstart — your first plugin
    • Examples

      • Runnable examples
      • Example: hello-scaffold — the minimal viable plugin
      • Example: gitlab-ci-scaffold — generate a complete CI project
      • Example: steward-validator — a custom governance rule
      • Example: prod-key-guard — apply-time invariant check
    • Journeys

      • Journeys
      • Your own CI/CD

        • You have your own CI/CD setup, no problem
        • GitLab CI — the bundle template
        • GitHub Actions — the bundle template
        • Jenkins — the bundle template
        • CircleCI — the bundle template
      • You have a strict project layout, no problem
      • You have governance rules, no problem
      • You want a check at apply time, no problem
    • Reference

      • Reference
      • Roles reference
      • Entry points reference
      • Trust model
      • Packaging
      • Companion packages
  • Providers

    • Providers
    • Provider Architecture
    • GCP Provider
    • AWS Provider
    • Snowflake Provider
    • Local Provider
    • Creating Custom Providers
    • Provider Roadmap
  • Advanced

    • Blueprints
    • Governance & Compliance
    • Airflow Integration
    • Built-in And Custom Forge Guidance
    • FLUID Forge Contract GPT Packet
    • Forge Discovery Guide
    • Forge Memory Guide
    • LLM Providers
    • Capability Warnings
    • LiteLLM Backend (opt-in)
    • MCP Server
    • Credential Resolver — Security Model
    • Cost Tracking
    • Agentic Primitives
    • Typed Errors
    • Typed CLI Errors
    • Authoring Forge Tools
    • Source-Aligned Acquisition
    • API Stability — fluid_build.api
    • Guided fluid forge UX
    • V1.5 Catalog Integration — Architecture Deep-Dive
    • V1.5 + V2 Hardening — Release Notes
  • Project

    • Contributing to Fluid Forge
    • Fluid Forge Docs Baseline: CLI 0.8.3
    • Fluid Forge Docs Baseline: CLI 0.8.0
    • Fluid Forge Docs Baseline: CLI 0.7.11
    • Fluid Forge Docs Baseline: CLI 0.7.9
    • Fluid Forge v0.7.1 - Multi-Provider Export Release

Companion packages

Three packages ship together as one platform. End users only need the CLI; plugin authors need the SDK; plugin authors who want to ship file-emitting plugins via Jinja+YAML bundles also need the custom-scaffold engine.

Quick reference

PackageVersionPyPIImport pathWhat you reach for it for
data-product-forge0.8.3pypi.org/project/data-product-forgeimport fluid_buildThe CLI itself — fluid command, all built-in providers, the fluid generate/validate/apply/publish lifecycle
data-product-forge-sdk0.9.0pypi.org/project/data-product-forge-sdkfrom fluid_sdk import …Zero-dependency ABCs (BasePlugin, CustomScaffold, Validator, etc.) + conformance test harness. Plugin authors only.
data-product-forge-custom-scaffold0.1.0pypi.org/project/data-product-forge-custom-scaffoldfrom data_product_forge_custom_scaffold import …Reference Jinja+YAML bundle engine. Use this when your plugin distributes templates via a git bundle (most common pattern).

Who installs what

You are…Install
End user consuming someone else's pluginspip install data-product-forge data-product-forge-custom-scaffold <plugin-package>
Plugin author writing a new role subclasspip install data-product-forge-sdk for development; the CLI itself for testing
Bundle author distributing Jinja templates to other teamsNo extra install — consumers install data-product-forge-custom-scaffold; you just host the bundle in git
Platform team building a custom CLI subcommandpip install data-product-forge-sdk if your plugin subclasses anything, otherwise no SDK needed (entry-point can be a plain function)

The SDK dual-naming explained

PyPI distribution: data-product-forge-sdk. Python import path: fluid_sdk.

pip install data-product-forge-sdk
from fluid_sdk import CustomScaffold, ContractHelper, write_file_action

This is deliberate, and standard PyPI practice. Same pattern as:

  • pillow ↔ from PIL import Image
  • scikit-learn ↔ from sklearn import …
  • pyyaml ↔ import yaml
  • attrs ↔ import attr

The PyPI name reflects the product brand (data-product-forge). The import path stays short, version-stable, and module-friendly (fluid_sdk was its name before the rename and hasn't changed).

You don't have to do anything special — pip install data-product-forge-sdk makes import fluid_sdk work. The CLI's requirements.txt and your plugin's pyproject.toml both use the dist name; only your Python source uses the import path.

Version pinning recommendations

If you're consuming the CLI

dependencies = [
    "data-product-forge==0.8.3",  # pin exact for reproducibility
]

For production deploys, exact pin (==) is right. For development environments, looser bound (>=0.8,<0.9) is fine — minor versions are backwards-compatible.

If you're writing a plugin

dependencies = [
    "data-product-forge-sdk>=0.9,<1",   # upper bound is important
]

The upper bound <1 is critical: the SDK is on the 0.x line and minor versions may break the API. Bump your upper bound (<1 → <2) only after testing against the new major version.

For the custom-scaffold engine (if you're shipping bundles that ride on it):

dependencies = [
    "data-product-forge-sdk>=0.9,<1",
    "data-product-forge-custom-scaffold>=0.1,<0.2",
]

If you're a plugin author shipping to PyPI

Your plugin ships with a pinned SDK requirement; your users install your plugin and let pip resolve the SDK transitively. That means you control which SDK version they use.

Best practice:

  1. Pin to the lowest SDK version your plugin actually needs.
  2. Run CI against multiple SDK versions to confirm the lower bound is real.
  3. Bump the upper bound only after testing against a new SDK release.

Version stability commitments

data-product-forge (CLI)

  • Semantic versioning since 0.8.0. Minor versions add features and may deprecate (with warning) but won't break. Major versions can break.
  • The 0.7.x contract schema is supported indefinitely by the 0.8 line — contracts using fluidVersion: 0.7.1 / 0.7.2 / 0.7.3 all validate.
  • Pre-releases are tagged with PEP 440 suffixes (0.8.4rc1, 0.8.4b1, etc.). They publish to PyPI but pip install skips them by default.

data-product-forge-sdk

  • Currently 0.9.0 — Beta classifier. First stable 1.0.0 planned after a validation window with the first external plugins on PyPI.
  • Minor versions (0.9 → 0.10) may break the API; we expect them not to in practice but the classifier reflects "we reserve the right." Pin the upper bound (<1).
  • Patch versions (0.9.0 → 0.9.1) only fix bugs; safe to consume without bumping.

data-product-forge-custom-scaffold

  • Currently 0.1.0 — Beta classifier. Same model as the SDK: first stable cut after the validation window.
  • The bundle manifest format is fluid.dev/custom-scaffold.v1 — a v2 would be a breaking change, and bundles would need to update their apiVersion. No v2 is on the roadmap.

Where to find the source

PackageRepoLicense
data-product-forgeAgenticstiger/forge-cliApache-2.0
data-product-forge-sdkAgenticstiger/forge-cli-sdkApache-2.0
data-product-forge-custom-scaffoldAgenticstiger/data-product-forge-custom-scaffoldApache-2.0

Issues, PRs, and discussions all happen on the upstream repos. The examples/ directories on each contain runnable starting points.

Upgrade compatibility

You're upgradingFrom → ToWhat might break
CLI0.8.x → 0.8.yNothing — patch and minor are backwards-compatible.
CLI0.8.x → 0.9.0(not yet released) Will be communicated via release notes.
SDK0.9.x → 0.9.yNothing — patches only fix bugs.
SDK0.9 → 0.10(not yet released) Possible API changes; check release notes; bump upper bound.
SDK0.9 → 1.0(not yet released) Will be the "stable cut." Should be a no-op if you've been on 0.9.x; if not, release notes will say.
Custom-scaffold0.1.x → 0.1.yNothing — patches only.
Custom-scaffold0.1 → 0.2Bundle manifest format unchanged (v1). Resolver protocol may change for plugin-bundle authors; check release notes.

Roadmap

(High-level — see each repo's GitHub for milestones)

  • CLI: continued growth of the v0.7.3 schema's acquisition-pattern engines; 0.9 line will introduce contract-versioning policy work.
  • SDK: stabilize at 1.0 after the validation window. No new roles planned; the four existing roles (CustomScaffold / Validator / InfraProvider / CatalogAdapter) cover the spec.
  • Custom-scaffold: 0.2 line will add a pypi resolver kind (so bundles can be installed via pip install directly) and an npm resolver kind. Today, path / git / entrypoint cover the common cases.

Reference

  • Packaging — how to ship a plugin to PyPI
  • Roles — the four roles and their helpers
  • Entry points — the six entry-point groups and when to use each
  • Trust model — what the CLI guarantees about plugins
Edit this page on GitHub
Last Updated: 5/13/26, 6:01 AM
Contributors: fas89
Prev
Packaging