Fluid Forge
Get Started
See it run
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
Demos
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
GitHub
Get Started
See it run
  • Local (DuckDB)
  • Source-Aligned (Postgres → DuckDB)
  • AI Forge + Data Models
  • GCP (BigQuery)
  • Snowflake Team Collaboration
  • Declarative Airflow
  • Orchestration Export
  • Jenkins CI/CD
  • Universal Pipeline
  • 11-Stage Production Pipeline
  • Catalog Forge End-to-End
CLI Reference
  • Overview
  • Quickstart
  • Examples
  • Your own CI
  • Your own scaffolding
  • Custom validator
  • Apply hook
  • Reference
Demos
  • Overview
  • Architecture
  • GCP (BigQuery)
  • AWS (S3 + Athena)
  • Snowflake
  • Local (DuckDB)
  • Custom Providers
  • Roadmap
GitHub
GitHub
  • Introduction

    • Home
    • Getting Started
    • Snowflake Quickstart
    • See it run
    • Forge Data Model
    • Vision & Roadmap
    • Playground
    • FAQ
  • Concepts

    • Concepts
    • Builds, Exposes, Bindings
    • What is a contract?
    • Quality, SLAs & Lineage
    • Governance & Policy
    • Agent Policy (LLM/AI governance)
    • Providers vs Platforms
    • Fluid Forge vs alternatives
  • Data Products

    • Product Types — SDP, ADP, CDP
  • Walkthroughs

    • Walkthrough: Local Development
    • Source-Aligned: Postgres → DuckDB → Parquet
    • AI Forge And Data-Model Journeys
    • Walkthrough: Deploy to Google Cloud Platform
    • Walkthrough: Snowflake Team Collaboration
    • Declarative Airflow DAG Generation - The FLUID Way
    • Generating Orchestration Code from Contracts
    • Jenkins CI/CD for FLUID Data Products
    • Universal Pipeline
    • The 11-Stage Pipeline
    • End-to-End Walkthrough: Catalog → Contract → Transformation
  • CLI Reference

    • CLI Reference
    • fluid init
    • fluid demo
    • fluid forge
    • fluid skills
    • fluid status
    • fluid validate
    • fluid plan
    • fluid apply
    • fluid generate
    • fluid generate artifacts
    • fluid validate-artifacts
    • fluid verify-signature
    • fluid generate-airflow
    • fluid generate-pipeline
    • fluid viz-graph
    • fluid odps
    • fluid odps-bitol
    • fluid odcs
    • fluid export
    • fluid export-opds
    • fluid publish
    • fluid datamesh-manager
    • fluid market
    • fluid import
    • fluid policy
    • fluid policy check
    • fluid policy compile
    • fluid policy apply
    • fluid contract-tests
    • fluid contract-validation
    • fluid diff
    • fluid test
    • fluid verify
    • fluid product-new
    • fluid product-add
    • fluid workspace
    • fluid ide
    • fluid ai
    • fluid memory
    • fluid mcp
    • fluid scaffold-ci
    • fluid scaffold-composer
    • fluid scaffold-ide
    • fluid docs
    • fluid config
    • fluid split
    • fluid bundle
    • fluid auth
    • fluid doctor
    • fluid providers
    • fluid provider-init
    • fluid roadmap
    • fluid version
    • fluid runs
    • fluid retention
    • fluid secrets
    • fluid stats
    • fluid contract
    • fluid ship
    • fluid rollback
    • fluid schedule-sync
    • Catalog adapters

      • Source Catalog Integration (V1.5)
      • BigQuery Catalog
      • Snowflake Horizon Catalog
      • Databricks Unity Catalog
      • Google Dataplex Catalog
      • AWS Glue Data Catalog
      • DataHub Catalog
      • Data Mesh Manager Catalog
    • CLI by task

      • CLI by task
      • Add quality rules
      • Add agent governance
      • Debug a failed pipeline run
      • Switch clouds with one line
  • Recipes

    • Recipes
    • Recipe — add a quality rule
    • Recipe — switch clouds with one line
    • Recipe — tag PII in your schema
  • SDK & Plugins

    • SDK & Plugins
    • Quickstart — your first plugin
    • Examples

      • Runnable examples
      • Example: hello-scaffold — the minimal viable plugin
      • Example: gitlab-ci-scaffold — generate a complete CI project
      • Example: steward-validator — a custom governance rule
      • Example: prod-key-guard — apply-time invariant check
    • Journeys

      • Journeys
      • Your own CI/CD

        • You have your own CI/CD setup, no problem
        • GitLab CI — the bundle template
        • GitHub Actions — the bundle template
        • Jenkins — the bundle template
        • CircleCI — the bundle template
      • You have a strict project layout, no problem
      • You have governance rules, no problem
      • You want a check at apply time, no problem
    • Reference

      • Reference
      • Roles reference
      • Entry points reference
      • Trust model
      • Packaging
      • Companion packages
  • Providers

    • Providers
    • Provider Architecture
    • GCP Provider
    • AWS Provider
    • Snowflake Provider
    • Local Provider
    • Creating Custom Providers
    • Provider Roadmap
  • Advanced

    • Blueprints
    • Governance & Compliance
    • Airflow Integration
    • Built-in And Custom Forge Guidance
    • FLUID Forge Contract GPT Packet
    • Forge Discovery Guide
    • Forge Memory Guide
    • LLM Providers
    • Capability Warnings
    • LiteLLM Backend (opt-in)
    • MCP Server
    • Credential Resolver — Security Model
    • Cost Tracking
    • Agentic Primitives
    • Typed Errors
    • Typed CLI Errors
    • Authoring Forge Tools
    • Source-Aligned Acquisition
    • API Stability — fluid_build.api
    • Guided fluid forge UX
    • V1.5 Catalog Integration — Architecture Deep-Dive
    • V1.5 + V2 Hardening — Release Notes
  • Project

    • Contributing to Fluid Forge
    • Fluid Forge Docs Baseline: CLI 0.8.3
    • Fluid Forge Docs Baseline: CLI 0.8.0
    • Fluid Forge Docs Baseline: CLI 0.7.11
    • Fluid Forge Docs Baseline: CLI 0.7.9
    • Fluid Forge v0.7.1 - Multi-Provider Export Release

Jenkins — the bundle template

Part of you have your own CI/CD setup, no problem. Read steps 0–2 there first — they set up the bundle repo and manifest that this template plugs into.

The complete Jenkinsfile.j2 template, ready to drop into your bundle's templates/ directory.

What this template does

  • Declarative pipeline syntax (pipeline { … }) — works with any Jenkins ≥ 2.290.
  • One stage('Deploy: <env>') per environment declared in the contract.
  • Uses Jenkins's built-in input block for the prod approval gate — pipeline pauses, a human clicks "Deploy to prod" before the stage runs.
  • Resolves credentials per environment via withCredentials — no plaintext keys in the Jenkinsfile.

templates/Jenkinsfile.j2

// Auto-generated Jenkinsfile for {{ contract.metadata.id }}
// Rendered from my-org-ci-bundle@{{ bundle.version }} — do not edit by hand.

pipeline {
    agent any

    environment {
        PRODUCT_ID    = "{{ contract.metadata.id }}"
        PRODUCT_OWNER = "{{ contract.metadata.owner.email }}"
    }

    stages {
        stage('Validate') {
            steps {
                sh 'python -m pip install --quiet "data-product-forge=={{ fluid_cli_version | default(\'0.8.3\') }}"'
                sh 'fluid validate contract.fluid.yaml --strict'
            }
        }

{% for env_name, env in contract.environments.items() %}
        stage('Deploy: {{ env_name }}') {
            when { branch 'main' }
            {% if env_name == "prod" -%}
            input {
                message "Approve prod deploy of {{ contract.metadata.id }}?"
                ok "Deploy to prod"
            }
            {%- endif %}
            steps {
                {% if env.cloud.provider == "aws" -%}
                withCredentials([[$class: 'AmazonWebServicesCredentialsBinding',
                                 credentialsId: 'aws-{{ env_name }}-{{ env.cloud.account }}']]) {
                    sh 'fluid apply contract.fluid.yaml --env {{ env_name }} --yes'
                }
                {%- elif env.cloud.provider == "gcp" -%}
                withCredentials([file(credentialsId: 'gcp-{{ env_name }}-{{ env.cloud.project }}', variable: 'GOOGLE_APPLICATION_CREDENTIALS')]) {
                    sh 'fluid apply contract.fluid.yaml --env {{ env_name }} --yes'
                }
                {%- endif %}
            }
        }
{% endfor %}
    }
}

Per-cloud credential conventions

The template assumes your Jenkins credentials are named with a per-env-per-account scheme:

CloudCredential typeNaming conventionRenders to
awsAWS Credentials (CloudBees AWS Credentials plugin)aws-<env>-<account>aws-prod-333333333333
gcpSecret file (Google credentials JSON)gcp-<env>-<project>gcp-prod-order-events-prod

Pre-create these in Manage Jenkins → Credentials. The template renders the right ID per env — the platform team only needs to keep credential names in sync with the contract's environments block.

Why the input block for prod

Three reasons it's the world-class choice on Jenkins:

  1. Discoverable. Anyone looking at the pipeline page sees a "Deploy to prod" button. No separate approval app to install.
  2. Auditable. Jenkins records who approved and when in the build log. Combine with submitter to scope approval to a specific group:
    input {
        message "Approve prod deploy?"
        submitter "data-platform-admins"   // group name from your auth provider
        ok "Deploy"
    }
    
  3. Timeout-aware. Wrap with timeout(time: 1, unit: 'HOURS') to auto-abort a stale approval — no abandoned pipelines holding agent slots.

Jenkins-specific install-mode (pypi vs. dev-source)

If your Jenkins doesn't have internet egress, the forge-cli has a built-in Jenkinsfile-generator with two install modes:

  • --install-mode pypi (production) — uses 4 build-time Jenkins parameters: FLUID_PACKAGE_SPEC, FLUID_PIP_INDEX_URL, FLUID_PIP_EXTRA_INDEX_URL, FLUID_ALLOW_PRERELEASE.
  • --install-mode dev-source (lab) — uses PYTHONPATH=/forge-cli-src and fails loud if the mount is missing.

The bundle pattern above uses pypi-mode by default (pip install over the public index). For dev-source mode, replace the python -m pip install line in the template with:

sh '''
  if [ ! -d /forge-cli-src ]; then
    echo "ERROR: /forge-cli-src not mounted; this Jenkinsfile expects dev-source mode" >&2
    exit 1
  fi
  export PYTHONPATH=/forge-cli-src
  fluid validate contract.fluid.yaml --strict
'''

Next

  • Back to the main journey — steps 4–7 (Dockerfile, README, static files, tagging, consumption).
  • Other CI variants: GitLab CI, GitHub Actions, CircleCI.
Edit this page on GitHub
Last Updated: 5/13/26, 6:01 AM
Contributors: fas89
Prev
GitHub Actions — the bundle template
Next
CircleCI — the bundle template