Skip to content

Latest commit

 

History

173 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FLUID

FLUID

Federated Layered Unified Interchange Definition

The open, declarative standard for Data Products — built for the agentic era.

📖 Documentation · 🧭 Schema Anatomy · 🚀 Examples · 🔄 vs ODCS / ODPS · ✨ What's New


FLUID is one YAML file that describes a data product end to end — schema, build, orchestration, agentic governance, sovereignty, and semantics. Write it once; validate it, compile it, and deploy it anywhere. It compiles to Bitol ODPS + ODCS for catalog interop via the reference compiler, forge-cli.

How the pieces fit

flowchart LR
    F["FLUID v0.7.5<br/>your .fluid.yml<br/>complete on its own"]
    FC["forge-cli<br/>compiler → IaC + DAGs"]
    BIT["Bitol ODPS + ODCS<br/>catalog interop"]
    F -.->|compile + deploy| FC
    F -.->|catalog interop| BIT
Loading

FLUID is standalone — the contract is complete on its own. Everything else is an optional adapter.

Minimal valid contract

fluidVersion: "0.7.5"
kind: DataProduct
id: demo.bronze.hello_world
name: Hello World
metadata:
  owner:
    team: data-platform
exposes:
  - exposeId: hello
    kind: table
    contract:
      schema:
        - name: id
          type: STRING
          required: true
    binding:
      platform: local
      format: parquet
      location:
        path: ./hello.parquet

→ Build it up step by step in FLUID by Example.

JSON Schema

  • Latest: https://open-data-protocol.github.io/fluid/schema/fluid-schema-0.7.5.json
  • Use it in your editor — add this line to any .fluid.yml:
    # yaml-language-server: $schema=https://open-data-protocol.github.io/fluid/schema/fluid-schema-0.7.5.json
  • All versions, diffs, and the generated HTML reference: Schema → Versions.

Note: 0.7.5 ("Streaming Kafka → Iceberg Sink & Confluent Tableflow") is additive and fully backward-compatible with 0.7.4 — every valid 0.7.4 contract still validates. See What's New in 0.7.5.

Build the docs locally

npm install
npm run docs:dev      # http://localhost:8080/fluid/
npm run docs:build    # static site → docs/.vuepress/dist

The site is built with VuePress 2 and deployed to GitHub Pages. Schema files and the generated HTML specs are mirrored into the published site by scripts/sync-public-assets.mjs, so …/fluid/schema/*.json keeps resolving.

Contributing & license

PRs welcome — see the Contributing Guide. Licensed under the MIT License.

About

Federated Layered Unified Interchange Definition

Resources

Code of conduct

Contributing

Security policy

Stars

4 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages