Skip to content

docs(iceberg): the forge-cli #710 fix wave — sink needs, sink/expose join, policy warnings and errors - #147

Merged
fas89 merged 2 commits into
mainfrom
docs/iceberg-defect-scan-wave
Oct 9, 2026
Merged

fas89 merged 2 commits into
mainfrom
docs/iceberg-defect-scan-wave

Conversation

@fas89

@fas89 fas89 commented Oct 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

Documents the forge-cli fix wave in forge-cli #710 (unreleased). Each change is marked (forge-cli #710, unreleased).

  • Streaming sinks (advanced/source-aligned-acquisition.md, providers/gcp.md):
    • The "A streaming sink needs" column changes: dynamodb needs a warehouse or a bucket to derive it from, jdbc needs uri plus that, and bigquery needs project.
    • New section: what a DynamoDB, JDBC or BigQuery sink needs. It covers bucket derivation, overrides, the gcp.bigquery.project-id / gcp.bigquery.location mapping, the BigQuery no-warehouse warning, and {{ env.* }} buckets.
    • New section: which exposes a streaming sink writes. It covers the outputs-driven join and the refusals; hand-written configs are unchanged.
    • The Confluent default catalog is now Glue, and the Tableflow grant has a worked example.
  • Policy (cli/policy-compile.md, cli/policy-apply.md, advanced/governance.md, cli/generate-artifacts.md): new ## Warnings and ## Errors sections. ## Errors is the anchor the new policy_compiler_crashed docs route points at. policy apply echoes the stored warnings.
  • Snowflake volume guard (cli/apply.md, providers/snowflake.md, advanced/production-troubleshooting.md): the new message names both possible causes.
  • Error catalogue (advanced/error-codes.md, advanced/typed-cli-errors.md): policy_compiler_crashed. Also iceberg_catalog_move_blocked, which has been catalogued since forge-cli #709 but had no entry on this page.

Every quoted message, derived config and bindings JSON came from running the #710 branch, not from paraphrasing the CHANGELOG.

Checks

  • Routed anchors: every _DOC_ROUTES target in #710 resolves to an existing file and heading. No page or heading was moved or renamed; cli/policy-compile.html#errors is new.
  • Scripts: scripts/check_cli_docs.py --flags-only and --versions-only pass.
  • Links: an anchor check of the 26 internal links added found 0 broken. The checker was first shown to fail on a fake anchor.
  • Build: not run locally, because the local Homebrew node is broken. CI builds the site.

Merge after forge-cli #710.

fas89 added 2 commits October 9, 2026 02:09
… #710)

- DynamoDB and JDBC sinks need a warehouse (location.warehouse, one derived
  from an explicit bucket on aws or gcp, or an override); BigQuery sinks need
  location.project and map region to gcp.bigquery.location
- a {{ env.* }} bucket whose variable is unset warns at validate and is
  refused by the run preflight
- a derived Kafka Connect sink writes the one Iceberg expose its outputs
  pick; a derived Debezium Server sink writes several only within one
  database and one catalog
- platform: confluent with no catalog reads as glue; policy compile grants
  the Glue table Tableflow publishes
- policy compile prints its warnings and fails on a compiler crash, with a
  new Errors section the CLI's policy_compiler_crashed link points to;
  policy apply echoes the bindings warnings
- the Snowflake EXTERNAL VOLUME guard message names both possible causes

This branch was successfully deployed

1 active deployment
github-pages — 250c5573 Deployed Oct 9, 2026 by fas89 via deploy #183
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant