feat(wire): S3/#108 — arrow shard writer (byte parity, header pass-through)#118
Merged
Conversation
write_shard: one (target,month) shard from declared primitives via views_frames.io.arrow.save, §2 header embedded, file named from the header's own declarations (§4.1b), SHA-256 of the complete bytes returned for the §4.2 manifest. month_slice joins the frame seam (frame → one month's primitives, missing month fails loud) so the writer never touches the frame API. Byte parity proven against the fixture arrow shard; toolchain pin asserted fail-loud (pyarrow 23.0.1) — drift can never read as conformance. Part of epic #105. Closes #108. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… (pyarrow 16.1.0) — §10 contract-change event, maintainer Option A The delivery repo's locked env can never exceed pyarrow <17 (views-pipeline-core → viewser → views-storage chain); the fixture's Hop-B bytes were generated on an unlocked dev env at 23.0.1. Regenerated arrow shard + sidecar + run manifest + SHA256SUMS under 16.1.0; Track-A bytes verified byte-identical (producer conformance untouched). New root hash 9658a648…; pyarrow now an explicit first-class pin (>=16.1.0,<17); ADR post-adoption entry records the event and the platform debt (lift the ceiling at source: pipeline-core#280); vendors notified on their PR #276. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Story S3 of epic #105.
What
unfao/wire/shard.py—write_shard(values, time, unit, *, header, directory) -> (name, sha256):views_frames.io.arrow.savewith the §2 header embedded; name derived from the header's ownrun_id/target/time_id(§4.1b), never invented.unfao/frame_extraction.py—month_slice(frame, month_id): the per-month sharding cut as a seam concern (writer stays frame-API-free); absent month fails loud.AC (all met)
SHA256SUMS.Closes #108. Epic #105 · Tracking #114.
🤖 Generated with Claude Code