Repository navigation
test(ts): run strict FFmpeg and TSDuck validation in CI #5328
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
29 commits
Select commit
Hold shift + click to select a range
38e998d
quest: define TS fidelity, recovery, and automated validation
kixelated 2b3a9f2
quest: name redundant TS work by its packet identity scope
kixelated d7e8ea4
quest: clarify TS recovery and validation evidence
kixelated fd0f423
Merge remote-tracking branch 'origin/main' into quest/m1/ts-reliabili…
kixelated 0495260
quest: claim automated TS validation
kixelated 406e3ff
test(ts): run strict FFmpeg and TSDuck validation in CI
kixelated 769f398
Merge origin/main and preserve independent validation jobs
kixelated 790622d
test(ts): drain live measurements and complete validation quest
kixelated eba0751
Claim TS pair acquisition quest
kixelated 75f3baf
fix(test): measure TS pair alignment on the acquired PCR timeline
kixelated e5a2d73
chore: claim initial catalog routing quest
kixelated e04c0fa
test(ts): require every source-declared PMT in pair captures
kixelated bc1dd11
test(net): reproduce catalog acquisition across session replacement
kixelated 06785b9
Merge the TS pair acquisition fix into automated validation
kixelated 43be550
Merge remote-tracking branch 'origin/main' into quest/m1/initial-cata…
kixelated 2849892
Merge remote-tracking branch 'origin/main' into quest/m1/ts-reliabili…
kixelated aab6a88
test(net): retain strict identity during catalog acquisition
kixelated 51d56b3
test(ts): negotiate epochs for seamless acquisition
kixelated ef18045
Merge catalog acquisition identity controls into TS validation
kixelated 19fb452
test(ts): require specific pair failures and retain evidence
kixelated a7a0241
Merge specific pair controls into TS validation
kixelated 95d2120
Merge origin/main into TS validation
kixelated 86f3c1f
Merge remote-tracking branch 'origin/main' into iterate-5328
kixelated 2f9d022
test(ts): keep the PCR accuracy skip for the no-samples control
kixelated 41eaf7c
Merge remote-tracking branch 'origin/main' into iterate-5328
kixelated 78283ba
quest: record the #5328 linger waiver and a local upgrade repro
kixelated afb5be8
Merge remote-tracking branch 'origin/main' into iterate-5328
kixelated adc6f2f
Merge origin/main into quest/m1/ts-reliability/validation
kixelated 6bb3dad
ci(ts): trigger TS validation on its workspace dependencies
kixelated File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -59,6 +59,7 @@ on: | |
| - release-winget | ||
| - rpm-repo | ||
| - Swift | ||
| - TS | ||
| - Video | ||
| types: | ||
| - completed | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,166 @@ | ||
| name: TS | ||
|
|
||
| # Decoder, transport structure, buffer-model and release-timing gates are | ||
| # independent of browser interop. Decoder and transport gates have real-tool controls. | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "0 8 * * *" | ||
| pull_request: | ||
| paths: | ||
| - "test/ts/**" | ||
| - "test/lib/**" | ||
| - "test/justfile" | ||
| - "rs/moq-mux/**" | ||
| - "rs/hang/**" | ||
| - "rs/moq-cli/**" | ||
| - "rs/moq-net/**" | ||
| - "rs/moq-tokio/**" | ||
| - "rs/moq-relay/**" | ||
| - "rs/moq-loc/**" | ||
| - "rs/moq-json/**" | ||
| # Workspace dependencies of moq-net, moq-tokio and moq-mux on the TS path. | ||
| - "rs/kio/**" | ||
| - "rs/moq-flate/**" | ||
| - "rs/moq-msf/**" | ||
| - "rs/moq-pattern/**" | ||
| - "rs/moq-sock/**" | ||
| - "Cargo.toml" | ||
| - "Cargo.lock" | ||
| - "rust-toolchain.toml" | ||
| - "flake.nix" | ||
| - "flake.lock" | ||
| - ".github/actions/rust-cache/**" | ||
| - ".github/workflows/ts.yml" | ||
|
|
||
| concurrency: | ||
| group: ts-${{ github.ref }} | ||
| cancel-in-progress: true | ||
|
|
||
| permissions: | ||
| id-token: write | ||
| contents: read | ||
|
|
||
| jobs: | ||
| ts: | ||
| name: TS validation | ||
| runs-on: ubuntu-latest | ||
| timeout-minutes: 60 | ||
| steps: | ||
| - name: Checkout | ||
| uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1 | ||
| with: | ||
| persist-credentials: false | ||
|
|
||
| - name: Free disk space | ||
| uses: jlumbroso/free-disk-space@ceedf095f4ec1a097402bc6bd80831f2e1a6fde6 # main | ||
| with: | ||
| tool-cache: false | ||
|
|
||
| - uses: DeterminateSystems/nix-installer-action@1d87d45818068401a10cf16bdc5f00b24994a83f # main | ||
| with: | ||
| determinate: false | ||
| extra-conf: | | ||
| extra-substituters = https://kixelated.cachix.org | ||
| extra-trusted-public-keys = kixelated.cachix.org-1:CmFcV0lyM6KuVM2m9mih0q4SrAa0XyCsiM7GHrz3KKk= | ||
|
|
||
| - name: Rust cache | ||
| uses: ./.github/actions/rust-cache | ||
|
|
||
| - name: FFmpeg and TSDuck controls | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts-controls | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
|
|
||
| - name: TS pair controls | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts-pair-controls | ||
|
|
||
| # Round-trips a PCR-paced TS through a relay and checks the subscriber's | ||
| # `export ts` output with TSDuck (tsp/tsanalyze from the nix devShell). | ||
| - name: TS compliance | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # The same round-trip at 2 Mb/s, where every keyframe outgrows a 25 ms PCR slot, | ||
| # so the export has to spread it over the slots before its DTS and still keep | ||
| # the constant-rate schedule. | ||
| - name: TS keyframe bursts | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts --bitrate 2000000 | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # 1080p video filling a broadcast-sized 9 Mbit CPB, at the default delay: the | ||
| # source sends pictures most of a second ahead of their decode time, and the | ||
| # export has to as well without overflowing the receiver's buffers. | ||
| - name: TS broadcast-sized CPB | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts --hrd | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # The same video beside four audio PIDs in a multiplex faster than its Rx: each slot | ||
| # has to interleave the video with the rest, or its transport buffer overflows. | ||
| - name: TS multiplex above the video's Rx | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts --headroom | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # The same round-trip over an open-GOP clip: every leading picture after a | ||
| # recovery point must come back, in decode order. | ||
| - name: TS open GOP | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts --open-gop | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # Builds the sparse-EPG and pending-version fixtures and round-trips | ||
| # them, asserting the schedule survives and pending sections are dropped. | ||
| - name: EIT fixtures | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts-eit | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # The T-STD model must pass a broadcast capture and fail the same capture | ||
| # delivered too slowly, too early, or in a burst. | ||
| - name: T-STD controls | ||
| if: ${{ !cancelled() }} | ||
| run: nix develop --command just test ts-tstd | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
| shell: bash -leo pipefail {0} | ||
|
|
||
| # The pair needs enough overlap to grade the slower table cadences. | ||
| - name: TS table alignment | ||
| if: ${{ !cancelled() && github.event_name != 'pull_request' }} | ||
| run: nix develop --command just test ts --pair | ||
|
kixelated marked this conversation as resolved.
Resolved
|
||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
|
|
||
| # Live timing needs the real-time window to distinguish drift from startup. | ||
| - name: TS live release timing | ||
| if: ${{ !cancelled() && github.event_name != 'pull_request' }} | ||
| run: nix develop --command just test ts --live --duration 120 | ||
| env: | ||
| MOQ_TEST_RUNS: ${{ runner.temp }}/moq-test-runs | ||
|
|
||
| - name: Upload failure artifacts | ||
| if: ${{ failure() }} | ||
| uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7 | ||
| with: | ||
| name: ts-failure | ||
| path: ${{ runner.temp }}/moq-test-runs | ||
| retention-days: 7 | ||
| if-no-files-found: error | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.