Skip to content

v2.0.1: download traces from GitHub release assets, and release notes - #568

Merged
JRPan merged 9 commits into
accel-sim:devfrom
purdue-aalp:trace-release-download
Oct 20, 2026
Merged

JRPan merged 9 commits into
accel-sim:devfrom
purdue-aalp:trace-release-download

Conversation

@JRPan

@JRPan JRPan commented Oct 20, 2026

Copy link
Copy Markdown
Collaborator

Prepares the v2.0.1 release. Pre-collected traces move from the FTP server to GitHub release assets and ship with the code release they were validated with.

Trace download (get-accel-sim-traces.py)

  • Rewritten to read manifest.json from a GitHub release (default: accel-sim/accel-sim-framework, tag v2.0.1).
  • -l lists the sets. -a GPU[/workload[/args]] downloads a selection, with all allowed at any level.
  • Every part is checked against its SHA-256, and so is the whole tar after extraction. Parts that are already downloaded and verified are skipped, so an interrupted download resumes.
  • Extracts under hw_run/ in the standard Accel-Sim layout:
    • <GPU>/traces/device-0/<cuda>/<workload>/<args>/traces/ is for run_simulations.py -T hw_run/<GPU>/traces/device-0/<cuda>.
    • <GPU>/device-0/<cuda>/<workload>/<args>/ncu.csv.* is for plot-correlation.py -H hw_run/<GPU>.
  • Every tar member must stay inside its set's trace or hardware directory. After extraction, the kernel count in kernelslist.g must match the manifest.
  • Private repositories work through GITHUB_TOKEN or the gh login.
  • The FTP path and the pre-2.0 trace listing are removed.

Publishing

Not part of this repository. The release assets are produced by the publish-trace-release skill in the AALP accel-sim-research plugin (purdue-aalp/AALP-claude-plugins#25).

Release notes

Release plan

  1. In progress: v2.0.1 is a pre-release, currently on dev acc3ab9, and the H200 ML traces are being published to it. That is 20 argument sets and 8942 kernels; a few kernels that do not complete in simulation are left out.
  2. Merge this PR.
  3. Move the v2.0.1 tag to the merge commit. The release keeps its assets.
  4. Tag gpgpu-sim_distribution v2.0.1 (dev, d922cf39). Set the release date in the notes, and mark the release official.

Testing

  • The first version of the download script was tested on a private test release: DLRM (1 part) and BERT 32_256 (3 parts) extracted byte-identical to the source. The standard-layout version will be re-tested against the v2.0.1 pre-release once the upload finishes.
  • run_simulations.py and plot-correlation.py are unchanged. Their directory lookups are already covered by CI.

🤖 Generated with Claude Code

JRPan and others added 5 commits October 20, 2026 14:12
…he FTP server

get-accel-sim-traces.py now reads manifest.json from a GitHub release, lists the
available GPU/workload/argument sets, downloads the selected tar parts (each under
2 GB), checks every part and the whole tar against SHA-256, and extracts them to
hw_run/traces/<GPU>/<workload>/<args>/. Private repositories use GITHUB_TOKEN or the
gh login. The old FTP trace listing is removed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
publish-trace-release.py packs one tar per GPU/workload/argument set, splits it
under GitHub's 2 GiB asset limit, uploads the parts and writes manifest.json plus a
README.md with download instructions. ncu_stats.csv now sits beside traces/ so the
extracted directory works with both run_simulations.py -T and plot-correlation.py -H.
get-accel-sim-traces.py defaults to the v2.0.1 release of accel-sim-framework.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Trace sets now ship as <GPU>/traces/device-0/<cuda>/<workload>/<args>/traces/ plus the
Nsight Compute stats in <GPU>/device-0/<cuda>/<workload>/<args>/, extracted under
hw_run/, so run_simulations.py -T and plot-correlation.py -H use them directly. Only
the kernels listed in each kernelslist.g are packed. The manifest moves to format 2
with per-set trace and hardware directories, and the download checks that every
member stays inside them and that the kernel count matches.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Publishing now lives in the publish-trace-release skill of the AALP accel-sim-research
plugin; the repository keeps only the download side.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@JRPan
JRPan force-pushed the trace-release-download branch from 75f17b5 to b8861f2 Compare October 20, 2026 18:12
JRPan and others added 4 commits October 20, 2026 15:37
main-sass (smoke and full), main-tracer and the weekly jobs launch with
--per-kernel --array -M 10G (SIM_PER_KERNEL in lib/common.sh) and verify
with --per-kernel-dirs, as the weekly ML job already did. A long kernel no
longer serialises the rest of its app or delays its failure: the
cutlass_48 warp-specialized GEMMs failed at kernel 4 only after 2-3h of
kernels 1-3. main-docker is unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
They were copied into accel-sim/H200/hw_run (device-7) from the
H200_ml_traces layer, with the same 29 kernels and HW rows left out; the
CI no longer reads another user's depot.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…v2.0.1 release notes

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@JRPan
JRPan merged commit 3ce4795 into accel-sim:dev Oct 20, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant