Skip to content

Preserve leading ray batch dimensions during volume compositing - #3799

Open
Afloat16 wants to merge 1 commit into
nerfstudio-project:mainfrom
Afloat16:fix/ray-batch-compositing
Open

Afloat16 wants to merge 1 commit into
nerfstudio-project:mainfrom
Afloat16:fix/ray-batch-compositing

Conversation

@Afloat16

Copy link
Copy Markdown

Problem

Volume-compositing weight helpers must preserve all leading ray-batch dimensions rather than relying on a flat batch. Incorrect singleton construction and concatenation dimensions can break multi-axis batches.

Change

Build leading singleton and transmittance tensors with the full ray-batch shape, preserving the sample axis and dtype across both alpha- and density-based weight paths.

Regression coverage

New CPU regressions exercise scalar, one-dimensional and multi-dimensional ray batches in float32/float64, comparing alpha-based and density-based transmittance against direct expressions. Historical baseline-versus-fix focused results were prepared on the source branch; they were not rerun in this handoff.

The upstream contribution guide requires the full ns-dev-test checks to pass. Existing Afloat16 Nerfstudio PRs show Core and Docker failures; this new PR has no own hosted CI. No GPU/rendering-quality benchmark is claimed.

The density and alpha compositing helpers are annotated for arbitrary leading ray batch dimensions, but create identity prefixes from only the first batch axis. The alpha helper also accumulates and slices along dimension 1. Unbatched rays and image-shaped ray batches consequently fail or composite along the wrong axis.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant