Skip to content

Fix attention_block_tkg d_head>128 decode Q/K layout corruption for batch>1 - #14

Open
jimburtoft wants to merge 1 commit into
aws-neuron:mainfrom
jimburtoft:fix/attention-block-tkg-d256-multibatch-layout
Open

jimburtoft wants to merge 1 commit into
aws-neuron:mainfrom
jimburtoft:fix/attention-block-tkg-d256-multibatch-layout

Fix attention_block_tkg d_head>128 decode Q/K layout corruption for b…

2ce2f1a
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs