Repository navigation
当前的QNN后端是否能够支持模型推理? #3
Answered
by
chraac
FranzKafkaYu
asked this question in
Q&A
|
@chraac Hi,作者你好。想问一下当前仓库的代码是否已经支持模型推理,还是说只是实现了部分算子?我可以基于当前版本的QNN后端部署大模型吗 |
Answered by
chraac
Sep 19, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
你好,现在matmul的这个算子还有问题,然后还有一个分支在重构中,具体可以看看这个PR(#2 )里面的说明,对代码有相关疑问也可以在里面讨论