Add Support for mac armv9 support, with A16W8 quantization. #63

Open

Assignees

Labels

opened

need port to mac (M4 + ) ARMv9
disable openMP (because default xcode clang not support openMP)
enable a16w8 quantization support to reduce RAM requirement.

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

kzjeef

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests