Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimized matrix multiplications for i-quants on __aarch64__ #464

Merged
merged 13 commits into from
Jun 8, 2024
Merged

Optimized matrix multiplications for i-quants on __aarch64__ #464

Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
bba8b88
Arm for i-quants
Kawrakow May 30, 2024
9347a82
Arm for i-quants: iq2_xxs
Kawrakow May 30, 2024
ffcb297
Arm for i-quants: iq3_s
Kawrakow May 30, 2024
79b3ba9
Arm for i-quants: iq3_xxs
Kawrakow May 30, 2024
6960310
Arm for i-quants: iq2_s
Kawrakow May 31, 2024
3fc3cd0
Arm for i-quants: iq2_xs
Kawrakow May 31, 2024
bf442bb
Arm for i-quants: abandoning special-casing Ny = 1
Kawrakow May 31, 2024
6f60746
Arm for i-quants: cleanup and disable iqk_mul_mat for Ny = 1
Kawrakow May 31, 2024
0609aa6
Arm for i-quants: holding the compiler's hand
Kawrakow Jun 1, 2024
eccc2c0
Arm for i-quants: iterating
Kawrakow Jun 1, 2024
91393f6
Arm for i-quants: iterating
Kawrakow Jun 3, 2024
7396ce0
Arm for i-quants: cleanup and comments
Kawrakow Jun 3, 2024
7a962c7
Remove forgotten experimental change in q3_K implementation
Kawrakow Jun 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading