JohannesGaessler's picture
CUDA: int8 tensor cores for MMQ (q4_K, q5_K, q6_K) (llama/7860)
154bf2b