Similar to Llama 3 quants comparison, Benchmarking effects of quantization, Mistral-Large 35GB quantization, and exl2 quantization, but they document that they are using ollama as the backend, and Similar to Llama 3 quants comparison, Benchmarking effects of quantization, Mistral-Large 35GB quantization, and exl2 quantization, but they document that they are using ollama as the backend, and Ollama-MMLU-Pro as the evaluation tool. as the evaluation tool.