pstore

exl2 quantization

1 min read

tags
huggingface
https://huggingface.co/LoneStriker/Aetheria-L2-70B-2.4bpw-h6-exl2-2
github
https://github.com/turboderp-org/exllamav2
post_id
t3_18eyf39
post_code
pe, spc
url
https://kweel.pythonanywhere.com/post/t3_18eyf39?file=topic_11.csv
comment_codes
  • adm: 5
  • kse: 5
  • kdr: 4
  • apf: 1
  • atu: 1
  • fb: 1
  • gut: 1
  • ksb: 1
  • ksk: 1
  • rqo: 1
  • rsc: 1
  • wok: 1

New quantization method that decreases the perplexity of low BPW quants.

Graph View

Backlinks