localllama
LocalLLaMA Wander 1 year ago 100%

What is better: higher quantiation or higher parameter count?

For example, does a 13B parameter model at 2_K quantiation perform worse than a 7B parameter model at 8bit or 16bit?

19
16
Comments 16