quantization Examples and Free Source Code

How to quantize a HF safetensors model and save it to llama.cpp GGUF format with less than q8_0 quan...

large-language-model huggingface quantization llamacpp

Why are model_q4.onnx and model_q4f16.onnx not 4 times smaller than model.onnx?...

deep-learning large-language-model huggingface onnx quantization

HuggingFace - 'optimum' ModuleNotFoundError...

python huggingface-transformers quantization modulenotfounderror pruning

Quantize Image using PIL and numpy...

image-processing python-imaging-library quantization

Does static quantization enable the model to feed a layer with the output of the previous one, witho...

neural-network artificial-intelligence onnx quantization static-quantization

Speeding up load time of LLMs...

huggingface-transformers large-language-model quantization

Llama QLora error: Target modules ['query_key_value', 'dense', 'dense_h_to_4h&#3...

python quantization large-language-model peft

How to set training=False for keras-model/layer outside of the __call__ method?...

tensorflow keras transfer-learning quantization tfmot

Diffrence between gguf and lora...

large-language-model quantization peft

Quantization and torch_dtype in huggingface transformer...

huggingface-transformers huggingface quantization

Image quantization with Numpy...

python numpy quantization

jpeg python 8x8 window DCT and quantisation process...

python huffman-code quantization dct

What's an elegant way to avoid "hopping" quantization errors when graphing a divergent...

c++qt sampling graphing quantization

There exists ONNX or Tensorflow CNN 4-bit quantized models available?...

tensorflow keras onnx quantization

What is the mathematical definition of the quantile transformation in xgboost.QuantileDMatrix?...

python machine-learning xgboost quantile quantization

Quantizing normally distributed floats in Python and NumPy...

python numpy floating-point k-means quantization

Tensorflow quantization process in detail - Anyone don't talk about this in detail...

python tensorflow tensorflow2.0 tensorflow-lite quantization

ValueError: Unsupported ONNX opset version: 13...

python pytorch onnx quantization onnxruntime

NeuQuant.js (JavaScript color quantization) hidden bug in JS conversion...

javascript neural-network quantization

How to quantize inputs and outputs of optimized tflite model...

python tensorflow-lite quantization google-coral

torch Parameter grad return none...

python deep-learning pytorch quantization

How do you find the quantization parameter inside of the ONNX model resulted in converting already q...

onnx yolov5 quantization tf2onnx

Why are some nn.Linear layers not quantized by Pytorch?...

pytorch quantization static-quantization

Method to quantize a range of values to keep precision when signficant outliers are present in the d...

python precision outliers quantization data-transform

network quantization——Why do we need "zero_point"? Why symmetric quantization doesn't ...

pytorch tensorflow-lite onnx quantization quantization-aware-training

Int8 quantization of a LSTM model. No matter which version, I run into issues...

python tensorflow tensorflow2.0 tensorflow-lite quantization

onnx.load() | ALBert throws DecodeError: Error parsing message...

python deep-learning onnx quantization onnxruntime

Reproducing arithmetic with pytorch's quantized tensors with numpy operations...

numpy pytorch quantization

Converting PyTorch to ONNX model increases file size for ALBert...

python pytorch onnx quantization onnxruntime

Use Quantization on HuggingFace Transformers models...

python deep-learning huggingface-transformers bert-language-model quantization