TypeError: quantize_dynamic() got an unexpected keyword argument 'activation_type' #75
premkumarelangovan
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am getting the error while quantizing the onxx_model on FastT5. The problem appears to be with the line 'activation_type=QuantType.QUInt8', please see the tracebelow. I would appreciate some help.
TypeError Traceback (most recent call last)
in <cell line: 2>()
1 #Step 2(recommended) quantize the converted model for fast inference to reduce model size
----> 2 quant_model_paths = quantize(onnx_model_paths)
/usr/local/lib/python3.10/dist-packages/fastT5/onnx_exporter.py in quantize(models_name_or_path)
264 model_name = model.as_posix()
265 output_model_name = f"{model_name[:-5]}-quantized.onnx"
--> 266 quantize_dynamic(
267 model_input=model_name,
268 model_output=output_model_name,
TypeError: quantize_dynamic() got an unexpected keyword argument 'activation_type'
Beta Was this translation helpful? Give feedback.
All reactions