Add support for quantization and custom audio context size to OpenVino#2184

Open

dscripka wants to merge 2 commits intoggerganov:masterfrom dscripka:openvino_audio_ctx_quantize

+43-6

Commits on May 24, 2024

updated openvino converstion script to support different audio context sizes as well as 4/8 bit quantization with nncf
dscripka
committed

Commits on May 25, 2024

updated nncf version to match openvino install
dscripka
committed