Whisper model files in custom ggml format

Model files for testing purposes The model files prefixed with for-tests- are empty (i.e. do not contain any weights) and are used by the CI for testing purposes. They are directly included in this repository for convenience and the Github Actions CI uses them to run various sanitizer tests. Fine-tuned models There are community efforts for creating fine-tuned Whisper models using extra training data. For example, this blog post describes a method for fine-tuning using Hugging Face (HF) Transformer implementation of Whisper. The produced models are in slightly different format compared to the original OpenAI format. To read the HF models you can use the convert-h5-to-ggml.py script like this: git clone https://github.com/openai/whisper git clone https://github.com/ggml-org/whisper.cpp # clone HF fine-tuned model (this is just an example) git clone https://huggingface.co/openai/whisper-medium # convert the model to ggml python3 ./whisper.cpp/models/convert-h5-to-ggml.py ./whisper-medium/ ./whisper . Distilled models Initial support for https://huggingface.co/distil-whisper is available. Currently, the chunk-based transcription strategy is not implemented, so there can be sub-optimal quality when using the distilled models with whisper.cpp. # clone OpenAI whisper and whisper.cpp git clone https://github.com/openai/whisper git clone https://github.com/ggml-org/whisper.cpp # get the models cd whisper.cpp/models git clone https://huggingface.co/distil-whisper/distil-medium.en git clone https://huggingface.co/distil-whisper/distil-large-v2 # convert to ggml python3 ./convert-h5-to-ggml.py ./distil-medium.en/ ../../whisper . mv ggml-model.bin ggml-medium.en-distil.bin python3 ./convert-h5-to-ggml.py ./distil-large-v2/ ../../whisper . mv ggml-model.bin ggml-large-v2-distil.bin