Instructions to use unity/inference-engine-whisper-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- unity-sentis
How to use unity/inference-engine-whisper-tiny with unity-sentis:
string modelName = "[Your model name here].sentis"; Model model = ModelLoader.Load(Application.streamingAssetsPath + "/" + modelName); IWorker engine = WorkerFactory.CreateWorker(BackendType.GPUCompute, model); // Please see provided C# file for more details
- Notebooks
- Google Colab
- Kaggle
Cannot import .onnx files into Unity
I have downloaded the model files (decoder_model.onnx, decoder_with_past_model.onnx, encoder_model.onnx and logmel_spectrogram.onnx) and imported them into Unity with Sentis 2.1.1, however, I'm getting errors such as "Asset import failed, "Assets/Model/decoder_model.onnx" > InvalidProtocolBufferException: Protocol message contained a tag with an invalid wire type.
".
It would be really great to see an example of how to use the current model files into a Unity project to be able to run Whisper through Sentis.
I got this issue as well. Waiting for the solution. :(
It would be really great to see an example of how to use the current model files into a Unity project to be able to run Whisper through Sentis.
The repo is a Unity project.
Just git clone https://huggingface.co/unity/sentis-whisper-tiny and add the existing project to Unity.
For my project I did not explicitly import onnx files into Unity - just copied them manually in windows file explorer.
hey how did you guys solve it in the end? the git clone link provided above doesn't work for me either :/