gorghoa
Hi!
We are using Bumblebee.Audio with whisper. It works pretty well and we are enjoying it.
We would like to enhance some domain specific words transcription though, we saw that Whisper can have an extra textual prompt for this (see Whisper prompting guide ).
We did not find a way to leverage this prompting facilities with Bumblebee.Audio. Is this correct?
If whisper prompting is not yet available within bumblebee, what would it take to implement it? With some guiding, maybe we could help?
Thanks!
Rodrigue
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Supporting innovation across the BEAM ecosystem.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ai
- #ecto-query
- #elixirconf-us
- #blog-post
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #metaprogramming
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Practical resources that improve the lives of professional developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
Bringing learning, work and compliance together since 1987.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 3- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
garrison
I didn’t dig very far, but it kinda looks like those tokens just get thrown into the decoder at the start like an LLM. I don’t see any explicit way to do this in the
Bumblebee.AudioAPI as it seems to offer only a high-level stream interface, but it probably wouldn’t be too hard to add.jstimps
Have you seen reliable results from prompting Whisper with the official python sdk? We have tried the method described in the linked blog post and found that the results are extremely sensitive to the contents of the prompt, to the point where changing a single
,to a.yielded very different results.As such we weren’t able to find a reliable way to actually effect the output. Curious to hear your experience!
garrison
This is just what LLMs are like when they’re not instruction-tuned (time flies). Now you see why ChatGPT was so popular
I know multimodal instruction-tuned LLMs exist. I don’t know anything about using them for speech-to-text, but I imagine it has been done.