exfrmdlrstu
I’m getting errors when trying to use {:local, cache_dir} in Bumblebee’s load_model function. Checking the cache directory using cache_dir(), I was able to locate the models that I previously downloaded, but the files inside are hashed. Is there any way I could use the downloaded models so I can call each model on demand and not use too much memory/storage?
Here is an example code that I use to load from the cache if the model is already downloaded:
defp maybe_load_from_cache(whisper_model) do
{_, model} = whisper_model
model_path = String.replace(model, "/", "--")
cache_dir = Path.join(Bumblebee.cache_dir(), "huggingface/#{model_path}")
case File.ls(cache_dir) do
{:ok, _files} ->
{:local, cache_dir}
_ ->
whisper_model
end
end
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
We build reliable cloud platforms for business-critical systems.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixirconf-us
- #blog-post
- #ai
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #hex
- #security
- #metaprogramming
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Producing high quality Elixir screencasts since 2017.
**Building the future of software with AI, trust, and human connection.**
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 2- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
jonatanklosko
Hey @exfrmdlrstu! There are two distinct bits:
The
:localsource allows you to point to a local directory that follows the usual structure of a HuggingFace Hub repository. For example, you couldgit clonea repository such as google-bert/bert-base-uncased and then use{:local, path_to_dir}to load from there.The internal cache, where bumblebee downloads the individual files from a remote repository. This cache is opaque and Bumblebee uses it to only download the given model/tokenizer file once. When you call
Bumblebee.load_model/1second time, it only makes a quick request to the HuggingFace repo to make sure the remote file hasn’t changed, and if it hasn’t, then simply reuses the one downloaded previously. You can actually disable all networking by settingBUMBLEBEE_OFFLINE=1env var, or by loading from{:hf, "org/repo", offline: true}(if the model is not in the cache yet, the function raises).Looking at your snippet specifically, I think what you are trying to do is what
Bumblebee.load_model/1already does by default, as described above. Let me know if I missed something : )exfrmdlrstu
I see, so that’s what Bumblebee’s cache is for. This makes a lot of sense. Looks like I don’t need to worry using
load_modelon demand. Thank you for this, @jonatanklosko !