carlgleisner
Hi all,
After having read about SmolDocling 
for parsing PDF:s I’m really keen to give it a spin as an alternative to the Azure Document Intelligence service (possibly!) 
SmolDocling is a multimodal Image-Text-to-Text model designed for efficient document conversion. It retains Docling’s most popular features while ensuring full compatibility with Docling through seamless support for DoclingDocuments .
However, I do realise that I cannot expect this model to work on Bumblebee out of the gate.
In another post Jonathan Klosko commented on use of a “receipts model” where a few required features were missing in Bumblebee. It would be reasonable to assume that this would be the case for SmolDocling as well.
** (ArgumentError) could not match the class name "Idefics3ForConditionalGeneration" to any of the supported models, please specify the :module and :architecture options
(bumblebee 0.6.3) lib/bumblebee.ex:434: Bumblebee.do_load_spec/4
(bumblebee 0.6.3) lib/bumblebee.ex:603: Bumblebee.maybe_load_model_spec/3
(bumblebee 0.6.3) lib/bumblebee.ex:591: Bumblebee.load_model/2
#cell:t4ttbdzq2pvyqvx7:1: (file)
Is there any reasonable path to have SmolDocling running on Bumblebee? If so, what would that entail?
Thank you in advance for any input!
Kind regards,
Carl
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Enabling companies to succeed by building software people love.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #phoenix_html
- #iex
- #graphql
- #ai
- #genstage
- #elixirconf-us
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Bringing learning, work and compliance together since 1987.
Enabling companies to succeed by building software people love.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 3- Show Best Posts
- Show All Posts (oldest first)
- Show All Posts (newest first)
pshoukry
The model has an onnx version maybe you can try Ortex? GitHub - elixir-nx/ortex: ONNX Runtime bindings for Elixir · GitHub
franc
@carlgleisner did you by chance get this to work?
carlgleisner
I haven’t had the time yet but I was very grateful for @pshoukry‘s tip.
The Python tooling around SmolDocling seems really nice (to me) so
pythonxcould be an option to get going quickly.Will return to this post once I can find the time of course.