ndrean
Image-To-Text model recommendation
I tried the 3 “standard” Image-To-Text models for image captioninng: “facebook/deit-base-distilled-patch16-224” and “microsoft/resnet-50” and "“google/vit-base-patch16-224”.
Results are poor, at least as low as the score 
This car is predicted as:
%{predictions: [%{label: "speedboat", score: 0.136890709400177}]}
Among the 280 proposed I2T models by Hugging Face, does anyone has a recommendation?
First Post!
jonatanklosko
Are you looking for “Image classification” (pick one of predefined labels) or “Image-to-text” (describe image with text)? Also, how are you making the prediction? You can use Livebook Neural network smart cell to explore the various models, here’s one example per each of the tasks:
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Enabling companies to succeed by building software people love.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #javascript
- #code-sync
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Practical resources that improve the lives of professional developers.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"