ndrean
Image-To-Text model recommendation
I tried the 3 “standard” Image-To-Text models for image captioninng: “facebook/deit-base-distilled-patch16-224” and “microsoft/resnet-50” and "“google/vit-base-patch16-224”.
Results are poor, at least as low as the score 
This car is predicted as:
%{predictions: [%{label: "speedboat", score: 0.136890709400177}]}
Among the 280 proposed I2T models by Hugging Face, does anyone has a recommendation?
First Post!
jonatanklosko
Are you looking for “Image classification” (pick one of predefined labels) or “Image-to-text” (describe image with text)? Also, how are you making the prediction? You can use Livebook Neural network smart cell to explore the various models, here’s one example per each of the tasks:
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Catch errors, track performance, monitor hosts and more.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"