Anyone tried to run Meta's Segment-Anything-Model in Elixir?

[herisson]

We finally got it to work!

Running facebook's segmentation model using ortex

Hi everyone, I recently took on a personal challenge of running Meta’s Segment Anything Model in Elixir. Since it’s not supported by Bumblebee, I started using Ortex to run ONNX models. Everything is mostly smooth, but my final masks are a bit distorted. Since it’s my first time using Nx/Ortex/ONNX, I’m struggling to figure out the problem. Could it be an issue with the ONNX model itself? Here is the outputs I’m getting: [Capture d’écran 2024-05-09 à 10.34.01] I’ve put my code into a gist…