@jonatanklosko what you wrote in your response makes total sense but it seems to either conflict or is just a different way of saying what is in the Bumblebee docs here … https://github.com/elixir-nx/bumblebee/tree/main/examples/phoenix#configuring-nx
My question is … Is there a reason or benefit to doing it one way or another? Because I tried it the way its explained in the bumblebee doc and I’m still getting a OOM error.






















