Sorry for the noise…

I added Image, and used the from_nx to transform resulting image to Vix.Vips.Image

From there it’s possible to dump a jpg.

Here is the sample with the default parameters (“numbat, forest, high quality, detailed, digital art”, “darkness, rainy, foggy”)

test512×512 40 KB

Have a nice weekend

I ended up using stb_image for that, then it gets pretty straighforward:

  @spec tensor_image_to_base64(Nx.Tensor.t()) :: String.t()
  defp tensor_image_to_base64(tensor) when is_struct(tensor, Nx.Tensor) do
    "data:image/png;base64,#{tensor |> StbImage.from_nx() |> StbImage.to_binary(:png) |> Base.encode64()}"
  end

Bumblebee is really cool though, I got to play with it and was really impressed, here’s the result sample app with few models: GitHub - bcat-eu/jimmy: Your friendly robot · GitHub

I’ve just now finished up the first integration between Image and Bumblebee which is image classification. I haven’t looked at StableDiffusion integration - will take a look and see what that might look like (but maybe not til early new year unless someone would like to dive in and contribute). I’m also looking forward to the work @seanmor5 is considering for object detection and image segmentation.