alvises
Hi everyone,
I’d like this thread to serve as a common place to track the ongoing development of Hailo8 M.2 support on Nerves. I know some community members are actively working on this integration.
For those unfamiliar, the Hailo8 is an AI processor, offering high-performance, low-power machine learning acceleration. It connects via PCIe to the RPi5 and is ideal for applications requiring efficient neural network inference.
-
With the
hailo-driverbranch of the official Nerves Raspberry Pi 5 system repository (nerves_system_rpi5), the Hailo8 device is successfully recognized when connected via PCIe. I think it needs some firmware file though. -
Additionally, Gus is working on integrating HailoRT (Hailo’s runtime SDK) into Nerves. Here’s the repo GitHub - gworkman/hailo_rpi5 at add_hailo · GitHub
Trending in Discussions
Other Trending Topics
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixir-ls
- #ai
- #elixirconf-us
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #hex
- #security
- #metaprogramming











Showing Posts 1 to 10- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
D4no0
What kind of applications we talk about? Training models on this hardware or using it to serve pre-trained models?
alvises
Mostly inference, I think it should be great for things like vision, robotics etc.. Yolov8n runs at 55fps (~8ms inference time) on it (compared to MacBook Air M3 which runs the same model at ~14ms).
D4no0
Damn, really nice! It’s great that hardware for this became so accessible, 5 years ago this kind of technology would have costed you an arm and a leg.
alvises
Absolutely agree! I’ve just added a picture to the first post to highlight how compact the form factor is.
joevandyk
Any updates on this? I’m looking at doing a computer vision project (trying to setup cameras to detect certain activities) and wondering if this would be useful.
lawik
It exists and works. Kind of an early version but Paulo and Vittoria took the efforts Cocoa, @gus and I put into making the driver work, swore at it, cursed our names, made it work again, gave us credit and then implemented the Elixir parts.
Then they made a yolo model work with some help from @alvises.
They showed it all off in Stockholm recently.
Their repo:
https://github.com/vittoriabitton/nx_hailo
Most news like this lands in the Nerves Newsletter even when I don’t remember to find all places it has been discussed to update on the situation
alfredfriedrich
Any chance that the talk was recorded and will be published? I see the keynotes are available on YT, but no further recordings.
lawik
They usually release keynotes early and then talks at some schedule. Will check if they can push it up the queue since it is a bit timely.
fhunleth
The Hailo AI accelerators are now supported in Nerves out-of-the-box on Raspberry Pi 5’s with the AI hat or M.2 AI module. The
nx_hailorepository has been updated to reference it and there’s a short mention in thenerves_system_rpi5release notes.lawik
I think they should be usable with a Pi4 as well. Though I think it requires a different thing for the PCI/PCIe bus. I believe Seeed Studio had some charts about performance for that.
Probably not worth shipping by default though.