alvises

alvises

Hi everyone,

I’d like this thread to serve as a common place to track the ongoing development of Hailo8 M.2 support on Nerves. I know some community members are actively working on this integration.

For those unfamiliar, the Hailo8 is an AI processor, offering high-performance, low-power machine learning acceleration. It connects via PCIe to the RPi5 and is ideal for applications requiring efficient neural network inference.

  • With the hailo-driver branch of the official Nerves Raspberry Pi 5 system repository (nerves_system_rpi5), the Hailo8 device is successfully recognized when connected via PCIe. I think it needs some firmware file though.

  • Additionally, Gus is working on integrating HailoRT (Hailo’s runtime SDK) into Nerves. Here’s the repo GitHub - gworkman/hailo_rpi5 at add_hailo · GitHub

Showing Posts 1 to 10

D4no0

D4no0

What kind of applications we talk about? Training models on this hardware or using it to serve pre-trained models?

alvises

alvises OP

Mostly inference, I think it should be great for things like vision, robotics etc.. Yolov8n runs at 55fps (~8ms inference time) on it (compared to MacBook Air M3 which runs the same model at ~14ms).

D4no0

D4no0

Damn, really nice! It’s great that hardware for this became so accessible, 5 years ago this kind of technology would have costed you an arm and a leg.

alvises

alvises OP

Absolutely agree! I’ve just added a picture to the first post to highlight how compact the form factor is.

joevandyk

joevandyk

Any updates on this? I’m looking at doing a computer vision project (trying to setup cameras to detect certain activities) and wondering if this would be useful.

lawik

lawik

Nerves Core Team

It exists and works. Kind of an early version but Paulo and Vittoria took the efforts Cocoa, @gus and I put into making the driver work, swore at it, cursed our names, made it work again, gave us credit and then implemented the Elixir parts.

Then they made a yolo model work with some help from @alvises.

They showed it all off in Stockholm recently.

Their repo:
https://github.com/vittoriabitton/nx_hailo

Most news like this lands in the Nerves Newsletter even when I don’t remember to find all places it has been discussed to update on the situation :slight_smile:

alfredfriedrich

alfredfriedrich

Any chance that the talk was recorded and will be published? I see the keynotes are available on YT, but no further recordings.

lawik

lawik

Nerves Core Team

They usually release keynotes early and then talks at some schedule. Will check if they can push it up the queue since it is a bit timely.

fhunleth

fhunleth

Co-author of Nerves

The Hailo AI accelerators are now supported in Nerves out-of-the-box on Raspberry Pi 5’s with the AI hat or M.2 AI module. The nx_hailo repository has been updated to reference it and there’s a short mention in the nerves_system_rpi5 release notes.

lawik

lawik

Nerves Core Team

I think they should be usable with a Pi4 as well. Though I think it requires a different thing for the PCI/PCIe bus. I believe Seeed Studio had some charts about performance for that.

Probably not worth shipping by default though.

Where Next? Top

Trending in Discussions Top

budgie
A little off-topic, but I feel like people here have a good head on their shoulders. I used to be quite good at making software. Was luc...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
axelson
Hi there! :wave: @frigidcode and I (but mostly him) have been running an Elixir Book club, we’re almost done with Designing Elixir Syste...
New
achempion
I’ve been using Emacs as my main code editor for more than a two years. It’s a custom build version although I’ve tried doom emacs and sp...
New
budgie
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with. But I don’t use it anymore. Serverless was the promis...
New
jtormey
Lately I’ve been thinking about how to organize components as a LiveView application grows. One of the pain points I’ve found (for myself...
New
Null-logic-0
What IDE or editor are you using for Elixir development? Personally, I use Zed, and I really like it, but sometimes I wish there were a ...
New

Other Trending Topics Top

KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New
kip
In 2021 I started a new library called Tempo with the objective of modelling time as a set of intervals - not as instants. In 2022 I gave...
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews