Nerves RPi5 Hailo8 M.2 AI module support

Nerves Forum Nerves Chat
,
1

Hi everyone,

I’d like this thread to serve as a common place to track the ongoing development of Hailo8 M.2 support on Nerves. I know some community members are actively working on this integration.

For those unfamiliar, the Hailo8 is an AI processor, offering high-performance, low-power machine learning acceleration. It connects via PCIe to the RPi5 and is ideal for applications requiring efficient neural network inference.

  • With the hailo-driver branch of the official Nerves Raspberry Pi 5 system repository (nerves_system_rpi5), the Hailo8 device is successfully recognized when connected via PCIe. I think it needs some firmware file though.

  • Additionally, Gus is working on integrating HailoRT (Hailo’s runtime SDK) into Nerves. Here’s the repo GitHub - gworkman/hailo_rpi5 at add_hailo

RPi5 with Hailo8
RPi5 with Hailo81080×810 90.3 KB

5 Likes
2

What kind of applications we talk about? Training models on this hardware or using it to serve pre-trained models?

3

Mostly inference, I think it should be great for things like vision, robotics etc… Yolov8n runs at 55fps (~8ms inference time) on it (compared to MacBook Air M3 which runs the same model at ~14ms).

1 Like
4

Damn, really nice! It’s great that hardware for this became so accessible, 5 years ago this kind of technology would have costed you an arm and a leg.

1 Like
5

Absolutely agree! I’ve just added a picture to the first post to highlight how compact the form factor is.

2 Likes