I was considering how I could build something straightforward that might be improved by SIMD (like matrix math) but it feels like I’m missing something.
The status quo is the very first step to enable this (like 10%). It only allows generating MLIR vector types and generate CPU code to process them. To really make it things really “out of box”, we need to compile the vector types to native SIMD instructions on CPU or GPU. (At this point, I am not sure how far I can push it forward. Maybe I need to find ways to raise money to find people solve problems I can’t solve)
The general plan is to implement equivalent functions to SIMD in mojo: https://docs.modular.com/mojo/stdlib/builtin/simd/SIMD/
- Vector type in MLIR: 'vector' Dialect - MLIR
- Instructions of different targets
https://mlir.llvm.org/docs/Dialects/X86Vector/
'arm_neon' Dialect - MLIR
'ArmSME' Dialect - MLIR