Rich_Morin

Rich_Morin

How to access memory-mapped image files (eg, using a NIF)?

The Magick Persistent Cache (MPC) is a memory-mapped file of pixels, used to store image data. ImageMagick maps this into memory, then accesses desired sets of pixels by indexing into the array. Each array element contains a single-precision (32 bit) float for each channel (eg, R, G, B, A).

I’d like to do something similar in Elixir. I assume that I could use a NIF to handle the memory mapping and binary pattern matching to access the pixels, but I’m clueless about the details. Might anyone have a clue (or better, code) to do this sort of thing?

-r

Most Liked

CptnKirk

CptnKirk

There’s a chance you get this with OTP 21. They’re moving the file and network io over to NIFs. Try and see if OTP 21’s File.open supports what you’re looking for. Although, I suspect they’re shooting for feature parity, and not added functionality for this release.

In OTP 20 you’d find the data you care about, (or whole file) read that into iodata, then File.open the iodata as ram. That should give a FD for additional File based calls. However, I think you’re still operating in memory at this point without transparent disk syncing. When you’re done with your memory FD copy, you’d write the iodata back out to disk yourself.

Or…you can write your own NIF based io subsystem. Nifsy (GitHub - ericentin/nifsy: A nifty NIF for the FS, providing faster filesystem operations for Elixir · GitHub) exists. Doesn’t directly support mmap’d files, but does show how a NIF based IO library can be written.

Where Next?

Popular in Questions Top

chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New
SoCreat
i’m a new one to elixir which editor can i use vs code? or atom? Thanks! :smiley:
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New
sergio_101
I am VERY much an elixir newbie. I have taken one elixir course and one phoenix course on Udemy. During that course, I saw the instructor...
New
dblack
I’ve got an issue with an app and I’ve no idea of how to troubleshoot it. I’m hoping someone here might have seen something similar. I p...
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list. ...
New
dotdotdotPaul
Okay, I’m having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I’m sure I’...
New

Other popular topics Top

malloryerik
Hi, this is for people who, like me, have had some friction using .html.heex templates in VSCode. The solution seems to be, in a hyphena...
New
lastday4you
I wanted to check elixir version in phoenix because i found that my elixir is 1.5 but when i use Enum.chunk_by it said the function is un...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod – where is this set? Thanks.
New
Lily
In templates/appointment/index.html.eex: <%= for appointment <- @appointments do %> <tr> <td><%= appoi...
New
pmjoe
I have a relationship of love and hate with Elixir. Lots of things are just absolutely right, but there are some things that are kind of ...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
belgoros
I’m not a pro in using Regex and can’t figure out why the following behaviour happens, especially if we take into account the difference ...
New
jason.o
In the code below, if the create action is not set to accept “extra_key” as an input, it errors out with a message shown above. Is there ...
New
PeterCarter
There are pre-rolled solutions for other frameworks that do work. However, Phoenix does not seem to have these. Have people had good expe...
New

We're in Beta

About us Mission Statement