sullyMusty

sullyMusty

Active Memory - A Simple ORM for ETS and Mnesia

active_memory is a package to help bring the power of in memory storage with ETS and Mnesia to your Elixir application.

ActiveMemory provides a simple interface and configuration which abstracts the ETS and Mnesia specifics and provides a common interface called a Store.

Downloads have exceeded 200,000 thus seems prudent to check in on it. Updated for changes in newer versions of Elixir and ran security checks and scans to ensure it is safe – all good!

Most Liked

sullyMusty

sullyMusty

Hi all :waving_hand: — a big update since I first announced ActiveMemory here.

v0.7 is now on Hex, and it’s grown from a simple ORM into a typed, attribute-queryable in-memory store for ETS and Mnesia — with the safety rails you’d want before trusting it with short-lived or sensitive data. Four highlights:

:locked: Atomic, take-once withdraw/1

withdraw/1 now fetches-and-deletes in a single atomic operation — :ets.select_delete/2 for ETS, a :mnesia.transaction/1 for Mnesia. Under concurrent access exactly one caller gets a given record; everyone else gets {:error, :not_found}. Great for one-time tokens and job-claim patterns:

{:ok, token} = TokenStore.withdraw(%{value: submitted_token})

:hourglass_not_done: TTL / record expiry

Give a table a ttl and its records expire automatically:

defmodule MyApp.Tokens.Token do
  use ActiveMemory.Table, type: :ets, ttl: :timer.hours(1)

  attributes do
    field(:value)
    field(:user_id)
  end
end

Enforcement is hybrid: a lazy read-filter means one/select/all/withdraw never return an expired record (exact and immediate), and a periodic sweep deletes them to reclaim memory (sweep_interval configurable, default 60s). Zero overhead for tables without a ttl.

:ring_buoy: Crash resilience (TableHeir)

An ETS table is owned by the process that creates it, so a Store crash used to mean losing the data. ActiveMemory now runs a tiny, stable heir process registered as the ETS :heir; on a crash the table transfers to it, and the restarted Store reclaims it — data intact. No configuration, no API change. (Mnesia tables were never affected — they already survive process crashes.)

:card_index_dividers: ActiveRepo — multiple tables, one process

For several tables under one supervised entry point:

defmodule MyApp.Repo do
  use ActiveMemory.ActiveRepo,
    tables: [MyApp.People.Person, MyApp.Tokens.Token]
end

MyApp.Repo.write(%Person{first: "Kara"})   # table inferred from the struct
MyApp.Repo.one(Token, %{value: raw})        # reads take the table explicitly

It’s named ActiveRepo (not Repo) so it won’t collide with your Ecto.Repo, and a single repo can mix ETS and Mnesia tables — each with its own ttl if you like.

Where it fits

ActiveMemory isn’t a cache — if you want key-based caching with eviction and hit/miss stats, Cachex and Nebulex are excellent. ActiveMemory is for structured records in memory that you query by their attributes:

SessionStore.select(%{user_id: user_id, active?: true})
StaffStore.select(match(:role == "admin" and :last_login < cutoff))

…the kind of query a key/value store can’t express without hand-rolled secondary indexes.

A note on concurrency

A question that came up at a conference recently: “isn’t the single GenServer a bottleneck?” No — the CRUD functions run in the caller’s process and delegate straight to the adapter, so reads/writes get full ETS/Mnesia concurrency. The GenServer only handles lifecycle, state, and the TTL sweep.


Docs: hexdocs.pm/active_memory · Repo: github.com/SullysMustyRuby/active_memory

Would love feedback, use cases, or contributions — and if anything in the new features doesn’t behave as documented, please open an issue. Thanks!

Last Post!

thiagomajesk

thiagomajesk

I kid you not, I was just trying to find this library on the forum yesterday, but I couldn’t remember the name, so I guess thanks for the reminder!? haha :see_no_evil_monkey:

I’ve been working on some games for the past few years, and I always end up creating custom loaders which end up being some version of this, so this library is going to be super helpful. Congratulations on the project! :rocket:

Where Next?

Popular in Announcing Top

bryanjos
Hi, I just published version 0.23.0 of Elixirscript. https://github.com/bryanjos/elixirscript/blob/master/CHANGELOG.md Most of the chan...
New
versilov
Could not wait for the missing Elixir ML libraries to appear, so, I wrote one myself, taking https://github.com/sdwolfz/exlearn as a foun...
New
anshuman23
Hello all, I have been working on my proposed project called Tensorflex as part of Google Summer of Code 2018.. Tensorflex can be used f...
New
maltoe
Hello! Came here to announce ChromicPDF, a pet project PDF generator I’ve been working on for the past few months. Why another PDF gener...
New
oltarasenko
Dear Elixir community, After a year of development, bug fixes, and improvements, we are proudly ready to share the release of Crawly 0.1...
New
nikokozak
Hello all, I’ve been working on Svonix - a library for quickly integrating Svelte components into Phoenix views. It’s a much-needed succ...
New
wojtekmach
Hey everyone! Req is an HTTP client for Elixir that I’ve been working on for quite some time. There is already a lot of HTTP clients out...
New

Other popular topics Top

grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 54092 488
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
jononomo
For some reason my phoenix channels are working for me in my local dev environment, but as soon as I deploy via Docker, I get a 403 error...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New

We're in Beta

About us Mission Statement