dominicletz

dominicletz

Creator of Elixir Desktop

Hey there,

for a side project I needed to store more than those max. 2gb that the builtin :dets supports and so I created this new pure Elixir library DetsPlus.

It has mostly the same API but is a more Elixir friendly as it supports the Enum protocol and structs/maps!. So you can do Enum.reduce() and friends on it.

When storing maps/structs we have to specify as kepos the field name instead of the element index for tuples. E.g. here an example storing maps with DetsPlus:

{:ok, dets} = DetsPlus.open_file(:example, keypos: :id)
DetsPlus.insert(dets, %{id: 1, value: 42})
[{%id: 1, value: 42}] = DetsPlus.lookup(dets, 1)
# or using the Enum protocol:
[{%id: 1, value: 42}] = Enum.to_list(dets)
:ok =  DetsPlus.close(dets)

It’s using a constant database approach inspired by D.J. Bernsteins CDB library https://cr.yp.to/cdb.html - and so key lookups are extremely efficient even though it’s going to disk. Also when updating the database the whole file is being replaced atomically making DetsPlus great for embedded and Nerves use cases where power might be gone at any time.

Docs: DetsPlus — DetsPlus v2.4.4
Github: GitHub - dominicletz/dets_plus: Pure Elixir disk backed key-value store. · GitHub

Add it to your deps and let me know any feedback!

def deps do
  [
    {:dets_plus, "~> 2.1"}
  ]
end

Showing Posts 1 to 3

richgal

richgal

Hi @dominicletz ,

Thanks for sharing this module, I immediatly started using it :slight_smile:

I ran into one issue. When I call the DetsPlus.close function a PagedFile process stays alive in hibernated mode and spawn a new process every time I call DetsPlus.open_file or DetsPlus.lookup.

Am I missing something and this the normal working of this module?

I made a github issue also, to help with follow up.

dominicletz

dominicletz OP

Creator of Elixir Desktop

Thanks @richgal that’s fixed!

richgal

richgal

Happy to hear, I’ll try out soon. I’m planning to use DetsPlus in a production app.

— All posts loaded —

Where Next? Top

Trending in Announcing Top

woylie
Flop is an Elixir library that applies filtering, ordering and pagination parameters to your Ecto queries. offset-based pagination with...
New
MRdotB
I needed to reuse React components from my Chrome extension in my Phoenix/LiveView backend. I noticed that for Svelte/Vue, there are live...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
fuelen
Hi all! I want to present a small library which provides a mix task for generating an Entity-Relationship Diagram for Ecto schemas. You...
New
anuaralfetahe
Hello Published a new library - ProcessHub! ProcessHub is a library designed to manage process distribution within the Elixir cluster. ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Dmk
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New
AstonJ
This showed up on my feed.. anyone heard of it? Just hype? Ox Alpha is a reasoning model designed for coding, sustained ag...
New
sergio
It’s not that it’s vocabulary is too advanced. It’s something worse. I get lost trying to follow even a paragraph written by Claude. It’...
New
sorenone
Today we’re releasing Oban for Python. Not an Oban client in Python. Not a pythonx wrapper embedded in Elixir. Nope, it’s a fully operati...
New
akoutmos
@hugobarauna, Dr. Dimitrios Koutmos (my brother) and I (Alex Koutmos) have been hard at work on writing a book on how you can use Elixir ...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews