Fl4m3Ph03n1x

Fl4m3Ph03n1x

I have been reading the ETS documentation and upon checking :ets.update_counter (which is supposed to be atomic and isolated) I read the following:

(The update is done atomically, that is, no process can access the ETS table in the middle of the operation.)

Is this a typo?
Does this really mean that updating a single counter locks the entire table?

If this is true, then this is a huge setback to any concurrent system using ETS tables, right?

Showing Posts 1 to 6

ericmj

ericmj

Elixir Core Team

ETS has many kinds of locks, read and write locks, table and row locks so you don’t necessarily lock the whole table for updates. You can tweak how the locks are used with the read_concurrency and write_concurrency options when you create the table [1]. This is fairly recent paper on the implementation of ETS [2] if you want to learn more.

[1] ets — OTP 29.0.2 (stdlib 8.0.1)
[2] http://winsh.me/papers/erlang_workshop_2013.pdf

dimitarvp

dimitarvp

Atomic increment means that it’s not possible for anything else to happen during the operation (hence the “atomic” moniker). It does NOT mean it locks the entire ETS table. It means that nothing even has a chance of doing anything to the table while the increment is happening. A lock-free guaranteed atomic operation.

You might also want to look at Erlang’s :atomics module if you need such a functionality.

bjorng

bjorng

Erlang Core Team

Thanks for pointing this out. We will update that part of the documentation in OTP 21.3. See Clarify the atomic guarantees for ets:update_counter().

bjorng

bjorng

Erlang Core Team

If you are looking for efficient counters, the counters module was introduced in OTP 21.2. I recently used the counters module to speed up cover.

Fl4m3Ph03n1x

Fl4m3Ph03n1x OP

Thanks for the clarifications and the initiative. I really appreciate the effort !

Interesting that this is actually faster than :ets.update_counter and that it is also atomic.
Do the changes in the counter have isolation? From the description:

A is done sequencially before write operation B, then a concurrent reader may see none of them, only A, or both A and B.

I understand that a client can see 2 writes happening at the same time. Or perhaps my definition is atomic operations is not the one shared by the community:

an updating operation to a single object either succeeds or fails completely

Where isolation for me, is the guarantee no that clients cannot see intermediary sates.

OvermindDL1

OvermindDL1

As I recall, the :counters module is built on the :atomic module, which is restricted to only word-sized integers or so, and thus it uses hardware-level atomic instructions (CAS and so forth) to perform efficient updates, where :ets’s is more generically typed, unbounded integers, etc… etc…

— All posts loaded —

Where Next? Top

Trending in Questions Top

water
I’m aware of 2 such projects, are there others? git: GitHub - team-alembic/realworld: A fullstack Phoenix LiveView application with back...
New
katta
I having some trouble figuring out if I have set myself too strict of standards for my production server. Currently I can handle 75% of r...
New
peck
Hi everyone. My team and I have been working on a fairly modest app based around video streaming and chat, but we’ve landed a customer t...
New
bradley
I really like the adapter patterns that ecto, nebulex, waffle, etc. use and would love find something similar for a key management servic...
New
unaware8150
Hello folks! So at work, we are seeing some situations where we have to define some “fixed” strings that are used across the codebase in...
New
Alvinkariuki
How Can I Optimise Compile Time Dependencies I have been building an elixir application for about 2 years now. Many modules and files ha...
New
leoschweizer
Hi, we run different LLM models across a cluster, with each node loading a configurable subset. Model-specific queues let nodes consume ...
New

Other Trending Topics Top

budgie
A little off-topic, but I feel like people here have a good head on their shoulders. I used to be quite good at making software. Was luc...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
budgie
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with. But I don’t use it anymore. Serverless was the promis...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews