ourway
** WARNING ** Mnesia is overloaded: {:dump_log, :write_threshold}
What is this and what to do about it? (For dummies please)
Most Liked
ConnorRigby
cmkarlsson
You can (and probably should) use sync transactions as mentioned in the linked blog post. And it may be worth playing around with the dump threshold settings but in general the overload event means your system is doing more than it is capable of. If these events keep coming you need to have more resources. If the overload is just temporary it is fine. (I.e a short burst of writes coming in).
That said, one thing that helps with performance is to limit the number of concurrent writers. In my experience having 1 writer per scheduler seems to work pretty well. I think I picked this up from a talk from WhatsApp but can’t remember
You can also subscribe to the overloaded event and try to be proactive by using a circuit breaker of some sort (GitHub - jlouis/fuse: A Circuit Breaker for Erlang · GitHub for example). If you run mnesia in a distributed setting this may be a bit harder.
One talk that that briefly mentions this is Mnesia for the CAPper (Erlang Factory - Ulf Wiger, Uber Erlang programmer and CTO of Erlang Solutions) (I’m sure there is a video somewhere as well). This talk also contains a few other things that is good to know about mnesia.
Popular in Questions
Other popular topics
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance









