beardedeagle
Mnesia crashing on nodeup in clustered configuration
I am running into a problem where mnesia is crashing on nodeup in clustered mode:
Mnesia('vanguard@test02'): mnesia_monitor starting: <0.259.0>
Mnesia('vanguard@test02'): Mnesia debug level set to verbose
Mnesia('vanguard@test02'): mnesia_subscr starting: <0.260.0>
Mnesia('vanguard@test02'): mnesia_locker starting: <0.261.0>
Mnesia('vanguard@test02'): mnesia_recover starting: <0.262.0>
Mnesia('vanguard@test02'): mnesia_tm starting: <0.263.0>
Mnesia('vanguard@test02'): Schema initiated from: default
Mnesia('vanguard@test02'): mnesia_controller starting: <0.265.0>
Mnesia('vanguard@test02'): mnesia_late_loader starting: <0.266.0>
Mnesia('vanguard@test02'): Intend to load tables: []
Mnesia('vanguard@test02'): mnesia_controller terminated: shutdown
Mnesia('vanguard@test02'): mnesia_tm terminated: shutdown
Mnesia('vanguard@test02'): mnesia_recover terminated: shutdown
Mnesia('vanguard@test02'): mnesia_locker terminated: shutdown
Mnesia('vanguard@test02'): mnesia_subscr terminated: shutdown
Mnesia('vanguard@test02'): mnesia_monitor terminated: shutdown
Mnesia('vanguard@test02'): mnesia_monitor starting: <0.280.0>
Mnesia('vanguard@test02'): Mnesia debug level set to verbose
Mnesia('vanguard@test02'): mnesia_subscr starting: <0.281.0>
Mnesia('vanguard@test02'): mnesia_locker starting: <0.282.0>
Mnesia('vanguard@test02'): mnesia_recover starting: <0.283.0>
Mnesia('vanguard@test02'): mnesia_tm starting: <0.284.0>
Mnesia('vanguard@test02'): Schema initiated from: default
Mnesia('vanguard@test02'): mnesia_controller starting: <0.286.0>
Mnesia('vanguard@test02'): mnesia_late_loader starting: <0.287.0>
Mnesia('vanguard@test02'): Intend to load tables: []
Mnesia('vanguard@test02'): Mnesia started, 0 seconds
[info] Application mnesia exited: :stopped
Mnesia('vanguard@test02'): Logging mnesia_up 'vanguard@test01'
Mnesia('vanguard@test02'): Logging mnesia_up 'vanguard@test02'
Mnesia('vanguard@test02'): Creating index for 'Elixir.ProcStore' 3 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.HandlerStore' 3 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.HandlerStore' 7 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.StatusStore' 3 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.StatusStore' 4 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.CheckStore' 3 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.CheckStore' 4 ordered
Mnesia('vanguard@test02'): Creating index for 'Elixir.CheckStore' 10 ordered
If I kill node 1, wait, then bring it back up I get the following:
Mnesia('vanguard@test01'): mnesia_monitor starting: <0.263.0>
Mnesia('vanguard@test01'): Mnesia debug level set to verbose
Mnesia('vanguard@test01'): mnesia_subscr starting: <0.264.0>
Mnesia('vanguard@test01'): mnesia_locker starting: <0.265.0>
Mnesia('vanguard@test01'): mnesia_recover starting: <0.266.0>
Mnesia('vanguard@test01'): mnesia_tm starting: <0.267.0>
Mnesia('vanguard@test01'): Schema initiated from: disc
Mnesia('vanguard@test01'): Initial dump of log during startup: [dumped,
dumped]
Mnesia('vanguard@test01'): mnesia_controller starting: <0.290.0>
Mnesia('vanguard@test01'): mnesia_late_loader starting: <0.291.0>
Mnesia('vanguard@test01'): Intend to load tables: [{'Elixir.ProcStore',
ram_only}]
Mnesia('vanguard@test01'): Logging mnesia_up 'vanguard@test02'
Mnesia('vanguard@test01'): Logging mnesia_up 'vanguard@test03'
Mnesia('vanguard@test01'): mnesia_controller terminated: shutdown
Mnesia('vanguard@test01'): mnesia_tm terminated: shutdown
Mnesia('vanguard@test01'): mnesia_recover terminated: shutdown
Mnesia('vanguard@test01'): mnesia_locker terminated: shutdown
Mnesia('vanguard@test01'): mnesia_subscr terminated: shutdown
Mnesia('vanguard@test01'): mnesia_monitor terminated: shutdown
Mnesia('vanguard@test01'): mnesia_monitor starting: <0.319.0>
Mnesia('vanguard@test01'): Mnesia debug level set to verbose
Mnesia('vanguard@test01'): mnesia_subscr starting: <0.320.0>
Mnesia('vanguard@test01'): mnesia_locker starting: <0.321.0>
Mnesia('vanguard@test01'): mnesia_recover starting: <0.322.0>
Mnesia('vanguard@test01'): mnesia_tm starting: <0.323.0>
Mnesia('vanguard@test01'): Schema initiated from: default
Mnesia('vanguard@test01'): mnesia_controller starting: <0.325.0>
Mnesia('vanguard@test01'): mnesia_late_loader starting: <0.326.0>
Mnesia('vanguard@test01'): Intend to load tables: []
Mnesia('vanguard@test01'): Mnesia started, 0 seconds
[error] Error in process #PID<0.295.0> on node :"vanguard@test01" with exit value:
{:badarg, [{:ets, :insert, [:mnesia_gvar, {:last_error, {{:aborted, {:node_not_running, :"vanguard@test01"}}, [{:mnesia_loader, :wait_on_load_complete, 1, [file: 'mnesia_loader.erl', line: 358]}, {:mnesia_tm, :apply_fun, 3, [file: 'mnesia_tm.erl', line: 836]}, {:mnesia_tm, :execute_transaction, 5, [file: 'mnesia_tm.erl', line: 811]}, {:mnesia_loader, :init_receiver, 5, [file: 'mnesia_loader.erl', line: 284]}, {:mnesia_loader, :do_get_network_copy, 5, [file: 'mnesia_loader.erl', line: 220]}, {:mnesia_controller, :"-load_table_fun/1-fun-3-", 5, [file: 'mnesia_controller.erl', line: 2180]}, {:mnesia_controller, :"-load_and_reply/2-fun-0-", 2, [file: 'mnesia_controller.erl', line: 2138]}]}}], []}, {:mnesia_lib, :set, 2, [file: 'mnesia_lib.erl', line: 444]}, {:mnesia_lib, :fix_error, 1, [file: 'mnesia_lib.erl', line: 906]}, {:mnesia_tm, :return_abort, 3, [file: 'mnesia_tm.erl', line: 958]}, {:mnesia_loader, :init_receiver, 5, [file: 'mnesia_loader.erl', line: 284]}, {:mnesia_loader, :do_get_network_copy, 5, [file: 'mnesia_loader.erl', line: 220]}, {:mnesia_controller, :"-load_table_fun/1-fun-3-", 5, [file: 'mnesia_controller.erl', line: 2180]}, {:mnesia_controller, :"-load_and_reply/2-fun-0-", 2, [file: 'mnesia_controller.erl', line: 2138]}]}
[error] Error in process #PID<0.294.0> on node :"vanguard@test01" with exit value:
{:badarg, [{:ets, :insert, [:mnesia_gvar, {:last_error, {{:aborted, {:node_not_running, :"vanguard@test01"}}, [{:mnesia_loader, :wait_on_load_complete, 1, [file: 'mnesia_loader.erl', line: 358]}, {:mnesia_tm, :apply_fun, 3, [file: 'mnesia_tm.erl', line: 836]}, {:mnesia_tm, :execute_transaction, 5, [file: 'mnesia_tm.erl', line: 811]}, {:mnesia_loader, :init_receiver, 5, [file: 'mnesia_loader.erl', line: 284]}, {:mnesia_loader, :do_get_network_copy, 5, [file: 'mnesia_loader.erl', line: 220]}, {:mnesia_controller, :"-load_table_fun/1-fun-3-", 5, [file: 'mnesia_controller.erl', line: 2180]}, {:mnesia_controller, :"-load_and_reply/2-fun-0-", 2, [file: 'mnesia_controller.erl', line: 2138]}]}}], []}, {:mnesia_lib, :set, 2, [file: 'mnesia_lib.erl', line: 444]}, {:mnesia_lib, :fix_error, 1, [file: 'mnesia_lib.erl', line: 906]}, {:mnesia_tm, :return_abort, 3, [file: 'mnesia_tm.erl', line: 958]}, {:mnesia_loader, :init_receiver, 5, [file: 'mnesia_loader.erl', line: 284]}, {:mnesia_loader, :do_get_network_copy, 5, [file: 'mnesia_loader.erl', line: 220]}, {:mnesia_controller, :"-load_table_fun/1-fun-3-", 5, [file: 'mnesia_controller.erl', line: 2180]}, {:mnesia_controller, :"-load_and_reply/2-fun-0-", 2, [file: 'mnesia_controller.erl', line: 2138]}]}
[info] Application mnesia exited: :stopped
Mnesia('vanguard@test01'): Logging mnesia_up 'vanguard@test03'
Mnesia('vanguard@test01'): Logging mnesia_up 'vanguard@test02'
Mnesia('vanguard@test01'): Logging mnesia_up 'vanguard@test01'
Mnesia('vanguard@test01'): Creating index for 'Elixir.ProcStore' 3 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.CheckStore' 3 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.CheckStore' 4 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.CheckStore' 10 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.HandlerStore' 3 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.HandlerStore' 7 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.StatusStore' 3 ordered
Mnesia('vanguard@test01'): Creating index for 'Elixir.StatusStore' 4 ordered
I’m not really able to make heads or tails of the situation unfortunately. I am using libcluster, Swarm and Mnesiam for distributed libs. Any and all help/tips/refrences are appreciated.
Most Liked
beardedeagle
Ok, I’ve since forked mnesiam here (with the blessing of the original lib author):
https://github.com/beardedeagle/mnesiac
And i’ve documented the issue here to work on it as I have time:
https://github.com/beardedeagle/mnesiac/issues/2
2
Popular in Questions
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
New
I have a phoenix application from which a user can download multiple(5-6) files of size 1MB. I couldn’t find anything related to sending ...
New
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
I tried installing
elixir 1.11.2
erlang 23.3.4
via asdf in my zsh shell. Enabled the versions locally and globally.
When I list them ...
New
Original source of discussion: This topic on the Pragmatic Programmers’ Functional Web Development with Elixir, OTP, and Phoenix forum.
...
New
Credo is smart enough to check for (something like) this:
assert length(the_list) == 0
with this response:
Checking if an enum is empt...
New
Hi everyone,
I was playing with phoenix liveView but I run into an issue. I have a form and want to validate each input text when the te...
New
Okay, I’m having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I’m sure I’...
New
Hello!
Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
Other popular topics
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch.
This project took far...
New
Hello, can anybody help here..? I have a list of players and I what to delete an element, but every for loop the list is reverting to ori...
New
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1]
15:22:35.803 [error] gen_event {lager_file_backend...
New
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
Hello, I have map which I want to convert it to string like this:
the map:
%{last_name: "tavakkoli", name: "shahryar"}
the string I ne...
New
Surface is an experimental library built on top of Phoenix LiveView and its new LiveComponent API that aims to provide a more declarative...
New
TL;DR: I’ve just released an implementation of Microsoft’s IDE-independent Language Server Protocol for Elixir. It adds language support ...
New
What learn first? Rust or Elixir
Hi Elixir community!
I’m here because i want learn a new language. I’m a junior developer and mainly i ...
New
I want to highlight html closing tags when i click a html tag. That works in .html files but doesnt work for html.eex templates. How can...
New
Seen any cool LiveView demos, sample apps or examples? Please post them here! :003:
New
Latest on Elixir Forum
Sponsor Spotlight
We build reliable cloud platforms for business-critical systems.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Practical resources that improve the lives of professional developers.
Develop your skills with books, videos, and courses.
Enabling companies to succeed by building software people love.
Courses that'll move you from confusion to "Aha, now I get it!"