Are your trying to build it so each user has its own node?
lud
RudManusachi
The only scenario of 1000 nodes I could think of that would make sense is some sort of an IoT.. with 1000 devices each running erlang and all connected to a cluster for some reason 
0
sbuttgereit
Kinda what I was thinking, too. The the asker may well be conflating the roles of “node” and “process”.
0
Erynn
ok i am explaining,
if i do not use 1000 nodes in ring then it can lead to increased overhead and complexity.
i choose this architecture for fault tolerance and scalability reason. because i am lazy sorry
when cluster have less nodes, we are using mnesia and it is working but when we started to add more nodes, we started to see mnesia do nothing but sit silently, write become very very difficult, now i am thinking to migrate to ets table because it is fast and very fast to write but the main problem is, ets table is for local nodes. so, we have to sync ets table in another node. so we are using consistant hashing to find nodes to sync. and we are using genserver to sync. the main problem is how we know pid of that node genserver to send ets table by using Kernel.send.
so i thought to create a local ets table in each node and keep all node genserver pid.
my main problem is, if one genserver crash and restart genserver again then it get new pid. will this GenServer.cast can send 1000 nodes in one go?
Enum.each(Node.list, fn node → GenServer.cast({Sync.GenServer, node}, {:presence, {Node.self, self}}))
0
Erynn
sbuttgereit
Erynn
Erynn
sbuttgereit
This is better link to the same sort of thing (and same subject) that you’re linking.
The reality is if I find myself needing those sorts of node counts, I probably need someone already highly versed, skilled, and experienced with BEAM internals and tuning to get to the right architecture.
I wish you the best.
1
dimitarvp
Again and again, you’re only saying what you are aiming to do and never once said why you are doing it.
Why were you using distributed Mnesia? What was wrong with a traditional database?
And what kind of app has 100s of millions of users? Are you working for Telegram?
You don’t seem to understand – we need to know what exact problem are you trying to solve. You already decided you’ll use 1000+ nodes and are asking how to do it. But we want to know why do you think you need those nodes.
Until you try to explain your needs and NOT repeat how you imagine your problem must be solved then nobody can help you.
1