armanm

armanm

Distributed Elixir not connecting between AWS ECS Fargate tasks

Setup:

  • ECS tasks with Cloud Map service discovery
  • Tasks accessible via service-name.namespace-name.local
  • dns_cluster is setup to query for tasks under service-name.namespace-name.local
  • Security group allows port 4369 (EPMD) internally
  • Nodes (running on different ECS tasks) can’t connect to each other

What am I missing? Are there additional ports or configuration steps needed for distributed Elixir on AWS ECS?

Most Liked

ruslandoga

ruslandoga

:waving_hand:

  • Security group allows port 4369 (EPMD) internally

Application ports would also need to be allowed. By default they are more or less randomly assigned. The ports can be configured with inet_dist_listen_min and inet_dist_listen_max kernel options like this. And don’t forget about cookies – they need to be the same for the nodes that attempt to connect; by default they are randomly generated on mix release so nodes with different container images won’t be able to connect. The cookie can be set with RELEASE_COOKIE env var.

armanm

armanm

@ruslandoga you were spot on. Those kernel ports were part of a different CloudFormation stack and thus were not applied properly. Clustering worked immediately as soon as the security group was updated to allow my port range which I set between 9000-9100.

Oh and for anyone else who might read this in the future, I also updated the vm.args.eex file to start Beam with the same kernal port range:

-kernel inet_dist_listen_min 9000 inet_dist_listen_max 9100

Where Next?

Popular in Questions Top

vertexbuffer
Hello, can anybody help here..? I have a list of players and I what to delete an element, but every for loop the list is reverting to ori...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
qwerescape
Is there a way to get the call stack or stack trace at any point in the code? Not from exceptions, but an expression that returns how the...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
itssasanka
Hi all, Trying to get some more clarity over utc_datetime and naive_datetime for Ecto: The documentation above suggests that while ...
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list. ...
New
komlanvi
Hi everyone, I was playing with phoenix liveView but I run into an issue. I have a form and want to validate each input text when the te...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New

Other popular topics Top

marius95
Hello everyone, I try to use an Javascript Event Handler in my root.html.leex file. Therefore I created a function in the app.js file: ...
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
chrismccord
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
johnnyicon
Hi all, I’ve just started learning Elixir and Phoenix Framework, so please pardon my n00bness at this stage. I’m trying to use Postgres...
New
chrismccord
This release brings a number of exciting features, including integration with the new Phoenix LiveDashboard and Phoenix LiveView. There h...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
hariharasudhan94
lets say i have a sample like a = 20; b = 10; if (a > b) do {:ok, "a"} end if (a < b) do {:ok, b} end if (a == b) do {:ok, "equa...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New

Latest on Elixir Forum

We're in Beta

About us Mission Statement