armanm

armanm

Distributed Elixir not connecting between AWS ECS Fargate tasks

Setup:

  • ECS tasks with Cloud Map service discovery
  • Tasks accessible via service-name.namespace-name.local
  • dns_cluster is setup to query for tasks under service-name.namespace-name.local
  • Security group allows port 4369 (EPMD) internally
  • Nodes (running on different ECS tasks) can’t connect to each other

What am I missing? Are there additional ports or configuration steps needed for distributed Elixir on AWS ECS?

Most Liked

ruslandoga

ruslandoga

:waving_hand:

  • Security group allows port 4369 (EPMD) internally

Application ports would also need to be allowed. By default they are more or less randomly assigned. The ports can be configured with inet_dist_listen_min and inet_dist_listen_max kernel options like this. And don’t forget about cookies – they need to be the same for the nodes that attempt to connect; by default they are randomly generated on mix release so nodes with different container images won’t be able to connect. The cookie can be set with RELEASE_COOKIE env var.

armanm

armanm

@ruslandoga you were spot on. Those kernel ports were part of a different CloudFormation stack and thus were not applied properly. Clustering worked immediately as soon as the security group was updated to allow my port range which I set between 9000-9100.

Oh and for anyone else who might read this in the future, I also updated the vm.args.eex file to start Beam with the same kernal port range:

-kernel inet_dist_listen_min 9000 inet_dist_listen_max 9100

Where Next?

Popular in Questions Top

New
chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
vegabook
I’m brand new to Phoenix and I have stripped one of the demo applications to the bone. I just want to get an svg up on the screen. Here i...
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New
pmjoe
I have a relationship of love and hate with Elixir. Lots of things are just absolutely right, but there are some things that are kind of ...
New
RisingFromAshes
I’ve read in another post that it may be possible with a router helper - but I couldn’t find an appropriate one, and tbh, I’m still just ...
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list. ...
New
svb
Hi! Currently I want to submit a form by pressing the Enter key. However, since my input field is of type “textarea” this is just adds a...
New

Other popular topics Top

sen
Hi All, I set a environment variables in dev.exs , like below code. when i start server, how can i set the ${enable} value? thanks. d...
New
malloryerik
Hi, this is for people who, like me, have had some friction using .html.heex templates in VSCode. The solution seems to be, in a hyphena...
New
msaraiva
Surface is an experimental library built on top of Phoenix LiveView and its new LiveComponent API that aims to provide a more declarative...
564 43622 214
New
JakeBecker
TL;DR: I’ve just released an implementation of Microsoft’s IDE-independent Language Server Protocol for Elixir. It adds language support ...
1144 53690 245
New
gausby
I asked this very same question on twitter and got some interesting feedback, but I thought it would be a good question to ask here as we...
1207 39297 209
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New
marick
I had some trouble figuring out how to make many-to-many associations work. Once I got it working, I wrote a blog post. Because I’m a nov...
New
Qqwy
Update: How to use the Blogs & Podcasts section You can post links to your blog posts or podcasts either in one of the Official Blog...
3271 126479 1222
New

We're in Beta

About us Mission Statement