julismz

julismz

I’m having problems creating a cluster with libcluster and K8S…

The error I’m having is:

`[warning] [libcluster:k8s] unable to connect to :"foo@10.244.2.106": not part of network

These are my kubernetes configs:

apiVersion: apps/v1
kind: Deployment
metadata:
  name: foo
spec:
  replicas: 4
  selector:
    matchLabels:
      app: foo
  template:
    metadata:
      labels:
        app: foo
    spec:
      serviceAccountName: foo-account
      containers:
        - name: foo
          image: full_node:latest
          args: ["--name", "foo@$(MY_POD_IP)", "--cookie", "foo-cookie"]
          imagePullPolicy: IfNotPresent
          ports:
            - containerPort: 4000
          env:
            - name: MY_POD_IP
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP

---

apiVersion: v1
kind: Service
metadata:
  name: foo-service
  namespace: default
spec:
  selector:
    app: foo
  ports:
    - protocol: TCP
      name: api
      port: 4000
      targetPort: 4000
    - protocol: TCP
      name: web
      port: 4001
      targetPort: 4001
  type: LoadBalancer

---
apiVersion: v1
kind: Service
metadata:
  name: foo-nodes
  namespace: default
spec:
  type: ClusterIP
  clusterIP: None
  selector:
    app: foo
  ports:
    - name: epmd
      port: 4369

---

kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  namespace: default
  name: pod-reader
rules:
  - apiGroups: [""]
    resources: ["pods", "endpoints"]
    verbs: ["get", "watch", "list"]

---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: read-pods
  namespace: default
subjects:
  - kind: ServiceAccount
    name: foo-account
    namespace: default
roleRef:
  kind: Role
  name: pod-reader
  apiGroup: rbac.authorization.k8s.io

---

apiVersion: v1
kind: ServiceAccount
metadata:
  name: foo-account
  namespace: default

The libcluster config:

topologies = [
      k8s: [
        strategy: Cluster.Strategy.Kubernetes.DNS,
        config: [
          service: "foo-nodes",
          application_name: "foo"
        ]
      ]
    ]

Communication between pods are fine. Endpoints

kubectl get endpoints
NAME           ENDPOINTS                                                           AGE
foo-nodes     10.244.2.100:4369,10.244.2.101:4369,10.244.2.102:4369 + 1 more...   15m

Services

kubectl get services
NAME           TYPE           CLUSTER-IP      EXTERNAL-IP   PORT(S)                         AGE
foo-nodes     ClusterIP      None            <none>        4369/TCP                        37m
foo-service   LoadBalancer   10.101.190.19   <pending>     4000:31343/TCP,4001:32461/TCP   4h53m

I followed several tutorials like this: Connecting Elixir Nodes with libcluster, locally and on Kubernetes Read the docu: Cluster.Strategy.Kubernetes.DNS — libcluster v3.5.0 I don’t know what else I can try…

Any though?

Showing Posts 1 to 2

mruoss

mruoss

What is the command that is executed in the container? --name and --cookie are arguments to the elixir or iex command. If you built a release try working with env vars instead of args:

          env:
            - name: MY_POD_IP
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
            - name: RELEASE_DISTRIBUTION
              value: name
            - name: RELEASE_NODE
              value: foo@$(MY_POD_IP)
            - name: RELEASE_COOKIE
              value: foo-cookie
julismz

julismz OP

Thanks, it worked!

— All posts loaded —

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
itzmidinesh
Hi all, I’m working on a Phoenix project where I need to make external HTTP requests and I’m trying to choose between Req and HTTPoison....
New
yarrichar
I’m very new to Elixir, so sorry if this is a silly question: I am wondering what happens to the mailbox of a process when the machine i...
New
pragdave
How do I tell Hologram not to escape HTML when substituting into templates? {Textile.render(@product.long_description)} escapes the HTM...
New
Fl4m3Ph03n1x
Background When trying to execute mix release on a Windows 11 machine for a Phoenix project I get the following error: * assembling mark...
New
leoschweizer
Hi, we run different LLM models across a cluster, with each node loading a configurable subset. Model-specific queues let nodes consume ...
New
rlipscombe
I’d like to create a file with 600 permissions (rw-------), but there’s a race condition if I create it and then change the permissions. ...
New

Other Trending Topics Top

dominicletz
Hey there, I haven’t seen a list of useful Elixir specific skills for the popular AI tools yet so I’m starting one here with my first. ...
New
raa-ziq
Hi everyone :waving_hand: I wanted to share something I’ve been building — NowBlind, a random chat app designed to help people discover ...
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New
kip
Localize is the next generation localisation library for Elixir. Think of it as ex_cldr version 3.0. The first version will be released ...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews