henrikc

henrikc

This is my first attempt at using Broadway, SQS and I am very new to Elixir, so there is hopefully a simple answer. I want to use broadway to consume from a queue in ElasticMQ so that I do not have to use AWS during development. My attempt at the configuration for broadway is,

name: __MODULE__,
producer: [
  module:
    {BroadwaySQS.Producer,
      queue_url: "http://localhost:9324/queue/service-queue",
      config: [
        access_key_id: "x",
        secret_access_key: "x",
        region: "elasticmq"
      ]}
],
processors: [
  default: []
],
batchers: [
  default: [
    batch_size: 10,
    batch_timeout: 2000
  ]
]

The docker-compose to set-up for ElasticMQ looks like,

 sqs:
  image: "softwaremill/elasticmq"
  ports:
   - "9324:9324"
   - "9325:9325"
  volumes:
    - ./elasticmq.conf:/opt/elasticmq.conf

and the elastic.conf file is,

include classpath("application.conf")

queues {
   service-queue {
     defaultVisibilityTimeout = 10 seconds
     delay = 5 seconds
     receiveMessageWait = 0 seconds
   }
}

The problem is that no events are received and after a few seconds I get the error message [error] Unable to fetch events from AWS. Reason: :nxdomain. How should I configure Broadway to make it work with ElasticMQ? Or is that not possible?

I should perhaps note that I tried out the url(since the error indicates a non-existing domain) to the queue using Python and boto3, as described on github, and that works for both receiving and sending messages. I suspect that there is something I missed in the configuration for the producer, any input would be awesome.

Showing Posts 1 to 1

henrikc

henrikc OP

Turns out It was a problem with the producer config. For the next person that might run in to the same error this was the correct config given the settings of elasticmq above:

BroadwaySQS.Producer,
queue_url: "http://localhost:9324/queue/service-queue",
config: [
   access_key_id: "x",
   secret_access_key: "x",
   host: "localhost",
   port: "9324",
   scheme: "http://",
   region: "elasticmq"
]

You need to specify port,scheme and host in the config as well. It was the same as this issue for connecting to localstack with ex_aws.

— All posts loaded —

Where Next? Top

Trending in Questions Top

RSP87
I’m working on a project that simulates the bumbl example in the programming phoenix book. It acts almost like an email client. We have a...
New
nseaSeb
Hello, I know there is an approach for handling lists that allows for optimized traversal, but I can’t recall the specific method (somet...
New
kpanic
Hi everyone, I am toying with the idea of building a “match maker” for giving personal help to people that wants to start coding. I sta...
New
brecabral
Documentation While reading the Scoped Routes section, I noticed that the documentation currently refers to a problem without explainin...
New
velrest
So my question is quite simple and i have found no conclusive answer on forum, google or AI. Should we use :erlang.float for Integer to ...
New
asweet-confluent
I recently noticed that Elixir’s Logger defaults its primary log level to :debug when no :logger, :level application configuration is pre...
New
ryanwinchester
apply_graft/2 doesn’t rewrite an add_many sub-workflow’s deps on an add step. Grafted jobs cancel with “upstream job was deleted” Version...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
mhanberg
Hi everyone! The first release candidate for the Expert language server project is now available! We’ve published a press release detai...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Dmk
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New

Latest on Elixir Forum

Elixir Forum

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews