sigmaml
Why does `broadway_sqs` not support writing to SQS?
Hello —
I am trying to use Broadway for the first time. I see that broadway_sqs is a “producer” that enables pulling messages from SQS and processing them.
My processing pipeline involves certain operations on the pulled messages and then enqueuing them into a second SQS queue (to be processed by a different stage/consumer).
Do I need to use a different library such as ex_aws_sqs to write to SQS? What are the reasons why this — in my experience — common case seems not enabled by Broadway? Am I missing something?
Thanks.
Marked As Solved
felix-starman
It’s meant to be an implementation detail left up to the user of the library.
Not everyone needs to send things back to a separate queuing system, and making a consumer that puts things back onto an external queue is fairly straightforward, so the library doesn’t bake it in as a fundamental concept
Also Liked
al2o3cr
FWIW, that library’s already used by broadway_sqs (line 30):
krasenyp
The reasons are that “Broadway is a concurrent, multi-stage tool for building data ingestion and data processing pipelines”.
Popular in Questions
Other popular topics
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #advent-of-code
- #elixirconf-us
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #performance









