gpcweb
I’am new on elixir and I’m building an application that downloads some pdf files from s3. It works just fine using a supervisor and poolboy to manage the process, but I would like to retrieve all the links from a database, I’m seeing ecto but when I used It tells me that I need a supervisor.
This is my current model module
defmodule Pdf.Consumption do
use Ecto.Schema
alias Pdf.Consumption
alias Pdf.Repo
schema "consumptions" do
field :invoice_url
end
def all do
Consumption
|> Repo.all
end
end
This is my current application module
defmodule Pdf do
use Application
def start(_type, _args) do
poolboy_config = [
{:name, {:local, pool_name()}},
{:worker_module, Pdf.Worker},
{:size, 2},
{:max_overflow, 0}
]
children = [:poolboy.child_spec(pool_name(), poolboy_config, [])]
options = [
strategy: :one_for_one,
name: Pdf.Supervisor
]
Supervisor.start_link(children, options)
end
defp pool_name() do
:pdf_pool
end
defp pdf_pool(link) do
:poolboy.transaction(
pool_name(),
fn(pid) -> :gen_server.call(pid, link) end, :infinity
)
end
def parallel_pool(links) do
Enum.each( links, fn(link) -> spawn( fn() -> pdf_pool(link) end ) end )
end
end
And I would like to make this on parallel_pool
def parallel_pool do
Pdf.Consumption.all
|>Enum.each( links, fn(link) -> spawn( fn() -> pdf_pool(link) end ) end )
end
So my question is, how can achieve this? I need another module that use Application?
Trending in Questions
Hello!
Suppose you are building workflow (order / task / payment) processing system with the following requirements:
Each workflow con...
New
I’m aware of 2 such projects, are there others?
git: GitHub - team-alembic/realworld: A fullstack Phoenix LiveView application with back...
New
Hi everyone.
My team and I have been working on a fairly modest app based around video streaming and chat, but we’ve landed a customer t...
New
I really like the adapter patterns that ecto, nebulex, waffle, etc. use and would love find something similar for a key management servic...
New
Hello folks!
So at work, we are seeing some situations where we have to define some “fixed” strings that are used across the codebase in...
New
Hi,
we run different LLM models across a cluster, with each node loading a configurable subset. Model-specific queues let nodes consume ...
New
Hi all, I’m new here and would like to hear peoples views on my Elixir/Phoenix based game-engine! :smiley:
Mutonex gamedesign was finish...
New
Other Trending Topics
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself.
My main conc...
New
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with.
But I don’t use it anymore.
Serverless was the promis...
New
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #ai
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #security
- #hex











Showing Posts 1 to 3- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
benwilson512
So there are really two questions here:
I’m gonna answer #2. Poolboy is not the way to do this. The easiest way is to use the Elixir 1.4 Task.async_stream. function:
This will download 20 links at a time. It will not return anything, I’m assuming that you’re writing to disk or something with
process_link. If you need the results you would just|> Enum.to_listinstead ofStream.rungpcweb
Can you explain me why poolboy is not the way to do this?
NobbZ
Because it adds a dependency while the work can be done with stuff from the std-lib easily.