mekusigjinn

mekusigjinn

Polling: via "use Task" and recursive poll() under Supervisor, versus GenServer + Process.send_after()

I have a question regarding polling strategies.

I generally like doing GenServer + Process.send_after because it’s more intuitive for me.

Lately I came across two Internet sources that do this:

defmodule Example.BitcoinPriceUpdater do
  use Task
  def start_link(_arg) do
    Task.start_link(&poll/0)
  end
  def poll() do
    receive do
    after
      60_000 ->
        get_price()
        poll()
    end
  end
  defp get_price() do
    # Call API & Persist
    IO.puts "To the moon!"
  end
end

(excerpt: https://medium.com/@efexen/periodic-tasks-with-elixir-5d9050bcbdb3)

And also the same usage in JokenJwks library:

      use Task, restart: :transient
...
      @doc false
      def poll(opts) do
        interval = opts[:time_interval]

        receive do
        after
          interval ->
            _ = check_fetch(opts)
            poll(opts)
        end
      end

Is there any "gotcha"s when you use Task-based polling under Supervisor?

Specifically, at work I had the JokenJwks.DefaultStrategyTemplate used (via use) in my Phoenix application, but I was able to crash the module based Task when I ran a custom Mix Task, while the app was running.

The custom Mix Task did not even remotely use the same code base.
Setting :logger config to:

config :logger,
  level: :debug,
  handle_sasl_reports: true

Allowed me to see that when the process crashed, resources were:

  • Heap Size: 29_000
  • Reduction was around 440_000. Isn’t that pretty high? I still don’t know how to guage reduction units..

When I do a Process.monitor() + receive, I get instantaneous DOWN messages, so I am even more puzzled.

Frankly, I can’t quite grasp how a recursing poll() in a use Task, under Supervisor would be running - so is this like a long-running process?

Now if we talk about doing a GenServer + polling via recursive Process.send_after, I totally get that right off the bat - I know what’s happening.

So I wanted to ask - is there a case where one would want to use receive + after polling with use Task? Besides the fact that it might look “simpler”, especially when the intention is for a long-running poll?

Thanks in advance.

Marked As Solved

ityonemo

ityonemo

I’m not convinced that using a task just because it gives you :$callers is the right move. Something that responds to a fixed-time recurring event is a much better fit for a GenServer responding to :timer.send_interval. part of the point of the videos is to show you how to make it so that if you do something like that sort of GenServer, how to get it to respect Mox or Ecto.checkouts :wink: hint: pass caller information in start_link

Also Liked

RudManusachi

RudManusachi

One advantage of using Task over GenServer comes to mind is the fact that Tasks have built in support for Ancestor and Caller Tracking which allows to easily test them with async: true.

Especially for your scenario API call can be easily mocked with Mox:

if you’re running on Elixir 1.8.0 or greater and your concurrency comes from a Task then you don’t need to add explicit allowances. Instead $callers is used to determine the process that actually defined the expectations.

source: Mox # Explicit allowances

And similarly Ecto Sandbox uses DBConnection that does callers lookup which again allows to run tests asynchronously.

To learn more in deep about the subject I highly recommend to take a look at the video series The Process by @ityonemo and particularly Tests with Mox and Ecto

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

GenServers also have ancestors so I’m not really sure that this is a relevant bit here.

@mekusigjinn it is much more idiomatic to use a GenServer for polling than a task. A GenServer with send_after will also let you inspect it with :sys.get_state and so on because it isn’t blocking while waiting.

Where Next?

Popular in Questions Top

Kurisu
For example for a current url like http://localhost:4000/cosmetic/products?_utf8=✓&query=perfume&page=2, I would like to get: ...
New
qwerescape
Is there a way to get the call stack or stack trace at any point in the code? Not from exceptions, but an expression that returns how the...
New
chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
vac
Hi, I’m quite new in Elixir and I’m trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and I...
New
dokuzbir
I want to highlight html closing tags when i click a html tag. That works in .html files but doesnt work for html.eex templates. How can...
New
beno
I will often find my self writing things similar to: case some_value do nil -> something() "" -> something() _ -> somethi...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New
Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New

Other popular topics Top

9mm
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
lessless
I believe there are people here who are dealing with CSV files import on the daily basis, and since Excel is a really popular tool there ...
New
JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
johnnyicon
Hi all, I’ve just started learning Elixir and Phoenix Framework, so please pardon my n00bness at this stage. I’m trying to use Postgres...
New
SoCreat
i’m a new one to elixir which editor can i use vs code? or atom? Thanks! :smiley:
New
romenigld
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
New
Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
AstonJ
We’ve put together this wiki for Phoenix LiveView - please feel free to add any info you feel is worth including. What is Phoenix LiveV...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New

We're in Beta

About us Mission Statement