Hello, in our Phoenix API, we’re making numerous calls to external APIs like Opena Ai, with long responses that can take 2 to 15 seconds.
As an HTTP client, we use Req {:req, "~> 0.5.2"}, when the number of user requests to our API reaches approximately 20 per second, hence the same number of calls we’re doing to the external API we’re getting the following error: (RuntimeError) Finch was unable to provide a connection within the timeout due to excess queuing for connections. Consider adjusting the pool size, count, timeout, or reducing the rate of requests if it is possible that the downstream service is unable to keep up with the current rate.

I played with Finch opts, in the Application supervision children:

children = [
      {Finch,
             name: MyConfiguredFinch,
             pools: %{
               :default => [
                 size: 1000,
                 count: 200,
                 pool_max_idle_time: 120_000,
                 conn_max_idle_time: 120_000
               ]
             }},
               ....
   ]

but seems it doesn’t help
I would highly appreciate any help since this happening in the production