grangerelixx

grangerelixx

I get the following intermittent test failure errors for some queries.

 ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 1102ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
     
       1. Ensuring your database is available and that you can connect to it
       2. Tracking down slow queries and making sure they are running fast enough
       3. Increasing the pool_size (albeit it increases resource consumption)
       4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
     
     See DBConnection.start_link/2 for more information
     

How should I resolve this? I have three config files, test, dev and pre_prod. I don’t think increasing the pool size in pre_prod contributes to test execution.

dev.exs Config

config :my_app, MyApp.Repo,
   username: "postgres",
   password: "postgres",
   database: "my_app_dev",
   hostname: "localhost",
   show_sensitive_data_on_connection_error: true,
   pool_size: 10

pre_prod.exs Config

config :my_app, MyApp.Repo,
  username: "postgres",
  password: "postgres",
  database: "my_app_preprod",
  hostname: "db",
  show_sensitive_data_on_connection_error: true,
  pool_size: 10

test.exs Config

config :my_app, MyApp.Repo,
  username: "postgres",
  password: "postgres",
  database: "my_app_test#{System.get_env("MIX_TEST_PARTITION")}",
  hostname: "localhost",
  pool: Ecto.Adapters.SQL.Sandbox

Showing Posts 1 to 6

APB9785

APB9785

Creator of ECSx

Can you post the queries?

grangerelixx

grangerelixx OP

This is one of the query tests

  test "query comments with sortBy inserted_at and sortOrder DESC", context do
       current_user = tennat_with_current_user(context.tenant)
 
       request_and_parse_gql(
         """
         query {
             comments(sort: { sortBy: INSERTED_AT, sortOrder: DESC}) {
                 entries{
                     id
                 }
             }
         }
         """
,
         %{current_user: current_user}
       )
       |> graphql_response(
         expected_response(
           [
             context.comment4,
             context.comment3,
             context.comment2,
             context.comment1
           ],
           [:id]
         ),
         200
       )
 
       parse_graphql(
         """
           query {
             comments(sort: { sortBy: INSERTED_AT, sortOrder: DESC}, limit: 2) {
               paginationMetadata {
                 after
                 before
                 limit
                 totalCount
                 totalCountCapExceeded
               }
             }
           }
         """,
         %{current_user: current_user}
       )
       |> graphql_response(
         %{
           "comments" => %{
             "paginationMetadata" => %{
               "after" =>
                 Paginator.cursor_for_record(
                   context.comment3,
                   id: :asc,
                   inserted_at: :desc
                 ),
               "before" => nil,
               "limit" => 2,
               "totalCount" => 4,
               "totalCountCapExceeded" => false
             }
           }
         },
         200
       )
     end
dimitarvp

dimitarvp

Not GraphQL queries. Post the SQL queries.

grangerelixx

grangerelixx OP

can I know where I can find this

al2o3cr

al2o3cr

One cause of this in tests: parallel tests that all get blocked waiting for each other’s DB transaction to commit/rollback.

For instance, let’s say you have a Company schema with a name field covered by a unique index.

If multiple tests try to insert a record with the same name, all but the first one will block until the first one completes - and since ex_unit starts System.schedulers_online * 2 cases in parallel, this can cause connection starvation like you’re seeing if the pool is too small.

Boosting the pool size can help, but the better fix is to make sure your code either:

  • inserts the shared records before switching the sandbox on
  • inserts unique values into the unique-indexed column (with an ExMachina sequence, for instance)
borybar

borybar

Hi! Is it possible to get an explanation how one can:

— All posts loaded —

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
jonnycharles
I’m in search of an Elixir library that offers PDF generation capabilities similar to Ruby’s Prawn. While there have been discussions abo...
New
spammy
I’m looking to build a personal workflow to quickly deploy web applications written in elixir/phoenix, for local consumption (ie not on t...
New
dli
Before I dive in myself, did anyone successfully sprinkle Hologram into their existing LiveView app? Looking for hints regarding: Addi...
New
roeland
Kia ora, We have been using elixir-google-api to connect to Google Drive. However, with the updates to Tesla due to CVEs this is now bro...
New
bottlenecked
Hi all, I wanted to ask how the community is dealing with post-release steps. Today we have Ecto migrations, which make sure that the db...
New
rahultumpala
Hello, I have an Elixir backend that implements a custom protocol over TCP. I want to load test the backend and assess the performance o...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews