skosch

skosch

My application, when encountering a database-related error, logs it as follows:

19:30:04.994 request_id=F4COjwtYrfbnTSkAABcx [debug] QUERY ERROR source="table_xyz" db=0.0ms queue=18.5ms idle=287.9ms SELECT ... FROM ... WHERE ... [1]
19:30:04.994 request_id=F4COjwtYrfbnTSkAABcx [info] Sent 500 in 81ms
19:30:04.994 request_id=F4COjwtYrfbnTSkAABcx [debug] Converted error Postgrex.Error to 500 response

This is eminently unhelpful – for one, this shouldn’t be debug level, but more importantly, it doesn’t show any information about the error itself that would allow me to fix it.

As far as I know, my logger configuration is limited to

config :logger, :console,
  format: "$time $metadata[$level] $message\n",
  metadata: [:request_id]

I’m not sure what else I may have misconfigured to cause this problem, and would be grateful for any ideas where to look next.

Showing Posts 1 to 7

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

Hey @skosch can you show the code that causes this error? This is definitely less information than I normally see if my ecto queries have an error, I’m used to seeing something like:

Repo.one from u in Sensetra.Model.User, where: u.id == "thisisntvalid"
** (Ecto.QueryError) iex:2: value `"thisisntvalid"` cannot be dumped to type :id. Or the value is incompatible or it must be interpolated (using ^) so it may be cast accordingly in query:

from u0 in Sensetra.Model.User,
  where: u0.id == "thisisntvalid",
  select: u0

Or

Repo.query!("select 1 + 'foo'", [])
** (Postgrex.Error) ERROR 22P02 (invalid_text_representation) invalid input syntax for type integer: "foo"

    query: select 1 + 'foo'
    (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
    iex:2: (file)
skosch

skosch OP

Hi Ben, in this particular case it was due to some_column missing in Postgres, so any query including it, like

MyTable
|> where([m], m.some_column == ^some_value)
|> App.Repo.all

would fail with the error shown above.

Do you know what log level your warnings show up at?

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

That error raises an Ecto.QueryError for me not a Postgrex.Error, what version of ecto / postgrex are you on?

To test this I created this function in my controller and then added a route to it.

  def fail(conn, _params) do
    import Ecto.Query
    alias Sensetra.Repo

    Sensetra.Model.User
    |> where(does_not_exist: "foo")
    |> Repo.all()

    conn
  end

When I went to /fail I get this error at log_level: :info.

09:08:39.939 request_id=F4DIU0mXfz3qFAEAAPqG [info] GET /fail
09:08:39.965 request_id=F4DIU0mXfz3qFAEAAPqG [info] Sent 500 in 31ms
09:08:39.968 [error] #PID<0.6302.0> running Phoenix.Endpoint.SyncCodeReloadPlug (connection #PID<0.6301.0>, stream id 1) terminated
Server: localhost:4000 (http)
Request: GET /fail
** (exit) an exception was raised:
    ** (Ecto.QueryError) lib/sensetra/web/controllers/health_controller.ex:21: field `does_not_exist` in `where` does not exist in schema Sensetra.Model.User in query:

from u0 in Sensetra.Model.User,
  where: u0.does_not_exist == "foo",
  select: u0

        (elixir 1.14.3) lib/enum.ex:1780: Enum."-map_reduce/3-lists^mapfoldl/2-0-"/3
        (elixir 1.14.3) lib/enum.ex:1780: Enum."-map_reduce/3-lists^mapfoldl/2-0-"/3
        (elixir 1.14.3) lib/enum.ex:2468: Enum."-reduce/3-lists^foldl/2-0-"/3
        (elixir 1.14.3) lib/enum.ex:2468: Enum."-reduce/3-lists^foldl/2-0-"/3
        (ecto 3.10.3) lib/ecto/repo/queryable.ex:211: Ecto.Repo.Queryable.execute/4
        (ecto 3.10.3) lib/ecto/repo/queryable.ex:19: Ecto.Repo.Queryable.all/3
        (sensetra 1.0.0) lib/sensetra/web/controllers/health_controller.ex:22
hauleth

hauleth

Try in production mode.

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

This is with debug_errors: false.

joey_the_snake

joey_the_snake

I think you’ll get Ecto.QueryError is the field is missing from your schema and Postgrex.Error if it’s in your schema but not in your database table.

skosch

skosch OP

Thank you both, this is very helpful as it’s helped me narrow the issue down a bit. Specifically, Postgrex.Error messages aren’t printed to the tmp/log/erlang.log.N files (haven’t yet tried with Ecto.QueryErrors)

When I try to query the missing column manually inside of the bin/app remote shell, I do get the error printed to my console:

** (Postgrex.Error) ERROR 42703 (undefined_column) column c0.missing_column does not exist                                                                                                     
                                                                                                                                                                                           
    query: SELECT ... FROM ... WHERE ...
                                                                                                                                                                                           
    hint: Perhaps you meant to reference the column ...                                                                                                    
    (ecto_sql 3.10.2) lib/ecto/adapters/sql.ex:1047: Ecto.Adapters.SQL.raise_sql_call_error/1                                                                                              
    (ecto_sql 3.10.2) lib/ecto/adapters/sql.ex:945: Ecto.Adapters.SQL.execute/6                                                                                                            
    (ecto 3.10.3) lib/ecto/repo/queryable.ex:229: Ecto.Repo.Queryable.execute/4                                                                                                            
    (ecto 3.10.3) lib/ecto/repo/queryable.ex:19: Ecto.Repo.Queryable.all/3                                                                                                                 
    iex:3: (file)                                                                                                                                                                          
                                                                                                                                                                                           
16:39:25.739 [debug] QUERY ERROR ...

But when I hit the same by making an actual request to the app that indirectly hits a resolver function trying to access that column, all I see in tmp/log/erlang.log.1 is the unhelpful

16:39:53.436 request_id=F4Eibp9VbPR3sHQAAAWB [debug] QUERY ERROR ...
16:39:53.436 request_id=F4Eibp9VbPR3sHQAAAWB [info] Sent 500 in 53ms
16:39:53.437 request_id=F4Eibp9VbPR3sHQAAAWB [debug] Converted error Postgrex.Error to 500 response
— All posts loaded —

Where Next? Top

Trending in Questions Top

Blokh
Hey guys, I’ve got a huge CSV ( around 10 GB ) that needs to be processed hourly Do you guys have any suggestions what is the best prac...
New
kszambelanczyk
Hello! Could someone please give me a help/sample code, how to delete a file from s3 using waffle/waffle_ecto from Phoenix app. I creat...
New
RemyXRenard
I’m seeing that a list inside a Kino.DataTable will be interpreted as a charlist, even if the Kino.configure() is set to charlists: :as_l...
New
velrest
So my question is quite simple and i have found no conclusive answer on forum, google or AI. Should we use :erlang.float for Integer to ...
New
samoloth
Hi, I’ve just set up an application with ash_authentication. There is only magic link strategy for now, so there is no confirmation add o...
New
FlyingNoodle
If a change or preparation module uses Ash.Changeset.get_argument/2 or Ash.Query.get_argument/2 (or any of the other get_argument functio...
New
psy-q
I’m trying to set up Emacs with elixir-ls via lsp-mode and credo via Flycheck. This should mostly be preconfigured as Flycheck picks up c...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge &amp; Solve. They are GUI (Emerge) and State management (S...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews