salomvary

salomvary

How to select virtual field from a CTE

Hi folks, I am very new to Elixir and Ecto and struggling to express an SQL query in Ecto where I have to select computed values from a CTE into virtual fields.

Schema and query look like this (simplified for readability):

schema "readings" do
  field :read_at, :naive_datetime
  field :value, :integer
  field :previous_value, :integer, virtual: true
  field :current_value, :integer, virtual: true
end

current_values_query =
  Reading
  |> select_merge([r], %{
    current_value:
      coalesce(
        r.value,
        lag(r.value)
        |> over(order_by: r.read_at)
      ),
  })

query = { "current_values", Reading }
  |> with_cte("current_values", as: ^current_values_query)
  |> select_merge([r], %{
    previous_value:
      lag(r.value)
      |> over(order_by: r.read_at),

  })
  |> order_by([r], [asc: r.read_at])

In a nutshell, I am querying a timeseries of current and previous values, and there might be gaps in values, in which which case the effective current value (current_velue) is the value from the previous row.

Because PostgreSQL does not allow values from window functions within window functions, I have to resort to a CTE.

The above query compiles and executs fine, but current_value is always nil.

The generated SQL looks like this, which seems correct, except missing c0.current_value in the second SELECT:

WITH "current_values"
         AS (SELECT sr0."id"                                                 AS "id",
                    sr0."read_at"                                            AS "read_at",
                    sr0."value"                                              AS "value",
                    sr0."gas"                                                AS "gas",
                    sr0."water"                                              AS "water",
                    sr0."inserted_at"                                        AS "inserted_at",
                    sr0."updated_at"                                         AS "updated_at",
                    COALESCE(sr0."value",
                             LAG(sr0."value") OVER (ORDER BY sr0."read_at")) AS "current_value"
             FROM "readings" AS sr0)
SELECT c0."id",
       c0."read_at",
       c0."value",
       c0."gas",
       c0."water",
       c0."inserted_at",
       c0."updated_at",
       LAG(c0."value") OVER (ORDER BY c0."read_at")
FROM "current_values" AS c0
ORDER BY c0."read_at";

Am I doing it wrong? Is this a limitation? Is this a bug?

Marked As Solved

salomvary

salomvary

All right, I managed to get this working using fragment in the second select_merge:

current_value: fragment("current_value")

Suggestions for a more elegant approach are still welcome :slight_smile:

Also Liked

LostKobrakai

LostKobrakai

Virtual fields are not selected by default based in the schema, so you need to explicitly select/select merge it in the last query.

Where Next?

Popular in Questions Top

skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
ycv005
I have followed this StackOverflow post to install the specific version of Erlang. And When I am running mix ecto.setup then getting fol...
New
baxterw3b
Hi guys, i’m new in the Elixir world, and i have to say, that i love it! i’m having some problem to understand anonymous functions with ...
New
SoCreat
i’m a new one to elixir which editor can i use vs code? or atom? Thanks! :smiley:
New
aalberti333
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this: ...
New
RisingFromAshes
I’ve read in another post that it may be possible with a router helper - but I couldn’t find an appropriate one, and tbh, I’m still just ...
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
yawaramin
In the Dialyzer docs ( dialyzer — OTP 29.0.2 (dialyzer 6.0.1) ), there is a way to turn off a specific warning for a function: -dialyzer...
New

Other popular topics Top

danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 29377 241
New
Darmani72
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
274 41539 114
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
aesmail
Hello guys, I have finally made it. I created an admin interface for a framework. It’s been on my todo list for years and with the curre...
New
gausby
I asked this very same question on twitter and got some interesting feedback, but I thought it would be a good question to ask here as we...
1207 39297 209
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers’ Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
dogweather
I wrote this comment on r/haskell, and it’s not popular there. :wink: But I think I’m on to something… Haskell reminds me of Java, and e...
New

We're in Beta

About us Mission Statement