Anko

Anko

Table.Reader for Elasticsearch isn't working :(

I’m trying to write a Table.Reader implementation for Snap.SearchResponse from the snap library (GitHub - breakroom/snap: An Elasticsearch/OpenSearch client for Elixir · GitHub) which talks to elasticsearch

This is what I think it should look like

if Code.ensure_loaded?(Table.Reader) do
  defimpl Table.Reader, for: Snap.SearchResponse do
    def init(result) do
      columns = get_columns(result)
      rows = get_rows(result)
      {:rows, %{columns: columns}, rows}
    end

    defp get_columns(response) do
      if response.hits.hits |> Enum.empty?() do
        []
      else
        hits = response.hits.hits
        hits |> List.first() |> Map.fetch!(:source) |> Map.keys()
      end
    end

    defp get_rows(response) do
      hits = response.hits.hits

      hits
      |> Enum.map(fn hit ->
        hit.source |> Map.values()
      end)
    end
  end
end

and here is an Example Snap.SearchResponse

%Snap.SearchResponse{
  took: 1,
  timed_out: false,
  shards: %{"failed" => 0, "skipped" => 0, "successful" => 1, "total" => 1},
  hits: %Snap.Hits{
    total: %{"relation" => "gte", "value" => 10000},
    max_score: 1.0,
    hits: [
      %Snap.Hit{
        index: "products",
        type: nil,
        id: "BH2lkY0BtfUXFCo5NxOU",
        score: 1.0,
        source: %{
          "Country" => "Myanmar",
          "Item Type" => "Beverages",
          "Order Date" => "5/29/2016",
          "Order ID" => "238846909",
          "Order Priority" => "L",
          "Region" => "Asia",
          "Sales Channel" => "Offline",
          "Ship Date" => "6/15/2016",
          "Total Cost" => "284933.77",
          "Total Profit" => "140360.58",
          "Total Revenue" => "425294.35",
          "Unit Cost" => "31.79",
          "Unit Price" => "47.45",
          "Units Sold" => "8963"
        },
        fields: nil,
        explanation: nil,
        matched_queries: nil,
        highlight: nil,
        inner_hits: nil
      },
      %Snap.Hit{
        index: "products",
        type: nil,
        id: "BX2lkY0BtfUXFCo5NxOU",
        score: 1.0,
        source: %{
          "Country" => "Costa Rica",
          "Item Type" => "Cereal",
          "Order Date" => "2/23/2017",
          "Order ID" => "673583209",
          "Order Priority" => "L",
          "Region" => "Central America and the Caribbean",
          "Sales Channel" => "Online",
          "Ship Date" => "2/26/2017",
          "Total Cost" => "830895.45",
          "Total Profit" => "628546.05",
          "Total Revenue" => "1459441.50",
          "Unit Cost" => "117.11",
          "Unit Price" => "205.70",
          "Units Sold" => "7095"
        },
        fields: nil,
        explanation: nil,
        matched_queries: nil,
        highlight: nil,
        inner_hits: nil
      },
      %Snap.Hit{
        index: "products",
        type: nil,
        id: "Bn2lkY0BtfUXFCo5NxOU",
        score: 1.0,
        source: %{
          "Country" => "Cameroon",
          "Item Type" => "Meat",
          "Order Date" => "7/30/2014",
          "Order ID" => "277272450",
          "Order Priority" => "H",
          "Region" => "Sub-Saharan Africa",
          "Sales Channel" => "Offline",
          "Ship Date" => "8/12/2014",
          "Total Cost" => "3623195.15",
          "Total Profit" => "568282.00",
          "Total Revenue" => "4191477.15",
          "Unit Cost" => "364.69",
          "Unit Price" => "421.89",
          "Units Sold" => "9935"
        },
        fields: nil,
        explanation: nil,
        matched_queries: nil,
        highlight: nil,
        inner_hits: nil
      },
      %Snap.Hit{
        index: "products",
        type: nil,
        id: "B32lkY0BtfUXFCo5NxOU",
        score: 1.0,
        source: %{
          "Country" => "Republic of the Congo",
          "Item Type" => "Clothes",
          "Order Date" => "9/23/2015",
          "Order ID" => "593713462",
          "Order Priority" => "H",
          "Region" => "Sub-Saharan Africa",
          "Sales Channel" => "Online",
          "Ship Date" => "10/7/2015",
          "Total Cost" => "66734.08",
          "Total Profit" => "136745.28",
          "Total Revenue" => "203479.36",
          "Unit Cost" => "35.84",
          "Unit Price" => "109.28",
          "Units Sold" => "1862"
        },
        fields: nil,
        explanation: nil,
        matched_queries: nil,
        highlight: nil,
        inner_hits: nil
      }
    ]
  },
  suggest: nil,
  aggregations: nil,
  scroll_id: nil,
  pit_id: nil
}

so i’ve forked snap, added this code and loaded it in a livebook

{:ok, results} = Snap.Search.search(Elastic, "products", %{query: %{match_all: %{}}})

results

I would expect livebook to show me a data table, but instead it just shows me the full Snap.SearchResponse pasted above. I have tried added IO.puts in the Table.Reader init function but to no avail. Any ideas how i can debug this?

Marked As Solved

jonatanklosko

jonatanklosko

Creator of Livebook

In order for Livebook to render a struct in a special way, it needs to implement the Kino.Render protocol. See kino_db/lib/kino_db.ex at 0de094fcefb2f28a5c413e95ce551adf00dcb5e7 · livebook-dev/kino_db · GitHub for example.

Last Post!

jonatanklosko

jonatanklosko

Creator of Livebook

I didn’t really interact with ES in practice, so I don’t have a strong opinion what would be most useful. For queries I can imagine the score being quite relevant, so perhaps it should also be a part of the table.

Where Next?

Popular in Questions Top

minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
Darmani72
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
marius95
Hello everyone, I try to use an Javascript Event Handler in my root.html.leex file. Therefore I created a function in the app.js file: ...
New
svb
Hi! Currently I want to submit a form by pressing the Enter key. However, since my input field is of type “textarea” this is just adds a...
New
senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New

Other popular topics Top

hariharasudhan94
I would like to know what is the best IDE for elixir development?
New
jononomo
For some reason my phoenix channels are working for me in my local dev environment, but as soon as I deploy via Docker, I get a 403 error...
New
dogweather
I wrote this comment on r/haskell, and it’s not popular there. :wink: But I think I’m on to something… Haskell reminds me of Java, and e...
New
greenz1
I have a phoenix application from which a user can download multiple(5-6) files of size 1MB. I couldn’t find anything related to sending ...
New
romenigld
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
New
AstonJ
Posting this to see if we can make things easier for people to get into Neovim. If you use Neovim and have a favourite distro please let ...
New

We're in Beta

About us Mission Statement