Anko
I’m trying to write a Table.Reader implementation for Snap.SearchResponse from the snap library (GitHub - breakroom/snap: An Elasticsearch/OpenSearch client for Elixir · GitHub) which talks to elasticsearch
This is what I think it should look like
if Code.ensure_loaded?(Table.Reader) do
defimpl Table.Reader, for: Snap.SearchResponse do
def init(result) do
columns = get_columns(result)
rows = get_rows(result)
{:rows, %{columns: columns}, rows}
end
defp get_columns(response) do
if response.hits.hits |> Enum.empty?() do
[]
else
hits = response.hits.hits
hits |> List.first() |> Map.fetch!(:source) |> Map.keys()
end
end
defp get_rows(response) do
hits = response.hits.hits
hits
|> Enum.map(fn hit ->
hit.source |> Map.values()
end)
end
end
end
and here is an Example Snap.SearchResponse
%Snap.SearchResponse{
took: 1,
timed_out: false,
shards: %{"failed" => 0, "skipped" => 0, "successful" => 1, "total" => 1},
hits: %Snap.Hits{
total: %{"relation" => "gte", "value" => 10000},
max_score: 1.0,
hits: [
%Snap.Hit{
index: "products",
type: nil,
id: "BH2lkY0BtfUXFCo5NxOU",
score: 1.0,
source: %{
"Country" => "Myanmar",
"Item Type" => "Beverages",
"Order Date" => "5/29/2016",
"Order ID" => "238846909",
"Order Priority" => "L",
"Region" => "Asia",
"Sales Channel" => "Offline",
"Ship Date" => "6/15/2016",
"Total Cost" => "284933.77",
"Total Profit" => "140360.58",
"Total Revenue" => "425294.35",
"Unit Cost" => "31.79",
"Unit Price" => "47.45",
"Units Sold" => "8963"
},
fields: nil,
explanation: nil,
matched_queries: nil,
highlight: nil,
inner_hits: nil
},
%Snap.Hit{
index: "products",
type: nil,
id: "BX2lkY0BtfUXFCo5NxOU",
score: 1.0,
source: %{
"Country" => "Costa Rica",
"Item Type" => "Cereal",
"Order Date" => "2/23/2017",
"Order ID" => "673583209",
"Order Priority" => "L",
"Region" => "Central America and the Caribbean",
"Sales Channel" => "Online",
"Ship Date" => "2/26/2017",
"Total Cost" => "830895.45",
"Total Profit" => "628546.05",
"Total Revenue" => "1459441.50",
"Unit Cost" => "117.11",
"Unit Price" => "205.70",
"Units Sold" => "7095"
},
fields: nil,
explanation: nil,
matched_queries: nil,
highlight: nil,
inner_hits: nil
},
%Snap.Hit{
index: "products",
type: nil,
id: "Bn2lkY0BtfUXFCo5NxOU",
score: 1.0,
source: %{
"Country" => "Cameroon",
"Item Type" => "Meat",
"Order Date" => "7/30/2014",
"Order ID" => "277272450",
"Order Priority" => "H",
"Region" => "Sub-Saharan Africa",
"Sales Channel" => "Offline",
"Ship Date" => "8/12/2014",
"Total Cost" => "3623195.15",
"Total Profit" => "568282.00",
"Total Revenue" => "4191477.15",
"Unit Cost" => "364.69",
"Unit Price" => "421.89",
"Units Sold" => "9935"
},
fields: nil,
explanation: nil,
matched_queries: nil,
highlight: nil,
inner_hits: nil
},
%Snap.Hit{
index: "products",
type: nil,
id: "B32lkY0BtfUXFCo5NxOU",
score: 1.0,
source: %{
"Country" => "Republic of the Congo",
"Item Type" => "Clothes",
"Order Date" => "9/23/2015",
"Order ID" => "593713462",
"Order Priority" => "H",
"Region" => "Sub-Saharan Africa",
"Sales Channel" => "Online",
"Ship Date" => "10/7/2015",
"Total Cost" => "66734.08",
"Total Profit" => "136745.28",
"Total Revenue" => "203479.36",
"Unit Cost" => "35.84",
"Unit Price" => "109.28",
"Units Sold" => "1862"
},
fields: nil,
explanation: nil,
matched_queries: nil,
highlight: nil,
inner_hits: nil
}
]
},
suggest: nil,
aggregations: nil,
scroll_id: nil,
pit_id: nil
}
so i’ve forked snap, added this code and loaded it in a livebook
{:ok, results} = Snap.Search.search(Elastic, "products", %{query: %{match_all: %{}}})
results
I would expect livebook to show me a data table, but instead it just shows me the full Snap.SearchResponse pasted above. I have tried added IO.puts in the Table.Reader init function but to no avail. Any ideas how i can debug this?
Trending in Questions
I’m working on a project that simulates the bumbl example in the programming phoenix book. It acts almost like an email client. We have a...
New
Hello!
Could someone please give me a help/sample code, how to delete a file from s3 using waffle/waffle_ecto from Phoenix app.
I creat...
New
I’m seeing that a list inside a Kino.DataTable will be interpreted as a charlist, even if the Kino.configure() is set to charlists: :as_l...
New
So my question is quite simple and i have found no conclusive answer on forum, google or AI.
Should we use :erlang.float for Integer to ...
New
Hi, I’ve just set up an application with ash_authentication. There is only magic link strategy for now, so there is no confirmation add o...
New
If a change or preparation module uses Ash.Changeset.get_argument/2 or Ash.Query.get_argument/2 (or any of the other get_argument functio...
New
apply_graft/2 doesn’t rewrite an add_many sub-workflow’s deps on an add step. Grafted jobs cancel with “upstream job was deleted”
Version...
New
Other Trending Topics
I am happy to introduce the very α version of the new programming language compiled to BEAM.
Welcome Cure.
It has literally three kille...
New
Hobbes is a low-level distributed database for the Elixir programming language.
Hobbes provides a simple, safe, and scalable storage lay...
New
Hi there! We created Gust: A task orchestrator inspired by Airflow.
For those who have never heard about Aiflow, it’s a Python-based wor...
New
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve.
They are GUI (Emerge) and State management (S...
New
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixirconf-us
- #blog-post
- #ai
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #hex
- #security
- #metaprogramming










Showing Posts 1 to 4- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
Anko
update:
works, so my Table.Reader works.. i don’t understand yet why it doesn’t show as tabular data in livebook
also works
jonatanklosko
In order for Livebook to render a struct in a special way, it needs to implement the
Kino.Renderprotocol. See kino_db/lib/kino_db.ex at 0de094fcefb2f28a5c413e95ce551adf00dcb5e7 · livebook-dev/kino_db · GitHub for example.Anko
Wow thanks
I had no idea this is what was wrong.
Do you have any thoughts on the best path forward for livebook + elasticsearch? It’s not exactly tabular data. I mean, it contains tabular data but it also has a great deal of metadata eg. aggregations shards etc.. as per the above example.
jonatanklosko
I didn’t really interact with ES in practice, so I don’t have a strong opinion what would be most useful. For queries I can imagine the score being quite relevant, so perhaps it should also be a part of the table.