fun2src

fun2src

Hi all,

I need to index patents from the sources available in the web. The current implementation enables querying over a database of patents published by the USPTO.

Current implementation: Apache Nutch, Apache Lucene and PostgreSQL.

Is there a Apache Lucene equivalent in Elixir?

Showing Posts 1 to 10

Ted

Ted

I’m not experienced enough with Elixir to comment on a direct equivalent of Lucene, but perhaps swapping out Lucene with Solr might do the trick.

Then you might be able to use an Elixir-based client, maybe:

.

lucaong

lucaong

Is it a project requirement for the full-text index to be embedded, or it is a possibility to use a search server like ElasticSearch or Solr (both based on Lucene internally)? In that case there are Elixir clients available.

sribe

sribe

It really wouldn’t be hard to set up your own Lucene server, then query it from Elixir. Full-text index & search is very CPU intensive–I’d call it a good example of something the BEAM is not suited for.

rodrigues

rodrigues

As @lucaong suggested, Solr and ElasticSearch are nice services based on Lucene, gotta see what is better for you. I use Elastic, but instead of a client package to interact with it, I use just a module that provides a minimal API to talk to it.

Definitely not a recommendation, but yes, there is at least one:

riak_search is a Lucene-like full-text search engine in the BEAM (Erlang), it just seems not to be under active development anymore – not sure if others are still working with it. Looks like it provides full text abilities just with BEAM, and also integration with Solr.

fun2src

fun2src OP

It is not a requirement of the project. ElasticSearch and Solr are interesting options.

Good idea! I will try this approach. :smile:

Thank you so much!

idi527

idi527

There is a rust alternative called tantivy which is not particularly hard to interact with from elixir via rustler.

mkunikow

mkunikow

There is Amazon rip off of elastic search also :slight_smile:

https://opendistro.github.io/for-elasticsearch/

mkunikow

mkunikow

nice Rust is cool kid on the block :slight_smile:

mkunikow

mkunikow

https://github.com/valeriansaliou/sonic
https://github.com/imerkle/sonix

brightball

brightball

And don’t forget, if you’re using Postgres as the database the full text search capabilities are quite good and can often prevent the need to involve an external engine.

Where Next? Top

Trending in Questions Top

itzmidinesh
Hi all, I’m working on a Phoenix project where I need to make external HTTP requests and I’m trying to choose between Req and HTTPoison....
New
yarrichar
I’m very new to Elixir, so sorry if this is a silly question: I am wondering what happens to the mailbox of a process when the machine i...
New
pragdave
How do I tell Hologram not to escape HTML when substituting into templates? {Textile.render(@product.long_description)} escapes the HTM...
New
Fl4m3Ph03n1x
Background When trying to execute mix release on a Windows 11 machine for a Phoenix project I get the following error: * assembling mark...
New
rlipscombe
I’d like to create a file with 600 permissions (rw-------), but there’s a race condition if I create it and then change the permissions. ...
New
saleyn
Is there a way to import record definitions in the iex shell for pretty printing (similar to the rr command in the erl shell)? This woul...
New
rlipscombe
When I use Mix.install with a git dependency, using git@github.com:... how do I change the SSH identity used? I’ve got two Github accoun...
New

Other Trending Topics Top

OliverFady
Name: Oliver Banoub Location: Cairo, Egypt (UTC+2) Remote / relocate: Remote only; can cover 10:00–17:00 US Eastern Looking for: Part-...
New
dominicletz
Hey there, I haven’t seen a list of useful Elixir specific skills for the popular AI tools yet so I’m starting one here with my first. ...
New
raa-ziq
Hi everyone :waving_hand: I wanted to share something I’ve been building — NowBlind, a random chat app designed to help people discover ...
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New
kip
Localize is the next generation localisation library for Elixir. Think of it as ex_cldr version 3.0. The first version will be released ...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews