Max

Max

Putting unaccent in existing query

Hi,

how do i add unaccent (already works on psql server) to the following query:

|> where( [a, b], ilike(a.title, ^“%#{search_string}%”) or ilike(b.name, ^“%#{search_string}%”)

I know something with fragment. But not sure how to add it. Would really appreciate any help here.

thanks

First 10 of 10 Posts Switch mode

Fl4m3Ph03n1x

Fl4m3Ph03n1x

Hello Max,

I am having trouble understanding your questions. Do you mean escaping? Do you want to escape the search string?

Could you provide us with a small example of what you are looking for?

Max

Max OP

Sorry for not beeing clear. For example: I have a user Horváth. Now if i search the name by typing Horvath ( a instead of á) there is no result. To ignore the accent postgres can use the extension unaccent.

SELECT * FROM users WHERE unaccent(lastname) = unaccent(‘Horváth’)

Now i don´t know how to combine ilike with unaccent.

Thanks for looking into it.

Fl4m3Ph03n1x

Fl4m3Ph03n1x

Would something like this be what you are looking for ?

Max

Max OP

No. But thank you for your suggention. Might come handy another time. I need a query with unaccent and ilike together.

NobbZ

NobbZ

To be honest, this will probably result in a linear scan of the table. Therefore I’d add an indexed column, which contains the unaccented name while not using like and friends unless necessary.

Max

Max OP

Thanks. But i don´t get it where the problem lies. The raw postgres query is somehow simple. Besides from ilike i tried the following but get an error that there is no function unaccent:

|> where(
      [a],
      fragment("unaccent(?)", ^search_string) == fragment("unaccent(?)", a.lastname)
    )

A second column would only be the last ( very last :slight_smile: ) option

NobbZ

NobbZ

But a solution that can benefit from an index and therefore make the query returning much faster…

NobbZ

NobbZ

Aside of that, please take a look at the generated query, does it look like you expect it? Does it work if you send that query to the DB directly?

Max

Max OP

You are absolutly right with the index and the performance. But it is not so relevant here.

But …

Got it working :slight_smile:

Here for anybody might looking for the same thing:

    |> where(
      [a],
      fragment("unaccent(?) ILIKE unaccent(?)", a.lastname, ^"%#{search_string}%")
    )
OvermindDL1

OvermindDL1

For note, just unaccenting won’t find slight misspelling and similar phenomes and so forth. If you are using PostgreSQL (as stated above) then you really should use it’s language lookup system (tsvector’s and all). It is significantly more powerful, more useful, and will also be faster than using ILIKE.

Also, you really don’t want to accept user string when using ILIKE/LIKE as it is quite possible to craft some exponentially bad lookups via it that can bring your database to a crawl or death.

A quick no-index setup but significantly more useful and safe than ILIKE while returning much better results would be something like changing your example into:

    |> where(
      [a],
      fragment("to_tsvector(?) @@ to_tsquery(?)", a.lastname, ^search_string)
    )

And there are tons of options on how to control it as well, but the defaults are perfectly fine for 95% of cases.

— All posts loaded —

Where Next?

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
jonnycharles
I’m in search of an Elixir library that offers PDF generation capabilities similar to Ruby’s Prawn. While there have been discussions abo...
New
spammy
I’m looking to build a personal workflow to quickly deploy web applications written in elixir/phoenix, for local consumption (ie not on t...
New
silverdr
Using Phoenix.LiveView.TagEngine as an EEx.Engine is deprecated! To compile HEEx, use Phoenix.LiveView.TagEngine.compile/2 instead. Sta...
New
dli
Before I dive in myself, did anyone successfully sprinkle Hologram into their existing LiveView app? Looking for hints regarding: Addi...
New
bottlenecked
Hi all, I wanted to ask how the community is dealing with post-release steps. Today we have Ecto migrations, which make sure that the db...
New
michallepicki
I am using Oban and occasionally, shortly after a deployment, a handful of jobs can fail because of dependency on other parts of the syst...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New
type1fool
I just stumbled on a newly redesigned elixir-lang.org. :tada: It looks like @Software_Mansion did the work, and I think it is generally a...
New
akoutmos
@hugobarauna and I (Alex Koutmos) have been hard at work on writing a book on Nerves that takes you from simply blinking LEDs to building...
New

We're in Beta

About us Mission Statement