egor
Hi all, I need to port this from JavaScript to Elixir:
/[\0-\uD7FF\uE000-\uFFFF]|[\uD800-\uDBFF][\uDC00-\uDFFF]|[\uD800-\uDBFF](?![\uDC00-\uDFFF])|(?:[^\uD800-\uDBFF]|^)[\uDC00-\uDFFF]/
When I try:
Regex.compile!("[\0-\uD7FF\uE000-\uFFFF]|[\uD800-\uDBFF][\uDC00-\uDFFF]|[\uD800-\uDBFF](?![\uDC00-\uDFFF])|(?:[^\uD800-\uDBFF]|^)[\uDC00-\uDFFF]", "u")
I get:
** (ArgumentError) invalid or reserved Unicode codepoint 55296
(elixir) src/elixir_interpolation.erl:200: :elixir_interpolation.append_codepoint/5
(elixir) src/elixir_interpolation.erl:81: :elixir_interpolation."-unescape_tokens/2-lc$^0/1-0-"/2
(elixir) src/elixir_interpolation.erl:81: :elixir_interpolation.unescape_tokens/2
(elixir) src/elixir_tokenizer.erl:673: :elixir_tokenizer.handle_strings/6
(elixir) lib/code.ex:669: Code.string_to_quoted/2
and when I try
~r/[\0-\x{D7FF}\x{E000}-\x{FFFF}]|[\x{D800}-\x{DBFF}][\x{DC00}-\x{DFFF}]|[\x{D800}-\x{DBFF}](?![\x{DC00}-\x{DFFF}])|(?:[^\x{D800}-\x{DBFF}]|^)[\x{DC00}-\x{DFFF}]/u
I get
** (Regex.CompileError) disallowed Unicode code point (>= 0xd800 && <= 0xdfff) at position 39
(elixir) lib/regex.ex:172: Regex.compile!/2
(elixir) expanding macro: Kernel.sigil_r/2
iex:43: (file)
Looks like the problem is with \uD800. Does anybody has an idea how to solve it?
Trending in Questions
I’m aware of 2 such projects, are there others?
git: GitHub - team-alembic/realworld: A fullstack Phoenix LiveView application with back...
New
I having some trouble figuring out if I have set myself too strict of standards for my production server. Currently I can handle 75% of r...
New
Hi everyone.
My team and I have been working on a fairly modest app based around video streaming and chat, but we’ve landed a customer t...
New
I really like the adapter patterns that ecto, nebulex, waffle, etc. use and would love find something similar for a key management servic...
New
Hello folks!
So at work, we are seeing some situations where we have to define some “fixed” strings that are used across the codebase in...
New
How Can I Optimise Compile Time Dependencies
I have been building an elixir application for about 2 years now. Many modules and files ha...
New
Other Trending Topics
A little off-topic, but I feel like people here have a good head on their shoulders.
I used to be quite good at making software. Was luc...
New
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with.
But I don’t use it anymore.
Serverless was the promis...
New
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #ai
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #security
- #metaprogramming










Showing Posts 1 to 9- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
Nicd
Looks like you are trying to find surrogate pairs? Elixir uses UTF-8 strings and that is AFAIK not allowed to contain surrogate pairs, so binaries containing them would not be valid strings. And since Regex operates on Elixir strings, it does not make sense to ask it to find them.
What is the actual thing you are trying to accomplish here?
egor
Thanks!
I need to linkify plain text links into html. I’m trying to port GitHub - markdown-it/linkify-it: Links recognition library with full unicode support · GitHub.
Nicd
Where is that regex there?
I think you can avoid running it if it only tries to detect and skip surrogate pairs (since they can’t be in Elixir strings), but would be nice if someone more knowledgeable than me replies also.
egor
https://github.com/markdown-it/linkify-it/blob/master/lib/re.js#L8
https://github.com/markdown-it/uc.micro/blob/master/properties/Any/regex.js
Thanks, I hope you’re right.
OvermindDL1
Perhaps this could be useful?
egor
Thanks! Looks good, but too simple for my case (doesn’t support urls with
http://, internationalized domain names, etc).OvermindDL1
Perhaps a set of PR’s to buff it up could be useful? It could be a great generic library for handling such things.
egor
Opened a PR: Formatter and TLD validation by minibikini · Pull Request #1 · smpallen99/auto_linker · GitHub
OvermindDL1
Ooo very cool, hope it gets accepted soon!