lindem

lindem

I want to write an elixir application performing some ETL work on an SQL Server database (I can see how to do it with ecto, and other ways I can see doing it are harder).

I have found mssql_ecto which does not seem to work with ecto 3, and tds_ecto also seems to not be up to date (I am aware of a fork of ecto_sql but could not glean much from it). Are there any other things I can try to make it work that I have not seen yet?

Showing Posts 1 to 10

Cruz

Cruz

Welcome to the forum!

I’m relatively new to Elixir as well, but for what I’ve seen Ecto adapters for commercial DBs are not updated as often as open source ones. It seems to be just a matter of the number of people using and maintaining those adapters.

You already found what is available for MS SQL. If you want/have to keep working with that DB, you’ll have to use Ecto 2.

Regards

lindem

lindem OP

Thanks for your reply.

I already thought that was going to be the case, but it never hurts to ask whether I missed something.

dimitarvp

dimitarvp

There are efforts which seem to be almost completed to bring MySQL up to speed. But not sure the core team would tackle MSSQL afterwards (or ever).

I personally think it could help Elixir’s adoption a lot.

al2o3cr

al2o3cr

You might try reaching out to the author of this issue:

https://github.com/findmypast-oss/mssqlex/issues/22

to see if they need help / additional contributors.

hectorsq

hectorsq

@lindem,

I am developing a Phoenix app using a legacy mssql database with tds_ecto and ecto 2.

Since I have plans to migrate to postgres I switch my app from tds_ecto + ecto 2 to postgrex + ecto 3 several times a week.

I have not found any unsolvable issues yet and everything seems to work fine.

Please let me know if I can help with a particular issue.

Regards

lindem

lindem OP

Thanks for all the replies.

@dimitarvp The company I have intended to do this for firmly believes in MSSQL, so those places exist.

@al2o3cr I am not sure whether the original project team will keep maintaining it, they have stated they don’t do much elixir anymore here, casting doubts on that project as a whole. That was the reason I kept looking.

@hectorsq I think that is what I am going to explore next. Thanks for telling me that that works for you.

kevn

kevn

The tds_ecto library is close to being ready for Ecto 3.0. A summary of the progress can be found here

ksherman

ksherman

Stoked I watch progress on the Ecto 3 stuff! Though honestly less because of Ecto 3 and more for an adapter with more consistent performance. Tds.Ecto has been great, but every now and then queries are crazy long (similar to findings in this article https://medium.com/asolvi/going-functional-part-iii-using-elixir-and-ecto-with-azure-sql-4e66b677f998)

lindem

lindem OP

The project is done now.

In case anybody finds this thread – I have tried some things, but the SQL Server database (running on Windows) itself was problematic to work with.

I tried/used

I was able to query the database with all adapters and drivers. The encoding issue surprisingly took most of the time. Most of the time I got recognizable text intermixed with garbage. The data could be queried correctly with raw SQL in SSMS (the SQL server GUI). There is another account of this difficulty with no solution here.

I suspect that at least one layer in the chain lied about its encoding.

I was not granted much time to try this. The database was not reachable off-premise, either.

Be that as it may, we ended up not using elixir.

Again, Thanks for everybody’s help.

ksherman

ksherman

Dunno if super related, but since you mention encoding issues, I used the custom type at this bottom of this issue: String with accents are converted to binary · Issue #63 · livehelpnow/tds_ecto · GitHub

and its been working well in pulling what td_ecto returns as binary data if the varchar field returns any characters. Just use the custom type and it seems to decode okay

field :ProductDescription, EfAPI.Types.VarChar

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
water
I’m aware of 2 such projects, are there others? git: GitHub - team-alembic/realworld: A fullstack Phoenix LiveView application with back...
New
peck
Hi everyone. My team and I have been working on a fairly modest app based around video streaming and chat, but we’ve landed a customer t...
New
bradley
I really like the adapter patterns that ecto, nebulex, waffle, etc. use and would love find something similar for a key management servic...
New
unaware8150
Hello folks! So at work, we are seeing some situations where we have to define some “fixed” strings that are used across the codebase in...
New
Alvinkariuki
How Can I Optimise Compile Time Dependencies I have been building an elixir application for about 2 years now. Many modules and files ha...
New
leoschweizer
Hi, we run different LLM models across a cluster, with each node loading a configurable subset. Model-specific queues let nodes consume ...
New

Other Trending Topics Top

mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New
budgie
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with. But I don’t use it anymore. Serverless was the promis...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews