lindem

lindem

I want to write an elixir application performing some ETL work on an SQL Server database (I can see how to do it with ecto, and other ways I can see doing it are harder).

I have found mssql_ecto which does not seem to work with ecto 3, and tds_ecto also seems to not be up to date (I am aware of a fork of ecto_sql but could not glean much from it). Are there any other things I can try to make it work that I have not seen yet?

Showing Posts 1 to 10

Cruz

Cruz

Welcome to the forum!

I’m relatively new to Elixir as well, but for what I’ve seen Ecto adapters for commercial DBs are not updated as often as open source ones. It seems to be just a matter of the number of people using and maintaining those adapters.

You already found what is available for MS SQL. If you want/have to keep working with that DB, you’ll have to use Ecto 2.

Regards

lindem

lindem OP

Thanks for your reply.

I already thought that was going to be the case, but it never hurts to ask whether I missed something.

dimitarvp

dimitarvp

There are efforts which seem to be almost completed to bring MySQL up to speed. But not sure the core team would tackle MSSQL afterwards (or ever).

I personally think it could help Elixir’s adoption a lot.

al2o3cr

al2o3cr

You might try reaching out to the author of this issue:

https://github.com/findmypast-oss/mssqlex/issues/22

to see if they need help / additional contributors.

hectorsq

hectorsq

@lindem,

I am developing a Phoenix app using a legacy mssql database with tds_ecto and ecto 2.

Since I have plans to migrate to postgres I switch my app from tds_ecto + ecto 2 to postgrex + ecto 3 several times a week.

I have not found any unsolvable issues yet and everything seems to work fine.

Please let me know if I can help with a particular issue.

Regards

lindem

lindem OP

Thanks for all the replies.

@dimitarvp The company I have intended to do this for firmly believes in MSSQL, so those places exist.

@al2o3cr I am not sure whether the original project team will keep maintaining it, they have stated they don’t do much elixir anymore here, casting doubts on that project as a whole. That was the reason I kept looking.

@hectorsq I think that is what I am going to explore next. Thanks for telling me that that works for you.

kevn

kevn

The tds_ecto library is close to being ready for Ecto 3.0. A summary of the progress can be found here

ksherman

ksherman

Stoked I watch progress on the Ecto 3 stuff! Though honestly less because of Ecto 3 and more for an adapter with more consistent performance. Tds.Ecto has been great, but every now and then queries are crazy long (similar to findings in this article https://medium.com/asolvi/going-functional-part-iii-using-elixir-and-ecto-with-azure-sql-4e66b677f998)

lindem

lindem OP

The project is done now.

In case anybody finds this thread – I have tried some things, but the SQL Server database (running on Windows) itself was problematic to work with.

I tried/used

I was able to query the database with all adapters and drivers. The encoding issue surprisingly took most of the time. Most of the time I got recognizable text intermixed with garbage. The data could be queried correctly with raw SQL in SSMS (the SQL server GUI). There is another account of this difficulty with no solution here.

I suspect that at least one layer in the chain lied about its encoding.

I was not granted much time to try this. The database was not reachable off-premise, either.

Be that as it may, we ended up not using elixir.

Again, Thanks for everybody’s help.

ksherman

ksherman

Dunno if super related, but since you mention encoding issues, I used the custom type at this bottom of this issue: String with accents are converted to binary · Issue #63 · livehelpnow/tds_ecto · GitHub

and its been working well in pulling what td_ecto returns as binary data if the varchar field returns any characters. Just use the custom type and it seems to decode okay

field :ProductDescription, EfAPI.Types.VarChar

Where Next? Top

Trending in Questions Top

Blokh
Hey guys, I’ve got a huge CSV ( around 10 GB ) that needs to be processed hourly Do you guys have any suggestions what is the best prac...
New
kszambelanczyk
Hello! Could someone please give me a help/sample code, how to delete a file from s3 using waffle/waffle_ecto from Phoenix app. I creat...
New
Onor.io
I have what I’ve heard referred to as a “lookup table” in my database. This is a way of assigning codes to common values. One common lo...
New
Trolleger
What approach to take when sending live updates to “random” users Hi! I have a question, I have a little chat app, and when I create a DM...
New
matt-savvy
Anyone here using Honeybadger? My Honeybadger account is being overwhelmed with noise from some bots. Seeing a lot of Bandit.HTTPError...
New
RemyXRenard
I’m seeing that a list inside a Kino.DataTable will be interpreted as a charlist, even if the Kino.configure() is set to charlists: :as_l...
New
samoloth
Hi, I’ve just set up an application with ash_authentication. There is only magic link strategy for now, so there is no confirmation add o...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
wintermeyer
There are three potential reasons for members of this forum to have a look at https://vutuv.de You are tired or annoyed of LinkedIn. Yo...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews