mekusigjinn

mekusigjinn

https://github.com/akoutmos/litestream

The creator is being supported by Fly.io (hired) to work full time on Litestream.
I have a new project I’m ramping up and it’s going to be an e-commerce project.

I’m wondering how Ecto Sqlite3 layer can work with Litestream, in an e-commerce platform.
Because if that works, then I can:

  • use S3 as a very cheap backup solution
  • auditing
  • provide fast user experience because no need for network hop (like when using Postgres)
  • it seems like this is somewhat of a next generation data store architecture

Thanks in advance!

Showing Posts 1 to 3

derpycoder

derpycoder

Litestream is a backup solution, you have to deploy S3 separately or pay for it.

“Litestream has limitations. I built it for single-node applications, so it won’t work well on ephemeral, serverless platforms or when using rolling deployments. It needs to restore all changes sequentially which can make database restores take minutes to complete.” - Ben Johnson


Why not use a distributed Rqlite?!?

When you absolutely must not lose any of your data.

rqlite is an easy-to-use, lightweight, distributed relational database, which uses SQLite as its storage engine. rqlite is simple to deploy, operating it is very straightforward, and its clustering capabilities provide you with fault-tolerance and high-availability.

It also has an in memory database mode with max 2 gb per node capacity! Which won’t loose data on restarts, since the Raft log is the authoritative store for all data, and it is stored on disk by each node, an in-memory database can be fully recreated on start-up from the information stored in the Raft log.

https://github.com/rqlite/rqlite


Also don’t be afraid to use the right tool for the right job.

Like Meilisearch for faster text search.
Or running MinIO if you want object storage.
Or CockroachDB if you want distributed Postgres like DB.

I’m using all 3 and still going to add Rqlite for storing data close to application, in memory. For config management that doesn’t belong on main db.


By no means thats a complete list of databases you will need.

You will end up needing ClickHouse for OLAP or Time series data storage, prometheus for monitoring, loki for logging, a key value store for something & who knows what, eventually.


P.S. Please be wary of the GitHub issues section.

I have been burned by jumping the gun and boarding the hype train, only to reach the end of the road.
Big teams can afford to migrate away from a tech debt, but you will be left hanging.

There’s a reason people prefer Postgres, and now I know why!!

engineeringdept

engineeringdept

I use it on a personal project that needs a sizeable database that’s predominantly read only, for which I want to minimise the number of moving (and costly) parts. It works well! But I’d stick with hosted Postgres for most things.

daveboo

daveboo

… I like that!

— All posts loaded —

Where Next? Top

Trending in Questions Top

Blokh
Hey guys, I’ve got a huge CSV ( around 10 GB ) that needs to be processed hourly Do you guys have any suggestions what is the best prac...
New
kszambelanczyk
Hello! Could someone please give me a help/sample code, how to delete a file from s3 using waffle/waffle_ecto from Phoenix app. I creat...
New
RemyXRenard
I’m seeing that a list inside a Kino.DataTable will be interpreted as a charlist, even if the Kino.configure() is set to charlists: :as_l...
New
velrest
So my question is quite simple and i have found no conclusive answer on forum, google or AI. Should we use :erlang.float for Integer to ...
New
samoloth
Hi, I’ve just set up an application with ash_authentication. There is only magic link strategy for now, so there is no confirmation add o...
New
FlyingNoodle
If a change or preparation module uses Ash.Changeset.get_argument/2 or Ash.Query.get_argument/2 (or any of the other get_argument functio...
New
psy-q
I’m trying to set up Emacs with elixir-ls via lsp-mode and credo via Flycheck. This should mostly be preconfigured as Flycheck picks up c...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews