Which DB do you use with Elixir/Erlang in write-heavy apps (no update)?

[defoemark]

I know that a couple of nosql dbs such as Cassandra or Couchbase work fine for write-heavy applications, but what about mnesia bag type disk_copies? Does it suit, despite of the table size limit?

[tpunt]

It depends upon what sort of data you’re looking to store and how you’re wanting to store it. If you can get away with using a key-value database (such as Redis), then that would most likely be your most performant option (not to mention the nice simplicity of the data model makes it pleasurable to work with). Otherwise, I’ve heard that ScyllaDB is suppose to be very performant, particularly for a column-family database (it aims to basically be a high performance version of Cassandra).

I can’t speak for mnesia though, since I have no experience with it.

[defoemark]

Thanks for reply @tpunt. I’m looking for a data, where primary key can be non-unique (key-value or column db), so I can fetch a batch of records using that primary key. Also it should be fast on writes. Probably the db would be CP.
Most likely the in-memory db would be too expensive. Is there any Elixir or Erlang client for Scylla?
I’ve also heard about RocksDB and that it’s designed to work with SSD.

[tpunt]

@defoemark

I’m looking for a data, where primary key can be non-unique (key-value or column db), so I can fetch a batch of records using that primary key

That doesn’t sound like a PK, but rather just some sort of grouping value.

@defoemark

CP

What’s CP?

@defoemark

Most likely the in-memory db would be too expensive.

Redis doesn’t keep the whole database in memory. It snapshots to disc periodically (I expect other key-value data stores to do the same too).

@defoemark

Is there any Elixir or Erlang client for Scylla?

Good question - I’m not sure if there is. A quick Google search would suggest not.

@defoemark

I’ve also heard about RocksDB and that it’s designed to work with SSD.

That looks like an interesting alternative, and it looks like there are clients for it in Erlang too.

[mkunikow]

Our blog post about databases

Hot Databases

What’s catching your eye in 2016? Huge fan of Postgres here. Some that are hitting the headlines recently include RethinkDB and ScyllaDB. Also worth mentioning… the database free architecure in Elixir/Erlang What about you? Which DBs do you like? Which have caught your eye recently?

So if you want search by something more than key (key must be unique :)) the option is column base database like Cassandra or Scylla. Cassandra is fast on write and slow on read. Cassandra is also eventually consistent → not CP database type. And it is not easy to maintain Cassandra :). I don’t know about Scyllia.
In other case you will need to create composite key and store collection of records in this key.

@tpunt

What’s CP?

CP (Consistency and Partition Tolerance) ?

[defoemark]

@mkunikow

CP (Consistency and Partition Tolerance) ?

Yes I mean consistency and partition tolerance.

@tpunt

That looks like an interesting alternative, and it looks like there are clients for it in Erlang too.

I found erocksdb adapter in Erlang[quote=“mkunikow, post:5, topic:739”]
So if you want search by something more than key (key must be unique :))
[/quote]

Mnesia bag type suits well in this component. The only thing is table size limit.

In case of Cassandra, this Erlang client looks pretty mature.

[krapans]

Anyone already used ScyllaDB with elixir/phoenix and can give feedback how it works?
Because I didn’t found any adapters for elixir /w scylladb

[mkunikow]

Fully compatible with Apache Cassandra

Does it work with something like this GitHub - cqerl/cqex: Idiomatic Cassandra client for Elixir ?

[krapans]

Thanks, didn’t thought about that. Thanks.

[CombinedCognitions]

well i think discord uses it in production

[ambareesha7]

@tpunt

I’ve heard that ScyllaDB is suppose to be very performant, particularly for a column-family database (it aims to basically be a high performance version of Cassandra).

I worked short period for a company who uses ScyllaDB, whatever tools, libraries works for CassandraDB they also works for ScyllaDB, like Xandra library
And ScyllaDB is a monster, very highly performant DB and I found this free GUI tool by Netflix this works for both Cassandra and ScyllaDB
If your use case suits for CassandraDB then I recommend to use ScyllaDB