uranther
Scalable Web Architecture and Distributed Systems - General Discussion, Blog Posts, Wiki
Distributed Systems
What distributed systems theory should a distributed systems engineer know?
- Distributed systems theory for the distributed systems engineer
- Scalable Web Architecture and Distributed Systems
- What We Talk about When We Talk about Distributed Systems (video/presentation) – from a core developer of RabbitMQ
- Design Patterns for Container-based Distributed Systems - Brendan Burns and David Oppenheimer, Google
Research Papers
Reactive Programming
Scalable Web Architecture
Data Pipeline
- Using logs to build a solid data infrastructure (or: why dual writes are a bad idea)
- The Log: What every software engineer should know about real-time data’s unifying abstraction
A system that assumes an external log is present allows the individual systems to relinquish a lot of their own complexity and rely on the shared log. Here are the things I think a log can do:
- Handle data consistency (whether eventual or immediate) by sequencing concurrent updates to nodes
- Provide data replication between nodes
- Provide “commit” semantics to the writer (i.e. acknowledging only when your write guaranteed not to be lost)
- Provide the external data subscription feed from the system
- Provide the capability to restore failed replicas that lost their data or bootstrap new replicas
- Handle rebalancing of data between nodes.
- Making Sense of Stream Processing
- Questioning the Lambda Architecture
- Netflix’s Data Pipeline with Steven Wu [podcast]
- Designing for Massive Scalability at Backtype [slide deck]
Resilient services
Most Liked
mkunikow
- reactivemanifesto
- reactive streams → this is something related to Java VM but the main idea is the you have producer and consumer over network with back pressure (the speed can adapt during time to producer and consumer). This help eliminate big buffer or loosing data if buffer is full → Assume you could add something like this to phoenix channel
####Key Requirements for Streaming Platforms: A Micro-Services Advantage - Whiteboard Walkthrough
3
Popular in Wikis
Introduction
After some discussion with a few other members we thought it might be an idea to start a thread where we can post about libr...
New
With the new year I am looking at travel for this year and I’d love to base some travel around Elixir. So in the spirit of the 2017 threa...
New
Preamble
This Wiki is intended to be a community-maintained (see the Contribution Guidelines if interested) resource of common “gotchas” ...
New
Introduction
Now that the language is picking up support and maturing nicely, I’d like to start a collection of common and recurring Elix...
New
Guide
Using an iPad for web development can be easily split into two main parts:
Setting up the iPad as a thin client
Working in a remo...
New
I’d like to start a discussion of data serialization formats, in the context of Elixir. The rest of this note is a combination of persona...
New
Hi people, since the new year is coming, I’d like to plan my travels for events in 2017.
So, what events (Elixir or FP related) that you...
New
At start some definitions:
HTTPS (is a protocol for secure communication over a computer network which is widely used on the Internet) -...
New
We’ve put together this wiki for Phoenix LiveView - please feel free to add any info you feel is worth including.
What is Phoenix LiveV...
New
I’ve noticed we’ve got a few now - wonder if we can compile a list? This is a wiki - anyone at Trust Level 1 can edit :023:
Link: http...
New
Other popular topics
Hello!
tl;dr Announcing Oban, an Ecto based job processing library with a focus on reliability and historical observability.
After spen...
New
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service.
Currently when I de...
New
If I have a post route which an argument:
post /my_post_route/:my_param1, MyController.my_post_handler
How would get the post params ...
New
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch.
This project took far...
New
Good day to you all.
I have been struggling to get a query involving like and ilike to work.
Can anyone assist me on this, please?
pro...
New
Hi!
In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir?
Searched the docs for ip address and the web, no good results.
Thanks!
New
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
Hi there,
I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 records...
New
What is the proper way to load a module from a file in to IEX?
In the python world, doing something like this pretty standard:
from ....
New
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
Latest on Elixir Forum
Sponsor Spotlight
Practical resources that improve the lives of professional developers.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Real-time error tracking, performance insights, and observability for devs.
Practical resources that improve the lives of professional developers.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
Courses that'll move you from confusion to "Aha, now I get it!"