axelson
Today’s talk is another one from Toyota Connected
ElixirConf 2017 - Elixir with Kafka - Mathew Gardner
Elixir with Apache Kafka is a distributed streaming platform which is great at building real-time, web-scale streaming data pipelines that reliably deliver data between producers and consumers. It’s a core component of many large big-data pipelines and sounds a lot like our favorite language, Elixir! Toyota Connected’s role as the global hub for Toyota’s vehicle data means that hundreds of thousands of data points are handled each second. Kafka allows us to maintain a constant stream of these messages into the application without being overwhelmed.
We will show how we used Elixir to handle this scale of throughput and how we interoperated with the other components of the big data ecosystem here at TC. We will show pros and cons with our approach and discuss the alternatives.
Audience: Intermediate-Advanced
All talks are available in the Elixir Conf 2017 Talks List or via the elixirconf2017 tag
Where Next?
Trending in Talks
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Courses that'll move you from confusion to "Aha, now I get it!"
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #ai
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #security
- #performance
Our Sponsors
Build Elixir applications with speed and confidence.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Practical resources that improve the lives of professional developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
**Building the future of software with AI, trust, and human connection.**
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"