chasers
Anyone interested in another logging thing?
I’ve been building out Logflare with Elixir, which has been great. Initially for Cloudflare customers via the Cloudflare app, but doing this made me want a bit more out of the Elixir logging ecosystem.
Announcing the Logflare Logger backend!
You can easily pump your structured (or not) Elixir logs to Logflare, which then automatically get inserted into a BigQuery table you can query and own directly.
We’ve been using it on production ourselves for a few weeks now. Here is a dashboard I’m using (we need to upgrade our box soon actually).
The whole idea really is that you should log structured data, and you should be able to log liberally into an inexpensive datastore that you can query over the long term. So essentially Logflare is just a fancy queue into BigQuery. Ultimately we should be able to do this a lot cheaper than your standard ELK based log management system because we’re not going to be marketing up the storage at all and BigQuery is way cheaper than Elastic. You Bring Your Own Backend™, and just pay Logflare to get the data there.
I don’t really want to get into the whole logs vs metrics debate because everything breaks at some scale and it’s always good to use the right tool for the job, but I think 95% of apps could just log structured events to a database instead of using statsd-like things. This gets you a ton of benefits over a timeseries db. Honeycomb.io, for example, is also pushing event-based metrics over a statd-like system.
I also am not saying telemetry is bad, because it’s awesome and I think Elixir needs standardized monitoring hooks. We actually hope to have a telemetry backend soon. It’s more the underlying storage I have an issue with, which is also why we ultimately want you to be able to use other databases than BigQuery (eventually).
Anyways, would love some feedback on this whole thing. Our Cloudflare users seem to really like it, and I’m hoping the Elixir community will too.
ps: None of this would even be possible without everything that Elixir/Phoenix is. I’ve been in the software business for over 10 years and I haven’t been this excited about something in a very long time.
pps: We should have LiveView based search done next week:
Where Next?
Trending in Discussions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Build Elixir applications with speed and confidence.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #ai
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #blog-post
- #elixirconf-us
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #elixirconf-eu
- #api
- #forms
- #security
- #metaprogramming
Our Sponsors
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Master modern tools, write cleaner code, and tackle real-world challenges.
Bringing learning, work and compliance together since 1987.
**Building the future of software with AI, trust, and human connection.**
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Most Liked- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
chasers
Logflare Logger Backend is now compatible with new context keys for Elixir 1.10.
I should probably post about this a bit more but in terms of the product Logflare itself, we’re now basically feature matched with something like Papertrail (in terms of streaming, searching, alerting and user access). Working on billing now, and are planning to go v1 once billing is launched. Oh, and we have a Zeit integration also if anyone has any (non-Elixir) stuff on Zeit.
Would love some feedback from Elixir folks!
chasers
And now you can send your browser security reports to Logflare!
Set your
Report-Tourl tohttps://api.logflare.app/logs/browser/reports?api_key=KEY&source_id=SOURCEand we’ll take in everything the reporting API sends over. So ideally you can do something like this for CSP, NEL, crash, intervention etc reports:https://p195.p4.n0.cdn.getcloudapp.com/items/5zuyB9wk/Screen+Shot+2020-03-06+at+10.22.20+AM.png?v=bf904058cbb874ae61b8b0bde5edf00e
chasers
Big update to our search UI … we now have a Date/Time picker, and the whole form is an actual query builder.
One really cool part of this is that if you have the Logflare UI set to local time it automatically converts your query to UTC.
It’s super easy to do timestamp ranges with
t:2020-04-10T01:{50..55}:00And we support microsecond time ranges like
t:2020-04-08T07:40:02.{000001..999999}https://p195.p4.n0.cdn.getcloudapp.com/items/4guy0P1w/Screen%20Recording%202020-04-10%20at%2012.13%20PM.gif?v=0fa3309471a0006b632fc2c61e723821
Now to finish billing…
Last Post!
chasers
logflare_logger_backendis now at0.10.1Improvements
LOGFLARE_and it will use those for your :logflare_logger_backend config.mix logflare_logger.verify_configto look for system env variables also.Fixes