madsobel
Hey folks 
Don’t know if this is the right place to post this, so apologies if not.
I’ve been playing around with an idea in my head for some time now, and sort of archived it for a bit, but it popped back into my head today, and now I gotta ask for some feedback on it.
In a nutshell it’s fairly simple. I was thinking about making server side web analytics based on logger data. Think of it as a custom Logger backend that will generate real-time accurate privacy friendly analytics data for you. Kinda like Webalizer (if anyone remembers that), that basically worked off off access logs.
Is this something you would use in your Phoenix projects, as an alternative to existing analytics solutions?
- Mads
Where Next?
Trending in Discussions
Other Trending Topics
Latest Phoenix Threads
Latest on Elixir Forum
Sponsor Spotlight
We build reliable cloud platforms for business-critical systems.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #ai
- #phoenix_html
- #elixirconf-us
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #hex
- #security
- #metaprogramming
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 5- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
gdub01
Sounds pretty neat!
https://github.com/plausible/analytics
Above is some prior art in elixir. I’d be curious how yours would compare/contrast? Also what do you think about data rollups? Like, how do you go from storing events hourly to daily to yearly? Would you do something with postgres or click house?
madsobel
Hi @gdub01
Thanks for the feedback. I was thinking about “streaming”/batch inserting the data into a BigQuery cluster with some multi tenancy, but that could very well be something different. I’d like that “reports” based on the analytics data could be built from SQL.
I didn’t know about the Dashbit article, I’ll check that out, thanks!.
We already use Plausible at work, and it’s fine, but it does not give you the full picture, because it’s (rightfully) respecting do-not-track settings, adblockers etc for privacy, plus it’s client side based.
I think that I can achieve the same level of privacy, but with a higher degree of accuracy with this
kwando
Logflare pushes logs to bigquery, maybe something to look into
madsobel
Indeed. The underlying architecture is very much inspired by Logflare.
I did however look a bit into ClickHouse, and it seems sick, and worth looking into I think
quatermain
Logflare is now opensource Supabase Logs: open source logging server