madsobel

madsobel

Hey folks :waving_hand:
Don’t know if this is the right place to post this, so apologies if not.
I’ve been playing around with an idea in my head for some time now, and sort of archived it for a bit, but it popped back into my head today, and now I gotta ask for some feedback on it.
In a nutshell it’s fairly simple. I was thinking about making server side web analytics based on logger data. Think of it as a custom Logger backend that will generate real-time accurate privacy friendly analytics data for you. Kinda like Webalizer (if anyone remembers that), that basically worked off off access logs.
Is this something you would use in your Phoenix projects, as an alternative to existing analytics solutions?

  • Mads

Showing Posts 1 to 5

gdub01

gdub01

Sounds pretty neat!

https://github.com/plausible/analytics

Above is some prior art in elixir. I’d be curious how yours would compare/contrast? Also what do you think about data rollups? Like, how do you go from storing events hourly to daily to yearly? Would you do something with postgres or click house?

madsobel

madsobel OP

Hi @gdub01
Thanks for the feedback. I was thinking about “streaming”/batch inserting the data into a BigQuery cluster with some multi tenancy, but that could very well be something different. I’d like that “reports” based on the analytics data could be built from SQL.
I didn’t know about the Dashbit article, I’ll check that out, thanks!.
We already use Plausible at work, and it’s fine, but it does not give you the full picture, because it’s (rightfully) respecting do-not-track settings, adblockers etc for privacy, plus it’s client side based.
I think that I can achieve the same level of privacy, but with a higher degree of accuracy with this :slight_smile:

kwando

kwando

Logflare pushes logs to bigquery, maybe something to look into :slight_smile:

madsobel

madsobel OP

Indeed. The underlying architecture is very much inspired by Logflare.
I did however look a bit into ClickHouse, and it seems sick, and worth looking into I think

quatermain

quatermain

Logflare is now opensource Supabase Logs: open source logging server

— All posts loaded —

Where Next? Top

Trending in Discussions Top

wmnnd
Hey folks, I wanted to share with you a project I’ve been working on for a while: It’s an Open Source (AGPLv3) newsletter tool. Think Ma...
New
axelson
Hi there! :wave: @frigidcode and I (but mostly him) have been running an Elixir Book club, we’re almost done with Designing Elixir Syste...
New
budgie
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with. But I don’t use it anymore. Serverless was the promis...
New
alexslade
Fly’s CEO posted this recently - Turn And Face The Strange · The Fly Blog It says that Fly is going all-in on sprites, which is a worry ...
New
sntran
In my third year of college, around 2010, I found Erlang. A few years later, I found Elixir. I liked the ideas at once: many small proces...
New
Ganna
Hi everyone, I have 8 years of production experience with Erlang/OTP and I’m just starting to get to know Elixir. What would you learn f...
New
johnkirkham
A note on form. Joe Armstrong, co-creator of the Erlang programming language, died in April 2019. What follows is a work of narrative non...
New

Other Trending Topics Top

mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews