madsobel

madsobel

Hey folks :waving_hand:
Don’t know if this is the right place to post this, so apologies if not.
I’ve been playing around with an idea in my head for some time now, and sort of archived it for a bit, but it popped back into my head today, and now I gotta ask for some feedback on it.
In a nutshell it’s fairly simple. I was thinking about making server side web analytics based on logger data. Think of it as a custom Logger backend that will generate real-time accurate privacy friendly analytics data for you. Kinda like Webalizer (if anyone remembers that), that basically worked off off access logs.
Is this something you would use in your Phoenix projects, as an alternative to existing analytics solutions?

  • Mads

Showing Posts 1 to 5

gdub01

gdub01

Sounds pretty neat!

https://github.com/plausible/analytics

Above is some prior art in elixir. I’d be curious how yours would compare/contrast? Also what do you think about data rollups? Like, how do you go from storing events hourly to daily to yearly? Would you do something with postgres or click house?

madsobel

madsobel OP

Hi @gdub01
Thanks for the feedback. I was thinking about “streaming”/batch inserting the data into a BigQuery cluster with some multi tenancy, but that could very well be something different. I’d like that “reports” based on the analytics data could be built from SQL.
I didn’t know about the Dashbit article, I’ll check that out, thanks!.
We already use Plausible at work, and it’s fine, but it does not give you the full picture, because it’s (rightfully) respecting do-not-track settings, adblockers etc for privacy, plus it’s client side based.
I think that I can achieve the same level of privacy, but with a higher degree of accuracy with this :slight_smile:

kwando

kwando

Logflare pushes logs to bigquery, maybe something to look into :slight_smile:

madsobel

madsobel OP

Indeed. The underlying architecture is very much inspired by Logflare.
I did however look a bit into ClickHouse, and it seems sick, and worth looking into I think

quatermain

quatermain

Logflare is now opensource Supabase Logs: open source logging server

— All posts loaded —

Where Next? Top

Trending in Discussions Top

AstonJ
As the title says, please share what you’ve been up to with Elixir. Whether that’s been learning it, looking into it, making stuff with i...
2977 94592 917
New
cblavier
Hey there, It’s been more than a year since we started using LiveView as our main UI library and building a whole library of UI componen...
New
mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
heathen
Quite interesting article Google brought me. Didn’t find any mentions about it here. What do you think in general? Would you use togethe...
New
mhanberg
Hi everyone! The first release candidate for the Expert language server project is now available! We’ve published a press release detai...
New
AstonJ
Since we have deprecated our Erlang sections (as we have dedicated Erlang Forums now) let’s add this thread for those who’d like to post ...
New
maennchen
:warning: Security advisory: Decimal DoS vulnerability A vulnerability has been published for decimal where very large exponents can cau...
New

Other Trending Topics Top

JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Dmk
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New

Latest on Elixir Forum

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews