madsobel

madsobel

Idea for alternative web analytics

Hey folks :waving_hand:
Don’t know if this is the right place to post this, so apologies if not.
I’ve been playing around with an idea in my head for some time now, and sort of archived it for a bit, but it popped back into my head today, and now I gotta ask for some feedback on it.
In a nutshell it’s fairly simple. I was thinking about making server side web analytics based on logger data. Think of it as a custom Logger backend that will generate real-time accurate privacy friendly analytics data for you. Kinda like Webalizer (if anyone remembers that), that basically worked off off access logs.
Is this something you would use in your Phoenix projects, as an alternative to existing analytics solutions?

  • Mads

Most Liked

gdub01

gdub01

Sounds pretty neat!

https://github.com/plausible/analytics

Above is some prior art in elixir. I’d be curious how yours would compare/contrast? Also what do you think about data rollups? Like, how do you go from storing events hourly to daily to yearly? Would you do something with postgres or click house?

madsobel

madsobel

Hi @gdub01
Thanks for the feedback. I was thinking about “streaming”/batch inserting the data into a BigQuery cluster with some multi tenancy, but that could very well be something different. I’d like that “reports” based on the analytics data could be built from SQL.
I didn’t know about the Dashbit article, I’ll check that out, thanks!.
We already use Plausible at work, and it’s fine, but it does not give you the full picture, because it’s (rightfully) respecting do-not-track settings, adblockers etc for privacy, plus it’s client side based.
I think that I can achieve the same level of privacy, but with a higher degree of accuracy with this :slight_smile:

quatermain

quatermain

Logflare is now opensource Supabase Logs: open source logging server

Where Next?

Popular in Discussions Top

AstonJ
Are there any Elixir or Erlang libraries that help with this? I’ve been thinking how streaming services like twitch have exploded recentl...
New
AstonJ
Please see the new poll here: Which code editor or IDE do you use? (Poll) (2022 Edition) It’s been a while since we first asked this, I...
208 31771 143
New
ricklove
I was just introduced to Elixir and Phoenix. I was told about the 2 million websocket test that was done 2 years ago. From my research, t...
New
pillaiindu
In django there is a cache framework backed by memcached. Rails also puts a lot of emphasis on caching, and even the idea of russian-doll...
New
PragTob
Hey everyone, this has been brewing in my head some time and it came up again while reading Adopting Elixir. GenServers, supervisors et...
New
boundedvariable
I am going through the kafka architecture. All the features what the kafka is providing are already in Erlang. I would like hear your opi...
New
tomekowal
Hey guys! I want to create a toy project that shows a chart of temperature over time and updates every 5 seconds. I feel LiveView is per...
New

Other popular topics Top

vertexbuffer
Hello, can anybody help here..? I have a list of players and I what to delete an element, but every for loop the list is reverting to ori...
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers’ Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
hariharasudhan94
Lets say I have map like this fetching from my database %{"_id" => #BSON.ObjectId<58eb1a7a9ad169198c3dXXXX>, "email" => ...
New
Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
AngeloChecked
What learn first? Rust or Elixir Hi Elixir community! I’m here because i want learn a new language. I’m a junior developer and mainly i ...
New

We're in Beta

About us Mission Statement