tjdam
Hi!
So I have this bunch of data I’m caching on ETS that refers to the content (videos) I want to be shown to all my users when they log in into my system. The content is the same for everybody, except they all have an association field that keeps track of each user’s progress percentage on each video.
I’ve been trying to come up with solutions to conciliate the cached information with users individual progress on the videos they started watching, like querying all progress data available and then going through each cached video and merging the data but I feel like very inefficient solution… I was wondering how you guys would go about handling this? 
Thank you!
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Develop your skills with books, videos, and courses.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #blog-post
- #phoenix_html
- #iex
- #graphql
- #ai
- #genstage
- #elixirconf-us
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Develop your skills with books, videos, and courses.
Bringing learning, work and compliance together since 1987.
Enabling companies to succeed by building software people love.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 4- Show Best Posts
- Show All Posts (oldest first)
- Show All Posts (newest first)
bartblast
I’d separate what changes (e.g progress) vs what is the same for all users into separate cache entries.
tjdam
Hi! Thanks for your suggestion!
I think what I’m having issues modeling in my mind is how to go about querying the user dependent data based on what is on cache.
For instance, picture a Netflix that always shows the same movies in the main page to every user. How to query for progress data for every movie reference that in cache?
I ask this because in my naive solution I’m querying all the movies in cache against the user id to get back which ones they started watching and their progress so far on each and then stitching the data together. But that got me thinking if this is not more inefficient (or as efficient) as not having a cache and querying the database for the entire set of movies + user progress each time…
harmon25
Could modal your data like this in ETS.
{"user_id", %{"movie_id" => %{progress: 50 }}}Where
user_idis the cache key. Once they start watching a video - progress data gets added. If amovie_iddoes not exist - they have not started watching. (progress = 0)Might be worth putting this kinda data in a DB though as you have realized…
bartblast
Yeah, keep all the user progress in one cache entry for reading, this way you need to access only one entry with a key that you always know (user id). But you should also write the data to the database when it is changed, so that you are sure it is always consistent (depending on the cache backend it may be ephemeral, etc.).