smpallen99

smpallen99

Whatwasit - Track the changes to your Ecto models

Just released a new package on hex for tracking changes to your Ecto models.

Its functional, but in the early stages. Could use some additional features like restore, version limits, etc. Let me know what you think.

First 10 of 12 Posts Switch mode

OvermindDL1

OvermindDL1

Huh, was actually thinking of making something like this myself. A question though, I notice that it seems to require a User schema of some form to mark whodoneit, however in my system the User is in an LDAP system (not exposed via Ecto since Ecto2 has no LDAP interface, as well as it would not work cross-repo anyway), and the unique ID from the LDAP database is a bigint integer in Ecto. How would I give it the bigint unique ID that does not have a corresponding ecto schema?

smpallen99

smpallen99 OP

It does not need a user model if you don’t want to track who made the change. Please add an issue if want to see support for an LDAP based user model.
To suport your use case, I think we can add an option to the installer for this. Something that would set the user_id to a simple field with a provided type. For the user name, we could add support for a {module, fun} tuple and call the fun if its a tuple.

What do you think?
Steve

OvermindDL1

OvermindDL1

That would be nice! All I’d need to store for ‘who’ made the change is a PostgreSQL bigint integer or larger, and that is included in the assign on every request or nil if not logged in, though it would be nice to, say, save the IP of the person making the change too perhaps? How about a user defined User, either a table reference or a base type like :bigint, as well as a metadata section (:map perhaps?) so we could store other things like IP address?

smpallen99

smpallen99 OP

I have about half of it implemented now with the syntax whatwasit.install —whodoneit-id=bigint syntax. Then you set name_field: {Mod, Fun} to fun/1 that will be called with the whodoneit-id to fetch the name.

Storing a map would be an interesting idea too. As I work though this, I’m thinking generating the Version model from a template in the projects namespace. This would all full customization of the fields.

OvermindDL1

OvermindDL1

Just as a comparison, my original idea for a module like this was less generic, I was planning an interface to use PostgreSQL’s natural ability to mark rows as ‘deleted/invalid’ and they no longer appear after in SQL queries (unless you use a specific one to get those specifically deleted ones), thus you can version that way. Could store something like a user on the table itself for example. I am unsure which method is better actually…

brightball

brightball

I had no idea PostgreSQL could do that…do you have an example handy?

OvermindDL1

OvermindDL1

There are a few ways. PostgreSQL used to have actual Time Travel functionality built in a long time ago but was removed for ANSI compliance over time and is now emulatable via: PostgreSQL: Documentation: 9.5: spi

Honestly that is overkill though, and database specific (which much of my code is anyway), and I am using such a row history as it is on one of my tables. On one of my tables I need to keep all history, and yet it is dynamic. I could have made a logging table but that is extra work so all I did was add a column of (in addition to the other primary keys):

field :invalidated_at, :datetime, primary_key: true

On initial write I set it far in the future (specific date of 294275 AD), on every query I add the 294275 AD date to the query via a helper on the schema. On write I update the :invalidated_at of the old row to now() and write out the new row with the new data with the 294275 AD future date. On delete I just set the :invalidated_at to now(). This is not a generic style that would be useful in most situations, not a good style for storing, say, who did it, although with minor modifications to some of the ordering it would be.

That table grew over a few versions to do that, I was thinking of redesigning it (would not need to be a primary key with an idea I have) with a set of helpers that I could pull out into a library to manage it for me, something as simple as just dropping another timestamps-like call into the migration and schema with a set of options it could take along. It would have been postgresql specific due to using its built in time handling functions though.

smpallen99

smpallen99 OP

I just published 0.2.0 on hex. This version has a mix whatwasit.install —whodoneit-map option that will save your user struct in the database as a map. This should work with any struct and not just an Ecto schema.

Steve

OvermindDL1

OvermindDL1

Awesome, much more generically useful! :slight_smile:

Eiji

Eiji

Is it support:

  1. multiple databases setup
  2. old value, new value and diff (String)
  3. create action (I see delete and update)
    I want to retrieve a user all activity history (create, delete, update - on update what was changed + diff if changed value is a string), so admin can control users work.

Where Next?

Trending in Announcing Top

bluzky
You may know https://ui.shadcn.com/, a UI component library for React. I really love it’s design style and components. I’ve built some co...
387 14960 120
New
JesseHerrick
Hey, I’m Jesse and I’m the main contributor behind Dexter, a full-featured, lightning-fast Elixir LSP optimized for large codebases. It s...
New
shahryarjb
The Chelekom project is a library of Phoenix and LiveView components generated via Mix tasks to fit developer needs seamlessly. One of i...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge & Solve. They are GUI (Emerge) and State management (S...
New
ausimian
Emily is an Elixir library that runs Nx computations on Apple’s MLX. Install it as the default Nx backend and Nx, defn, Axon, Nx.Serving,...
New
wintermeyer
There are three potential reasons for members of this forum to have a look at https://vutuv.de You are tired or annoyed of LinkedIn. Yo...
New

Other Trending Topics Top

type1fool
I just stumbled on a newly redesigned elixir-lang.org. :tada: It looks like @Software_Mansion did the work, and I think it is generally a...
New
akoutmos
@hugobarauna and I (Alex Koutmos) have been hard at work on writing a book on Nerves that takes you from simply blinking LEDs to building...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
bjorng
We want to introduce a new native datatype to Erlang: native records. Although replacing all tuple records with native records is not our...
New
spammy
I’m looking to build a personal workflow to quickly deploy web applications written in elixir/phoenix, for local consumption (ie not on t...
New
alexslade
Fly’s CEO posted this recently - Turn And Face The Strange · The Fly Blog It says that Fly is going all-in on sprites, which is a worry ...
New

We're in Beta

About us Mission Statement