Aider + claude 3.5 sonnet works really well with Elixir

Can anyone here can compare the performance of Claude 3.5 vs OpenAi 4o for elixir tasks?

The top model on Aider LLM leaderboard is claude-3.5-sonnet.

I have switched from OpenAI 4o and in my experience in Elixir claude 3.5 sonnet is way ahead.

Thanks for recommendation but i have some questions.

It seems that aider auto-commits requested changes, is it worth it? Currently i commit my changes every time i fix a bug or i want to have a place where i can safely come back after doing something i later may want to undo, making a commit every time i ask for some changes doesn’t seem like the best approach(at least at first).

Wouldn’t it be more convenient to ask for changes, and then have an option to accept, discard or make adjustments to generated code(that’s how Cursor works).

PS. i also use claude 3.5, it’s awesome

Auto commits were annoying for me too so I have this in my .aider.conf.yml:

  ## Enable/disable auto commit of LLM changes (default: True)
  auto-commits: false
  
  ## Attribute aider code changes in the git author name (default: True)
  attribute-author: false
  
  ## Attribute aider commits in the git committer name (default: True)
  attribute-committer: false

@preciz thanks for the tips on Aider and Claude. Already helpful.

I use continue.dev + claude 3.5 sonnet.

+1 to Claude Sonnet!

From my experience, Claude 3.5 Sonnet outperforms OpenAI 4o in handling Elixir tasks. Having worked with Elixir for eight months, I’ve consistently found Claude to be superior in generating Elixir code. Previously, Opus was quite good, but Sonnet has significantly surpassed it.

Do you have more examples? Can it generate a module which was not already in the training data? I can imagine it saw many examples of a Modal with JS functions.

Maybe you can ask it to create a module that can record interactions with a LiveView and can then generate tests based on those recordings. All the database query can be mocked out by what is found in the recordings. Think ExVCR for LiveView.

If it works, I would love to use that code!

Is Claude 3.5 really that good?

Claude 3 Opus was already good and 3.5 Sonnet is good too, and apparently quicker.