joangavelan

joangavelan

Reducing incremental compilation times in Phoenix/Ash project

So I’m building a couple of projects with Elixir/Ash/Phoenix/Inertia/React and I’m being EXTREMELY productive with this stack — I mean it, VERY productive — making great progress on both projects at the same time.

Although, I’ve run into a roadblock that’s been discouraging me and I fear it will get worse. One of the projects has started to grow, and every little change I make in a file is taking quite a while to recompile (incremental compilation). It’s slowing down my productivity a lot. It started at 2–3s and now it’s up to 8–10s on every change.

I’m almost certain this is due to my lack of experience in the language and that I might be doing something wrong with the way I’m architecting/writing my code. I’ve done some research and it seems related to compile/runtime dependencies and the like. I’d really appreciate actionable advice or links to resources that can help me fix this. Will this keep getting worse as my project grows, or can it be kept low?

As a side note, I had Claude analyze my repo and it found 13 circular dependency cycles. I’m sure some of you will resonate with this and can guide me on identifying, measuring, and fixing the problem — and avoiding it in the future.

Thanks in advance.

Most Liked

sodapopcan

sodapopcan

You can use xref to help better understand how your modules are connected. There can be a bit of a learning curve but some useful commands are:

mix xref graph --format cycles --label compile-connected

and

mix xref graph --label cycles --sink lib/path/to/file/that/causes/many/recompilations.ex

Cycles aren’t 100% avoidable. For example in has_many and belongs_to relationships, A is going to refer to B and B is going to refer to A. But you should avoid calling functions in this scenario, ie, avoid this:

defmodule A do
  def a, do: B.b()
end

defmodule B do
  def b, do: A.a()
end

This is a bit of a deep topic and there are a lot of threads about this on this forum (search for “transitive dependencies”) as well as some blog posts. Here’s a good one. But it’s very hard to give specific actionable advice without seeing some code (though it would require seeing a lot of code which is of course probably not possible and not something I’d really wanna do, lol).

Some brief tips, though:

  • Avoid defining macros in files that change often.
  • Avoid having modules that you sometimes use in some modules, and sometimes just call random functions (or import) in other modules. Split those up.
  • Avoid calling functions in a module’s body. For example, if you have @foo Foo.bar(), change that to def foo, do: Foo.bar(). This can be ok, but these are brief tips so it’s easier to say Just Don’t Do It.
  • Sometimes you want to avoid even referring to a module in another module’s body (though I believe this isn’t as much of a problem anymore)
  • Along the lines of avoiding cycles: don’t (ever) call any Web functions from your domain modules/resources modules.

That’s all I got. If you have more questions I’m happy to try and answer. I’m not a huge expert here though have helped squash compiletime deps in a few projects and enjoy the topic.

joangavelan

joangavelan

Thank you everyone for your contributions! My mistake was writing inline action hooks within my Ash resources. Moving them into their own modules fixed the issue. I was even experiencing slow compilation times when changing code in my Phoenix controllers, because they referenced Ash domains, which in turn pointed to resources that referenced other modules in the inline hook implementations—creating the so-called transitive dependencies. Breaking those action hooks into separate modules completely solved the problem. Also worth mentioning @zachdaniel for his support in the Ash Discord community. Thanks again!

arcanemachine

arcanemachine

I can’t help you with the Ash side of things, but you can use this tool to get a more concrete view of your dependency graph if that a concern:

Where Next?

Popular in Questions Top

sergio
In Ruby, I can go: User.find_by(email: "foobar@email.com").update(email: "hello@email.com") How can I do something similar in Elixir? ...
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
lessless
I believe there are people here who are dealing with CSV files import on the daily basis, and since Excel is a really popular tool there ...
New
johnnyicon
Hi all, I've just started learning Elixir and Phoenix Framework, so please pardon my n00bness at this stage. I'm trying to use Postg...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
vrod
I am using the Starship cross-shell prompt – it seems pretty nice, but I get some errors: [WARN] - (starship::utils): Executing command ...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
SoCreat
i’m a new one to elixir which editor can i use vs code? or atom? Thanks! :smiley:
New
chensan
I have a User schema with a :from_id field set to type :string: defmodule TweetBot.Repo.Migrations.CreateUsers do use Ecto.Migration ...
New
dotdotdotPaul
Okay, I'm having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I'm sure I'...
New

Other popular topics Top

marius95
Hello everyone, I try to use an Javascript Event Handler in my root.html.leex file. Therefore I created a function in the app.js file: ...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
274 41454 115
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
boundedvariable
I am going through the kafka architecture. All the features what the kafka is providing are already in Erlang. I would like hear your opi...
New
Qqwy
Update: How to use the Blogs & Podcasts section You can post links to your blog posts or podcasts either in one of the Official Blog...
3271 126226 1237
New
PeterCarter
There are pre-rolled solutions for other frameworks that do work. However, Phoenix does not seem to have these. Have people had good expe...
New
senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New

We're in Beta

About us Mission Statement