zorn

zorn

:pencil: Phoenix’s built-in LiveView test helpers require you to hand-build the form payload and start a fresh pipe after every click. Worse, that payload means a test can pass even when the button it “submits” was renamed.

phoenix_test writes the entire flow as a single pipe from the user’s point of view and fails with a focused error instead of the entire page’s HTML. I used it on my last side project, and I don’t want to turn back.

Showing Posts 1 to 6

dimitarvp

dimitarvp

I have used phoenix_test and loved it but noticed a real added wall-clock time using it.

zorn

zorn OP

I’ll have to keep an eye out for that and see if any performance increases should be considered. In general, I’m happy to give up some cycles for this kind of readability tradeoff. I wonder aloud if this is a larger phoenix_test project in the wild I should look to for a sample.

dbaer

dbaer

I hadn’t noticed, but I had migrated during major performance refactors to my tests (20 minutes to less than 30 seconds for the suite :scream:). I’m surprised there is much difference between phoenix_test and not

zorn

zorn OP

I did some AI-sourced experiments on the performance question to scratch a personal curiosity.

The main finding (not verified personally) was that, yes, there is some slowdown when using phoenix_test. It seems to range from 1.3 to 1.6 times slower on most things (and a larger 3.8x on form-submit flows), but mostly because it does more detailed work and runs render(view) a lot more.

The AI’s report suggested that if you are seeing slow test suite wall clocks, make sure you are reaching for async: true before investing in other more drastic findings, which makes sense to me.

https://github.com/zorn/phoenix_test/blob/wayfinder/perf-optimizations/bench/OPTIMIZATION-FINDINGS.md#phoenix_test-optimization-findings

In my LocalCents project, almost all my tests are async: true and when run on my M1 Max, mix tests runs 20 modules at a time. I think GitHub CI runs only about 8 at a time.

dimitarvp

dimitarvp

I think it was related to spawning a browser but that’s more than 12 months in the past now so can’t remember well. Thanks for following up.

hugobarauna

hugobarauna

Livebook Core Team

Agents are usually good at performance optimization.

Wondering if one could point their agent to it, ask it to optimize, and see what happens. :thinking:

(yes, it’s a “lazy comment” expecting someone would do this :sweat_smile: and report back)

— All posts loaded —

Where Next? Top

Trending in Blog Posts Top

ryanzidago
Up until then, I found it very hard to communicate to LLMs that I specifically do not want to handle X case because maybe it has never ha...
New
T0ha666
An automated trigger fired every two minutes for 8 hours. 243 agent runs. 31M tokens. $63 wasted. The problem: nobody noticed until morni...
New
lawik
The words are insufficient to describe what transpired. What we tried to do met what the people wanted it to be. It became beautiful. Th...
New
New
fuelen
I finally found time to write down my journey away from ExMachina, including the workaround I tried first and the API experiments that fo...
New
UlfAnger
Hi all, I’ve built a small demo app to understand what an “AI agent” actually is under the hood, and to show it with Elixir’s own tools ...
New
ryanrborn
A backtest worker and a live trading node had to share one broker rate limit and one set of OAuth tokens, and both only work if there’s e...
New

Other Trending Topics Top

budgie
A little off-topic, but I feel like people here have a good head on their shoulders. I used to be quite good at making software. Was luc...
New
KristerV
Hey. Is there anyone here who creates agents in their apps? Not talking about using agents, but creating them. I’m finding it pretty diff...
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
juhalehtonen
There has been a thread to discuss the Stack Overflow Developer Survey on this forum every year since 2018, so here’s yet another one for...
New
budgie
I love Elixir. It’s one of 2 programming languages I’ve ever fallen in love with. But I don’t use it anymore. Serverless was the promis...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews