Bandit server for Phoenix is next level, check it out!

Chat / Discussions
,
1

Hey Guys,

Did you know that there’s an alternative to Cowboy for Phoenix, called Bandit?

And it recently reached {:bandit, "~> 1.0-pre"} version!

Here’s my observation:

In Cowboy based phoenix builds, I noticed that there’s a delay before the websocket connection happened.

As you can notice in the gif below. Other pages load within 100ms, however the websocket connection reaches close to 435ms:

Cowboy

That doesn’t happen with Bandit!

All the resources, along with the socket connection happen within 100ms!
Bandit

Check it out:

7 Likes
2

I’m already using it in production. It works. The performance is about the same in my use case.

On the plus side, Bandit is built on top of OTP primitives and doesn’t do the annoying silent crashes that Cowboy does.

On the downside, it’s still fairly young, and there are rough edges. Pre-9 version had some breaking bugs, the current (pre-10) version seems okay but some behaviors differ from Cowboy like the lack of interrupting requests when client drops off. We also observed increased memory usage, but these things can be related to one another.

Generally, it looks like it’s the future, and at some point should probably be the default over Cowboy, but you should use it with caution on production (I’m hovering my hand over the switch back to Cowboy just in case for now).

14 Likes
3

This is the insight I was looking for, thank you.

I’m sticking with Bandit, because I like where its going, and It’s necessary for others to adopt it, so that we can detect those cases where failure happens, and library will improve because of that.

I see only 5 issues on that repo as of now.

6 Likes
4

I’m here if anyone has any specific blocking issues for adoption at your shops!

28 Likes
7

The current APM for e.g new relic don’t work with Bandit. This takes away visibility for the apps as there is no telemetry. Any plans to make the telemetry compatible to cowboy so it can be used without losing metrics

11

The groundwork has been laid, but I do not personally have any plans for such a library (mostly time limitations and the fact that there’s still a lot to do on the core of Bandit).

Bandit provides a rich telemetry interface today (as does Thousand Island). There’s enough there for someone to build everything that’s needed.

3 Likes
12

Making it “compatible with cowboy” would mean literally emitting events tagged with the :cowboy atom from bandit (and making sure all the metadata was a superset of cowboy’s). The place for bandit support to be added is in the New Relic agent.

3 Likes
13

On average, I have noticed a 2x - 3x boost in performance with Bandit over Cowboy and it works great with Nginx.

3 Likes
14

Hi…

When you say it works great with Nginx… What’s the role of Nginx in your case?

I’m curious since it’s both servers, right?

Are you using Nginx as a reverse proxy or maybe for serving static assets only and letting Bandit for the “application” server?

Do you mind sharing some details on your infra?

Thanks!

15

@hubertlepicki and others; 1.3.0 just went out with a fix for the long-standing issue of increasing memory use (which wasn’t really a memory issue so much as it was an issue with how memory use is reported, but anyway), along with a few other fixes. See CHANGELOG as always. Hopefully this fixes your issue; please report back if so as I’d love to have more evidence that we’ve finally licked this.

9 Likes
16

Yes, I’m using Nginx as a reverse proxy, caching, serving static files, TLS/SSL termination, and a proxy for gRPC connections.

2 Likes
17

Hi…
Thanks for the reply…
Does it mean that the requests for static files (e.g. under /priv) are no longer hitting the Phoenix server (here bandit)?
Are you setting this config on Phoenix side or Nginx side? I guess it’s on Nginx… Then the config for static assets on Phoenix becomes somehow useless, right?
For reverse proxy and SSL I was using traefik but I also want to add caching and static assets serving…
So I guess I’ll also switch to Nginx…
Do you think you can share your nginx file (or just the main parts)?