D4no0

D4no0

I would not trust hetzner with anything serious, at the end of the day there is a price for their dirt-cheap servers. Dev servers and pipelines I would go for hetzner all day long, especially with their new ARM servers.

One of my previous employer had some serious problems back in the day hosting hardware in their datacenters, it was so bad that at some point they were planning on taking legal action.

4
Post #11
adw632

adw632

Well in Australia at least the cloud providers and the entire supply chain do get to enjoy a rigorous assurance process if they want to participate.

Datacenters must be certified strategic, which involves multiple Agency assessments including intelligence agencies. Similarly cloud service providers are also subject to specific audits. Liability for data service providers is unlimited as is any important cloud service..
.

0
Post #12
lessless

lessless

That’s an excellent insight on FreeBSD. Thanks! I recently started looking around to escape the mess the Linux is, and apart from a bit chaotic firewall frontends story, it seems like a breath of fresh air!

I’m curious if it would be possible to apply Kamal’s approach on FreeBSD with Elixir releases. That is, build and pack release and do blue/green deployment. That would be nice!
(Given that FreeBSD doesn’t support OCI containers as far as I know).

For deployment I also prefer FreeBSD jail’s which are also supported by Nomad .

can you please elaborate on that?

1
Post #13
drobban

drobban

I switched to FreeBSD - Have no experience in deploying elixir/freebsd to other services as I host on my own hardware.

So far, I’m so happy with the simplicity given with ZFS, jails and amazed how far I’m able to go without all the complexity added by docker.

I sure like the features given by containers like docker - and so far I’m able to solve most of the problems with jails that dock helped me with in the past. Instead of config & docker files - I use shell-scripts.

For me - it has for sure been worth it to really explore the freebsd alternative.

5
Post #14
lessless

lessless

I’m a long-standing BSD fan, even though I never had a chance to use it in production because of business reasons (time to market, cost of maintaining own infra, etc.)

For me, it’s much more sane and straightforward than Linux, even if it falls short in some respects.

What’s your current setup and production load?

1
Post #15
drobban

drobban

Nothing big or fancy.

I have a product that each customer run their own instance of.

The planned “load” is perhaps best described as - 50-60 instances running a elixir-service in a container. To that Im using Haproxy and postgresql.

I have no data of interest when it comes to network load or I/O load.

My current setup is
Ampere Altra - 128core (ARM Neoverse-N1 r3p1)
384Mb of ram.

a Zpool of 6disk SSD’s running ZFS raidz2.

My containers are run in jails.

At the moment I have written my own very simple scripts to run tests and builds of new containers when new commits arrives to the repo.

The deployment is “semi” automated at the moment. Evaluating available tools for assisting blue/green deployments.

Running on my hardware has so far been very straight forward and simple.
As the load Im having is most likely to be very static. I have no need to achieve elastic scaling of resources.

Time to market - doesnt really sound to be relevant factor when it comes to selection of OS.
When it comes to cost. sure. There is a cost of running my own infra. So far Im more agile deploying new instances with the tools at hand then doing the same operation using google-cloud. So for me - It has been cost reduction in both time and “rent”.

The scripts are so simple that I wouldnt consider it as adding technical debt - its on the level that Im actually considering it as documentation of my test/build/deploy process.

When it comes to stats handling loads, I believe Netflix has some presentations on that topic more interesting then what Im having.

5
Post #16
lessless

lessless

Thanks for shedding light.

Evaluating available tools for assisting blue/green deployments.

Any luck so far? Maybe there would be some lessons in the https://kamal-deploy.org/
I reckon it might be pretty straightforward with Traefik or Caddy.

1
Post #17
tj0

tj0

Did you buy servers and colocate them? Or are these dedicated servers?

0
Post #18
drobban

drobban

Bought hardware.

So I’m not using services like Hertzner.

2
Post #19
tj0

tj0

Awesome. The old-schoolness of this makes my curmudgeoness reduces ever so slightly.

What did you buy and where are you co-locating it?

1
Post #20