ausimian

ausimian

I spent a bit of time looking at getting code-coverage metrics and reporting working for an umbrella project in a self-hosted GitLab instance (15.3). There were a few things I tried along the way and I’m posting it here in the hope that it might save others a little bit of time in the future. Also I don’t have a blog, and no interest in maintaining one, so this will be my own aide memoir.

Regarding GitLab, there appear to be basically two different aspects of support for code-coverage. First, a single metric providing a % measure of total code-coverage which is used in a number of places:

  • On pipelines, i.e. what is the coverage of a particular build
  • On merge requests, which also tells us the delta vs the current coverage of the default branch, typically main
  • As a charted time-series value in ‘Analytics’
  • As a value you can stick on a badge, also taken from the default branch

The second, is a more detailed view, allowing you to visualise the actual changes to coverage in individual files within an existing merge request (discussed in more detail here).

With that out of the way, here’s what I landed on:

Run all the tests with coverage

In the .gitlab-ci.yml:

script:
  - MIX_ENV=test mix test --cover export-coverage default

Note, I didn’t need to add any test_coverage: configuration to any of the mix projects, nor the root one.

Calculate the total test coverage

This is what will be used for pipelines, stats and badges.

after_script:
  # Generate test coverage metric
  - MIX_ENV=test mix test.coverage || true
...
coverage:
  - '/    Coverage:   \d+.\d+%/'

Generate Cobertura files

In order to present coverage in merge requests, GitLab requires that coverage reports in Cobertura format be available. Generating a single coverage file from all umbrella applications was achieved using covertool.

In the root mix.exs, add the following dependency:

def deps do
  [
    {:covertool, "~> 2.0.4", only: :test, runtime: false, app: false, compile: "rebar3 escriptize"}
  ]
end

Then, in the after_script: section of the .gitlab-ci.yml, have covertool build a single coverage.xml file from the raw coverage data generated during the test run, first by using cover to combine the individual coverage files into one, and then using covertool to convert that into cobertura format. In the example below, there are 3 projects in the umbrella, imaginatively named :proj_a, :proj_b and :proj_c.

after_script:
  # Generate test coverage metric
  - MIX_ENV=test mix test.coverage || true
  # Build a single coverage file, all.coverdata
  - elixir 
    -e "Enum.each(~w(proj_a proj_b proj_c), fn app -> :cover.import(~c(./apps/#{app}/cover/default.coverdata)) end)"
    -e ":cover.export(~c(./all.coverdata))"
  # Convert it to cobertura format in a single coverage.xml file
  - ./deps/covertool/_build/default/bin/covertool
    -cover all.coverdata
    -output coverage.xml
    -ebin _build/test/lib/proj_a/ebin,_build/test/lib/proj_b/ebin,_build/test/lib/proj_c/ebin
  # Fix up the paths in the resulting file
  - sed -i "/\/builds\/umbrella\///g" coverage.xml

The final step fixes up the paths in the coverage.xml file so the <filename> elements contain the same path that GitLab uses in the merge requests. In the above example this has the affect of changing
<filename>/builds/umbrella/apps/...</filename to <filename>apps/...</filename.

Upload the coverage report

artifacts:
  reports:
    coverage_report:
      coverage_format: cobertura
      path: coverage.xml

A final note - in the above examples I’ve used multiline yaml in some of the commands to improve the formatting, but in my own system it’s not been written and tested that way so you might need to tweak it a bit.

Where Next? Top

Trending in Discussions Top

AstonJ
The obligatory hello world thread! Who are you and where are you from? :stuck_out_tongue:
4663 61218 595
New
cblavier
Hey there, It’s been more than a year since we started using LiveView as our main UI library and building a whole library of UI componen...
515 12931 101
New
sntran
In my third year of college, around 2010, I found Erlang. A few years later, I found Elixir. I liked the ideas at once: many small proces...
New
gtcode
I’ve been tinkering with Lynx (by José) via hold_ledger. I used AI to write the code, a separate specification, the tests, and the Lean p...
New
AstonJ
A remark @Garrison made… ..has already inspired a thread for the technical side of reclaiming our internet, but there is of course anot...
New
ManuelGarcia
Hi everyone! I’m the developer of PaperForge, and I’ve been working on something alongside it that I’d like your opinion on. I’m conside...
New
bartblast
This is where the projects in the Hologram Showcase get posted: apps built with Hologram and libraries made for it. New ones go up usuall...
New

Other Trending Topics Top

GenericJam
Edit: 2026 May 15 - This post is archived. Mob is alive!! Main docs: mob v0.7.11 — Documentation A bit of explanation for the slightly c...
261 13183 112
New
mudasobwa
I fully migrated to my own harness from Anthropic/Gemini and I think it’s time to share it. Welcome DSH, the DeepSeek Harness, fully writ...
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New
kip
Localize is the next generation localisation library for Elixir. Think of it as ex_cldr version 3.0. The first version will be released ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews