The compatibility guarantee is given for modules and code in .beam
files - it’s not the same as having a release running on different versions.
A release is always built against a specific runtime version and can’t run on other versions. In particular, a part of the release is a “boot script” that is responsible for loading modules and applications that lists every single module to be loaded explicitly.