We used to be able to download MUMPS with apt, but that gives an older version that PETSc no longer support (see #4661).
In the future we should look into whether we can go back to using a system MUMPS, either if PETSc restore support for older versions, or with higher MUMPS versions in future Ubuntu LTS releases.