Incremental Cardano DB artifacts production enhancements

[jpraynaud]

Why

We have noticed few optimizations and enhancements that need to be addressed with the artifacts produced for the Incremental Cardano DB.

What

Implement the optimizations and enhancements:

• Ancillary archive file should be deleted after upload sequence
• URLs are not correctly formed in the artifact locations
• Immutable files archives are removed at node startup

How

• Delete the ancillary archive after the upload sequence of the ancillary builder
• URLs are not correctly formed in the artifact locations
  • Address is incorrect for the template of the immutable archives in the local uploader (should be http://0.0.0.0:8080/aggregator/cardano_database_download/immutable/{immutable_file_number}.tar.zst)
  • Same for the ancillary archives
  • Same for the digests archives
  • The Cardano immutable files full and Cardano Database files should be in separate directories (cardano-immutable-files-full and cardano-database)
  • Rename the get_server_url in the configuration of the aggregator to get_local_server_url
  • Add a new optional configuration (with fall back on the get_server_url) in the aggregator for the (external) aggregator endpoint url which is used to create the url of the digests route of the aggregator in the digests builder.
  • Adapt the infrastructure to provide this new configuration
  • Adapt the documentation with this new configuration
• Immutable files archives are removed at node startup (Pending snapshot folder is completely cleared at node startup when immutables files should be kept )
  • Move files to a final subfolder of snapshot_directory
  • Artifact builder verifies if the archive exists in the final folder. If not, ask the snapshotter to create the archive
  • Expose the files of the final folder with the file uploader
• Activate the CardanoDatabase certification in testing-preview