fix(rust): better profile URL handling

[imobachgs]

Fix for bsc#1234362. It should unblock QA.

It fixes the behavior when importing an auto-installation profile:

• Follow redirections.
• Determine the file format from the content instead of the extension. It does not apply to AutoYaST profiles, where it still uses the extension in the URL for backward compatibility.

Follow-up

The agama profile import command was not updated after adding the --api switch. Therefore, if you try to import a profile from a remote system, the profile will be processed on your machine (not in the remote one). Among other potential problems, it will use hardware information from the wrong system.

We need to move the logic to preprocess the profile from agama-cli to agama-server.

[jreidinger]

be aware that shebang is not mandatory for shell scripts and also that after shebang can be something like python :)
In general as this means that shell scripts without shebang ends with "unknown file" it think it would be nice to combine both approaches...suffix and content. I would say ideally if there is suffix base decision on it as it is fast...and then check content if suffix is not there or unknown.

[imobachgs]

Yes, it is optional, but you cannot trust the suffix (as the script comes from a URL, you might not even have a suffix). I think we can educate our users to include a shebang line :-)

Actually, I do not know if using something different from bash would work at all. Check how we build the command.

[mvidner]

As Josef said, we are checking for any script, even Python, but then run it with bash.

1. Either check for #!/bin/bash,
2. or make it executable and Command::new(tmp_profile_path)

[imobachgs]

Yes, that's why I pointed to how we run those scripts after reading @jreidinger's comment . For the scripting support, I followed the 2nd approach (make it executable).

However, when handling the agama.auto we have never considered anything different from bash.

So we can keep the current check and make it executable; or just check for bash.

[imobachgs]

Just to clarify, this line of code was already there. It was just moved in this PR.

[jreidinger]

👍