Merge #145: Migrate CI workflows from bash scripts to Rust dependency-installer binary

6986a72 feat: [#119] Update CI workflows to use dependency-installer and remove bash scripts (copilot-swe-agent[bot])
976ab16 Initial plan (copilot-swe-agent[bot])

Pull request description:

  Replaces bash-based dependency installation in GitHub Actions workflows with the `dependency-installer` Rust binary (from #113). Removes obsolete bash scripts.

  ## Changes

  **Updated 3 workflow files** to use unified installation:
  - `.github/workflows/test-e2e-provision.yml`
  - `.github/workflows/test-e2e-config.yml`
  - `.github/workflows/test-lxd-provision.yml`

  ```yaml
  # Before: Multiple bash script calls
  - name: Install and configure LXD
    run: ./scripts/setup/install-lxd-ci.sh
  - name: Install OpenTofu
    run: ./scripts/setup/install-opentofu.sh

  # After: Single binary invocation
  - name: Install dependencies
    run: |
      cargo build -p torrust-dependency-installer --bin dependency-installer
      cargo run -p torrust-dependency-installer --bin dependency-installer -- install
  ```

  **Removed bash scripts** from `scripts/setup/`:
  - `install-lxd-ci.sh`
  - `install-opentofu.sh`
  - `install-ansible.sh`

  **Updated `scripts/setup/README.md`** with migration notice documenting the new approach.

  Closes #119
  Part of #112 (E2E test execution refactor)

  > [!WARNING]
  >
  > <details>
  > <summary>Firewall rules blocked me from connecting to one or more addresses (expand for details)</summary>
  >
  > #### I tried to connect to the following addresses, but was blocked by firewall rules:
  >
  > - `192.0.2.1`
  >   - Triggering command: `ssh -i /nonexistent/key -p 22 -o ConnectTimeout=5 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null testuser@192.0.2.1 echo &#39;SSH connected&#39;` (packet block)
  >   - Triggering command: `ssh -i /nonexistent/key -p 22 -o StrictHostKeyChecking=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null testuser@192.0.2.1 echo &#39;SSH connected&#39;` (packet block)
  > - `get.opentofu.org`
  >   - Triggering command: `curl --proto =https --tlsv1.2 -fsSL REDACTED -o /tmp/install-opentofu.sh` (dns block)
  >
  > If you need me to access, download, or install something from one of these locations, you can either:
  >
  > - Configure [Actions setup steps](https://gh.io/copilot/actions-setup-steps) to set up my environment, which run before the firewall is enabled
  > - Add the appropriate URLs or hosts to the custom allowlist in this repository's [Copilot coding agent settings](https://github.com/torrust/torrust-tracker-deployer/settings/copilot/coding_agent) (admins only)
  >
  > </details>

  <!-- START COPILOT CODING AGENT SUFFIX -->

  <details>

  <summary>Original prompt</summary>

  >
  > ----
  >
  > *This section details on the original issue you should resolve*
  >
  > <issue_title>Update CI Workflows and Remove Bash Scripts</issue_title>
  > <issue_description>**Parent Epic**: #112 - Refactor and Improve E2E Test Execution
  > **Depends On**: #113 - Create Dependency Installation Package for E2E Tests
  >
  > ## Summary
  >
  > Update GitHub Actions workflows to use the new `dependency-installer` binary instead of bash scripts, and remove the obsolete bash scripts from `scripts/setup/`. This completes the migration from bash-based dependency management to the Rust-based solution.
  >
  > ## Objectives
  >
  > - Update all GitHub Actions workflows to use `dependency-installer` binary
  > - Remove obsolete bash scripts from `scripts/setup/`
  > - Update documentation to reference the new dependency installation method
  > - Verify CI workflows pass with the new approach
  >
  > ## Workflow Files to Update
  >
  > The following 3 GitHub Actions workflow files need updates:
  >
  > 1. **`.github/workflows/test-e2e-provision.yml`**
  >    - Currently uses: `./scripts/setup/install-lxd-ci.sh`
  >    - Currently uses: `./scripts/setup/install-opentofu.sh`
  >
  > 2. **`.github/workflows/test-e2e-config.yml`**
  >    - Currently uses: `./scripts/setup/install-ansible.sh`
  >
  > 3. **`.github/workflows/test-lxd-provision.yml`**
  >    - Currently uses: `./scripts/setup/install-lxd-ci.sh`
  >    - Currently uses: `./scripts/setup/install-opentofu.sh`
  >
  > **Note**: Other workflow files do NOT use bash scripts and do not need modification.
  >
  > ## Workflow Changes
  >
  > Update workflows to use the Rust binary:
  >
  > ```yaml
  > - name: Install dependencies
  >   run: |
  >     cargo build --bin dependency-installer
  >     cargo run --bin dependency-installer install
  > ```
  >
  > ## Acceptance Criteria
  >
  > - Pre-commit checks pass
  > - All 3 workflows updated to use dependency-installer
  > - Bash scripts removed from scripts/setup/
  > - CI workflows pass with new approach
  > - Documentation updated
  >
  > ## Time Estimate
  >
  > 2-4 hours
  >
  > ## Specification
  >
  > See detailed specification: [docs/issues/119-1-3-update-ci-workflows-and-remove-bash-scripts.md](https://github.com/torrust/torrust-tracker-deployer/blob/main/docs/issues/119-1-3-update-ci-workflows-and-remove-bash-scripts.md)</issue_description>
  >
  > ## Comments on the Issue (you are @copilot in this section)
  >
  > <comments>
  > </comments>
  >

  </details>

  - Fixes #119

  <!-- START COPILOT CODING AGENT TIPS -->
  ---

  💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more [Copilot coding agent tips](https://gh.io/copilot-coding-agent-tips) in the docs.

ACKs for top commit:
  josecelano:
    ACK 6986a72

Tree-SHA512: 479101f509b7b8c80f689a4e9b434edabb17cad4fe5a7b266995c15b70ffb68670fae9158ce1bdc5754622ab0843cd99b50fe13d5bbf69b001f2effd75364007

Author: josecelano

.github/workflows/test-e2e-config.yml

@@ -41,8 +41,10 @@ jobs:
       - name: Cache Rust dependencies
         uses: Swatinem/rust-cache@v2
 
-      - name: Install Ansible
-        run: ./scripts/setup/install-ansible.sh
+      - name: Install dependencies
+        run: |
+          cargo build -p torrust-dependency-installer --bin dependency-installer
+          cargo run -p torrust-dependency-installer --bin dependency-installer -- install
 
       - name: Setup Docker
         uses: docker/setup-buildx-action@v3

.github/workflows/test-e2e-provision.yml

@@ -37,11 +37,10 @@ jobs:
       - name: Cache Rust dependencies
         uses: Swatinem/rust-cache@v2
 
-      - name: Install and configure LXD
-        run: ./scripts/setup/install-lxd-ci.sh
-
-      - name: Install OpenTofu
-        run: ./scripts/setup/install-opentofu.sh
+      - name: Install dependencies
+        run: |
+          cargo build -p torrust-dependency-installer --bin dependency-installer
+          cargo run -p torrust-dependency-installer --bin dependency-installer -- install
 
       - name: Verify installations
         run: |

.github/workflows/test-lxd-provision.yml

@@ -44,12 +44,6 @@ jobs:
       - name: Tune GitHub-hosted runner network
         uses: smorimoto/tune-github-hosted-runner-network@v1
 
-      - name: Install and configure LXD
-        run: ./scripts/setup/install-lxd-ci.sh
-
-      - name: Install OpenTofu
-        run: ./scripts/setup/install-opentofu.sh
-
       - name: Setup Rust toolchain and build template system
         uses: dtolnay/rust-toolchain@stable
         with:
@@ -58,6 +52,11 @@ jobs:
       - name: Cache Rust dependencies
         uses: Swatinem/rust-cache@v2
 
+      - name: Install dependencies
+        run: |
+          cargo build -p torrust-dependency-installer --bin dependency-installer
+          cargo run -p torrust-dependency-installer --bin dependency-installer -- install
+
       - name: Render template configurations
         run: |
           # Build the template system and render the static templates

scripts/setup/README.md

@@ -1,115 +1,100 @@
-# Setup Scripts
+# Setup Scripts - MIGRATION NOTICE
 
-This directory contains installation and configuration scripts for the tools required by the Torrust Tracker Deployer project.
+**⚠️ This directory has been migrated to the Rust-based dependency installer.**
 
-## Available Scripts
+## Migration Notice
 
-### Core Infrastructure Tools
+The bash installation scripts (`install-opentofu.sh`, `install-ansible.sh`, `install-lxd-ci.sh`) have been **removed** and replaced with the Rust-based `dependency-installer` binary.
 
-- **`install-opentofu.sh`** - Install OpenTofu (Terraform alternative)
-- **`install-ansible.sh`** - Install Ansible automation platform
+### New Installation Method
 
-### Container/VM Providers
-
-- **`install-lxd-ci.sh`** - Install and configure LXD (CI-optimized)
-
-## Usage
-
-### Individual Installation
+For dependency installation, use the `dependency-installer` binary:
 
 ```bash
-# Install OpenTofu
-./scripts/setup/install-opentofu.sh
-
-# Install Ansible
-./scripts/setup/install-ansible.sh
+# Install all dependencies
+cargo run -p torrust-dependency-installer --bin dependency-installer -- install
 
-# Install LXD (CI environment)
-./scripts/setup/install-lxd-ci.sh
-```
+# Check which dependencies are installed
+cargo run -p torrust-dependency-installer --bin dependency-installer -- check
 
-### Batch Installation
+# List all available dependencies
+cargo run -p torrust-dependency-installer --bin dependency-installer -- list
 
-```bash
-# Install all core tools
-./scripts/setup/install-opentofu.sh
-./scripts/setup/install-ansible.sh
+# Install specific dependency
+cargo run -p torrust-dependency-installer --bin dependency-installer -- install --dependency opentofu
 
-# Install container provider
-./scripts/setup/install-lxd-ci.sh
+# See all options
+cargo run -p torrust-dependency-installer --bin dependency-installer -- --help
 ```
 
-## CI vs Local Development
-
-### CI Environment Detection
-
-The scripts automatically detect CI environments and apply appropriate configurations:
+### Benefits of the New Approach
 
-- **CI Detection**: Checks for `CI=true`, `GITHUB_ACTIONS=true`, or `RUNNER_USER` environment variables
-- **CI Optimizations**: Uses `sudo` commands and socket permission fixes
-- **Logging**: Provides clear feedback about environment detection
+- **Type-safe**: Rust's type system catches errors at compile time
+- **Better error handling**: Clear, actionable error messages
+- **Consistent logging**: Structured logging via `tracing` crate
+- **Testable**: Unit and integration tests ensure reliability
+- **Maintainable**: Single codebase for all dependency management
+- **Cross-platform ready**: Foundation for supporting multiple platforms
 
-### Local Development
-
-For local development, see the dedicated documentation:
-
-- **LXD**: [templates/tofu/lxd/README.md](../../templates/tofu/lxd/README.md)
-- **LXD Tech Stack**: [docs/tech-stack/lxd.md](../../docs/tech-stack/lxd.md)
+### Supported Dependencies
 
-**Important**: The CI scripts use `sudo` commands and socket permission modifications that are **NOT recommended** for local development. Use proper group membership for local setups.
+The dependency installer supports:
 
-## Script Features
+- **cargo-machete** - Detects unused Rust dependencies
+- **OpenTofu** - Infrastructure provisioning tool (Terraform alternative)
+- **Ansible** - Configuration management and automation platform
+- **LXD** - Lightweight VM manager for container-based testing
 
-### Common Features
+### Documentation
 
-- **Idempotent**: Safe to run multiple times
-- **Verbose Logging**: Clear progress indicators with colored output
-- **Error Handling**: Proper error checking and meaningful messages
-- **Version Detection**: Skips installation if tool is already installed
+For complete documentation on the dependency installer, see:
 
-### Error Handling
-
-All scripts use `set -euo pipefail` for strict error handling:
+- **Package README**: [packages/dependency-installer/README.md](../../packages/dependency-installer/README.md)
+- **LXD Setup**: [templates/tofu/lxd/README.md](../../templates/tofu/lxd/README.md)
+- **LXD Tech Stack**: [docs/tech-stack/lxd.md](../../docs/tech-stack/lxd.md)
 
-- **`-e`**: Exit on any command failure
-- **`-u`**: Exit on undefined variable usage
-- **`-o pipefail`**: Exit on pipe command failures
+### CI/CD Integration
 
-### Logging Levels
+GitHub Actions workflows now use the dependency installer:
 
-- **🟢 INFO**: Normal progress messages
-- **🟡 WARN**: Important notices or CI-specific actions
-- **🔴 ERROR**: Failure messages
+- **`.github/workflows/test-e2e-provision.yml`** - E2E provision and destroy tests
+- **`.github/workflows/test-e2e-config.yml`** - E2E configuration tests
+- **`.github/workflows/test-lxd-provision.yml`** - LXD provisioning tests
 
-## Integration with Workflows
+Example workflow step:
 
-These scripts replace duplicated installation code in GitHub Actions workflows:
+```yaml
+- name: Install dependencies
+  run: |
+    cargo build -p torrust-dependency-installer --bin dependency-installer
+    cargo run -p torrust-dependency-installer --bin dependency-installer -- install
+```
 
-- **`.github/workflows/test-e2e.yml`**
-- **`.github/workflows/test-lxd-provision.yml`**
+### Local Development
 
-## Troubleshooting
+For local development, the dependency installer automatically handles:
 
-### Permission Issues
+- **CI Detection**: Automatically applies CI-specific configurations when needed
+- **Permissions**: Proper handling of LXD socket permissions
+- **Group Membership**: Sets up appropriate user groups
 
-If you encounter permission errors:
+**Important**: For local LXD development, follow the proper group membership approach documented in the tech stack guides.
 
-1. **For CI**: Scripts should handle permissions automatically
-2. **For Local**: Follow the group membership setup in the tech stack documentation
+### Troubleshooting
 
-### Installation Failures
+If you encounter issues with the dependency installer:
 
-1. Check internet connectivity for download-based installations
-2. Verify system requirements (Ubuntu/Debian for apt-based installs)
-3. Check available disk space
-4. Review script output for specific error messages
+1. **Check installation status**: `cargo run -p torrust-dependency-installer --bin dependency-installer -- check`
+2. **Enable debug logging**: Add `--verbose` flag or `--log-level debug`
+3. **View available dependencies**: `cargo run -p torrust-dependency-installer --bin dependency-installer -- list`
+4. **Check exit codes**: Exit code 0 = success, non-zero = failure
 
-### Tool-Specific Issues
+For detailed troubleshooting, see the [dependency installer README](../../packages/dependency-installer/README.md).
 
-- **OpenTofu**: Requires `curl` and package management tools
-- **Ansible**: Requires Python and pip (usually pre-installed)
-- **LXD**: Requires snap and sufficient privileges
+### Migration Timeline
 
-## Future Enhancements
+- **Created**: Issue #113 (Create Dependency Installation Package)
+- **Migrated**: Issue #119 (Update CI Workflows and Remove Bash Scripts)
+- **Removed bash scripts**: November 2025
 
-These bash scripts are designed to be simple and maintainable. For more complex installation logic, they may be replaced by Rust utilities in the future while maintaining the same interface.
+This directory is preserved for documentation purposes and may be removed in future versions.