Switch to GitHub Actions

[Fryguy]

Our contract with Travis has ended, and while we expected to revert to the prior default of 5 free workers, we were incorrect as it seems Travis doesn't have support for open source anymore, so we're stuck 🙃 (technically they support 10000 free credits which is not much at all). Need to switch everything to GitHub Actions.

Core Repositories

• ManageIQ/manageiq
  • Support GitHub Actions #21682
  • Switch to GitHub Actions #21683
  • Fix dependabot PRs made in the core/plugin repos #21685
• Switch to GitHub Actions manageiq-api#1127
• Remove specs and Ruby manageiq-appliance#347 (there were no tests, so removed Travis)
• Switch to GitHub Actions manageiq-appliance-build#507
• Switch to GitHub Actions manageiq-automation_engine#494
• Switch to GitHub Actions manageiq-consumption#192
• Switch to GitHub Actions manageiq-content#703
• Switch to GitHub Actions manageiq-decorators#64
• ManageIQ/manageiq-gems-pending
  • Add GitHub Actions manageiq-gems-pending#530
  • Switch to GitHub Actions manageiq-gems-pending#531
  • Fix simplecov handling for codeclimate via GitHub Actions manageiq-gems-pending#532
• ManageIQ/manageiq-graphql (removed on master so not in najdorf)
• Switch to GitHub Actions manageiq-pods#812
• Switch to GitHub Actions manageiq-providers-amazon#740
• Switch to GitHub Actions manageiq-providers-ansible_tower#276
• Switch to GitHub Actions manageiq-providers-autosde#131
• Switch to GitHub Actions manageiq-providers-azure#493
• Switch to GitHub Actions manageiq-providers-azure_stack#75
• Switch from Travis CI to Github Actions manageiq-providers-dummy_provider#44
• Switch to GitHub Actions manageiq-providers-foreman#98
• Switch to GitHub Actions manageiq-providers-google#211
• Switch to GitHub Actions manageiq-providers-ibm_cic#5
• Switch to GitHub Actions manageiq-providers-ibm_cloud#336
• Switch to GitHub Actions manageiq-providers-ibm_power_hmc#35
• Switch to GitHub Actions manageiq-providers-ibm_power_vc#41
• Switch to GitHub Actions manageiq-providers-ibm_terraform#76
• Switch to GitHub Actions manageiq-providers-kubernetes#460
• Switch to GitHub Actions manageiq-providers-kubevirt#199
• Switch to GitHub Actions manageiq-providers-lenovo#351
• Switch to GitHub Actions manageiq-providers-nsxt#66
• ManageIQ/manageiq-providers-nuage
  • Switch to GitHub Actions manageiq-providers-nuage#266
  • Restore deleted before_install manageiq-providers-nuage#267
• Switch to GitHub Actions manageiq-providers-openshift#220
• ManageIQ/manageiq-providers-openstack
  • Switch to GitHub Actions manageiq-providers-openstack#774
  • Restore deleted before_install manageiq-providers-openstack#775
• Switch to GitHub Actions manageiq-providers-oracle_cloud#46
• Switch to GitHub Actions manageiq-providers-ovirt#592
• Switch to GitHub Actions manageiq-providers-redfish#153
• Switch to GitHub Actions manageiq-providers-scvmm#200
• Switch to GitHub Actions manageiq-providers-vmware#791
• ManageIQ/manageiq-rpm_build
  • Initial attempt at Github Actions manageiq-rpm_build#235
  • Fix invalid workflow file syntax manageiq-rpm_build#236
  • Cleanup GitHub Actions manageiq-rpm_build#238
  • Fix TRAVIS env vars manageiq-rpm_build#240
• ManageIQ/manageiq-schema
  • Switch to GitHub Actions manageiq-schema#636
  • Ensure we connect to PG over TCP and not a socket in Github Actions manageiq-schema#637)
• Switch to GitHub Actions manageiq-ui-classic#8098
• ManageIQ/manageiq-ui-service
  • Switch to GitHub Actions manageiq-ui-service#1762
  • More GitHub Actions changes manageiq-ui-service#1763
• ManageIQ/manageiq-v2v (removed on master so not in najdorf)

Gems & packages

• Switch to GitHub Actions activerecord-id_regions#27
• ManageIQ/activerecord-virtual_attributes
  • Using actions instead of travis ci activerecord-virtual_attributes#98
  • Update GitHub actions for consistency activerecord-virtual_attributes#100 (doesn't use manageiq/postgresql, but that's probably ok)
• Switch to GitHub Actions awesome_spawn#62
• Switch to GitHub Actions azure-armrest#414
• ManageIQ/azure-signature
• Switch to GitHub Actions binary_struct#20
• Switch to GitHub Actions bundler-inject#25
• Switch to GitHub Actions dbus_api_service#30
• Switch to GitHub Actions ffi-vix_disk_lib#27
• Switch to GitHub Actions font-fabulous#70
• Switch to GitHub Actions foreman_api_client#18
• ManageIQ/inventory_refresh
  • Switch to GitHub Actions inventory_refresh#104
  • Fix GHA yaml syntax inventory_refresh#105
• Switch to GitHub Actions linux_admin#230
• Switch to GitHub Actions linux_block_device#7
• Switch to GitHub Actions log_decorator#18
• Switch to GitHub Actions manageiq-api-client#104
• ManageIQ/manageiq-api-client-python
• Switch to GitHub Actions manageiq-appliance_console#178
• Replace Travis with Github Actions manageiq-cross_repo#83
• Switch to GitHub Actions manageiq-loggers#46
• Switch to GitHub Actions manageiq-messaging#69
• Switch to GitHub Actions manageiq-password#31
• Switch to GitHub Actions manageiq-postgres_ha_admin#31
• Switch to GitHub Actions manageiq-smartstate#167
• Switch to GitHub Actions manageiq-ssh-util#13
• Switch to GitHub Actions manageiq-style#28
• Switch to GitHub Actions memory_buffer#16
• Switch to GitHub Actions more_core_extensions#105
• Switch to GitHub Actions net_app_manageability#14
• ManageIQ/optimist
  • Migrate to GitHub Actions optimist#126
  • Remove now unused .travis.yml file optimist#127
  • Various cleanups for GitHub Actions optimist#128
• Switch to GitHub Actions ovirt#104
• Switch to GitHub Actions ovirt_metrics#43
• Switch to GitHub Actions pg-dsn_parser#14
• Switch to GitHub Actions pg-logical_replication#14 (still broken)
• Switch to GitHub Actions query_relation#23
• ManageIQ/rbvmomi2 (already done)
• Switch to GitHub Actions ui-components#466
• Switch to GitHub Actions vmware_web_service#110
• Switch to GitHub Actions wim_parser#4

Non-core repositories

• Switch to GitHub Actions amazon_ssa_support#73
• ManageIQ/ansible-manageiq-automate
• ManageIQ/ansible-manageiq-vmdb
• Automate container build container-amazon-smartstate#16
• Switch to GitHub Actions container-httpd#68
• Switch to GitHub Actions container-httpd-init#18
• Switch to GitHub Actions container-memcached#11
• Switch to GitHub Actions container-postgresql#35
• ManageIQ/httpd_configmap_generator
• ManageIQ/manageiq-debug
• ManageIQ/manageiq-performance
• ManageIQ/manageiq-release
• ManageIQ/manageiq-v2v-conversion_host
• ManageIQ/manageiq-v2v-conversion_host-build
• ManageIQ/manageiq-vagrant-dev
• ManageIQ/manageiq_org-spaces_purger
• [WIP] Switch to GitHub Actions mime-types-redirector#4
• Switch to GitHub Actions miq_bot#591
• ManageIQ/sprint_statistics

Website and Documentation

• Switch to GitHub Actions guides#484
• Switch to GitHub Actions manageiq-documentation#1643
• ManageIQ/manageiq.github.io
  • Switch to GitHub Actions manageiq.github.io#12
  • GitHub Actions - Use pr_number instead of commit_message in payload manageiq.github.io#13
  • Fix asynchronous commands that should be run sequentially manageiq.github.io#14
  • Fixed bundle install and refactored commit message manageiq.github.io#15
  • Move deploy.sh to bin/deploy manageiq.github.io#16
• ManageIQ/manageiq.org
  • Switch to GitHub Actions manageiq.org#1061
  • Get PR Number into payload manageiq.org#1062
  • Simplify GitHub Action CI manageiq.org#1063
  • Notify with ref_name instead of ref manageiq.org#1064
  • Add GHA CI badge manageiq.org#1065

Not code

• ManageIQ/.github
• ManageIQ/manageiq-design
• ManageIQ/manageiq-lxca-docs
• ManageIQ/manageiq-nuage-docs
• ManageIQ/manageiq-redfish-docs
• ManageIQ/manageiq-vcloud-docs
• ManageIQ/manageiq_build_status

[chessbyte]

@Fryguy why are the v2v repos in the list above? I thought we no longer pull them in. Or is that just for completeness as well as maybe backporting to branches where they were released before.

BTW, do each of these need to be backported to all the prior branches?

[Fryguy]

For now, I just did a grandiose "fetch all public repos that are not forks nor archived" and dropped the list here. Some of them may not apply. Some, like v2v we may want to do anyway for backport reasons. I was already getting lost with what is done/not done, so I wanted a checklist where we can make these decisions.

BTW, do each of these need to be backported to all the prior branches?

I'm not sure yet...we do run cron jobs on older branches, so we may want to backport to at least the branches we care to cron the tests on.

[Fryguy]

Need to also fix an issue where branches pushed to local forks fail on the Gemfile.lock.release (though a PR made with that branch will succeed). I thikn it's because it's technically a non-master branch, but also not a PR. Not sure how to solve this just yet, but it's annoying in the GitHub Notifications.

[Fryguy]

Other TODO:

• fix an issue where branches pushed to local forks fail on the Gemfile.lock.release [ref] (Think this is fixed in the core PR: Switch to GitHub Actions #21683 + Fix dependabot PRs made in the core/plugin repos #21685)
• release scripts
  • Remove Travis things for new plugin setup manageiq-release#249
• Cleanup some of the first actions for consistency:
  • Cleanup GitHub Action for consistency manageiq-gems-pending#539
  • Cleanup for consistency vmware_web_service#115
  • pg-logical_replication
  • Cleanup for consistency activerecord-virtual_attributes#108
• Cross repo tests
  • Changes for Github Actions manageiq-cross_repo#82 + Replace Travis with Github Actions manageiq-cross_repo#83 + Rename ci.yml -> ci.yaml for consistency manageiq-cross_repo#84 + Add matrix to reusable workflow manageiq-cross_repo#85 + Make test-repos plural in workflow manageiq-cross_repo#86
  • Switch to github actions based cross-repo-tests manageiq-cross_repo-tests#581 + Update default ci.yaml workflow manageiq-cross_repo-tests#583 + [BOT] Cross repo test for ManageIQ/manageiq#21680 manageiq-cross_repo-tests#585
  • Update miq_bot for cross-repo-tests github actions miq_bot#578 + Use a matrix for test-repos not jobs miq_bot#579 + Fix YAML replacing on: with true: in github workflow miq_bot#580
• pull_request_blaster_outer scripts
• guides/providers/writing_a_new_provider.md
• plugin generator
• spec/models/manageiq/providers/embedded_ansible/automation_manager/configuration_script_source_spec.rb:307
• Refactor manageiq setup so that the plugins can reuse more of core: [WIP] Refactor ManageIQ setup #21684 + [WIP] Use core's before_install after cloning it manageiq-providers-amazon#744
• Blast removals of codeclimate-test-reporter and coveralls

[Fryguy]

I'm going back and adding crons to all of the repos. As discussed with @agrare we will do all "manageiq application" repos daily and the rest of the repos like gems and such weekly

Core repositories (daily)

• Run CI daily #21709
• Cron for GitHub Actions manageiq-api#1139
• Cron for GitHub Actions manageiq-appliance-build#510
• Cron for GitHub Actions manageiq-automation_engine#496
• Cron for GitHub Actions manageiq-consumption#194
• Cron for GitHub Actions manageiq-content#708
• Cron for GitHub Actions manageiq-decorators#67
• Cron for GitHub Actions manageiq-gems-pending#541
• Cron for GitHub Actions manageiq-pods#819
• Cron for GitHub Actions manageiq-providers-amazon#745
• Cron for GitHub Actions manageiq-providers-ansible_tower#279
• Cron for GitHub Actions manageiq-providers-autosde#137
• Cron for GitHub Actions manageiq-providers-azure#498
• Cron for GitHub Actions manageiq-providers-azure_stack#78
• Cron for GitHub Actions manageiq-providers-cisco_intersight#33
• Cron for GitHub Actions manageiq-providers-dummy_provider#45
• Cron for GitHub Actions manageiq-providers-foreman#100
• Cron for GitHub Actions manageiq-providers-google#213
• Cron for GitHub Actions manageiq-providers-ibm_cic#8
• Cron for GitHub Actions manageiq-providers-ibm_cloud#347
• Cron for GitHub Actions manageiq-providers-ibm_power_hmc#42
• Cron for GitHub Actions manageiq-providers-ibm_power_vc#47
• Cron for GitHub Actions manageiq-providers-ibm_terraform#78
• Cron for GitHub Actions manageiq-providers-kubernetes#462
• Cron for GitHub Actions manageiq-providers-kubevirt#201
• Cron for GitHub Actions manageiq-providers-lenovo#357
• Cron for GitHub Actions manageiq-providers-nsxt#69
• Cron for GitHub Actions manageiq-providers-nuage#271
• Cron for GitHub Actions manageiq-providers-openshift#222
• Cron for GitHub Actions manageiq-providers-openstack#782
• Cron for GitHub Actions manageiq-providers-oracle_cloud#48
• Cron for GitHub Actions manageiq-providers-ovirt#597
• Cron for GitHub Actions manageiq-providers-redfish#156
• Cron for GitHub Actions manageiq-providers-scvmm#202
• Cron for GitHub Actions manageiq-providers-vmware#794
• Cron for GitHub Actions manageiq-rpm_build#271
• Cron for GitHub Actions manageiq-schema#642
• Cron for GitHub Actions manageiq-ui-classic#8147
• Cron for GitHub Actions manageiq-ui-service#1774

Gems and packages (weekly)

• Cron for GitHub Actions activerecord-id_regions#28
• Cron for GitHub Actions activerecord-virtual_attributes#109
• Cron for GitHub Actions awesome_spawn#63
• Cron for GitHub Actions azure-armrest#416
• Cron for GitHub Actions binary_struct#21
• Cron for GitHub Actions inventory_refresh#108
• Cron for GitHub Actions manageiq-cross_repo#89
• Cron for GitHub Actions optimist#129
• Cron for GitHub Actions rbvmomi2#12
• Cron for GitHub Actions vmware_web_service#116

Non-core repositories (weekly)

• Cron for GitHub Actions amazon_ssa_support#74
• Cron for GitHub Actions container-amazon-smartstate#17
• Cron for GitHub Actions container-httpd#70
• Cron for GitHub Actions container-httpd-init#20
• Cron for GitHub Actions container-memcached#12
• Cron for GitHub Actions container-postgresql#36

Website and Documentation (daily)

• Cron for GitHub Actions guides#489
• Cron for GitHub Actions manageiq-documentation#1647
• Cron for GitHub Actions manageiq.org#1073

[Fryguy]

I'm closing this as completed as of Najdorf. There are a handful of known repos that are more difficult and I will open those as separate issues in their respective repos.

• Switch to GitHub Actions manageiq-appliance_console#178
• Fix database connection using a socket on CI pg-logical_replication#15

The following still need to be completed but are low priority

• Convert to GitHub Actions manageiq-api-client-python#56
• Convert to GitHub Actions manageiq-performance#76
• Convert to GitHub Actions httpd_configmap_generator#69