Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CI: So many failing EC2 acceptance tests #35747

Open
ewbankkit opened this issue Feb 9, 2024 · 2 comments
Open

CI: So many failing EC2 acceptance tests #35747

ewbankkit opened this issue Feb 9, 2024 · 2 comments
Labels
service/ec2 Issues and PRs that pertain to the ec2 service. service/ipam Issues and PRs that pertain to the ipam service. service/transitgateway Issues and PRs that pertain to the transitgateway service. service/verifiedaccess Issues and PRs that pertain to the verifiedaccess service. service/vpc Issues and PRs that pertain to the vpc service. service/vpnsite Issues and PRs that pertain to the vpnsite service. tests PRs: expanded test coverage. Issues: expanded coverage, enhancements to test infrastructure.

Comments

@ewbankkit
Copy link
Contributor

ewbankkit commented Feb 9, 2024 •
edited
Loading

In CI there are currently 147 failing EC2 acceptance tests:

  • TestAccEC2AMIDataSource_instanceStore
  • TestAccEC2AMIDataSource_localNameFilter
  • TestAccEC2AMIDataSource_natInstance
  • TestAccEC2AMIDataSource_windowsInstance
  • TestAccEC2AMIIDsDataSource_basic
  • TestAccEC2AMIIDsDataSource_sorted
  • TestAccEC2AMILaunchPermission_group
  • TestAccEC2EBSDefaultKMSKeyDataSource_basic
  • TestAccEC2EBSSnapshotCopy_tags
  • TestAccEC2EBSVolumeAttachment_disappears
  • TestAccEC2Fleet_TargetCapacitySpecification_targetCapacityUnitType
  • TestAccEC2Fleet_TargetCapacitySpecification_totalTargetCapacity
  • TestAccEC2Instance_BlockDeviceTags_attachedVolume
  • TestAccEC2Instance_EBSRootDevice_modifyDeleteOnTermination
  • TestAccEC2Instance_EBSRootDevice_multipleDynamicEBSBlockDevices
  • TestAccEC2Instance_atLeastOneOtherEBSVolume
  • TestAccEC2Instance_networkInstanceRemovingAllSecurityGroups
  • TestAccEC2Instance_networkInstanceSecurityGroups
  • TestAccEC2Instance_networkInstanceVPCSecurityGroupIDs
  • TestAccEC2Instance_rootInstanceStore
  • TestAccEC2LaunchTemplate_instanceRequirements_acceleratorCount
  • TestAccEC2LaunchTemplate_instanceRequirements_acceleratorManufacturers
  • TestAccEC2LaunchTemplate_instanceRequirements_acceleratorNames
  • TestAccEC2LaunchTemplate_instanceRequirements_acceleratorTotalMemoryMiB
  • TestAccEC2LaunchTemplate_instanceRequirements_acceleratorTypes
  • TestAccEC2LaunchTemplate_instanceRequirements_allowedInstanceTypes
  • TestAccEC2LaunchTemplate_instanceRequirements_bareMetal
  • TestAccEC2LaunchTemplate_instanceRequirements_baselineEBSBandwidthMbps
  • TestAccEC2LaunchTemplate_instanceRequirements_burstablePerformance
  • TestAccEC2LaunchTemplate_instanceRequirements_cpuManufacturers
  • TestAccEC2LaunchTemplate_instanceRequirements_excludedInstanceTypes
  • TestAccEC2LaunchTemplate_instanceRequirements_instanceGenerations
  • TestAccEC2LaunchTemplate_instanceRequirements_localStorageTypes
  • TestAccEC2LaunchTemplate_instanceRequirements_localStorage
  • TestAccEC2LaunchTemplate_instanceRequirements_memoryGiBPerVCPU
  • TestAccEC2LaunchTemplate_instanceRequirements_memoryMiBAndVCPUCount
  • TestAccEC2LaunchTemplate_instanceRequirements_networkBandwidthGbps
  • TestAccEC2LaunchTemplate_instanceRequirements_networkInterfaceCount
  • TestAccEC2LaunchTemplate_instanceRequirements_onDemandMaxPricePercentageOverLowestPrice
  • TestAccEC2LaunchTemplate_instanceRequirements_requireHibernateSupport
  • TestAccEC2LaunchTemplate_instanceRequirements_spotMaxPricePercentageOverLowestPrice
  • TestAccEC2LaunchTemplate_instanceRequirements_totalLocalStorageGB
  • TestAccEC2SpotDatafeedSubscription_serial
  • TestAccEC2SpotFleetRequest_diversifiedAllocation
  • TestAccEC2SpotFleetRequest_instanceStoreAMI
  • TestAccEC2SpotInstanceRequest_interruptHibernate
  • TestAccEC2SpotInstanceRequest_interruptUpdate
  • TestAccEC2SpotInstanceRequest_vpc
  • TestAccEC2SpotInstanceRequest_withBlockDuration
  • TestAccEC2Tag_basic
  • TestAccIPAMOrganizationAdminAccount_basic
  • TestAccIPAMPreviewNextCIDR_ipv4Basic
  • TestAccIPAMResourceDiscovery_serial
  • TestAccIPAM_cascade
  • TestAccSiteVPNCustomerGateway_certificate
  • TestAccTransitGateway_serial
  • TestAccVPCDHCPOptionsAssociation_Disappears_dhcp
  • TestAccVPCDHCPOptions_disappears
  • TestAccVPCDefaultNetworkACL_Deny_ingress
  • TestAccVPCDefaultNetworkACL_subnetRemoval
  • TestAccVPCDefaultNetworkACL_withIPv6Ingress
  • TestAccVPCEndpointPolicy_disappears_endpoint
  • TestAccVPCEndpointServiceAllowedPrincipal_migrateID
  • TestAccVPCEndpointService_disappears
  • TestAccVPCEndpoint_interfaceWithSubnetAndSecurityGroup
  • TestAccVPCManagedPrefixListEntry_disappears
  • TestAccVPCNetworkACLAssociation_disappears_NACL
  • TestAccVPCNetworkACLAssociation_disappears_Subnet
  • TestAccVPCNetworkACLAssociation_disappears
  • TestAccVPCNetworkACLRule_Disappears_networkACL
  • TestAccVPCNetworkACL_Egress_mode
  • TestAccVPCNetworkACL_Ingress_mode
  • TestAccVPCNetworkACL_OnlyIngressRules_basic
  • TestAccVPCNetworkACL_OnlyIngressRules_update
  • TestAccVPCNetworkACL_caseSensitivityNoChanges
  • TestAccVPCNetworkACL_disappears
  • TestAccVPCNetworkACL_egressAndIngressRules
  • TestAccVPCNetworkACL_espProtocol
  • TestAccVPCNetworkACL_ipv6Rules
  • TestAccVPCNetworkACL_ipv6VPCRules
  • TestAccVPCNetworkACL_onlyEgressRules
  • TestAccVPCNetworkInsightsAnalysis_basic
  • TestAccVPCNetworkInsightsAnalysis_filterInARNs
  • TestAccVPCNetworkInterface_ignoreExternalAttachment
  • TestAccVPCPeeringConnectionOptions_differentRegionSameAccount
  • TestAccVPCPeeringConnection_options
  • TestAccVPCRouteTable_Disappears_subnetAssociation
  • TestAccVPCRouteTable_disappears
  • TestAccVPCRouteTable_ipv4ToInstance
  • TestAccVPCRouteTable_ipv4ToInternetGateway
  • TestAccVPCRouteTable_multipleRoutes
  • TestAccVPCRoute_Disappears_routeTable
  • TestAccVPCRoute_IPv4ToNetworkInterface_attached
  • TestAccVPCRoute_IPv4ToNetworkInterface_twoAttachments
  • TestAccVPCRoute_PrefixListToNetworkInterface_attached
  • TestAccVPCRoute_ipv4ToInstance
  • TestAccVPCRoute_ipv6ToInstance
  • TestAccVPCRoute_prefixListToInstance
  • TestAccVPCSecurityGroupRule_DescriptionAllPorts_nonZeroPorts
  • TestAccVPCSecurityGroupRule_Ingress_icmpv6
  • TestAccVPCSecurityGroupRule_Ingress_ipv4AndIPv6
  • TestAccVPCSecurityGroupRule_Ingress_ipv6
  • TestAccVPCSecurityGroupRule_Ingress_multipleIPv6
  • TestAccVPCSecurityGroupRule_Ingress_multiplePrefixLists
  • TestAccVPCSecurityGroupRule_Ingress_peeredVPC
  • TestAccVPCSecurityGroupRule_Ingress_prefixListAndSelf
  • TestAccVPCSecurityGroupRule_Ingress_prefixListAndSource
  • TestAccVPCSecurityGroupRule_Ingress_protocol
  • TestAccVPCSecurityGroupRule_Ingress_vpc
  • TestAccVPCSecurityGroupRule_MultipleRuleSearching_allProtocolCrash
  • TestAccVPCSecurityGroupRule_PartialMatching_basic
  • TestAccVPCSecurityGroupRule_PartialMatching_source
  • TestAccVPCSecurityGroupRule_egress
  • TestAccVPCSecurityGroupRule_expectInvalidTypeError
  • TestAccVPCSecurityGroupRule_issue5310
  • TestAccVPCSecurityGroupRule_prefixListEgress
  • TestAccVPCSecurityGroupRule_selfReference
  • TestAccVPCSecurityGroupRule_selfSource
  • TestAccVPCSecurityGroup_allowAll
  • TestAccVPCSecurityGroup_forceRevokeRulesFalse
  • TestAccVPCSecurityGroup_forceRevokeRulesTrue
  • TestAccVPCSecurityGroup_ipRangeAndSecurityGroupWithSameRules
  • TestAccVPCSecurityGroup_ipRangesWithSameRules
  • TestAccVPCSecurityGroup_rulesDropOnError
  • TestAccVPCTrafficMirrorSession_basic
  • TestAccVPCTrafficMirrorSession_tags
  • TestAccVerifiedAccessEndpoint_policyDocument
  • TestAccVerifiedAccessGroup_basic
  • TestAccVerifiedAccessGroup_disappears
  • TestAccVerifiedAccessGroup_policy
  • TestAccVerifiedAccessGroup_setPolicy
  • TestAccVerifiedAccessGroup_tags
  • TestAccVerifiedAccessGroup_updatePolicy
  • TestAccVerifiedAccessInstanceLoggingConfiguration_accessLogsCloudWatchLogsKinesisDataFirehoseS3
  • TestAccVerifiedAccessInstanceLoggingConfiguration_accessLogsCloudWatchLogs
  • TestAccVerifiedAccessInstanceLoggingConfiguration_accessLogsIncludeTrustContext
  • TestAccVerifiedAccessInstanceLoggingConfiguration_accessLogsKinesisDataFirehose
  • TestAccVerifiedAccessInstanceLoggingConfiguration_accessLogsLogVersion
  • TestAccVerifiedAccessInstanceLoggingConfiguration_accessLogsS3
  • TestAccVerifiedAccessInstanceLoggingConfiguration_disappears
  • TestAccVerifiedAccessInstanceTrustProviderAttachment_basic
  • TestAccVerifiedAccessInstanceTrustProviderAttachment_disappears
  • TestAccVerifiedAccessInstance_basic
  • TestAccVerifiedAccessInstance_description
  • TestAccVerifiedAccessInstance_disappears
  • TestAccVerifiedAccessInstance_fipsEnabled
  • TestAccVerifiedAccessInstance_tags

😭.
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 9, 2024

Community Note

Voting for Prioritization

  • Please vote on this issue by adding a 👍 reaction to the original post to help the community and maintainers prioritize this request.
  • Please see our prioritization guide for information on how we prioritize.
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request.

Volunteering to Work on This Issue

  • If you are interested in working on this issue, please leave a comment.
  • If this would be your first contribution, please review the contribution guide.

@ewbankkit
Copy link
Contributor Author

ewbankkit commented Feb 9, 2024 •
edited
Loading

TestAccEC2AMIDataSource_instanceStore, TestAccEC2SpotFleetRequest_instanceStoreAMI, and TestAccEC2Instance_* should be fixed by #35745.

@ewbankkit ewbankkit added tests PRs: expanded test coverage. Issues: expanded coverage, enhancements to test infrastructure. service/ec2 Issues and PRs that pertain to the ec2 service. service/verifiedaccess Issues and PRs that pertain to the verifiedaccess service. service/ipam Issues and PRs that pertain to the ipam service. service/transitgateway Issues and PRs that pertain to the transitgateway service. service/vpc Issues and PRs that pertain to the vpc service. service/vpnsite Issues and PRs that pertain to the vpnsite service. labels Feb 9, 2024
This was referenced Feb 12, 2024
Merged
Merged
This was referenced Mar 11, 2024
Merged
Merged
This was referenced Mar 19, 2024
Closed
Merged
@ewbankkit ewbankkit mentioned this issue Apr 16, 2024
Merged
This was referenced Apr 30, 2024
Merged
Merged
@DanielRieske DanielRieske mentioned this issue May 11, 2024
Merged
@jar-b jar-b mentioned this issue May 15, 2024
Merged
This was referenced May 16, 2024
Merged
Open
Open
@DanielRieske DanielRieske mentioned this issue Jul 14, 2024
Merged
@ewbankkit ewbankkit mentioned this issue Jul 24, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
service/ec2 Issues and PRs that pertain to the ec2 service. service/ipam Issues and PRs that pertain to the ipam service. service/transitgateway Issues and PRs that pertain to the transitgateway service. service/verifiedaccess Issues and PRs that pertain to the verifiedaccess service. service/vpc Issues and PRs that pertain to the vpc service. service/vpnsite Issues and PRs that pertain to the vpnsite service. tests PRs: expanded test coverage. Issues: expanded coverage, enhancements to test infrastructure.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ewbankkit