Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make troubleshooter output less verbose #865

Merged
merged 1 commit into from
Jun 11, 2019
Merged

Make troubleshooter output less verbose #865

merged 1 commit into from
Jun 11, 2019

Conversation

errordeveloper
Copy link
Contributor

@errordeveloper errordeveloper commented Jun 11, 2019 •
edited
Loading

Description

Small step towards #491.

/cc @mhausenblas

Before:

[ℹ]  2 sequential tasks: { create cluster control plane "beautiful-hideout-1560245357", create nodegroup "ng-398ca642" }
[ℹ]  building cluster stack "eksctl-beautiful-hideout-1560245357-cluster"
[ℹ]  deploying stack "eksctl-beautiful-hideout-1560245357-cluster"
[✖]  unexpected status "ROLLBACK_IN_PROGRESS" while waiting for CloudFormation stack "eksctl-beautiful-hideout-1560245357-cluster"
[ℹ]  fetching stack events in attempt to troubleshoot the root cause of the failure
[ℹ]  AWS::CloudFormation::Stack/eksctl-beautiful-hideout-1560245357-cluster: ROLLBACK_IN_PROGRESS – "The following resource(s) failed to create: [RouteTableAssociationPublicUSWEST2B, RouteTableAssociationPublicUSWEST2D, RouteTableAssociationPrivateUSWEST2C, RouteTableAssociationPublicUSWEST2C, RouteTableAssociationPrivateUSWEST2D, NATGateway, RouteTableAssociationPrivateUSWEST2B]. . Rollback requested by user."
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2C: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2C: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2D: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2D: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2B: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2B: CREATE_FAILED – "Resource creation cancelled"
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2C: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2D: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2D: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2B: CREATE_IN_PROGRESS – "Resource creation Initiated"
[✖]  AWS::EC2::NatGateway/NATGateway: CREATE_FAILED – "Performing this operation would exceed the limit of 5 NAT gateways (Service: AmazonEC2; Status Code: 400; Error Code: NatGatewayLimitExceeded; Request ID: 246e7c9a-02cb-4e86-a3e1-59c6d62cdefd)"
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2B: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2C: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2D: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2C: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::NatGateway/NATGateway: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2D: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2B: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Route/PublicSubnetRoute: CREATE_COMPLETE
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2B: CREATE_COMPLETE
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2C: CREATE_COMPLETE
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2B: CREATE_COMPLETE
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2D: CREATE_COMPLETE
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2D: CREATE_COMPLETE
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2C: CREATE_COMPLETE
[ℹ]  AWS::EC2::VPCGatewayAttachment/VPCGatewayAttachment: CREATE_COMPLETE
[ℹ]  AWS::IAM::Policy/PolicyNLB: CREATE_COMPLETE
[ℹ]  AWS::IAM::Policy/PolicyCloudWatchMetrics: CREATE_COMPLETE
[ℹ]  AWS::EC2::SecurityGroupIngress/IngressInterNodeGroupSG: CREATE_COMPLETE
[ℹ]  AWS::EC2::SecurityGroupIngress/IngressInterNodeGroupSG: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::SecurityGroupIngress/IngressInterNodeGroupSG: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SecurityGroup/ClusterSharedNodeSecurityGroup: CREATE_COMPLETE
[ℹ]  AWS::EC2::SecurityGroup/ControlPlaneSecurityGroup: CREATE_COMPLETE
[ℹ]  AWS::EC2::SecurityGroup/ClusterSharedNodeSecurityGroup: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::SecurityGroup/ControlPlaneSecurityGroup: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Route/PublicSubnetRoute: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Route/PublicSubnetRoute: CREATE_IN_PROGRESS
[ℹ]  AWS::IAM::Policy/PolicyNLB: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::IAM::Policy/PolicyCloudWatchMetrics: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::RouteTable/PrivateRouteTable: CREATE_COMPLETE
[ℹ]  AWS::IAM::Policy/PolicyNLB: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::RouteTable/PublicRouteTable: CREATE_COMPLETE
[ℹ]  AWS::IAM::Policy/PolicyCloudWatchMetrics: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2C: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::VPCGatewayAttachment/VPCGatewayAttachment: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2B: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2B: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2D: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::RouteTable/PublicRouteTable: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::RouteTable/PrivateRouteTable: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2C: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2C: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::VPCGatewayAttachment/VPCGatewayAttachment: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2B: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2D: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2D: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::RouteTable/PublicRouteTable: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2C: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SecurityGroup/ClusterSharedNodeSecurityGroup: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::SecurityGroup/ControlPlaneSecurityGroup: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Subnet/SubnetPublicUSWEST2B: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::RouteTable/PrivateRouteTable: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::Subnet/SubnetPrivateUSWEST2D: CREATE_IN_PROGRESS
[ℹ]  AWS::IAM::Role/ServiceRole: CREATE_COMPLETE
[ℹ]  AWS::EC2::VPC/VPC: CREATE_COMPLETE
[ℹ]  AWS::EC2::EIP/NATIP: CREATE_COMPLETE
[ℹ]  AWS::EC2::InternetGateway/InternetGateway: CREATE_COMPLETE
[ℹ]  AWS::IAM::Role/ServiceRole: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::VPC/VPC: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::EIP/NATIP: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::IAM::Role/ServiceRole: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::EIP/NATIP: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::VPC/VPC: CREATE_IN_PROGRESS
[ℹ]  AWS::EC2::InternetGateway/InternetGateway: CREATE_IN_PROGRESS – "Resource creation Initiated"
[ℹ]  AWS::EC2::InternetGateway/InternetGateway: CREATE_IN_PROGRESS
[ℹ]  AWS::CloudFormation::Stack/eksctl-beautiful-hideout-1560245357-cluster: CREATE_IN_PROGRESS – "User Initiated"
[ℹ]  building nodegroup stack "eksctl-beautiful-hideout-1560245357-nodegroup-ng-398ca642"
[ℹ]  2 error(s) occurred and cluster hasn't been created properly, you may wish to check CloudFormation console
[ℹ]  to cleanup resources, run 'eksctl delete cluster --region=us-west-2 --name=beautiful-hideout-1560245357'
[✖]  waiting for CloudFormation stack "eksctl-beautiful-hideout-1560245357-cluster" to reach "CREATE_COMPLETE" status: ResourceNotReady: failed waiting for successful resource state
[✖]  invalid cluster config: missing CertificateAuthorityData
[✖]  failed to create cluster "beautiful-hideout-1560245357"

After:

[ℹ]  2 sequential tasks: { create cluster control plane "beautiful-sheepdog-1560245255", create nodegroup "ng-5a3f5839" }
[ℹ]  building cluster stack "eksctl-beautiful-sheepdog-1560245255-cluster"
[ℹ]  deploying stack "eksctl-beautiful-sheepdog-1560245255-cluster"
[✖]  unexpected status "ROLLBACK_IN_PROGRESS" while waiting for CloudFormation stack "eksctl-beautiful-sheepdog-1560245255-cluster"
[ℹ]  fetching stack events in attempt to troubleshoot the root cause of the failure
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2B: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2C: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPublicUSWEST2A: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::SubnetRouteTableAssociation/RouteTableAssociationPrivateUSWEST2A: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::Route/PublicSubnetRoute: CREATE_FAILED – "Resource creation cancelled"
[✖]  AWS::EC2::NatGateway/NATGateway: CREATE_FAILED – "Performing this operation would exceed the limit of 5 NAT gateways (Service: AmazonEC2; Status Code: 400; Error Code: NatGatewayLimitExceeded; Request ID: da38da90-5c76-45a2-892a-784eda638b20)"
[ℹ]  building nodegroup stack "eksctl-beautiful-sheepdog-1560245255-nodegroup-ng-5a3f5839"
[ℹ]  2 error(s) occurred and cluster hasn't been created properly, you may wish to check CloudFormation console
[ℹ]  to cleanup resources, run 'eksctl delete cluster --region=us-west-2 --name=beautiful-sheepdog-1560245255'
[✖]  waiting for CloudFormation stack "eksctl-beautiful-sheepdog-1560245255-cluster" to reach "CREATE_COMPLETE" status: ResourceNotReady: failed waiting for successful resource state
[✖]  invalid cluster config: missing CertificateAuthorityData
[✖]  failed to create cluster "beautiful-sheepdog-1560245255"

Checklist

  • Code compiles correctly (i.e make build)
  • All unit tests passing (i.e. make test)

@errordeveloper

This comment has been minimized.

Sign in to view
@errordeveloper
Copy link
Contributor Author

invalid cluster config: missing CertificateAuthorityData is confusing, it's not meant to appear - will try to address that also.

I found a bug in stack manager, will open another PR for that.

@errordeveloper errordeveloper mentioned this pull request Jun 11, 2019
Merged
4 tasks
@errordeveloper errordeveloper merged commit 7376280 into master Jun 11, 2019
@errordeveloper errordeveloper deleted the less-verbosed-troubleshootter-output branch June 11, 2019 10:19
@errordeveloper errordeveloper mentioned this pull request Jun 14, 2019
Closed
torredil pushed a commit to torredil/eksctl that referenced this pull request May 20, 2022
@k8s-ci-robot
Merge pull request eksctl-io#865 from vdhanan/master
645e018 
release v1.0.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@martina-if martina-if martina-if approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@errordeveloper @martina-if