Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix compute model validation errors #22271

Merged
merged 40 commits into from
Mar 1, 2023
Merged

Conversation

grizzlytheodore
Copy link
Member

@grizzlytheodore grizzlytheodore commented Jan 20, 2023

ARM API Information (Control Plane)

98% of this PR is updating examples to address modelvalidations and updating example names to be consistent.
We had to update swagger object property to correctly reflect objects that do not return IDs.

MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.

Azure 1st Party Service can try out the Shift Left experience to initiate API design review from ADO code repo. If you are interested, may request engineering support by filling in with the form https://aka.ms/ShiftLeftSupportForm.

Changelog

Add a changelog entry for this PR by answering the following questions:

  1. What's the purpose of the update?
    • new service onboarding
    • new API version
    • update existing version for new feature
    • update existing version to fix swagger quality issue in s360
    • Other, please clarify
  2. When are you targeting to deploy the new service/feature to public regions? Please provide the date or, if the date is not yet available, the month.
  3. When do you expect to publish the swagger? Please provide date or, the the date is not yet available, the month.
  4. By default, Azure SDKs of all languages (.NET/Python/Java/JavaScript for both management-plane SDK and data-plane SDK, Go for management-plane SDK only ) MUST be refreshed with/after swagger of new version is published. If you prefer NOT to refresh any specific SDK language upon swagger updates in the current PR, please leave details with justification here.

Contribution checklist (MS Employees Only):

If any further question about AME onboarding or validation tools, please view the FAQ.

ARM API Review Checklist

Applicability: ⚠️

If your changes encompass only the following scenarios, you should SKIP this section, as these scenarios do not require ARM review.

  • Change to data plane APIs
  • Adding new properties
  • All removals

Otherwise your PR may be subject to ARM review requirements. Complete the following:

  • Check this box if any of the following apply to the PR so that the label "ARMReview" and "WaitForARMFeedback" will be added by bot to kick off ARM API Review. Missing to check this box in the following scenario may result in delays to the ARM manifest review and deployment.

    • Adding a new service
    • Adding new API(s)
    • Adding a new API version
      -[ ] To review changes efficiently, ensure you copy the existing version into the new directory structure for first commit and then push new changes, including version updates, in separate commits. You can use OpenAPIHub to initialize the PR for adding a new version. For more details refer to the wiki.
  • Ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

  • If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist

If you have any breaking changes as defined in the Breaking Change Policy, request approval from the Breaking Change Review Board.

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Additional details on the process and office hours are on the Breaking Change Wiki.

NOTE: To update API(s) in public preview for over 1 year (refer to Retirement of Previews)

Please follow the link to find more details on PR review process.

@openapi-workflow-bot
Copy link

Hi, @grizzlytheodore Thanks for your PR. I am workflow bot for review process. Here are some small tips.

  • Please ensure to do self-check against checklists in first PR comment.
  • PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.
  • For specs comparison cross API versions, Use API Specs Comparison Report Generator
  • If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

  • Any feedback about review process or workflow bot, pls contact swagger and tools team. vscswagger@microsoft.com

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jan 20, 2023

    Swagger Validation Report

    ️❌BreakingChange: 2 Errors, 5 Warnings failed [Detail]
    compared swaggers (via Oad v0.10.4)] new version base version
    availabilitySet.json 2022-11-01(3badca6) 2022-11-01(main)
    capacityReservation.json 2022-11-01(3badca6) 2022-11-01(main)
    computeRPCommon.json 2022-11-01(3badca6) 2022-11-01(main)
    dedicatedHost.json 2022-11-01(3badca6) 2022-11-01(main)
    image.json 2022-11-01(3badca6) 2022-11-01(main)
    restorePoint.json 2022-11-01(3badca6) 2022-11-01(main)
    sshPublicKey.json 2022-11-01(3badca6) 2022-11-01(main)
    virtualMachine.json 2022-11-01(3badca6) 2022-11-01(main)
    virtualMachineExtensionImage.json 2022-11-01(3badca6) 2022-11-01(main)
    virtualMachineImage.json 2022-11-01(3badca6) 2022-11-01(main)
    virtualMachineScaleSet.json 2022-11-01(3badca6) 2022-11-01(main)
    common.json 1.0(3badca6) 1.0(main)
    Rule Message
    1033 - RemovedProperty The new version is missing a property found in the old version. Was 'id' renamed or removed?
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4136:7
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4134:7
    1033 - RemovedProperty The new version is missing a property found in the old version. Was 'id' renamed or removed?
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4279:7
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4280:7
    ⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4470:11
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4475:11
    ⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4198:11
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4200:11
    ⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L5601:11
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L5604:11
    ⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4135:5
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4133:5
    ⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
    New: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4278:5
    Old: ComputeRP/stable/2022-11-01/virtualMachineScaleSet.json#L4279:5
    ️️✔️Breaking Change(Cross-Version) succeeded [Detail] [Expand]
    There are no breaking changes.
    ️️✔️CredScan succeeded [Detail] [Expand]
    There is no credential detected.
    ️🔄LintDiff inProgress [Detail]
    ️⚠️Avocado: 1 Warnings warning [Detail]
    Rule Message
    ⚠️ MULTIPLE_API_VERSION The default tag contains multiple API versions swaggers.
    readme: specification/compute/resource-manager/readme.md
    tag: specification/compute/resource-manager/readme.md#tag-package-2022-11-01
    ️️✔️ApiReadinessCheck succeeded [Detail] [Expand]
    ️⚠️~[Staging] ServiceAPIReadinessTest: 0 Warnings warning [Detail]

    API Test is not triggered due to precheck failure. Check pipeline log for details.

    ️️✔️SwaggerAPIView succeeded [Detail] [Expand]
    ️️✔️CadlAPIView succeeded [Detail] [Expand]
    ️️✔️ModelValidation succeeded [Detail] [Expand]
    Validation passes for ModelValidation.
    ️️✔️SemanticValidation succeeded [Detail] [Expand]
    Validation passes for SemanticValidation.
    ️️✔️PoliCheck succeeded [Detail] [Expand]
    Validation passed for PoliCheck.
    ️️✔️PrettierCheck succeeded [Detail] [Expand]
    Validation passes for PrettierCheck.
    ️️✔️SpellCheck succeeded [Detail] [Expand]
    Validation passes for SpellCheck.
    ️️✔️Lint(RPaaS) succeeded [Detail] [Expand]
    Validation passes for Lint(RPaaS).
    ️️✔️CadlValidation succeeded [Detail] [Expand]
    Validation passes for CadlValidation.
    ️️✔️PR Summary succeeded [Detail] [Expand]
    Validation passes for Summary.
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jan 20, 2023

    Swagger Generation Artifacts

    ️️✔️ApiDocPreview succeeded [Detail] [Expand]
     Please click here to preview with your @microsoft account. 
    ️❌SDK Breaking Change Tracking failed [Detail]

    Breaking Changes Tracking

    azure-sdk-for-go - sdk/resourcemanager/compute/armcompute - Approved - 5.0.0
    +	Field `ID` of struct `VirtualMachineScaleSetIPConfiguration` has been removed
    +	Field `ID` of struct `VirtualMachineScaleSetNetworkConfiguration` has been removed
    azure-sdk-for-python-track2 - track2_azure-mgmt-compute - Approved - 29.2.0b1
    +	Model VirtualMachineScaleSetIPConfiguration no longer has parameter id
    +	Model VirtualMachineScaleSetNetworkConfiguration no longer has parameter id

    ️❌ azure-sdk-for-net-track2 failed [Detail]
    • Failed [Logs]Release - Generate from 0326108. SDK Automation 14.0.0
      command	pwsh ./eng/scripts/Automation-Sdk-Init.ps1 ../azure-sdk-for-net_tmp/initInput.json ../azure-sdk-for-net_tmp/initOutput.json
      command	pwsh ./eng/scripts/Invoke-GenerateAndBuildV2.ps1 ../azure-sdk-for-net_tmp/generateInput.json ../azure-sdk-for-net_tmp/generateOutput.json
      cmderr	[Invoke-GenerateAndBuildV2.ps1] �[31;1mGeneratePackage: �[0m/mnt/vss/_work/1/s/azure-sdk-for-net/eng/scripts/automation/GenerateAndBuildLib.ps1:672
      cmderr	[Invoke-GenerateAndBuildV2.ps1] �[36;1mLine |
      cmderr	[Invoke-GenerateAndBuildV2.ps1] �[36;1m 672 | �[0m         �[36;1mGeneratePackage -projectFolder $projectFolder -sdkRootPath $s�[0m …
      cmderr	[Invoke-GenerateAndBuildV2.ps1] �[36;1m     | �[31;1m         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      cmderr	[Invoke-GenerateAndBuildV2.ps1] �[31;1m�[36;1m     | �[31;1mFailed to build sdk. exit code: False
      cmderr	[Invoke-GenerateAndBuildV2.ps1] �[0m
    • Azure.ResourceManager.Compute [View full logs]  [Release SDK Changes] Breaking Change Detected
      info	[Changelog] Breaking Changes: /home/cloudtest/.nuget/packages/microsoft.dotnet.apicompat/5.0.0-beta.20467.1/build/Microsoft.DotNet.ApiCompat.targets(96,5): error : ApiCompat failed for '/mnt/vss/_work/1/s/azure-sdk-for-net/artifacts/bin/Azure.ResourceManager.Compute/Debug/netstandard2.0/Azure.ResourceManager.Compute.dll' [/mnt/vss/_work/1/s/azure-sdk-for-net/sdk/compute/Azure.ResourceManager.Compute/src/Azure.ResourceManager.Compute.csproj::TargetFramework=netstandard2.0]
    ️⚠️ azure-sdk-for-python-track2 warning [Detail]
    • ⚠️Warning [Logs]Release - Generate from 0326108. SDK Automation 14.0.0
      command	sh scripts/automation_init.sh ../azure-sdk-for-python_tmp/initInput.json ../azure-sdk-for-python_tmp/initOutput.json
      cmderr	[automation_init.sh] WARNING: Skipping azure-nspkg as it is not installed.
      command	sh scripts/automation_generate.sh ../azure-sdk-for-python_tmp/generateInput.json ../azure-sdk-for-python_tmp/generateOutput.json
      cmderr	[automation_generate.sh] npm notice
      cmderr	[automation_generate.sh] npm notice New minor version of npm available! 9.3.1 -> 9.5.1
      cmderr	[automation_generate.sh] npm notice Changelog: <https://github.com/npm/cli/releases/tag/v9.5.1>
      cmderr	[automation_generate.sh] npm notice Run `npm install -g npm@9.5.1` to update!
      cmderr	[automation_generate.sh] npm notice
    • ️✔️track2_azure-mgmt-compute [View full logs]  [Release SDK Changes] Breaking Change Detected
      info	[Changelog] ### Features Added
      info	[Changelog]
      info	[Changelog]   - Model VirtualMachineScaleSetVMInstanceView has a new parameter computer_name
      info	[Changelog]   - Model VirtualMachineScaleSetVMInstanceView has a new parameter hyper_v_generation
      info	[Changelog]   - Model VirtualMachineScaleSetVMInstanceView has a new parameter os_name
      info	[Changelog]   - Model VirtualMachineScaleSetVMInstanceView has a new parameter os_version
      info	[Changelog]
      info	[Changelog] ### Breaking Changes
      info	[Changelog]
      info	[Changelog]   - Model VirtualMachineScaleSetIPConfiguration no longer has parameter id
      info	[Changelog]   - Model VirtualMachineScaleSetNetworkConfiguration no longer has parameter id
    ️️✔️ azure-sdk-for-java succeeded [Detail] [Expand]
    ️️✔️ azure-sdk-for-js succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 0326108. SDK Automation 14.0.0
      command	sh .scripts/automation_init.sh ../azure-sdk-for-js_tmp/initInput.json ../azure-sdk-for-js_tmp/initOutput.json
      warn	File azure-sdk-for-js_tmp/initOutput.json not found to read
      command	sh .scripts/automation_generate.sh ../azure-sdk-for-js_tmp/generateInput.json ../azure-sdk-for-js_tmp/generateOutput.json
    • ️✔️@azure/arm-compute [View full logs]  [Release SDK Changes]
      info	[Changelog] **Features**
      info	[Changelog]
      info	[Changelog]   - Interface VirtualMachineScaleSetVMInstanceView has a new optional parameter computerName
      info	[Changelog]   - Interface VirtualMachineScaleSetVMInstanceView has a new optional parameter hyperVGeneration
      info	[Changelog]   - Interface VirtualMachineScaleSetVMInstanceView has a new optional parameter osName
      info	[Changelog]   - Interface VirtualMachineScaleSetVMInstanceView has a new optional parameter osVersion
      info	[Changelog]   - Enum KnownStorageAccountType has a new value StandardSSDLRS
    ️️✔️ azure-sdk-for-go succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 0326108. SDK Automation 14.0.0
      command	sh ./eng/scripts/automation_init.sh ../../../../../azure-sdk-for-go_tmp/initInput.json ../../../../../azure-sdk-for-go_tmp/initOutput.json
      command	generator automation-v2 ../../../../../azure-sdk-for-go_tmp/generateInput.json ../../../../../azure-sdk-for-go_tmp/generateOutput.json
    • ️✔️sdk/resourcemanager/compute/armcompute [View full logs]  [Release SDK Changes] Breaking Change Detected
      info	[Changelog] ### Breaking Changes
      info	[Changelog]
      info	[Changelog] - Field `ID` of struct `VirtualMachineScaleSetIPConfiguration` has been removed
      info	[Changelog] - Field `ID` of struct `VirtualMachineScaleSetNetworkConfiguration` has been removed
      info	[Changelog]
      info	[Changelog] ### Features Added
      info	[Changelog]
      info	[Changelog] - New value `StorageAccountTypeStandardSSDLRS` added to type alias `StorageAccountType`
      info	[Changelog] - New field `ComputerName` in struct `VirtualMachineScaleSetVMInstanceView`
      info	[Changelog] - New field `HyperVGeneration` in struct `VirtualMachineScaleSetVMInstanceView`
      info	[Changelog] - New field `OSName` in struct `VirtualMachineScaleSetVMInstanceView`
      info	[Changelog] - New field `OSVersion` in struct `VirtualMachineScaleSetVMInstanceView`
      info	[Changelog]
      info	[Changelog] Total 2 breaking change(s), 2 additive change(s).
    ️⚠️ azure-resource-manager-schemas warning [Detail]
    • ⚠️Warning [Logs]Release - Generate from 0326108. Schema Automation 14.0.0
      command	.sdkauto/initScript.sh ../azure-resource-manager-schemas_tmp/initInput.json ../azure-resource-manager-schemas_tmp/initOutput.json
      cmderr	[initScript.sh] WARN old lockfile
      cmderr	[initScript.sh] npm WARN old lockfile The package-lock.json file was created with an old version of npm,
      cmderr	[initScript.sh] npm WARN old lockfile so supplemental metadata must be fetched from the registry.
      cmderr	[initScript.sh] npm WARN old lockfile
      cmderr	[initScript.sh] npm WARN old lockfile This is a one-time fix-up, please be patient...
      cmderr	[initScript.sh] npm WARN old lockfile
      warn	File azure-resource-manager-schemas_tmp/initOutput.json not found to read
      command	.sdkauto/generateScript.sh ../azure-resource-manager-schemas_tmp/generateInput.json ../azure-resource-manager-schemas_tmp/generateOutput.json
    • ️✔️compute [View full logs]  [Release Schema Changes]
    ️❌ azure-powershell failed [Detail]
    • Failed [Logs]Release - Generate from 0326108. SDK Automation 14.0.0
      command	sh ./tools/SwaggerCI/init.sh ../azure-powershell_tmp/initInput.json ../azure-powershell_tmp/initOutput.json
      command	pwsh ./tools/SwaggerCI/psci.ps1 ../azure-powershell_tmp/generateInput.json ../azure-powershell_tmp/generateOutput.json
    • Az.compute [View full logs]  [Release SDK Changes]
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jan 20, 2023

    Generated ApiView

    Language Package Name ApiView Link
    Go sdk/resourcemanager/compute/armcompute https://apiview.dev/Assemblies/Review/c658a507d675415a90febe91c73b21eb
    Java azure-resourcemanager-compute-generated Create ApiView failed. Please ask PR assignee for help
    .Net Azure.ResourceManager.Compute Create ApiView failed. Please ask PR assignee for help
    JavaScript @azure/arm-compute Create ApiView failed. Please ask PR assignee for help

    @ArcturusZhang ArcturusZhang added Approved-ModelValidation and removed DoNotMerge <valid label in PR review process> use to hold merge after approval labels Mar 1, 2023
    @tadelesh tadelesh added the Approved-SdkBreakingChange-Go Approve the breaking change tracking for azure-sdk-for-go label Mar 1, 2023
    @openapi-pipeline-app openapi-pipeline-app bot added the DoNotMerge <valid label in PR review process> use to hold merge after approval label Mar 1, 2023
    @ArcturusZhang ArcturusZhang removed the DoNotMerge <valid label in PR review process> use to hold merge after approval label Mar 1, 2023
    @ArcturusZhang
    Copy link
    Member

    /azp run

    @azure-pipelines
    Copy link

    Azure Pipelines successfully started running 1 pipeline(s).

    @openapi-pipeline-app openapi-pipeline-app bot added DoNotMerge <valid label in PR review process> use to hold merge after approval and removed DoNotMerge <valid label in PR review process> use to hold merge after approval labels Mar 1, 2023
    @ArcturusZhang
    Copy link
    Member

    Offline talked with the author, the PR is good to merge now

    @ArcturusZhang ArcturusZhang merged commit 0326108 into main Mar 1, 2023
    @ArcturusZhang ArcturusZhang deleted the fixComputeModelValidation branch March 1, 2023 07:28
    aviyerMSFT pushed a commit to aviyerMSFT/azure-rest-api-specs that referenced this pull request Mar 22, 2023
    * remove instance view from virtualmachine list
    
    * remove instance view from vm list
    
    * add id to availability set object in examples
    
    * add id for dedicated host
    
    * add id for ssh key in examples
    
    * add id for capacity reservation in examples
    
    * LRO_Response_Header for examples
    
    * fix all the example titles to be singular
    
    * make example titles also singular
    
    * add vmss id in vmss get/list
    
    * add vmExtensionImage ids to examples
    
    * add VMExtension id to examples
    
    * add id for managed disks
    
    * Revert "add id for managed disks"
    
    This reverts commit adbeabb.
    
    * fix example name error
    
    * point managed disk to SubResourceIdNotRequired
    
    * remove instance view from virtualmachine list
    
    * update Swagger files to resolve model validations
    
    * fix examples
    
    * change "header" to "headers" in examples
    
    * fix examples.
    
    * fix LIntDiffs
    
    * add schema description
    
    * try suppressing lintDiff
    
    * revert last commit
    
    * lintdiff suppress
    
    * try
    
    * try
    
    * updated
    
    * fix
    
    * try
    
    * try
    
    * try
    
    * remove R2062
    
    * suppress XmsResourceInPutResponse
    
    * remove x-ms-azure-resource tag from SubResource, SubResourceReadOnly and add it to objects referring to them instead.
    
    * remove x-ms-azure-resource from virtualMachineImage because it is not a tracked resource
    
    * fix generation error
    
    * mitigate track 1 generating issue
    
    ---------
    
    Co-authored-by: Theodore Chang <theodore.l.chang@gmail.com>
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    Approved-BreakingChange DO NOT USE! OBSOLETE label. See https://github.com/Azure/azure-sdk-tools/issues/6374 Approved-ModelValidation Approved-SdkBreakingChange-Go Approve the breaking change tracking for azure-sdk-for-go Approved-SdkBreakingChange-JavaScript Approved-SdkBreakingChange-Python BreakingChangeReviewRequired <valid label in PR review process>add this label when breaking change review is required CI-BreakingChange-Go CI-BreakingChange-JavaScript Compute DoNotMerge <valid label in PR review process> use to hold merge after approval resource-manager SuppressionReviewRequired
    Projects
    None yet
    Development

    Successfully merging this pull request may close these issues.

    8 participants