Deployment 2017.04.12

[skofman1]

Deployment 2017.04.12

Status: Planned

Planned production date: 04/12/2017

Focus: Sprint Deployment, Clearing the path for SemVer2 support

Services to Deploy:

Note: it's important to deploy catalog2* before feed2catalog.

Branch	Service	INT	PROD
NuGetGallery	V2 Gallery
NuGet.Services.Metadata	Search Service
NuGet.Services.Metadata	catalog2registration
NuGet.Services.Metadata	catalog2lucene
NuGet.Services.Metadata	catalog2dnx
NuGet.Services.Metadata	feed2catalog
NuGet.Services.Metadata	db2catalog	N/A	N/A
NuGet.Jobs	Gallery.CredentialExpiration
NuGet.Jobs	Gallery.Maintenance
NuGet.Jobs	HandlePackageEdits
NuGet.Jobs	NuGet.SupportRequests.Notifications	N/A
NuGet.Jobs	Stats.AggregateCdnDownloadsInGallery
NuGet.Jobs	Stats.CollectAzureCdnLogs
NuGet.Jobs	Stats.CreateAzureCdnWarehouseReports
NuGet.Jobs	Stats.ImportAzureCdnStatistics
NuGet.Jobs	Stats.RollUpDownloadFacts

Related blog posts/docs:

• None

Deployed commit:

Deployment Process

Gallery

• Update DB schema
• Deploy services
• Update deployments overview
• Deploy secondary region

Search Service (NuGet.Services.Metadata)

• Deploy services

Jobs (NuGet.Jobs & NuGet.ServicesMetadata)

• Deploy services

Test Plan:

• Run all functional tests
• Smoke testing

Changes

- Gallery:

• Functional:

  • EMD: The Copyright field isn't wide enough for typical copyright statements. #1446 - Increase width of text fields/areas on Edit Package and Login pages (PR remove fixed width and force 100% width for input fields #3389) - Thanks @robertmuehsig for this contribution!
  • feed2catalog produces catalog items with invalid dependency version ranges #3482 - Gallery no longer accepts packages with illegal package dependency version ranges (PR Block packages with illegal package dependency version ranges #3728)
  • QUESTION: Generic URL to latest pre-release package on NuGet? #2567 - Generic URL to absolute latest package (PR Code and tests for issue #2567 #3458) - Thanks @supergibbs for this contribution!

• Technical:

  • [Engineering/Updating routes to be REST-based #241] - .NET 4.6 for Gallery (PR .NET 4.6 for Gallery #3736)
  • Package metadata appears in Gallery DB, but package is not in storage #3661 - Package content can be lost in rare cases where you are concurrently pushing many of the same version (PR Make file storage implementations atomically check for overwrite #3706)
  • Store SemVerLevel for newly pushed/uploaded packages to gallery #3675 - Store SemVerLevel field for newly pushed/uploaded packages to the gallery (PR #3675 Store SemVerLevel for newly pushed/uploaded packages to gallery #3678)
    Includes the following db schema change:

    ALTER TABLE [dbo].[Packages] ADD [SemVerLevelKey] [int]

  • Filter SemVer v2.0.0 packages by default on v1 and v2 gallery endpoints #3686 - Filter SemVer2 package versions by default on v1, v2 and v2-curated endpoints (PR [SemVer2] Filter SemVer v2.0.0 package versions by default on v1 and v2 OData endpoints #3694)
  • Engineering/#352 Fix compiler warning for CA ruleset
  • Engineering/#244 NuGetGalleryDB: in OData queries - override the automatic EF orderby Id
  • Gallery telemetry - log client version #3659 - Gallery telemetry - log client version (PR Add client information property to request telemetry #3759)

- Search Service (NuGet.Services.Metadata):

• Functional:

• Technical:

  • Fix duplicate event logging ServerCommon#28 Fix duplicate Application Insights event logging

- Jobs (NuGet.Services.Metadata)

• Functional:

  • Feed2Catalog:

    • SemVer 2.0.0 packages have their full version string written to the catalog entry Update feed2catalog to support SemVer 2.0.0 #3680

  • Catalog2Registration:

    • SemVer 2.0.0 packages can be put into another container Update catalog2registration to support SemVer 2.0.0 #3560

• Technical:

  • All

    • Fix duplicate event logging ServerCommon#28 Fix duplicate Application Insights event logging

  • Catalog2Registration:

    • Bug fix: multiple catalog commits for a single package are not processed by commit time Catalog2Registration: multiple catalog commits for a single package are not processed by commit time #3716
    • Bug fix: catalog commits can be skipped when there are transient failures Catalog entries can get skipped by catalog2registration when there are transient failures #3733
    • Bug fix: catalog2registration sets wrong listed value on non-UTC machines catalog2registration on non-UTC machine set listed property incorrectly #3740

  • Catalog2Dnx:

    • Bug fix: Catalog2Dnx does not delete the deleted packages from the flat container

- Jobs (NuGet.Jobs)

• Fix duplicate event logging ServerCommon#28 Fix duplicate Application Insights event logging for the following jobs:
  • Gallery.CredentialExpiration
  • Gallery.Maintenance
  • HandlePackageEdits
  • NuGet.SupportRequests.Notifications
  • Stats.AggregateCdnDownloadsInGallery
  • Stats.CollectAzureCdnLogs
  • Stats.CreateAzureCdnWarehouseReports
  • Stats.ImportAzureCdnStatistics
  • Stats.RollUpDownloadFacts