v0.22.3

CHANGES since v0.22.2:🐞

• New VHD image fixes expired NVIDIA gpg certificate (PR #3913 @mboersma)

v0.22.2

CHANGES since v0.22.1: 🌈🔧🐞

• Kubernetes v1.12.0-rc.2 support (PR #3893 @mboersma)
• Allow cloudprovider rate limit / backoff disabling (PR #3891 @jackfrancis)
• Use dockerhub.akscn.io in mooncake (PR #3887 @andyzhangx)
• Ubuntu 16.04.201809120 for non-AKS base image installs (PR #3898 @jackfrancis)

v0.22.1

CHANGES since v0.22.0: 🌈🐞

• Kubernetes v1.10.8 support (PR #3868 @mboersma)
• Kubernetes v1.12.0-rc.1 support (PR #3872 @mboersma)
• Update AKS base image to 0.15.0 (PR #3870 @mboersma)
• Update cloudprovider cluster role bindings for k8s 1.12 (PR #3855 @andyzhangx)
• Fix scale with MSI (PR #3845 @CecileRobertMichon)
• Disable AKS base image installs for sovereign clouds (PR #3874 @CecileRobertMichon)

v0.22.0

ATTN: 🚀

The big reveal with this release is 1st class AKS-curated golden OS images during provisioning (Azure Public Cloud only for now). This means:

• major reduction in transient vm deployment errors due to external I/O dependencies (e.g., k8s.gcr.io)

  • observational error rate reduction from 0.1% to 0.001% for vm provisioning due to runtime paving

• major reduction in median cluster deployment time

  • from ~6 minutes to ~4 minutes for a "small" (3 nodes) VMSS-backed cluster
  • from ~15 minutes to ~7 minutes for a "large" (55 nodes) VMSS-backed cluster

• PRs #3708 #3718 #3720 #3724 #3721 #3742 #3764 #3784 #3801 #3809 #3819 #3826 #3844 #3849 #3862 (@CecileRobertMichon @jackfrancis) tells the tale

Additionally a notable change is a reduction in k8s versions that can be used to create new clusters. Going forward we will allow 2 (most commonly the 2 most recent) patch versions for each k8s minor release train in a set of Kubernetes minor releases. For now that set is 1.7 through 1.11 (1.12 pre-dot-zero releases are also offered). This has no effect on pre-existing clusters, which can be scaled without regard to whether or not they are running a specific version of k8s in the list of versions that are enabled for creation; and those clusters are also able to be upgraded at any time to any of the versions in the new reduced versions set.

• PR #3750 (@CecileRobertMichon) tells the tale

FEATURES: 🌈

• Kubernetes 1.11.3 (PR #3823 @mboersma)
• Kubernetes 1.12.0-beta.1 (PR #3825 @jackfrancis)
• Availability zone support for Kubernetes 1.12+ (PRs #3453 @sozercan)
• Add k8s health monitor script for docker and kubelet (PRs #3782 #3817 @mboersma)
• Azure CNI v1.0.11 for both Linux and Windows (PR #3722 @jackfrancis)
• Support for kubernetes clusters with user assigned MSI (PR #3736 @kkmsft)
• Update to go-autorest v10.15.4 (PR #3843 @ultimateboy)
• Update keyvault-flexvol image and default to enabled (PR #3841 @ritazh)
• Enable user-configurable addons manifests (PR #3840 @tariq1890)
  Caveat: This change introduces a minor change in addons if duplicate addon names are found. With this change, the first (as opposed to the last one in previous releases) add-on of the list of add-ons with duplicate addon names will end up being selected. Although acs-engine accepts multiple add-ons with the same name, this practice is highly discouraged and we recommend that you sanitize your apimodel to include only unique add-on names.

BUGS FIXED: 🐞

• Create kube manifest dirs on node provision. (PR #3744 @tariq1890)
• Enable pod priority for kubelet by default (PR #3743 @chengliangli0918)
• Check for nil before using osPublisher (PR #3768 @cherwin)
• Fix kubeletConfig for Windows agent nodes (PR #3753 @PatrickLang)
• add missing apimodel cli parameter description (PR #3775 @serbrech)
• Remove etcd binaries from agent VMs (PR #3793 @tariq1890)
• Windows nodes not working with kubenet plugin (PR #3800 @PatrickLang)
• Remove deprecated method calls in kubeclient (PR #3805 @tariq1890)
• Fix version deprecation validation for VMSS and windows clusters (PR #3818 @tariq1890)
• Only enable aggregated api if rbac != disabled (PR #3813 @jackfrancis)
• Removing code duplication in addon logic (PR #3832 @tariq1890)

DEV IMPROVEMENTS/CHORES: 🔧

• Minor if else optimization in the kubernetes base template (PR #3758 @tariq1890)
• Layer ADD source-code prior to make bootstrap layer in Dockerfile (PR #3767 @ashish-amarnath)
• Using dep 0.5.0 and adding dep check to the CI/CD cycle (PR #3709 @tariq1890)
• Make cmd more testable by abstracting authArgs and AzureClient (PR #3756 @serbrech)
• Store Azure CNI version in api model (PR #3804 @jackfrancis)
• Enable "gosimple" linter plugin (PR #3802 @mboersma)
• Update to go 1.11 and fix new linting errors (PR #3763 @mboersma)
• Docs updates!
  • Ingress routing in mixed OS cluster (PR #3734 @PatrickLang)
  • Fix swapped username/password in Windows tutorial (PR #3761 @PatrickLang)
  • Documentation for Container monitoring addon (PR #3735 @rashmichandrashekar)
  • Update go prerequisite to 1.11 and add links (PR #3838 @mboersma)
• CI/E2E maintenance/improvements!
  • Adding E2E network policy tests (PR #3717 @saiyan86)

v0.22.0-rc.2

<!--
v0.22.0-rc.2
-->

v0.22.0-rc.1

<!--
v0.22.0-rc.1
-->

v0.21.2

CHANGES since v0.21.1: 🔧

• Fixes a regression in cloudprovider backoff/rate limit functionality "on by default" (PR #3774 @jackfrancis)

v0.21.1

CHANGES since v0.21.0: 🌈🔧

• Kubernetes v1.12.0-beta.0 support (PR #3685 @ritazh @jackfrancis)
• Standardize ARM ops timeout to 2.5 hours (PR #3741 @jackfrancis)

v0.21.0

FEATURES: 🌈

• Kubernetes v1.10.7 support (PR #3706 @mboersma)
• AAD pod identity as addon (PR #3475 @kkmsft)
• Get sub id automatically from azure CLI context (PR #3519 @cpuguy83)
• Update k8s-azure-kms to v0.0.4 (PR #3703 @ritazh)
• Update Azure CNI to v1.0.10 (PR #3551 @jackfrancis)
• Use default cluster configuration when --api-model not set (PR #3384 @cpuguy83)
• Enable docker health probe (PR #3529 @jackfrancis)
• Enable up to 9 agent node pools for most cluster configurations
  • Remove unnecessary ARM vars (PR #3623 @jackfrancis)
  • Move duplicated variables to parameters (PRs #3627 #3649 @jackfrancis)
  • Rationalize conditional ARM params (PR #3668 @jackfrancis)
• Update ubuntu image to 16.04.201808140 (PR #3698 @jackfrancis)
• blobfuse and smb drivers as addons (PRs #3575 #3648 @jackfrancis @andyzhangx)
• Enable ILB probe (PR #3652 @jackfrancis)
• Harden SSH: kex/ciphers/MACS + disable X11 forwarding (PR #3612 @seanknox)
• Support for Standard LB in k8s v1.11 (PR #3515 @sozercan)
• Allow kube-proxy to run regardless of any node taint (PR #3639 @seanknox)
• Rework the way to parse --set flag values (PR #3573 @jcorioland)
• Add extension for Windows patching at deployment (PR #3704 @PatrickLang)
• Setup for custom VHD deployments:
  • Add AKS distro (PR #3671 @CecileRobertMichon)
  • Golden image (PR #3696, #3680 @CecileRobertMichon)
  • Add Packer (PR #3650, #3672, #3675, #3676 @CecileRobertMichon, @seanknox)
  • Refactor CSE to separate installs (PR #3642 @CecileRobertMichon)

BUGS FIXED: 🐞

• Remove datadisk to allow scale after upgrade (PR #3482 @shanalily)
• --max-pods=30 should be Azure CNI-only (PR #3543 @jackfrancis)
• fix an issue where networkPlugin was not defined correctly when using calico or cilium (PR #3271 @dcasati)
• Add validation when PodCidr is set in the Azure CNI case. (PR #3562 @JunSun17)
• Fix validation when using keyvaultSecretRef (PR #3585 @ritazh)
• Fix errors pointed out by "make test-style" (PR #3593 @mboersma)
• Make the calico daemonset manifest pass validation in k8s 1.11 (PR #3602 @oivindoh)
• Fix cni cleanup during kubelet start to be graceful & not loose any logs (PR #3618 @madhanrm)
• Windows kubelet configs shouldn't overwrite Linux config in hybrid clusters (PR #3651 @PatrickLang)
• Errors parsing templates (parts/*) are ignored instead of raised (PR #3656 @PatrickLang)
• VMSS upgrading (PR #3665 @chengliangli0918)
• Change registry proxy for azure china cloud (PR #3683 @andyzhangx)
• Don't print error as info (PR #3691 @CecileRobertMichon)
• Scale down shouldn't depend on VM index (PR #3644 @shanalily
• Remove static allowed vals array for agent pool count (PR #3679 @jackfrancis)
• Kubernetes: Azure CNI network monitor agents configuration errata (PR #3674 @jackfrancis)
• Add dkms to manage nvidia gpu kmod compliation across different linux kernels (PR #3688 @lachie83)

DEV IMPROVEMENTS/CHORES: 🔧

• Parallelizing tests (PRs #3512 #3598 @tariq1890)
• Installing vendored go-bindata binaries (PR #3527 @tariq1890)
• Optimizations to Kubernetes provision script implementation
  • Change outbound networking check to use more portable constructs (PR #3570 @PaulCharlton)
  • Kubernetes CSE: add func to ensure executable download (PR #3700 @jackfrancis)
• Adding 'make dev' equivalent for Windows (PR #3471 @PatrickLang)
• Fix a DCOS upgrade test case when ~/.azure/config exists (PR #3587 @mboersma)
• Add a README.md badge for code documentation (PR #3592 @mboersma)
• Update go-dev tools image (PR #3611 @mboersma)
• Simplify addons implementation (PR #3641 @jackfrancis)
• Deprecate ACS v1 classic mode support (PR #3647 @jackfrancis)
• Allow deprecating k8s versions (PR #3493 @CecileRobertMichon)
• Docs updates!
  • Update prereqs (PR #3521 @CecileRobertMichon)
  • Document required manual calico 2.6.3 -> calico 3.1.1 upgrade when upgrading from < 0.17.0-provisioned clusters (PR #3208 @oivindoh)
  • Update user guide list to include Windows, update description of clusters (PR #3473 @PatrickLang)
  • Fix Documented Default Value for clusterSubnet (PR #3474 @apeschel)
  • Update docs for some e2e environment variables (PR #3589 @mboersma)
  • Add available docker versions (PR #3631 @seanknox)
  • Simplify Windows walkthrough (PR #3614 @PatrickLang)
  • Remove old scale example files (PR #3701 @CecileRobertMichon)
  • Fix az command in day2-operations (PR #3713 @carlpett)
  • Document orchestrator release and version (PR #3711 @idanlevin)
  • updated DC/OS doc to point to the forked project (PR #3710 @dmitsh)
• CI/E2E maintenance/improvements!
  • Reenable AzureFile tests for Windows on K8s 1.11.1 (PR #3496 @PatrickLang)
  • Scaffolding to support VHD image building in vsts (PR #3591 @jchauncey)
  • Improve VHD VSTS pipeline output URL (PR #3682 @CecileRobertMichon)

v0.21.0-rc.1

<!--
v0.21.0-rc.1
-->