Release notes
1.24
May 6th, 2022 - charmed-kubernetes --channel 1.24/stable
Before upgrading, please read the upgrade notes. Specific instructions for the 1.23 => 1.24 upgrade can be found here.
What's new
- Transition to Charmhub
Starting with this release, charms and bundles will be published to Charmhub instead of the Charm Store.
If you have any processes that rely on pulling Charmed Kubernetes components
from the Charm Store (for example, references to cs:charmed-kubernetes
or
cs:~containers/...
), make sure you update those processes to pull from
Charmhub instead.
When upgrading existing clusters, please refer to the upgrade notes for instructions on how to navigate this transition properly.
- kubernetes-master renamed to kubernetes-control-plane
The kubernetes-master charm has been renamed to kubernetes-control-plane. See the inclusive naming page for more details about this change.
- Kubelet added to kubernetes-control-plane
The kubernetes-control-plane charm now includes Kubelet, allowing kubernetes-control-plane units to participate as fully functioning nodes within Kubernetes clusters.
By default, the kubernetes-control-plane nodes will be
configured with a taint to prevent pods from being scheduled to them. The new
register-with-taints
config option can be used to control this behavior at
deploy time.
- Calico is now the default CNI
The charmed-kubernetes
and kubernetes-core
reference bundles have been
updated to use Calico for pod networking instead of Flannel. We recommend Calico
as the default CNI choice for all new deployments due to the rich set of
advanced networking features that it provides.
While we do recommend Calico as the default choice, we will continue to support new and existing deployments that use Flannel as well.
- Docker support deprecated
The default container runtime in Charmed Kubernetes has been containerd for some time. The Docker container runtime is no longer supported.
Component upgrades
- calico 3.21.4
- cephcsi 3.5.1
- cinder-csi-plugin 1.23.0
- coredns 1.9.0
- ingress-nginx 1.2.0
- k8s-keystone-auth 1.23.0
- kube-state-metrics 2.4.2
- kubernetes-dashboard 2.5.1
- openstack-cloud-controller-manager 1.23.0
Fixes
A list of bug fixes and other feature updates in this release can be found at the launchpad milestone page.
Notes and Known Issues
- LP 1907153 Snap install failure in LXD
Snaps may fail to install when the kubernetes-control-plane
charm is deployed to a LXD container.
This happens when the version of snapd
on the host does not match the version inside the
container. As a workaround, ensure the same version of snapd
is installed on the host and
in LXD containers.
Deprecations and API changes
- Upstream
For details of other deprecation notices and API changes for Kubernetes 1.24, please see the relevant sections of the upstream release notes.
1.23
December 15, 2021 - charmed-kubernetes-862
What's new
- CNI support added to kubernetes-master
The core CNI plugins have been added to kubernetes-master, and the CNI subordinate charms have been updated to render CNI configuration when attached to kubernetes-master. These changes pave the way for Kubelet to be added to kubernetes-master in a future release.
- Grafana dashboard for etcd
The etcd charm can now be related to the Prometheus and Grafana charms. When doing so, a new Grafana dashboard will be created that makes it easier to monitor the performance characteristics of etcd.
Component upgrades
- kube-dns 1.21.1 (note: coredns 1.8.3 is the default DNS provider)
- metrics-server 0.5.1
Fixes
A list of bug fixes and other feature updates in this release can be found at the launchpad milestone page.
Notes and Known Issues
- LP 1907153 Snap install failure in LXD
Snaps may fail to install when the kubernetes-master
charm is deployed to a LXD container.
This happens when the version of snapd
on the host does not match the version inside the
container. As a workaround, ensure the same version of snapd
is installed on the host and
in LXD containers.
LP 1936816 and LP 1913228 Filesystem Hierachy Standards
Applications running inside a kubernetes-master should set pid files and log files in appropriate operational locations like
/run/
and/var/log/kubernetes/
. Care was taken to restart services using these new locations and migrate some existing files out of/root/cdk/
.For the service
cdk.master.auth-webhook
the new pid file and log files are named/run/cdk.master.auth-webhook.pid
and/var/log/kubernetes/cdk.master.auth-webhook.log
to match the systemctl service name.If the
filebeat
charm is related to kubernetes-master, ensure that its logpath include this new path ( e.g.juju config filebeat logpath='/var/log/kubernetes/*.log'
)
Deprecations and API changes
- Upstream
For details of other deprecation notices and API changes for Kubernetes 1.23, please see the relevant sections of the upstream release notes.
1.22+ck2 Bugfix release
October 27, 2021 - charmed-kubernetes-814
Fixes
A list of bug fixes and other minor feature updates in this release can be found at the launchpad milestone page for 1.22+ck2.
1.22+ck1 Bugfix release
October 21, 2021 - charmed-kubernetes-807
What's new
- Configurable default PodSecurityPolicy
A new pod-security-policy
config option has been added to the
kubernetes-master charm. This option allows you to override the default
PodSecurityPolicy that is created by the charm.
- Configurable Nvidia APT sources
New config options have been added to the containerd charm:
nvidia_apt_key_urls
, nvidia_apt_sources
, and nvidia_apt_packages
. These
provide better support for Nvidia GPUs in air gapped deployments by allowing
you to specify where the Nvidia Container Runtime and CUDA packages are pulled
from.
- Better OpenStack credential handling
The openstack-integrator charm now checks for updated cloud credentials from
Juju every time its update-status hook runs, ensuring that cloud credentials
are properly detected a short time after they change. To expedite this process,
you can use the new openstack-integrator charm's new refresh-credentials
action to force a recheck immediately.
Fixes
A list of bug fixes and other minor feature updates in this release can be found at the launchpad milestone page for 1.22+ck1.
1.22
September 1, 2021 - charmed-kubernetes-761
What's new
- Calico BGP Service IP Advertisement
The Calico charm now supports advertising Kubernetes service IPs using Border Gateway Protocol (BGP). More information can be found in the CNI with Calico page.
- Improved load balancer provider support
Support for load balancing the Kubernetes control plane is being improved with
two new relation endpoints: loadbalancer-external
and loadbalancer-internal
.
This change adds support for Azure native load balancers for the Kubernetes control
plane, and improves LB configurability while still simplifying the relations needed
between the various components of the cluster.
Component upgrades
- cephcsi 3.3.1 (note: see upstream notes if upgrading from a previous release)
- kube-dns 1.17.3 (note: coredns 1.8.3 is the default DNS provider)
- nginx-ingress 1.0.0-beta.3
- metrics-server 0.5.0
Fixes
A list of bug fixes and other feature updates in this release can be found at the launchpad milestone page.
Notes and Known Issues
LP 1935992 Code cleanup
Previously deprecated features have been removed in this release. This includes the following
kubernetes-master
features:addons-registry
configcreate-rbd-pv
action and related templatesmonitoring-storage
configkube-dns
interfacemigrate_from_pre_snaps
code
The following deprecated
kubernetes-worker
features have been removed in this release:allow-privileged
configkube-dns
interfaceregistry
action and related templates- code paths for k8s < 1.10
LP 1907153 Snap install failure in LXD
Snaps may fail to install when the
kubernetes-master
charm is deployed to a LXD container. This happens when the version ofsnapd
on the host does not match the version inside the container. As a workaround, ensure the same version ofsnapd
is installed on the host and in LXD containers.
Deprecations and API changes
Upstream
For details of other deprecation notices and API changes for Kubernetes 1.22, please see the relevant sections of the upstream release notes.
Previous releases
Please see [this page][rel] for release notes of earlier versions.
1.21+ck3 Bugfix release
August 02, 2021 - charmed-kubernetes-733
Fixes
A list of bug fixes and other minor feature updates in this release can be found at the launchpad milestone page.
1.21+ck2 Bugfix release
May 28, 2021 - charmed-kubernetes-679
Fixes
A list of bug fixes and other minor feature updates in this release can be found at the launchpad milestone page.
1.21+ck1 Bugfix release
May 04, 2021 - charmed-kubernetes-655
Fixes
A list of bug fixes and other minor feature updates in this release can be found at the launchpad milestone page.
1.21
April 15, 2021 - charmed-kubernetes-632
What's new
- Azure Arc conformance
Charmed Kubernetes is compliant with the Azure Arc Validation test suite. More information about this program can be found in the [azure-arc-validation documentation][arc-docs].
- Container images by release
LP 1891530 describes an upgrade failure for deployments that use a private image registry. The Charmed Kubernetes release process now publishes a [list of required images per-release][images-per-release] for administrators to easily determine what registry changes are needed prior to an upgrade.
Component upgrades
- cloud-provider-openstack 1.20.0
- coredns 1.8.3
- kube-state-metrics 1.9.8
- kubernetes-dashboard 2.2.0
- nginx-ingress 0.44.0
- pause 3.4.1
Fixes
A list of bug fixes and other minor feature updates in this release can be found at the launchpad milestone page.
Notes and Known Issues
- LP 1920216 MetalLB speaker pod logs error with "selfLink was empty, can't make reference".
Deprecations and API changes
- Private container registry action
The registry
action of the kubernetes-worker
charm is deprecated and will
be removed in a future release. See the
Private Docker Registry
documentation for using a custom registry with Charmed Kubernetes.
- Upstream
For details of other deprecation notices and API changes for Kubernetes 1.21, please see the relevant sections of the upstream release notes
Previous releases
Please see [this page][rel] for release notes of earlier versions.
[upgrade-notes]: /kubernetes/docs/upgrade-notes [rel]: /kubernetes/docs/release-notes [images-per-release]: https://github.com/charmed-kubernetes/bundle/tree/master/container-images [arc-docs]: https://github.com/Azure/azure-arc-validation/blob/main/README.md # 1.20+ck1 Bugfix release ### February 23rd, 2021 - [charmed-kubernetes-596](https://raw.githubusercontent.com/charmed-kubernetes/bundle/main/releases/1.20/bundle.yaml) ## Fixes A list of bug fixes and other minor feature updates in this release can be found at [the launchpad milestone page](https://launchpad.net/charmed-kubernetes/+milestone/1.20+ck1) ## Notes / Known Issues - Secret names [LP 1906732](https://bugs.launchpad.net/charm-kubernetes-master/+bug/1906732) highlighted an issue where `kubernetes-worker` units would overwrite existing secrets when deployed as different application names. This lead to some worker units losing the ability to authenticate with the cluster. This has be resolved by ensuring new secrets are uniquely named in the form: `auth-$username-$random`. - Juju and GCP [LP 1761838](https://bugs.launchpad.net/juju/+bug/1761838) describes an issue with Juju and Google cloud where deployments may fail due to FAN networking. Workaround this by disabling FAN configuration for Google cloud models: `juju model-config -mPrevious releases
Please see this page for release notes of earlier versions.