Your submission was sent successfully! Close

You have successfully unsubscribed! Close

Charmed Kubeflow 1.6: what’s new?

Andreea Munteanu

on 13 September 2022

Kubeflow 1.6 was released on September 7, and Charmed Kubeflow 1.6 (Canonical’s distribution) came shortly after, as it follows the same roadmap. Charmed Kubeflow introduces a new version of Kubeflow pipelines as well as model training enhancements.  Read our official press release.

Kubeflow pipelines: a better user experience

Kubeflow pipelines are an end-to-end orchestration platform that helps users build and deploy reusable multi-step ML workflows. The alpha release of the functionality (KFP v2) represents the biggest improvement, which brings a better user experience and new features that help you save time and improve efficiency.

Metadata is a project that is used to better track and manage machine learning workflows. It provides information about runs, models, datasets and data artefacts, enabling users to monitor and understand their artificial intelligence projects. However, in the previous versions of Kubeflow, machine learning engineers had to manually configure it to benefit from this feature, which was often challenging. Moreover, they could not log additional metadata or use any metadata in downstream components. Kubeflow 1.6 changes the asynchronous process implementation that the metadata project had. It offers more assurance that the metadata is captured and recorded, regardless of the deployment step. The metadata is now sourced from the pipeline execution cache. KFP concepts are used to capture the metadata instead of the Pod spec. 

The latest version of Kubeflow improved the correlation between the input and output as well. It makes it more intuitive for those unaware of the rules they need to follow when writing their own pipelines. Lastly, changes have been made to the authoring component, allowing engineers and data scientists to develop faster. The YAML components will be supported in the future, but some parts of the code will need to change, such as ContainerOp. 

Watch our livestream and learn more about Kubeflow Pipelines!

Hyperparameter support in Katib

Katib is a Kubernetes-native project dedicated to automated machine learning (AutoML).  Katib supports hyperparameter tuning. It is important to have this feature available for data scientists who want to control a parameter in the learning process. Katib is agnostic of the AI framework and allows developers to write their programming language of choice. Population-based training (PBT) provides optimised modelling and ease of production fit for models and is available in the latest Kubeflow version.  Kubeflow’s distributed training operator combines PBT with various frameworks such as Tensorflow, PyTorch or MPI operator.  The model serving was also part of Kubeflow’s roadmap. In the latest version, a new Model Spec was introduced to the inference service, aiming to specify new models.

CI/CD for Charmed Kubeflow

Charmed Kubeflow is Canonical’s enterprise-ready distribution of Kubeflow, an open-source machine learning toolkit designed for use with Kubernetes. Charmed Kubeflow is composed of a bundle of charms, which are Kubernetes operators that automate maintenance and security operations. 

One of Canonical’s objectives was to align Charmed Kubeflow releases with the upstream release. Thus, the engineering team invested time in automating the CI/CD pipelines to enable faster operations. This gives the user the chance to use the latest stable release, but also the latest edge, allowing them to see the latest technical updates that the team does.

Learn more about Charmed Kubeflow

Upgrade to the latest version of Charmed Kubeflow by following our guide and contact us if you have any questions.

Follow our tutorials and have fun with Charmed Kubeflow.

Read our whitepaper and get started with AI.

kubeflow logo

Run Kubeflow anywhere, easily

With Charmed Kubeflow, deployment and operations of Kubeflow are easy for any scenario.

Charmed Kubeflow is a collection of Python operators that define integration of the apps inside Kubeflow, like katib or pipelines-ui.

Use Kubeflow on-prem, desktop, edge, public cloud and multi-cloud.

Learn more about Charmed Kubeflow ›

kubeflow logo

What is Kubeflow?

Kubeflow makes deployments of Machine Learning workflows on Kubernetes simple, portable and scalable.

Kubeflow is the machine learning toolkit for Kubernetes. It extends Kubernetes ability to run independent and configurable steps, with machine learning specific frameworks and libraries.

Learn more about Kubeflow ›

kubeflow logo

Install Kubeflow

The Kubeflow project is dedicated to making deployments of machine learning workflows on Kubernetes simple, portable and scalable.

You can install Kubeflow on your workstation, local server or public cloud VM. It is easy to install with MicroK8s on any of these environments and can be scaled to high-availability.

Install Kubeflow ›

Newsletter signup

Select topics you're
interested in

In submitting this form, I confirm that I have read and agree to Canonical's Privacy Notice and Privacy Policy.

Related posts

AI in the public sector: practical applications and use cases

The public sector is investing heavily on artificial intelligence and machine learning initiatives. Deloitte AI Institute reported that 60% of government AI...

Charmed Kubeflow is now available on AWS Marketplace

Run an MLOps toolkit within a few clicks on a major public cloud Canonical is proud to announce that Charmed Kubeflow is now available as a software appliance...

Open source MLOps at Kubecon with Canonical

Date: 17-21 April 2023 Location: Amsterdam  Booth: P15 In just a few weeks, Kubecon will be held at RAI Convention Center, in Amsterdam, the Netherlands....