Topic: kserve

SD Times Open-Source Project of the Week: KServe

KServe is a tool for serving machine learning models on Kubernetes. It encapsulates the complexity of tasks like autoscaling, networking, health checking, and server configuration. This allows users to provide their machine learning deployments with features like GPU Autoscaling, Scale to Zero, and Canary Rollouts.  Created by IBM and Bloomberg’s Data Science and Compute Infrastructure … continue reading Protection Status