Kubernetes Operations for AI Workloads with the Rafay Platform | Rafay

Rafay Powers the AI/ML Workloads For Enterprises

Deliver the automation AI/ML developers, data scientists and operations want with the right level of standardization, control and governance platform teams need for AI/ML workloads

With KOP for AI Workloads, you can:

Provide a Self-Service Experience for Engineers and Data Scientists

Deploy, view, manage, and upgrade all of your Amazon EKS (& EKS-A) clusters in any AWS region using Rafay’s self-service workflows

Deliver World-Class Security and Governance

As AI/ML goes mainstream, Platform teams find themselves having to demonstrate that they are operating with world-class security and governance. With Rafay, enterprises enforce standards, RBAC, and have an end-to-end audit trail of all actions performed on Kubernetes clusters running LLM-based applications, for example.

Single Pane of Glass Management Across Public Clouds, Data Centers & Edge

Manage your entire fleet of AI/ML applications from a single pane of glass - across AWS, Azure, GCP (and others), in your on-premises data centers, and at the edge. Leverage a single, consistent GPU-specific dashboard to deploy, view and manage clusters and workloads across all your clusters.

Accelerate Your Migration to Artificial Intelligence (AI) Applications

Do you have a deadline by which you need to deploy AI/ML applications? With Rafay, your AI/ML clusters and LLM workloads will be up and running in days and your apps will be deployed in even less time.

Rafay Uniquely Solves 4 Key Requirements Kubernetes for AI Workloads

Turnkey Cluster Provisioning & Lifecycle Mgmt

Automated provisioning and upgrades for EKS, AKS, GKE & Upstream Kubernetes

Multi-Cluster Standardization & Add-on Management

Standardization of config across multiple clusters via centralized blueprints & drift detection

Bi-Modal Multi-Tenancy Support w/ Self-Service

Internal customers can easily consume multiple clusters, multiple namespaces or a combination, in a self-service fashion

Zero-Trust Based Multi-Cluster Access For Devs/SREs

Enable users to easily access multiple clusters and/or namespaces with centralized control and auditing

Rafay Makes Life Easy for Platform Teams

Platform Teams ❤️ Rafay because our solution delivers the automation developers and operations want with the right level of standardization, control and governance platform teams need. With Rafay, these teams take advantage of the following platform services:

Automation & Self-Service

Multi-Cluster Management

Manage the lifecycle of K8s clusters for managed Kubernetes services, such as Amazon EKS and Azure AKS, as well as offerings such as Rancher and RedHat OpenShift.

GitOps for Kubernetes

Environment Manager

1 in 4 enterprises take three months or longer to deploy a modern application due to challenges with provisioning environments. Environment Manager automates environment provisioning and accelerates app deployment.

Visibility & Monitoring

Enables development, operations and security/governance teams to visualize and monitor modern apps and underlying Kubernetes infrastructure through dedicated dashboards.

Kubernetes Addon Catalog

Quickly integrate new Kubernetes software addons with clusters and allow admins to curate a catalog of apps developers can deploy in clusters.

Security & Governance

Zero-Trust Access

Enables controlled, audited access for developers, SREs and automation systems to Kubernetes infrastructure.

Blueprints & Drift Detection

Standardize cluster configurations and software add-ons across environments and clouds to achieve compliance

Cost Management

Get a consolidated view of all your Kubernetes cloud spend across clusters in AWS, Azure, and on-premise datacenters with fine-grained visibility and reporting for shared clusters.

Kubernetes Policy Management

Enables policy management for clusters via the Open Policy Agent (OPA) framework for Kubernetes security and governance.

Network Policy Manager

Enforces isolation boundaries and reduces the lateral attack surface with network flow visualization.

Backup & Restore

Enables disaster recovery and migration of the Kubernetes control plane and application data.

How Rafay Works

Rafay’s single cloud controller manages hundreds of clusters with ease while allowing software-defined isolation across any department, business group, or geography. The service operates at 99.99% uptime governed by an SLA and is SOC 2 Type 2 certified. A self-managed version is also available.

Flexible Deployment Options to Suit your IT Strategy

SaaS

Let Rafay manage the controller with 99.99% SLA while you manage your clusters. This is our most popular deployment option.

Self-Hosted

Host the Rafay solution yourself and self-manage the controller and clusters. This option is also used in air-gapped environments.

Fully-Managed K8s Service

Let Rafay manage your entire K8s operations & clusters with our expert K8s operations team.

Leverage the Power of SaaS for Kubernetes Cluster Management

As enterprises modernize their applications, they are quickly realizing the significant increase in the cost and resources required to manage Kubernetes clusters. Rafay’s SaaS-first approach enables companies to gain efficiencies from Kubernetes almost immediately, thus speeding digital transformation initiatives while keeping operating costs low.

Reliability

Rafay’s platform has consistently maintained >99.99% uptime

Fast time to K8s

Gain the benefits of Kubernetes in hours, not months

Operational Scalability

Easily manage hundreds of clusters and apps in software-defined groups with no management needed for administrative clusters

Zero-Trust Security

Cloak your K8s API endpoints so they’re never visibible on the Internet, and centrally configure role-based access control for easy access to any cluster, anywhere

Deployment Flexibility

Leverage the cloud or deploy the platform in air-gapped environments

Zero-Trust Security Architecture

The KOP’s unique zero-trust architecture doesn’t require inbound access to your Kubernetes clusters. Rafay’s Zero-Trust Kubectl Access (ZTKA) governs kubectl activity by end-users as well as CI/CD systems with role-based access control and user-level auditing of all actions.

Sample Kubernetes Operations Proof of Concept (POC) Test Plan

This document contains sample test objectives, schedules, and success criteria that you can customize and use for your POC including key workflows, add-ons, and scoping features.