LLM

Stay updated with our expert articles and insights on cloud-native and AI infrastructure management and orchestration topics.

Serving LLMs on Arm: Running Rafay Token Factory on NVIDIA DGX Spark

Learn how Rafay Token Factory turns NVIDIA DGX Spark into a managed, multi-tenant LLM serving endpoint with Arm-native Kubernetes, metering, governance, and OpenAI-compatible API access. Read Now

Introduction to Disaggregated Inference: Why It Matters

Learn how disaggregated inference improves GPU utilization, scalability, and cost efficiency by separating compute, memory, and serving layers—enabling more flexible, self-service AI infrastructure. Read Now

Understanding Model Deployment Metrics in Rafay's Token Factory

When running LLMs at scale, "the model works" isn't enough. Discover the key latency, throughput, and resource metrics you need to track to ensure a production-grade user experience using Rafay's Token Factory. Read Now

Trusted by leading enterprises, neoclouds and service providers

.png)