Overview

Features Overview

Install

Pre-installation Configuration

Install Alauda AI Essentials

Install Alauda AI

Upgrade

Upgrade from AML 1.2

Infrastructure Management

Device Management

About Alauda Build of Hami

About Alauda Build of NVIDIA GPU Device Plugin

Multi-Tenant

Guides

Namespace Management

Model Deployment & Inference

Overview

Inference Service

Guides

Feature Introduction

Troubleshooting

Experiencing Inference Service Timeouts with MLServer Runtime

how_to

Configure External Access for Inference Services

Model Management

Guides

Feature Introduction

Monitoring & Ops

Overview

Features Overview

Logging & Tracing

Guides

Resource Monitoring

Guides

Resource Monitoring

API Reference

Kubernetes APIs

Manage APIs

AmlNamespace [manage.aml.dev/v1alpha1]

Operator APIs

AmlCluster [amlclusters.aml.dev/v1alpha1]

Inference Service APIs

ClusterServingRuntime [serving.kserve.io/v1alpha1]

InferenceService [serving.kserve.io/v1beta1]

Overview

Introduction

Model Management
Inference Service

Features

Model Management
Inference Service

📝 Edit this page on GitHub

Previous PageModel Deployment & Inference

Next PageIntroduction