Alauda Build of Hami

Allocate certain device memory

TOC

Allocate certain device memory to container

Allocate certain device memory to container

To allocate a specific amount of GPU device memory, specify nvidia.com/gpumem alongside nvidia.com/gpu.

apiVersion: v1
kind: Pod
metadata:
  name: gpu-pod
spec:
  containers:
    - name: ubuntu-container
      image: ubuntu:18.04
      command: ["bash", "-c", "sleep 86400"]
      resources:
        limits:
          nvidia.com/gpu: 2 # requesting 2 vGPUs
          nvidia.com/gpumem: 3000 # each vGPU requests 3G device memory

NOTICE: nvidia.com/gpumem can't be used together with nvidia.com/gpumem-percentage