Problem
GCP provides fractional RTX PRO 6000 GPUs through these G4 machine types:
g4-standard-6: 1/8 GPU, 12GB GPU memory
g4-standard-12: 1/4 GPU, 24GB GPU memory
g4-standard-24: 1/2 GPU, 48GB GPU memory
They are not currently supported by dstack and should be excluded as part of #4039. Unlike full-GPU G4 instances, these shapes expose an NVIDIA vGPU and require GCP's specific vGPU/GRID guest driver and VM identity authentication.
Proposed support
Expose each fractional shape as one CUDA-visible RTX PRO 6000 vGPU with its effective memory (12GB, 24GB, or 48GB), so normal dstack GPU-memory matching remains correct.
Provisioning must:
- Select the fractional-G4 path by GCP machine type, not by globally classifying
RTXPRO6000 as requiring proprietary modules.
- Install/use Google's supported G4 vGPU/GRID driver and preserve the service account/scopes required for VM identity authentication.
- Verify host GPU discovery before accepting the instance.
- Keep the existing open-driver path for full-GPU
g4-standard-48 and larger shapes.
Acceptance criteria
- Offers report one GPU with the effective memory for each fractional shape.
- A memory requirement cannot match a fractional shape with less effective memory.
- A minimal CUDA container sees
/dev/nvidia0, a working nvidia-smi, and the expected memory.
- Full-GPU G4 offers and workloads remain unchanged.
References:
Problem
GCP provides fractional RTX PRO 6000 GPUs through these G4 machine types:
g4-standard-6: 1/8 GPU, 12GB GPU memoryg4-standard-12: 1/4 GPU, 24GB GPU memoryg4-standard-24: 1/2 GPU, 48GB GPU memoryThey are not currently supported by dstack and should be excluded as part of #4039. Unlike full-GPU G4 instances, these shapes expose an NVIDIA vGPU and require GCP's specific vGPU/GRID guest driver and VM identity authentication.
Proposed support
Expose each fractional shape as one CUDA-visible RTX PRO 6000 vGPU with its effective memory (12GB, 24GB, or 48GB), so normal dstack GPU-memory matching remains correct.
Provisioning must:
RTXPRO6000as requiring proprietary modules.g4-standard-48and larger shapes.Acceptance criteria
/dev/nvidia0, a workingnvidia-smi, and the expected memory.References: