# Step 3 — GPU Assessment

**Goal**: Match detected hardware to known profiles and surface compatibility constraints.

Load and consult [gpu-profiles.md](../gpu-profiles.md).

For each GPU type detected in Step 1:
1. Look up the model in `gpu-profiles.md`
2. Report: VRAM per card, total cluster VRAM, supported dtypes, recommended attention backend
3. Surface compatibility warnings:

| GPU | Warning |
|-----|---------|
| T4 | Does not support bfloat16. Set `--dtype float16` in serving args. |
| V100 | Does not support bfloat16; limited flash attention. Use xformers backend. |

**CPU-only path:** Note CPU-only inference is available via KAITO + llama.cpp. Recommend `google/gemma-3-1b-it-qat-q8_0-gguf`.

Use the **Model Sizing Guide** in [model-sizing.md](../model-sizing.md) to calculate maximum model size for the cluster.
