Hardware GuideShanghai AI Lab

The Best GPUs for Running InternLM3-72B

46GB VRAM Recommended

Need to calculate exact token speeds?

Use our Token Speed Estimator tool to calculate exact memory bandwidth requirements and tokens-per-second (t/s) generation rates for InternLM3-72B based on your specific GPU.

Launch Token Speed Tool