WizardLMTeam
/

WizardCoder-15B-V1.0

Eval Results (legacy)

Model card Files Files and versions

How much RAM and VRAM do I need at least to run this model？

#15

by zhwongbo - opened Jul 6, 2023

How much RAM and VRAM do I need at least to run this model？

I'm running it on an A100 40GB and most of the time it's using 33GB of VRAM, peaking at 38GB.
RAM also uses 30+GB.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment