karamjotsingh
/

Llama-3.2-1B

Model card Files Files and versions

2.48 GB

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

karamjotsingh's picture

llama3.2 1B model awq log for A4 quantizer

6011754 verified 3 months ago

.gitattributes

1.52 kB
initial commit 6 months ago
awq.log

274 kB
llama3.2 1B model awq log for A4 quantizer 3 months ago
awq_scales.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
1.11 MB
xet

llama3.2 1B model awq scales for A4 quantizer 3 months ago
rqp_converted.pth
Detected Pickle imports (8)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "rqp.quantization.null_quantizer.NullQuantizer",
- "collections.OrderedDict",
- "rqp.quantization.statistics.min_max_stats.MinMaxStats",
- "torch.FloatStorage",
- "__builtin__.set",
- "rqp.quantization.same_quantizer.SameQuantizer"
How to fix it?
2.47 GB
xet

NQ Updated inputs in model 6 months ago