Spectra Suite of Low Bitwdith Models

AI & ML interests

None defined yet.

in SpectraSuite/TriLM_3.9B_Unpacked 12 months ago

Update README.md

#1 opened 12 months ago by

updated a Space about 1 year ago

README

authored 2 papers over 1 year ago

Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP

Paper • 2110.03618 • Published Oct 7, 2021

Efficient Encoders for Streaming Sequence Tagging

Paper • 2301.09244 • Published Jan 23, 2023

updated a model over 1 year ago

SpectraSuite/minicpm_appendixD_190M_10k_steps_olmo

Updated Nov 23, 2024

authored 3 papers almost 2 years ago

LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression

Paper • 2309.14021 • Published Sep 25, 2023 • 1

Logical Fallacy Detection

Paper • 2202.13758 • Published Feb 28, 2022

Spectra: A Comprehensive Study of Ternary, Quantized, and FP16 Language Models

Paper • 2407.12327 • Published Jul 17, 2024 • 79

updated 12 models almost 2 years ago

SpectraSuite/FloatLM_3.9B

Text Generation • 4B • Updated Jul 9, 2024 • 15 • 1

SpectraSuite/FloatLM_2.4B

Text Generation • 2B • Updated Jul 9, 2024 • 12

SpectraSuite/FloatLM_1.5B

Text Generation • 2B • Updated Jul 9, 2024 • 12

SpectraSuite/FloatLM_1.1B

Text Generation • 1B • Updated Jul 9, 2024 • 10

SpectraSuite/FloatLM_830M

Text Generation • 0.8B • Updated Jul 9, 2024 • 10

SpectraSuite/FloatLM_560M

Text Generation • 0.6B • Updated Jul 9, 2024 • 10

SpectraSuite/FloatLM_390M

Text Generation • 0.4B • Updated Jul 9, 2024 • 13

SpectraSuite/FloatLM_190M

Text Generation • 0.2B • Updated Jul 9, 2024 • 10

SpectraSuite/FloatLM_99M

Text Generation • 99.8M • Updated Jul 9, 2024 • 13

SpectraSuite/TriLM_3.9B_Unpacked

Text Generation • 4B • Updated May 30, 2025 • 44 • 13

SpectraSuite/TriLM_560M_Unpacked

Text Generation • 0.6B • Updated Jul 9, 2024 • 67

SpectraSuite/TriLM_830M_Unpacked

Text Generation • 0.8B • Updated Jul 9, 2024 • 10