Daggr 3d
π
4
Not Lain PRO
not-lain
AI & ML interests
custom AI models with HF integration, HuggingFace fellow π€
Recent Activity
liked
a Space
about 7 hours ago
abidlabs/daggr-3d
reacted
to
alvarobartt's
post
with π
1 day ago
π₯ `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag!
`uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable.
π‘ Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (Γ la vLLM) manually if preferred.
reacted
to
alvarobartt's
post
with π₯
1 day ago
π₯ `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag!
`uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable.
π‘ Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (Γ la vLLM) manually if preferred.
Organizations
liked
a
Space
about 7 hours ago
reacted to
alvarobartt's
post with ππ₯
1 day ago
Post
1547
π₯
π‘ Alternatively, you can also set the
hf-mem v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the --experimental flag!uvx hf-mem --model-id ... --experimental will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable.π‘ Alternatively, you can also set the
--max-model-len, --batch-size and --kv-cache-dtype arguments (Γ la vLLM) manually if preferred.
- 1 reply
upvoted
a
collection
1 day ago
updated
2
Spaces
1 day ago
liked
a
model
1 day ago
upvoted
a
changelog
3 days ago
Changelog
MLX Hardware Compatibility
β’
32
liked
2
Spaces
3 days ago
upvoted
an
article
9 days ago
Article
Small Yet Mighty: Improve Accuracy In Multimodal Search and Visual Document Retrieval with Llama Nemotron RAG Models
β’
20
upvoted
a
paper
21 days ago
upvoted
an
article
22 days ago
Article
Scaling Real-Time Voice Agents with Cache-Aware Streaming ASR
β’
72
upvoted
a
changelog
22 days ago
Changelog
HuggingChat for Papers
β’
99
upvoted
an
article
25 days ago
Article
The Engineering Handbook for GRPO + LoRA with Verl: Training Qwen2.5 on Multi-GPU
β’
12
upvoted
a
paper
27 days ago
upvoted
a
changelog
about 1 month ago
Changelog
Set your primary organization on your profile
β’
108
upvoted
an
article
about 1 month ago
Article
Tokenization in Transformers v5: Simpler, Clearer, and More Modular
- +4
β’
119
liked
a
Space
about 1 month ago
upvoted
a
changelog
about 2 months ago
Changelog
HuggingChat for Docs
β’
114