KingNish/multiturn_curated_dataset_test
Viewer
•
Updated
•
10
•
2
Nishith Jain
KingNish
AI & ML interests
AI is fun actually.
Recent Activity
upvoted
an
article
22 minutes ago
Unlocking Agentic RL Training for GPT-OSS: A Practical Retrospective
upvoted
a
paper
1 day ago
SAMTok: Representing Any Mask with Two Words
reacted
to
alvarobartt's
post
with 🔥
1 day ago
💥 `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag!
`uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable.
💡 Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (à la vLLM) manually if preferred.
Organizations
