Hugging Face's logo
Kyle O'Brien's picture
48 3 101

Kyle O'Brien PRO

Kyle1668
JWBickel's profile picture Fishtiks's profile picture sumitfordata's profile picture
·
https://kyleobrien.io

AI & ML interests

pretraining, alignment, open-source

Recent Activity

new activity about 14 hours ago
geodesic-research/pa-warm-start-1B-sft-mix:Restore `default` config in the configs: mapping The explicit top-level `configs:` section (added by the per-config pushes) shadows the implicit default config, so load_dataset(repo, 'default') fails with "BuilderConfig 'default' not found" even though data/ holds the blended mix. This adds the data_files mapping for it (data/train-*, 265,048 rows).
new activity about 18 hours ago
geodesic-research/nemotron-think-tokenizer:Add {% generation %} markers around assistant outputs Without these, apply_chat_template(return_assistant_tokens_mask=True) returns an all-zero mask, so answer_only_loss=True SFT packing silently falls back to all-token loss (now blocked by the megatron-bridge pack guard). Rendered text is byte-identical to the previous template on all conversation shapes; masks now match nemotron-think-tokenizer-prefill-parity exactly. Validated battery in GEOD-147.
updated a dataset about 19 hours ago
geodesic-research/pa-warm-start-1B-sft-mix
View all activity

Organizations

EleutherAI's profile picture Unlearning's profile picture Geodesic Research's profile picture