-
Aligning Teacher with Student Preferences for Tailored Training Data Generation
Paper • 2406.19227 • Published • 25 -
Pre-training Distillation for Large Language Models: A Design Space Exploration
Paper • 2410.16215 • Published • 18 -
Baichuan Alignment Technical Report
Paper • 2410.14940 • Published • 51 -
MiniPLM: Knowledge Distillation for Pre-Training Language Models
Paper • 2410.17215 • Published • 16
By
ByRookie
AI & ML interests
None yet
Recent Activity
liked a dataset about 17 hours ago
Crownelius/Complete-FABLE.5-traces-2M upvoted a collection 4 months ago
Nemotron-Cascade 2 liked a dataset 4 months ago
stepfun-ai/Step-3.5-Flash-SFTOrganizations
None yet
llm math
llm length control
dataset
kd
-
Aligning Teacher with Student Preferences for Tailored Training Data Generation
Paper • 2406.19227 • Published • 25 -
Pre-training Distillation for Large Language Models: A Design Space Exploration
Paper • 2410.16215 • Published • 18 -
Baichuan Alignment Technical Report
Paper • 2410.14940 • Published • 51 -
MiniPLM: Knowledge Distillation for Pre-Training Language Models
Paper • 2410.17215 • Published • 16
pretrain data selectection
llm math
llm engineer
llm length control
reward model
dataset