| base_model: esm3-open | |
| library_name: esm3 | |
| # Model Card for Model-Demo-1.4B | |
| <slot name='description'> | |
| ## Task type | |
| Protein-level Classification | |
| ## Model input type | |
| AA Sequence | |
| ## ESM3 Model config | |
| - **base_model:** esm3-open | |
| - **model_type:** ESM3 Fine-tuning | |
| - **task_type:** Protein-level Classification | |
| ## Training config | |
| - **optimizer:** | |
| - **class:** AdamW | |
| - **betas:** (0.9, 0.98) | |
| - **weight_decay:** 0.01 | |
| - **learning rate:** 0.0005 | |
| - **epoch:** 5 | |
| - **batch size:** 1 | |
| - **precision:** 16-mixed | |