| --- |
| language: pl |
| license: apache-2.0 |
| --- |
| |
| <h1 align="center">polish-roberta-large-v2</h1> |
|
|
| An encoder model based on the RoBERTa architecture, pre-trained on a large corpus of Polish texts. |
| More information can be found in our [GitHub repository](https://github.com/sdadas/polish-roberta) and in the publication [Pre-training polish transformer-based language models at scale](https://arxiv.org/pdf/2006.04229). |
|
|
| ## Citation |
|
|
| ```bibtex |
| @inproceedings{dadas2020pre, |
| title={Pre-training polish transformer-based language models at scale}, |
| author={Dadas, S{\l}awomir and Pere{\l}kiewicz, Micha{\l} and Po{\'s}wiata, Rafa{\l}}, |
| booktitle={International Conference on Artificial Intelligence and Soft Computing}, |
| pages={301--314}, |
| year={2020}, |
| organization={Springer} |
| } |
| ``` |
