Comparison of Czech Transformers on Text Classification Tasks
Paper • 2107.10042 • Published
How to use fav-kky/FERNET-News_sk with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="fav-kky/FERNET-News_sk") # Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("fav-kky/FERNET-News_sk")
model = AutoModelForMaskedLM.from_pretrained("fav-kky/FERNET-News_sk")FERNET-News_sk is a monolingual Slovak RoBERTa-base model pre-trained from 4.5GB of thoroughly cleaned Slovak news corpus.
It is a Slovak version of our Czech FERNET-News model.
Preprint of our paper is available at https://arxiv.org/abs/2107.10042.