BERTuit: Understanding Spanish language in Twitter through a native transformer
Paper • 2204.03465 • Published
How to use AIDA-UPM/BERTuit-base with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="AIDA-UPM/BERTuit-base") # Load model directly
from transformers import TFAutoModel
model = TFAutoModel.from_pretrained("AIDA-UPM/BERTuit-base", dtype="auto")Model BERTuit as presented in the BERTuit: Understanding Spanish language in Twitter through a native transformer article.
Before tokenization replace user tags and urls with "<usr>" and "<url>" respectively.
Tokenize text with base class RoBERTaTokenizer.