model_name = "cardiffnlp/twitter-roberta-base-sentiment-latest" tokenizer = RobertaTokenizer.from_pretrained(model_name) model = RobertaForSequenceClassification.from_pretrained(model_name)
One of BERT’s key innovations was the "Masked Language Model" (MLM) objective, where random words in a sentence are hidden (masked), and the model must predict them. roberta-based