description: Roberta trained from scratch with 50 GB filtered data
tags:
  - roberta
params:
  epochs: 1