Abstract Text classification is a widely studied problem and has broad applications. In many real-world problems, the number of texts for training models limited, which renders these prone to overfitting. To address this problem, we propose SSL-Reg, data-dependent regularization approach based on self-supervised learning (SSL). SSL (Devlin et al., 2019a) an unsupervised that defines auxiliary t...