Semi-supervised and self-supervised learning

Semi-supervised uses a small labeled set plus large unlabeled data. Self-supervised creates labels from the data itself, like predicting the next word.

• Semi-supervised combines labeled and unlabeled data.
• Self-supervised creates its own training signals.