Self Supervised Representation Learning in NLP
An overview of self-supervised pretext tasks in Natural Language Processing
self-supervised-learning natural-language-processing article representation-learning tutorial

  • Understand how self-supervised methods are applied to learn from raw text corpus without explicit labels
  • Know about papers that implement this ideas

Don't forget to tag @amitness in your comment, otherwise they may not be notified.

Authors original post
I explain machine learning concepts using diagrams, animations and intuition.
Share this project
Similar projects
SimCLR - Contrastive Learning of Visual Representations
How to load pretrained/finetuned SimCLR models from hub modules for fine-tuning.
OpenSelfSup: Self-Supervised Learning Toolbox and Benchmark
An open source unsupervised representation learning toolbox based on PyTorch.
Understanding & Implementing SimCLR - an ELI5 guide
I explain the SimCLR and its contrastive loss function step by step, build image embeddings and then show how to use them to train image classifier on top.
Self-Supervised Learning - PyTorch Lightning
This bolts module houses a collection of all self-supervised learning models.
Top collections