Recurrent Neural Networks (RNN)


A recurrent neural network (RNN) is a class of artificial neural networks where connections between nodes form a directed graph along a temporal sequence. This allows it to exhibit temporal dynamic behavior. Derived from feedforward neural networks, RNNs can use their internal state (memory) to process variable length sequences of inputs.

Getting started

Lecture 10 | Recurrent Neural Networks
Discuss the use of recurrent neural networks for modeling sequence data.
recurrent-neural-networks gated-recurrent-units lstm language-modeling
Understanding LSTM Networks
A closer look at the inner workings of LSTM networks.
recurrent-neural-networks lstm tutorial article

Tutorials

A Visual Guide to Recurrent Layers in Keras
Understand how to use Recurrent Layers like RNN, GRU and LSTM in Keras with diagrams.
recurrent-neural-networks lstm keras tensorflow
Introduction to Neural Network Models of Cognition - Online Book
On-line interactive book introducing the history, theory, and math of Neural Network Models with Python, from a Cog Science perspective.
neural-networks convolutional-neural-networks recurrent-neural-networks deep-learning
From GRU to Transformer
How recurrent units and self-attention are related to each other.
self-attention recurrent-neural-networks gated-recurrent-units transformers
Neural ODE Explained
Explains "Neural Ordinary Differential Equations", a very interesting idea came out in NIPS 2018.
recurrent-neural-networks differential-equation neural-ode ordinary-differential-equations
C++ Implementation of PyTorch Tutorials for Everyone
This repository provides tutorial code in C++ to learn PyTorch by building CNNs, RNNs, etc. Tutorials are divided into three sections based on complexity.
pytorch c++ torch torchscript

Libraries

Neural Slime Volleyball
Recurrent neural network playing slime volleyball. Can you beat them?
interactive video-games recurrent-neural-networks convnet-js
Visualizing Memorization in RNNs
Inspecting gradient magnitudes in context can be a powerful tool to see when recurrent units use short-term or long-term contextual understanding.
interpretability visualization recurrent-neural-networks memorization

Research

C++ Implementation of PyTorch Tutorials for Everyone
This repository provides tutorial code in C++ to learn PyTorch by building CNNs, RNNs, etc. Tutorials are divided into three sections based on complexity.
pytorch c++ torch torchscript
Sentiment analysis
Identify the emotion of the speaker from 'neutral' , 'surprise' , 'fear' , 'sadness' , 'joy' , 'disgust' , 'anger'
deep-learning recurrent-neural-networks lstm research
Control Catchy Captions
Inject elements of engagement and humanity into our image captions with fine-tunable styles
personalization attribute-control text-generation image-captioning
Show, Infer & Tell: Contextual Inference for Creative Captioning
The beauty of the work lies in the way it architects the fundamental idea that humans look at the overall image and then individual pieces of it.
image-captioning deep-learning recurrent-neural-networks attention

Recent

Generating cooking recipes using TensorFlow and LSTM RNN
This article contains details of how the recipes generation LSTM model was trained on Python using TensorFlow 2 with Keras API.
cooking tensorflow keras recurrent-neural-networks
Introduction to Neural Network Models of Cognition - Online Book
On-line interactive book introducing the history, theory, and math of Neural Network Models with Python, from a Cog Science perspective.
neural-networks convolutional-neural-networks recurrent-neural-networks deep-learning
From GRU to Transformer
How recurrent units and self-attention are related to each other.
self-attention recurrent-neural-networks gated-recurrent-units transformers
Control Catchy Captions
Inject elements of engagement and humanity into our image captions with fine-tunable styles
personalization attribute-control text-generation image-captioning
Sentiment analysis
Identify the emotion of the speaker from 'neutral' , 'surprise' , 'fear' , 'sadness' , 'joy' , 'disgust' , 'anger'
deep-learning recurrent-neural-networks lstm research
Table of Contents
Share a resource
Share a resource you found useful for this specific topic.
Topic experts
Share