From the course: Advanced NLP with Python for Machine Learning
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
What is a recurrent neural network? - Python Tutorial
From the course: Advanced NLP with Python for Machine Learning
What is a recurrent neural network?
- [Instructor] Recall our neural network definition and diagram. A neural network does pattern matching through the connection of many very simple functions to create one very powerful function. A recurrent neural network, or RNN for short, is a specific type of neural network. So it carries out the same function, but what makes RNN so powerful for text is that the resulting function has an understanding of the data's sequential nature. It does this by using feedback loops that form a sense of memory. If you think about a sentence, each word should not be treated individually. Recall that Word2vec accounted for this by using a window to try to capture the context in which a word is used. RNNs tackle this by treating the data as sequential and effectively, remembering everything that came before a given word to attempt to learn the meaning of that word. So here's effectively what this function looks like. It starts…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.