Course Materials
Books
-
Manning, Christopher D., Christopher D. Manning, and Hinrich Schütze. Foundations of statistical natural language processing. MIT press, 1999. PDF, Companion Website.
-
Jurafsky, Dan, and James H. Martin. Speech and language processing. Vol. 3. London: Pearson, 2014 PDF, Page.
- Koehn, Philipp. Statistical machine translation. Cambridge University Press, 2009. Page
Online Courses
This course closely follows Prof. Manning’s NLP with deep learning course. There is an earlier version of the course with a more traditional approach by Dan Jurafsky and Christopher Manning on Natural Language Processing which is also highly recommended. You can find the slides of the earlier version of the course here and the videos here. Other online courses:
- From Languge to Information by Dan Jurafsky: videos, course page.
- Food Talks: The Language of Food by Dan Jurafsky (Course Page)
Prof. Dan Jurafsky is a leading reasearcher and teacher in Natural Language Processing. You can find a list of courses taught by him here.
NLP at Other Universities
- Chris Mannings’s Natural Language Processing with Deep Learning course at Stanford.
- Deep Learning for NLP at Oxford.
- Advanced NLP at MIT.
- Introduction to Machine Learning at MIT.
- NLP related courses at MIT
- Michael Collins NLP Course at Columbia.
- Dan Klein’s NLP Course at Berkeley.
- NLP and Applied NLP at Berekley.
- NLP at UIUC.
- NLP at Maryland, also here.
Tutorials
- Deep Learning for Natural Language Processing: Tutorials with Jupyter Notebooks (link).
- How to solve 90% of NLP problems: a step-by-step guide (link)
- The Advantures in Machine Learning blog (link)
- ACL 2012 + NAACL 2013 Tutorial: Deep Learning for NLP (without Magic) (link, slides)
More Reading Material
- The Language of Food
- Bird, Steven, Ewan Klein, and Edward Loper. Natural language processing with Python: analyzing text with the natural language toolkit. “ O’Reilly Media, Inc.”, 2009.(link)
- The foundation of data science.
Resources
- NLP for Hackers
- Using Google-Colab like a PRO
- Colab setup for Conda, SSH and GitHub
- CNN Explainer
- BiDAF Notebook
- Seq-Seq NMT Visualization
- Transformer Illustrated
- BERT Illustrated
- GPT-2 Illustrated
- Neural Attention Visualization
- FAST-AI Book and Course, github link, course link
- Interactive Deep Learning Book
- AI-Summer and their github-page
NLP Projects
- QANTA.org
Answers
- What is a 1 by 1 convolution for? link