This is my blog where I try to distil NLP/ML concepts to the best of my ability and write about my research. I try to use intuitions and illustrations to understand complex concepts in NLP/ML. There is nothing new here just better explanations for somethings. You can reach out to me on twitter for collaboration on NLP ideas.

Posts

Generating Text with VAEs and Posterior Collapse

Understanding why do VAEs suffer with posterior collapse for text generation

May 5, 2021
Generalizing Attention in NLP and Understanding Self-Attention

Generalizing the idea of attention in NLP and understanding various methods of calculating attention used in the literature so far. Also, understand and implement multiheaded self-attention using PyTorch.

Jul 6, 2020
Character Embeddings and Highway Layers in NLP

Understand in detail using code a repetitve pattern in many important NLP systems.

Apr 22, 2020
Understanding Depth-wise Separable Convolutions

Understand how depthwise convolutions are calculated and why they are faster than normal convolutions with intuition and illustrations and code.

Mar 20, 2020
Building Sequential Models in PyTorch

Build a sentiment analysis model using PyTorch and torchText

Jan 10, 2020
Understanding LSTMs

Understand the internal structure of LSTMs and implement from scratch using PyTorch.

Dec 28, 2019
Understanding Word Embeddings

Deep dive into the details of word2vec and Global Vectors (GloVe)

Nov 13, 2019