2022  3

January  3

Paper Review - Learning To Retrieve Prompts for In-Context Learning

January 25, 2022 · 2 min

Paper Review - SUMMAC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization

January 24, 2022 · 2 min

Paper Review - Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation

January 20, 2022 · 2 min

2021  46

October  3

Paper Review - Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

October 25, 2021 · 5 min

Paper Review - Knowledge Neurons in Pretrained Transformers

October 24, 2021 · 3 min

Paper Review - Learning to summarize from human feedback

October 18, 2021 · 2 min

September  10

Paper Review - Inspecting the Factuality of Hallucinated Entities in Abstractive Summarization

September 27, 2021 · 2 min

Paper Review - Decision-Focused Summarization

September 22, 2021 · 3 min

Paper Review - A Survey of the State of Explainable AI for Natural Language Processing

September 21, 2021 · 2 min

Paper Review - An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next

September 14, 2021 · 1 min

Paper Review - GNNExplainer: Generating Explanations for Graph Neural Networks

September 13, 2021 · 2 min

Paper Review - Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation

September 10, 2021 · 2 min

Paper Review - Discretized Integrated Gradients for Explaining Language Models

September 8, 2021 · 2 min

Paper Review - What’s in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization

September 7, 2021 · 3 min

Paper Review - Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond

September 6, 2021 · 4 min

Paper Review - Flexible Operations for Natural Language Deduction

September 2, 2021 · 2 min

August  18

Paper Review - Discourse-Aware Neural Extractive Text Summarization

August 21, 2021 · 2 min

Paper Review - Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval

August 19, 2021 · 2 min

Paper Review - REALM: Retrieval-Augmented Language Model Pre-Training

August 17, 2021 · 3 min

Paper Review - Joint Retrieval and Generation Training for Grounded Text Generation

August 16, 2021 · 3 min

Paper Review - Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks

August 14, 2021 · 3 min

Paper Review - Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks

August 13, 2021 · 3 min

Paper Review - Noisy Channel Language Model Prompting for Few-Shot Text Classification

August 12, 2021 · 3 min

Paper Review - TWAG: A Topic-guided Wikipedia Abstract Generator

August 11, 2021 · 2 min

Paper Review - Improving Factual Consistency of Abstractive Summarization via Question Answering

August 10, 2021 · 3 min

Paper Review - Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution

August 9, 2021 · 2 min

Paper Review - Generating Query Focused Summaries from Query-Free Resources

August 8, 2021 · 4 min

Paper Review - BLEURT: Learning Robust Metrics for Text Generation

August 7, 2021 · 2 min

Paper Review - Big Bird: Transformers for Longer Sequences

August 6, 2021 · 3 min

Paper Review - LongSumm 2021: Session based automatic summarization model for scientific document

August 5, 2021 · 2 min

Paper Review - Annotating and Modeling Fine-grained Factuality in Summarization

August 4, 2021 · 2 min

Paper Review - GSum: A General Framework for Guided Neural Abstractive Summarization

August 3, 2021 · 2 min

Paper Review - Nutri-bullets Hybrid: Consensual Multi-document Summarization

August 2, 2021 · 2 min

Paper Review - CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes

August 1, 2021 · 4 min

July  12

Paper Review - Noisy Self-Knowledge Distillation for Text Summarization

July 31, 2021 · 2 min

Paper Review - PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation

July 30, 2021 · 2 min

Paper Review - Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection

July 29, 2021 · 2 min

Paper Review - Scoring Sentence Singletons and Pairs for Abstractive Summarization

July 29, 2021 · 1 min

Paper Review - Efficient Attentions for Long Document Summarization

July 28, 2021 · 2 min

Paper Review - AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization

July 27, 2021 · 2 min

Paper Review - FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization

July 27, 2021 · 2 min

Paper Review - Neural Text Summarization: A Critical Evaluation

July 26, 2021 · 2 min

Paper Review - On Faithfulness and Factuality in Abstractive Summarization

July 26, 2021 · 2 min

Paper Review - Learning Neural Templates for Text Generation

July 25, 2021 · 2 min

Paper Review - Bottom-Up Abstractive Summarization

July 23, 2021 · 2 min

Paper Review - Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation

July 23, 2021 · 2 min

January  3

Paper Review - Decoupling Representation and Classifier for Long-Tailed Recognition

January 8, 2021 · 6 min

Overlook of Relation Extraction

January 3, 2021 · 6 min

Paper Review - Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphs

January 1, 2021 · 8 min

2020  29

December  1

Cross-Lingual Learning

December 28, 2020 · 13 min

September  3

BERT and RoBERTa

September 18, 2020 · 3 min

Paper Review - What Does BERT Look At? An Analysis of BERT’s Attention

September 14, 2020 · 4 min

Paper Review - The More You Know: Using Knowledge Graphs for Image Classification

September 2, 2020 · 9 min

August  6

Graph Convolutional Neural Network - Spectral Convolution

August 24, 2020 · 9 min

Graph Convolutional Neural Network - Spatial Convolution

August 20, 2020 · 9 min

Introduction to Graph Neural Network (GNN)

August 17, 2020 · 9 min

Kaggle: Jigsaw Multilingual Toxic Comment Classification - top solutions

August 11, 2020 · 9 min

Multi-lingual: M-Bert, LASER, MultiFiT, XLM

August 8, 2020 · 15 min

Knowledge Distillation

August 5, 2020 · 7 min

July  2

Kaggle: Tweet Sentiment Extraction - top solutions

July 2, 2020 · 14 min

Kaggle: Tweet Sentiment Extraction - common methods

July 1, 2020 · 11 min

June  1

Recurrent Neural Network (RNN) and Long Short Term Memory (LSTM)

June 4, 2020 · 5 min

May  5

Intro to Deep Learning and Backpropagation

May 26, 2020 · 7 min

Log-Linear Model, Conditional Random Field(CRF)

May 19, 2020 · 8 min

Gaussian mixture model (GMM), k-means

May 16, 2020 · 6 min

Probabilistic Graphical Model (PGM)

May 11, 2020 · 8 min

Hidden Markov Model (HMM)

May 3, 2020 · 14 min

April  6

EM (Expectation–Maximization) Algorithm

April 24, 2020 · 8 min

Skip-gram

April 18, 2020 · 8 min

Distributed representation, Hyperbolic Space, Gaussian/Graph Embedding

April 17, 2020 · 7 min

NLP Basics, Spell Correction with Noisy Channel

April 10, 2020 · 9 min

Kaggle: Google Quest Q&A Labeling - my solution

April 4, 2020 · 7 min

SVM, Dual SVM, Non-linear SVM

April 1, 2020 · 7 min

March  5

Introduction to Convex Optimization - Primal problem to Dual problem

March 29, 2020 · 7 min

Introduction to Convex Optimization - Basic Concepts

March 28, 2020 · 8 min

XGBoost

March 27, 2020 · 4 min

Maximum Likelihood Estimation (MLE) and Maximum a Posteriori (MAP)

March 26, 2020 · 1 min

Logistic Regression, L1, L2 regularization, Gradient/Coordinate descent

March 25, 2020 · 4 min