Extraction

2019

Matching the Blanks: Distributional Similarity for Relation Learning

ACL 2019, Livio Baldini Soares, Nicholas FitzGerald, Jeffrey Ling, Tom Kwiatkowski

2021

Prototypical Representation Learning for Relation Extraction

ICLR 2021, Ning Ding, Xiaobin Wang, Yao Fu, Guangwei Xu, Rui Wang, Pengjun Xie, Ying Shen, Fei Huang, Hai-Tao Zheng, Rui Zhang

Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval

ICLR 2021, Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul N. Bennett, Junaid Ahmed, Arnold Overwijk

SENT: Sentence-level Distant Relation Extraction via Negative Training

ACL 2021, Ruotian Ma, Tao Gui, Linyang Li, Qi Zhang, Yaqian Zhou, Xuanjing Huang

Few-Shot Question Answering by Pretraining Span Selection

ACL 2021, Ori Ram, Yuval Kirstain, Jonathan Berant, Amir Globerson, Omer Levy

CIL: Contrastive Instance Learning Framework for Distantly Supervised Relation Extraction

ACL 2021, Tao Chen, Haizhou Shi, Siliang Tang, Zhigang Chen, Fei Wu, Yueting Zhuang

Element Intervention for Open Relation Extraction

ACL 2021, Fangchao Liu, Lingyong Yan, Hongyu Lin, Xianpei Han, Le Sun

CLEVE: Contrastive Pre-training for Event Extraction

ACL 2021, Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li, Jie Zhou

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

ACL 2021, Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou

Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning

NAACL 2021, Hui Liu, Danqing Zhang, Bing Yin, Xiaodan Zhu

Denoising Distantly Supervised Named Entity Recognition via a Hypergeometric Probabilistic Model

AAAI 2021, Wenkai Zhang, Hongyu Lin, Xianpei Han, Le Sun, Huidan Liu, Zhicheng Wei, Nicholas Jing Yuan

Relation Classification with Cognitive Attention Supervision

CMCL 2021, Erik McGuire, Noriko Tomuro

AdaPrompt: Adaptive Prompt-based Finetuning for Relation Extraction

Arxiv 2021, Xiang Chen, Xin Xie, Ningyu Zhang, Jiahuan Yan, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen

Multi-facet Universal Schema

EACL 2021, Rohan Paul, Haw-Shiuan Chang, Andrew McCallum

2020

Improving Relation Extraction with Relational Paraphrase Sentences

COLING 2020, Junjie Yu, Tong Zhu, Wenliang Chen, Wei Zhang, Min Zhang

A Two-phase Prototypical Network Model for Incremental Few-shot Relation Classification

COLING 2020, Haopeng Ren, Yi Cai, Xiaofeng Chen, Guohua Wang, Qing Li

Event Guided Denoising for Multilingual Relation Learning

COLING 2020, Amith Ananthram, Emily Allaway, Kathleen McKeown

Improving Relation Extraction by Leveraging Knowledge Graph Link Prediction

Arxiv 2020, George Stoica, Emmanouil Antonios Platanios, Barnabás Póczos

RDSGAN: Rank-based Distant Supervision Relation Extraction with Generative Adversarial Framework

Arxiv 2020, Guoqing Luo, Jiaxin Pan, Min Peng

Machine Translation

Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment

ACL 2021, Zewen Chi, Li Dong, Bo Zheng, Shaohan Huang, Xian-Ling Mao, Heyan Huang, Furu Wei

Contrastive Learning for Many-to-many Multilingual Neural Machine Translation

ACL 2021, Xiao Pan, Mingxuan Wang, Liwei Wu, Lei Li

Exploring Unsupervised Pretraining Objectives for Machine Translation

ACL 2021, Christos Baziotis, Ivan Titov, Alexandra Birch, Barry Haddow

Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation

NAACL 2021, Alexandra Chronopoulou, Dario Stojanovski, Alexander Fraser

Others

SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization

ACL 2021, Yixin Liu, Pengfei Liu

Structure-Grounded Pretraining for Text-to-SQL

NAACL 2021, Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, Oleksandr Polozov, Huan Sun, Matthew Richardson

General

FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders

ICLR 2021, Pengyu Cheng, Weituo Hao, Siyang Yuan, Shijing Si, Lawrence Carin

Contrastive Learning with Adversarial Perturbations for Conditional Text Generation

ICLR 2021, Seanie Lee, Dong Bok Lee, Sung Ju Hwang

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

ICLR 2021, Beliz Gunel, Jingfei Du, Alexis Conneau, Veselin Stoyanov

Relating by Contrasting: A Data-efficient Framework for Multimodal Generative Models

ICLR 2021, Yuge Shi, Brooks Paige, Philip Torr, Siddharth N

Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene

ACL 2021, Ruikun Luo, Guanhuan Huang, Xiaojun Quan

CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding

ACL 2021, Dong Wang, Ning Ding, Piji Li, Hai-Tao Zheng

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

ACL 2021, Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Kyomin Jung

UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning

ACL 2021, Wei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu, Jiachen Liu, Hua Wu, Haifeng Wang

Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning

ACL 2021, Zhiyuan Zeng, Keqing He, Yuanmeng Yan, Zijun Liu, Yanan Wu, Hong Xu, Huixing Jiang, Weiran Xu

Self-Guided Contrastive Learning for BERT Sentence Representations

ACL 2021, Taeuk Kim, Kang Min Yoo, Sang-goo Lee

DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

ACL 2021, John Giorgi, Osvald Nitski, Bo Wang, Gary Bader

ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer

ACL 2021, Yuanmeng Yan, Rumei Li, Sirui Wang, Fuzheng Zhang, Wei Wu, Weiran Xu

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models

WWW Workshop 2021, Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun

Multilingual BERT Post-Pretraining Alignment

NAACL 2021, Lin Pan, Chung-Wei Hang, Haode Qi, Abhishek Shah, Saloni Potdar, Mo Yu

Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis

NAACL 2021, Hirokazu Kiyomaru, Sadao Kurohashi

Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach

NAACL 2021, Yue Yu, Simiao Zuo, Haoming Jiang, Wendi Ren, Tuo Zhao, Chao Zhang

Supporting Clustering with Contrastive Learning

NAACL 2021, Dejiao Zhang, Feng Nan, Xiaokai Wei, Shang-Wen Li, Henghui Zhu, Kathleen McKeown, Ramesh Nallapati, Andrew O. Arnold, Bing Xiang