论文与标准

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

以掩码语言建模和句间目标预训练双向 Transformer 表示。

Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova · 2019 · Proceedings of NAACL-HLT 2019