基于BERT-CNN的增强语义自然语言推理算法
首发时间:2021-02-03
摘要:自然语言推理是当前自然语言处理技术中一个基础的任务,它可以很好的用来评价模型对文本之间的语义理解能力。针对当前研究对文本对之间的语义的理解不充分,本文提出了一个基于BERT-CNN的增强语义的自然语言推理模型。该模型首先通过基础BERT网络提取文本对整体交互分类的特征向量及两个文本每个字符的语义向量,随后随用CNN网络对两个文本每个字符的语义向量进行编码得到两个文本的特征向量,最后拼接整体交互分类的特征向量及两个文本的特征向量并使用前向网络进行分类预测。实验结果表明,与传统的自然语言推理算法对比,本文提出的基于BERT-CNN的增强语义自然语言推理算法的准确率更高,进一步提高了模型的性能,从而验证了所提出方法的有效性。
For information in English, please click here
Enhanced semantic natural language inference algorithm based on BERT-CNN
Abstract:Natural language inference is a basic task in current natural language processing technology, which can be used to evaluate the model\'s ability to understand semantics between texts. In view of the insufficient understanding of the semantics between text pairs in current research, this paper proposes a natural language reasoning model based on BERT-CNN with enhanced semantics. The model first extracts the feature vector of the overall interactive classification of the text through the basic BERT network and the semantic vector of each character of the two texts, and then uses the CNN network to encode the semantic vector of each character of the two texts to obtain the features of the two texts Vector, and finally concatenate the feature vector of the overall interactive classification and the feature vector of the two texts and use the forward network for classification prediction. The experimental results show that, compared with the traditional natural language inference algorithm, the enhanced semantic natural language inference algorithm based on BERT-CNN proposed in this paper has higher accuracy and further improves the performance of the model, thus verifying the effectiveness of the proposed method
Keywords: natural language inference BERT CNN
基金:
引用
No.****
动态公开评议
共计0人参与
勘误表
基于BERT-CNN的增强语义自然语言推理算法
评论
全部评论0/1000