Improving Knowledge-aware Dialogue Generation Via Knowledge Base Question Answering · The Large Language Model Bible Contribute to LLM-Bible

Improving Knowledge-aware Dialogue Generation Via Knowledge Base Question Answering

Wang Jian, Liu Junhao, Bi Wei, Liu Xiaojiang, He Kejing, Xu Ruifeng, Yang Min. Arxiv 2019

[Paper] [Code]    
Applications Attention Mechanism Has Code Model Architecture

Neural network models usually suffer from the challenge of incorporating commonsense knowledge into the open-domain dialogue systems. In this paper, we propose a novel knowledge-aware dialogue generation model (called TransDG), which transfers question representation and knowledge matching abilities from knowledge base question answering (KBQA) task to facilitate the utterance understanding and factual knowledge selection for dialogue generation. In addition, we propose a response guiding attention and a multi-step decoding strategy to steer our model to focus on relevant features for response generation. Experiments on two benchmark datasets demonstrate that our model has robust superiority over compared methods in generating informative and fluent dialogues. Our code is available at https://github.com/siat-nlp/TransDG.

Similar Work