Will It Blend? Mixing Training Paradigms & Prompting For Argument Quality Prediction

Van Der Meer Michiel, Reuver Myrthe, Khurana Urja, Krause Lea, Santamaría Selene Báez. Arxiv 2022

[Paper]    
GPT Model Architecture Prompting Training Techniques

This paper describes our contributions to the Shared Task of the 9th Workshop on Argument Mining (2022). Our approach uses Large Language Models for the task of Argument Quality Prediction. We perform prompt engineering using GPT-3, and also investigate the training paradigms multi-task learning, contrastive learning, and intermediate-task training. We find that a mixed prediction setup outperforms single models. Prompting GPT-3 works best for predicting argument validity, and argument novelty is best estimated by a model trained using all three training paradigms.

Similar Work