We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Artificial Intelligence & Machine Learning/Learning from Dialogue after Deployment: Feed Yourself, Chatbot!
Conference ProceedingsArtificial Intelligence & Machine Learning

Learning from Dialogue after Deployment: Feed Yourself, Chatbot!

Checking your access to this record.

Abstract & Overview

The majority of conversations a dialogue agent sees over its lifetime occur after it has already been trained and deployed, leaving a vast store of potential training signal untapped.In this work, we propose the self-feeding chatbot, a dialogue agent with the ability to extract new training examples from the conversations it participates in.As our agent engages in conversation, it also estimates user satisfaction in its responses.When the conversation appears to be going well, the user's responses become new training examples to imitate.When the agent believes it has made a mistake, it asks for feedback; learning to predict the feedback that will be given improves the chatbot's dialogue abilities further.On the PERSONACHAT chitchat dataset with over 131k training examples, we find that learning from dialogue with a selffeeding chatbot significantly improves performance, regardless of the amount of traditional supervision.

Cite this record

Braden Hancock, Antoine Bordes, Pierre-Emmanuel Mazaré, Jason Weston (2019). Learning from Dialogue after Deployment: Feed Yourself, Chatbot!. Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/p19-1358

Copy in another style

Hancock, B., Bordes, A., Mazaré, P., & Weston, J. (2019). Learning from Dialogue after Deployment: Feed Yourself, Chatbot! Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/p19-1358
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.