I Am Not Your Typical Chatbot: Hedonic and Utilitarian Evaluation of Open-Domain Chatbots

초록

With the development of natural language processing (NLP), open-domain chatbots can operate as companions. The success of open-domain chatbots depends on understanding how positive and negative expectancy violations affect both utilitarian and hedonic gratification, which in turn influences user satisfaction and continued use. Therefore, this study examines how violations of expectations influence the hedonic and utilitarian evaluations of open-domain chatbots using the expectancy-violation theory. Participants (n = 204) interacted with an improvising AI chatbot and reported their satisfaction. Results indicated that both hedonic and utilitarian satisfaction were higher when negative expectations were met compared to when expectations were violated. However, no significant difference was found in hedonic gratification between the chatbot's expected performance and positively unexpected performance. Conversations meeting expectations elicited more utilitarian satisfaction than positively surprising interactions. These findings highlight the dynamics between value types and expectation violations in AI chatbot evaluations.

키워드