A conversational agent for creating automations exploiting large language models-Reference-Cited by-同舟云学术

A conversational agent for creating automations exploiting large language models

Published:2024-07-04 Issue: Volume: Page:
ISSN:1617-4909
Container-title:Personal and Ubiquitous Computing
language:en
Short-container-title:Pers Ubiquit Comput

Author:

Gallo Simone^ORCID,Paternò Fabio^ORCID,Malizia Alessio^ORCID

Abstract

AbstractThe proliferation of sensors and smart Internet of Things (IoT) devices in our everyday environments is reshaping our interactions with everyday objects. This change underlines the need to empower non-expert users to easily configure the behaviour of these devices to align with their preferences and habits. At the same time, recent advances in generative transformers, such as ChatGPT, have opened up new possibilities in a variety of natural language processing tasks, enhancing reasoning capabilities and conversational interactions. This paper presents RuleBot + + , a conversational agent that exploits GPT-4 to assist the user in the creation and modification of trigger-action automations through natural language. After an introduction to motivations and related work, we present the design and implementation of RuleBot + + and report the results of the user test in which users interacted with our solution and Home Assistant, one of the most used open-source tools for managing smart environments.

Funder

ISTI - PISA

Publisher

Springer Science and Business Media LLC

Link

https://link.springer.com/content/pdf/10.1007/s00779-024-01825-5.pdf

Reference24 articles.

1. Brush AB, Lee B, Mahajan R, Agarwal S, Saroiu S, Dixon C (2011) Home automation in the wild: challenges and opportunities. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Vancouver BC Canada, pp 2115–2124. https://doi.org/10.1145/1978942.1979249

2. He W, Martinez J, Padhi R, Zhang L, Ur B (2019) When smart devices are stupid: negative experiences using home smart devices. In: 2019 IEEE Security and Privacy Workshops (SPW). pp 150–155. IEEE, San Francisco, CA, USA. https://doi.org/10.1109/SPW.2019.00036

3. Yang R, Newman MW (2013) Learning from a learning thermostat: lessons for intelligent systems for the home. In: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. pp 93–102. ACM, Zurich Switzerland. https://doi.org/10.1145/2493432.2493489

4. Gallo S, Paterno F, Malizia A (2023) Conversational interfaces in IoT ecosystems: where we are, what is still missing. In: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia. pp 279–293. ACM, Vienna Austria. https://doi.org/10.1145/3626705.3627775

5. Monge Roffarello A, De Russis L (2023) Defining trigger-action rules via voice: a novel approach for end-user development in the IoT. In: Spano LD, Schmidt A, Santoro C, and Stumpf S (eds.) End-User Development. pp 65–83. Springer Nature Switzerland, Cham. https://doi.org/10.1007/978-3-031-34433-6_5