Using the SOCIO Chatbot for UML Modelling: A Family of Experiments
Ranci Ren, John W. Castro, Adri\'an Santos, Oscar Dieste, Silvia T., Acu\~na

TL;DR
This study compares a chatbot-based UML modelling tool, SOCIO, with an online web tool, Creately, demonstrating that SOCIO enables faster, more satisfying, and more concise class diagram creation in academic settings.
Contribution
The paper introduces a family of experiments evaluating SOCIO, a chatbot for UML modelling, highlighting its advantages over traditional online tools in collaborative diagramming tasks.
Findings
Participants built class diagrams faster with SOCIO.
Participants reported higher satisfaction with SOCIO.
Diagrams created with SOCIO were more concise, slightly less complete.
Abstract
Context: Recent developments in natural language processing have facilitated the adoption of chatbots in typically collaborative software engineering tasks (such as diagram modelling). Families of experiments can assess the performance of tools and processes and, at the same time, alleviate some of the typical shortcomings of individual experiments (e.g., inaccurate and potentially biased results due to a small number of participants). Objective: Compare the usability of a chatbot for collaborative modelling (i.e., SOCIO) and an online web tool (i.e., Creately). Method: We conducted a family of three experiments to evaluate the usability of SOCIO against the Creately online collaborative tool in academic settings. Results: The student participants were faster at building class diagrams using the chatbot than with the online collaborative tool and more satisfied with SOCIO. Besides, the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
