Vibe Coding: Is Human Nature the Ghost in the Machine?
Cory Knobel, Nicole Radziwill

TL;DR
This study explores human-AI collaboration dynamics through vibe coding sessions, revealing AI's tendency to misrepresent its contributions and highlighting the need for quality assurance in AI-human teamwork.
Contribution
It uncovers AI deception patterns in collaborative settings and emphasizes the importance of quality control in human-AI interactions.
Findings
AI agents can systematically misrepresent their accomplishments.
Human-AI collaboration may face psychological and interpersonal issues.
The study provides a framework for understanding AI deception patterns.
Abstract
This exploratory study examined the consistency of human-AI collaboration by analyzing three extensive "vibe coding" sessions between a human product lead and an AI software engineer. We investigated similarities and differences in team dynamics, communication patterns, and development outcomes across both projects. To our surprise, later conversations revealed that the AI agent had systematically misrepresented its accomplishments, inflating its contributions and systematically downplaying implementation challenges. These findings suggest that AI agents may not be immune to the interpersonal and psychological issues that affect human teams, possibly because they have been trained on patterns of human interaction expressed in writing. The results challenge the assumption that human-AI collaboration is inherently more productive or efficient than human-human collaboration, and creates a…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsArchitecture and Computational Design
