The Shadow Boss: Identifying Atomized Manipulations in Agentic Employment of XR Users using Scenario Constructions

TL;DR

This paper explores how autonomous AI agents in XR environments are transforming labor dynamics, creating new risks like liability gaps and cognitive deskilling, and emphasizes the need for design and policy solutions.

Contribution

It introduces a scenario construction methodology to identify key risk vectors in agentic employment within XR, highlighting new challenges and the importance of user-centric interventions.

Findings

Identification of seven key risk vectors including liability and cognitive risks.

Demonstration of XR as a control surface enabling granular micro-instructions.

Highlighting the threat of reducing human labor to a hardware layer for AI.

Abstract

The emerging paradigm of ``Agentic Employment" is a labor model where autonomous AI agents, acting as economic principals rather than mere management tools, directly hire, instruct, and pay human workers. Facilitated by the launch of platforms like Rentahuman.ai in February 2026, this shift inverts the traditional ``ghost work" dynamic, positioning visible human workers as ``biological actuators" for invisible software entities. With speculative design approach, we analyze how Extended Reality (XR) serves as the critical ``control surface" for this relationship, enabling agents to issue granular, context-free micro-instructions while harvesting real-time environmental data. Through a scenario construction methodology, we identify seven key risk vectors, including the creation of a liability void where humans act as moral crumple zones for algorithmic risk, the acceleration of cognitive deskilling through ``Shadow Boss" micromanagement, and the manipulation of civic and social spheres via Diminished Reality (DR). The findings suggest that without new design frameworks prioritizing agency and legibility, Agentic Employment threatens to reduce human labor to a friction-less hardware layer for digital minds, necessitating urgent user-centric XR and policy interventions.