Seeing virtual while acting real: Visual display and strategy effects on the time and precision of eye-hand coordination

TL;DR

This study examines how different visual display types, including 2D and 3D views, affect the speed and accuracy of eye-hand coordination in a pick-and-place task among novices.

Contribution

It provides empirical evidence on the negative impact of computer-generated visual displays on task performance compared to natural viewing.

Findings

All visual conditions impaired performance relative to natural viewing.

3D stereoscopic view did not improve performance over 2D views.

Sub-optimal monitor placement further reduced task efficiency.

Abstract

Effects of computer generated 2D and 3D views on the time and precision of bare-handed or tool-mediated eye-hand coordination were investigated in a pick-and-place-task with complete novices. All of them scored well above average in spatial perspective taking ability and performed the task with their dominant hand. Two groups of novices, four men and four women in each group, had to place a small object in a precise order on the centre of five targets on a Real-world Action Field (RAF), as swiftly as possible and as precisely as possible, using a tool or not (control). Each individual session consisted of four visual display conditions. The order of conditions was counterbalanced between individuals and sessions. Subjects looked at what their hands were doing 1) directly in front of them (natural top-down view) 2) in topdown 2D fisheye camera view 3) in top-down undistorted 2D view or 4) in 3D stereoscopic top-down view (head-mounted OCULUS DK 2). It was made sure that object movements in all image conditions matched the real-world movements in time and space. One group was looking at the 2D images with the monitor positioned sideways (sub-optimal); the other group was looking at the monitor placed straight ahead of them (near-optimal). All image viewing conditions had significantly detrimental effects on time (seconds) and precision (pixels) of task execution when compared with natural direct viewing.