# Mobile Head Tracking for eCommerce and Beyond

## TL;DR

This paper introduces an open-source head tracking button for iPhone X that enables hands-free interaction for eCommerce, gaming, and accessibility, demonstrated through a sample shopping app and user studies.

## Contribution

It presents a novel, accessible head tracking solution for smartphones that is easy for developers to integrate into various applications.

## Key findings

- Effective head movement sensitivity at multiple distances
- Positive user feedback on ease of use and accessibility
- Potential for broader application in hands-free scenarios

## Abstract

Shopping is difficult for people with motor impairments. This includes online shopping. Proprietary software can emulate mouse and keyboard via head tracking. However, such a solution is not common for smartphones. Unlike desktop and laptop computers, they are also much easier to carry indoors and outdoors.To address this, we implement and open source button that is sensitive to head movements tracked from the front camera of iPhone X. This allows developers to integrate in eCommerce applications easily without requiring specialized knowledge. Other applications include gaming and use in hands-free situations such as during cooking, auto-repair. We built a sample online shopping application that allows users to easily browse between items from various categories and take relevant action just by head movements. We present results of user studies on this sample application and also include sensitivity studies based on two independent tests performed at 3 different distances to the screen.