Photogrammetry-Reconstructed 3D Head Meshes for Accessible Individual Head-Related Transfer Functions

TL;DR

This study explores using consumer-grade photogrammetry to generate 3D head meshes for synthesizing individual HRTFs, finding it feasible but with limitations in high-frequency spectral accuracy affecting perceptual quality.

Contribution

It demonstrates that photogrammetry can produce usable 3D head meshes for HRTF synthesis, highlighting current limitations and potential for accessible spatial audio customization.

Findings

PR HRTFs preserve ITD cues but have higher ILD and spectral errors.

Behavioral tests show PR HRTFs lead to more localization errors than measured HRTFs.

Photogrammetry-based HRTFs are limited by insufficient pinna detail and spectral fidelity.

Abstract

Individual head-related transfer functions (HRTFs) are essential for accurate spatial audio binaural rendering but remain difficult to obtain due to measurement complexity. This study investigates whether photogrammetry-reconstructed (PR) head and ear meshes, acquired with consumer hardware, can provide a practically useful baseline for individual HRTF synthesis. Using the SONICOM HRTF dataset, 72-image photogrammetry captures per subject were processed with Apple's Object Capture API to generate PR meshes for 150 subjects. Mesh2HRTF was used to compute PR synthetic HRTFs, which were compared against measured HRTFs, high-resolution 3D scan-derived HRTFs, KEMAR, and random HRTFs through numerical evaluation, auditory models, and a behavioural sound localisation experiment (N = 27). PR synthetic HRTFs preserved ITD cues but exhibited increased ILD and spectral errors. Auditory-model predictions and behavioural data showed substantially higher quadrant error rates, reduced elevation accuracy, and greater front-back confusions than measured HRTFs, performing worse than random HRTFs on perceptual metrics. Current photogrammetry pipelines support individual HRTF synthesis but are limited by insufficient pinna morphology details and high-frequency spectral fidelity needed for accurate individual HRTFs containing monaural cues.