Chinese herb medicine in augmented reality

TL;DR

This paper presents an augmented reality platform for Chinese herb medicine education, enabling real-time visualization and interaction with herbal models to enhance learning interest and provide accurate identification.

Contribution

The paper introduces a novel AR system using 3dsMax and Unity that allows real-time interaction and identification of Chinese herbs through mobile devices.

Findings

System shows high accuracy in herbal identification

Provides real-time 3D visualization and interaction

Enhances learner engagement in herbal medicine education

Abstract

Augmented reality becomes popular in education gradually, which provides a contextual and adaptive learning experience. Here, we develop a Chinese herb medicine AR platform based the 3dsMax and the Unity that allows users to visualize and interact with the herb model and learn the related information. The users use their mobile camera to scan the 2D herb picture to trigger the presentation of 3D AR model and corresponding text information on the screen in real-time. The system shows good performance and has high accuracy for the identification of herbal medicine after interference test and occlusion test. Users can interact with the herb AR model by rotating, scaling, and viewing transformation, which effectively enhances learners' interest in Chinese herb medicine.