MaRginalia: Enabling In-person Lecture Capturing and Note-taking Through Mixed Reality
Leping Qiu, Erin Seongyoon Kim, Sangho Suh, Ludwig Sidenmark, Tovi, Grossman

TL;DR
MaRginalia leverages mixed reality to enable students to take notes during lectures more efficiently and with less distraction by integrating digital notes, lecture slides, and audio transcripts in a seamless MR environment.
Contribution
This paper introduces MaRginalia, a novel MR-based note-taking system that allows students to capture lecture information quickly without diverting attention from the lecture.
Findings
MaRginalia improves note-taking speed and accuracy.
Students reported increased engagement and reduced distraction.
The system is feasible and beneficial in real lecture settings.
Abstract
Students often take digital notes during live lectures, but current methods can be slow when capturing information from lecture slides or the instructor's speech, and require them to focus on their devices, leading to distractions and missing important details. This paper explores supporting live lecture note-taking with mixed reality (MR) to quickly capture lecture information and take notes while staying engaged with the lecture. A survey and interviews with university students revealed common note-taking behaviors and challenges to inform the design. We present MaRginalia to provide digital note-taking with a stylus tablet and MR headset. Students can take notes with an MR representation of the tablet, lecture slides, and audio transcript without looking down at their device. When preferred, students can also perform detailed interactions by looking at the physical tablet. We…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
