Grade of membership analysis for multi-layer ordinal categorical data

TL;DR

This paper introduces a multi-layer extension of the Grade of Membership model for ordinal categorical data, providing a new estimation method and theoretical guarantees for analyzing complex multi-time point test data.

Contribution

It proposes a novel multi-layer GoM model and a debiased Gram matrix-based estimation method, extending GoM to handle multi-layer ordinal data with theoretical convergence guarantees.

Findings

GoM-DSoG outperforms competitors in experiments.

Fewer no-responses and more layers improve estimation accuracy.

Method accurately determines the number of latent classes.

Abstract

Consider a group of individuals (subjects) participating in the same psychological tests with numerous questions (items) at different times, where the choices of each item have an implicit ordering. The observed responses can be recorded in multiple response matrices over time, named multi-layer ordinal categorical data, where layers refer to time points. Assuming that each subject has a common mixed membership shared across all layers, enabling it to be affiliated with multiple latent classes with varying weights, the objective of the grade of membership (GoM) analysis is to estimate these mixed memberships from the data. When the test is conducted only once, the data becomes traditional single-layer ordinal categorical data. The GoM model is a popular choice for describing single-layer categorical data with a latent mixed membership structure. However, GoM cannot handle multi-layer ordinal categorical data. In this work, we propose a new model, multi-layer GoM, which extends GoM to multi-layer ordinal categorical data. To estimate the common mixed memberships, we propose a new approach, GoM-DSoG, based on a debiased sum of Gram matrices. We establish GoM-DSoG's per-subject convergence rate under the multi-layer GoM model. Our theoretical results suggest that fewer no-responses, more subjects, more items, and more layers are beneficial for GoM analysis. We also propose an approach to select the number of latent classes. Extensive experimental studies verify the theoretical findings and show GoM-DSoG's superiority over its competitors, as well as the accuracy of our method in determining the number of latent classes.