Adaptive Bi-Level Variable Selection of Conditional Main Effects for Generalized Linear Models

TL;DR

This paper introduces an adaptive bi-level variable selection method for conditional main effects within generalized linear models, enhancing interpretability and selection accuracy in complex interaction modeling.

Contribution

It develops an adaptive penalized likelihood approach with an efficient algorithm, addressing limitations of previous methods like cmenet in GLMs.

Findings

Improved variable selection accuracy demonstrated in simulations.

Effective application shown in gene association analysis.

Enhanced interpretability of interaction effects.

Abstract

Understanding interaction effects among variables is important for regression modeling in various applications. The conventional approach of quantifying interactions as the product of variables often lacks clear interpretability, especially in complex systems. The concept of conditional main effects (CME) provides a more intuitive and interpretable framework for capturing interaction effects by quantifying the effect of one variable conditional on the level of another. A recent method called cmenet further considered the bi-level selection of CMEs by leveraging their natural grouping structure (e.g., sibling and cousin groups) through penalization. However, there are several limitations in the cmenet method, including the coupling ability of penalties for within-group CMEs, lack of adaptiveness for between-group penalties, and restriction to linear models with continuous responses. To overcome these limitations, we propose an adaptive cmenet method for CME selection under the generalized linear model (GLM) framework. The proposed method considers a penalized likelihood approach with adaptive weights to enable effective bi-level variable selection, improving both between-group and within-group selection. An efficient algorithm for parameter estimation is also developed by employing an iteratively reweighted least squares procedure. The performance of the proposed method is evaluated by both simulation studies and real-data studies in gene association analysis.