sklarsomega: An R Package for Measuring Agreement Using Sklar's Omega Coefficient

TL;DR

The sklarsomega R package offers a comprehensive tool for measuring agreement across various data types using Sklar's omega coefficient, unifying multiple agreement metrics and supporting classical and Bayesian inference.

Contribution

It introduces an R package that implements Sklar's omega, a versatile agreement measure subsuming Krippendorff's alpha, with extensive applicability and inference options.

Findings

Supports nominal, ordinal, interval, and ratio data

Handles multiple units, coders, and missing data

Provides classical and Bayesian inference methods

Abstract

R package sklarsomega provides tools for measuring agreement using Sklar's omega coefficient, which subsumes Krippendorff's alpha coefficient, which in turn subsumes a number of other well-known agreement coefficients. The package permits users to apply the omega methodology to nominal, ordinal, interval, or ratio scores; can accommodate any number of units, any number of coders, and missingness; and can measure intra-coder agreement, inter-coder agreement, and agreement relative to a gold standard. Classical inference is available for all levels of measurement while Bayesian inference is available for interval data and ratio data only.