ARTAI: An Evaluation Platform to Assess Societal Risk of Recommender Algorithms
Qin Ruan, Jin Xu, Ruihai Dong, Arjumand Younus, Tai Tan Mai, Barry, O'Sullivan, and Susan Leavy

TL;DR
ARTAI is an evaluation platform designed to assess societal risks of recommender algorithms, facilitating large-scale audits and supporting regulatory compliance to mitigate online content dissemination harms.
Contribution
The paper introduces ARTAI, a novel evaluation environment that enables comprehensive assessment of recommender algorithms for societal risks and transparency.
Findings
Supports large-scale societal risk assessments
Identifies harmful content distribution patterns
Facilitates regulatory compliance and transparency
Abstract
Societal risk emanating from how recommender algorithms disseminate content online is now well documented. Emergent regulation aims to mitigate this risk through ethical audits and enabling new research on the social impact of algorithms. However, there is currently a need for tools and methods that enable such evaluation. This paper presents ARTAI, an evaluation environment that enables large-scale assessments of recommender algorithms to identify harmful patterns in how content is distributed online and enables the implementation of new regulatory requirements for increased transparency in recommender systems.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRecommender Systems and Techniques
