# EASSE: Easier Automatic Sentence Simplification Evaluation

## TL;DR

EASSE is a Python package that streamlines the evaluation of sentence simplification systems by providing comprehensive metrics, data, and visualization tools for better comparison and analysis.

## Contribution

It introduces a unified platform with diverse evaluation resources and visualization capabilities for automatic sentence simplification assessment.

## Key findings

- Enhanced comparison of SS systems using EASSE's metrics.
- EASSE facilitates better understanding of SS system performance.
- The package supports standard datasets and metrics for consistent evaluation.

## Abstract

We introduce EASSE, a Python package aiming to facilitate and standardise automatic evaluation and comparison of Sentence Simplification (SS) systems. EASSE provides a single access point to a broad range of evaluation resources: standard automatic metrics for assessing SS outputs (e.g. SARI), word-level accuracy scores for certain simplification transformations, reference-independent quality estimation features (e.g. compression ratio), and standard test data for SS evaluation (e.g. TurkCorpus). Finally, EASSE generates easy-to-visualise reports on the various metrics and features above and on how a particular SS output fares against reference simplifications. Through experiments, we show that these functionalities allow for better comparison and understanding of the performance of SS systems.