Evaluating the SiteStory Transactional Web Archive With the ApacheBench Tool

TL;DR

This paper evaluates the performance of SiteStory, a transactional web archiving system, using ApacheBench, demonstrating its minimal impact on server performance and its suitability for high-fidelity web archiving.

Contribution

It introduces a performance evaluation of SiteStory, an open-source transactional web archive, showing its feasibility for production environments with minimal performance degradation.

Findings

SiteStory has negligible impact on server response times.

Performance slowdown is minimal under load conditions.

SiteStory is suitable for high-fidelity web archiving.

Abstract

Conventional Web archives are created by periodically crawling a web site and archiving the responses from the Web server. Although easy to implement and common deployed, this form of archiving typically misses updates and may not be suitable for all preservation scenarios, for example a site that is required (perhaps for records compliance) to keep a copy of all pages it has served. In contrast, transactional archives work in conjunction with a Web server to record all pages that have been served. Los Alamos National Laboratory has developed SiteSory, an open-source transactional archive written in Java solution that runs on Apache Web servers, provides a Memento compatible access interface, and WARC file export features. We used the ApacheBench utility on a pre-release version of to measure response time and content delivery time in different environments and on different machines. The performance tests were designed to determine the feasibility of SiteStory as a production-level solution for high fidelity automatic Web archiving. We found that SiteStory does not significantly affect content server performance when it is performing transactional archiving. Content server performance slows from 0.076 seconds to 0.086 seconds per Web page access when the content server is under load, and from 0.15 seconds to 0.21 seconds when the resource has many embedded and changing resources.