Symbol Resolution MatRs: Make it Fast and Observable with Stable Linking

TL;DR

This paper introduces stable linking via MatR, a new mechanism that improves performance and observability of symbol resolution by calculating relocation mappings at epoch boundaries, replacing traditional dynamic linking.

Contribution

It presents MatR, the first stable linker, which separates system state management from runtime linking, enabling faster symbol resolution and better dependency management.

Findings

MatR improves symbol resolution performance by 2.19x on average.

Stable linking allows developers to inspect relocation mappings during epochs.

The system enhances dependency management through clear epoch-based state separation.

Abstract

Dynamic linking is the standard mechanism for using external dependencies since it enables code reuse, streamlines software updates, and reduces disk/network use. Dynamic linking waits until runtime to calculate an application's relocation mapping, i.e., the mapping between each externally referenced symbol in the application to the dependency that provides the symbol. Unfortunately, it comes with two downsides. First, dynamic linking limits the performance of current systems since it can take seconds to calculate a relocation mapping for a large program. Second, dynamic linking limits the dependency management of applications since it prevents a developer from accurately observing a relocation mapping except at runtime. This paper makes the key insight that the benefits conventionally attributed to dynamic linking: code reuse, streamlined software updates, and reduced disk/network use are actually benefits of shared libraries. Thus, we present stable linking, a new mechanism for using dependencies that uses shared libraries to retain their benefits but eliminates the downsides of dynamic linking. Stable linking separates a system's state into management times; when the system can be modified, and epochs when it cannot. Stable linking calculates each application's relocation mapping at the beginning of each epoch, allows developers to inspect the relocation mapping during the epoch, and reuses the mapping for subsequent executions in the epoch. We design and build MatR, the first stable linker. We use MatR in three workloads and show that it improves upon dynamic linking performance by a factor of 2.19 on average. Additionally, we use the system in three vignettes, or case-studies, that illustrate the system's improvements to dependency management.