A Queuing Model for CPU Functional Unit and Issue Queue Configuration
Shane Carroll, Wei-Ming Ling

TL;DR
This paper introduces a novel queuing model for analyzing the configuration of functional units and issue queues in superscalar processors, aiding in optimizing hardware resource allocation for better performance.
Contribution
It presents a new queuing network model that captures the behavior of instruction waiting and resource sharing in superscalar pipelines, including operand dependencies.
Findings
Provides a method to estimate queue lengths for different instruction types.
Models shared issue queues with server-specific waiting conditions.
Generalizes to other resource-allocation problems in pipeline design.
Abstract
In a superscalar processor, instructions of various types flow through an execution pipeline, traversing hardware resources which are mostly shared among many different instruction types. A notable exception to shared pipeline resources is the collection of functional units, the hardware that performs specific computations. In a trade-off of cost versus performance, a pipeline designer must decide how many of each type of functional unit to place in a processor's pipeline. In this paper, we model a superscalar processor's issue queue and functional units as a novel queuing network. We treat the issue queue as a finite-sized waiting area and the functional units as servers. In addition to common queuing problems, customers of the network share the queue but wait for specific servers to become ready (e.g., addition instructions wait for adders). Furthermore, the customers in this queue…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsParallel Computing and Optimization Techniques · Distributed and Parallel Computing Systems · Interconnection Networks and Systems
