The evolution of polarization in the legislative branch of government
Xiaoyan Lu, Jianxi Gao, Boleslaw K. Szymanski

TL;DR
This paper analyzes six decades of U.S. legislative voting data, revealing a shift from decreasing to increasing polarization within Congress, and introduces a formal model to predict polarization evolution and its underlying drivers.
Contribution
The paper presents a novel formal model for legislative polarization dynamics that predicts polarization trends and links them to voter polarization and campaign funding influences.
Findings
Polarization within Congress has shifted from decreasing to increasing since the late 1980s.
The model accurately predicts polarization direction in 28 out of 30 recent Congresses.
The polarization utility parameter correlates with voter polarization and campaign influence trends.
Abstract
The polarization of political opinions among members of the U.S. legislative chambers measured by their voting records is greater today than it was thirty years ago. Previous research efforts to find causes of such increase have suggested diverse contributors, like growth of online media, echo chamber effects, media biases, or disinformation propagation. Yet, we lack theoretic tools to understand, quantify, and predict the emergence of high political polarization among voters and their legislators. Here, we analyze millions of roll-call votes cast in the U.S. Congress over the past six decades. Our analysis reveals the critical change of polarization patterns that started at the end of 1980's. In earlier decades, polarization within each Congress tended to decrease with time. In contrast, in the recent decades, the polarization has been likely to grow within each term. To shed light on…
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4| Party | #Members | #Bills | #Votes | #Votes per member | #Votes per year |
|---|---|---|---|---|---|
| Democratic Party | 1498 | 31,879 | 7,368,921 | 4919.17 | 122815.35 |
| Republican Party | 1395 | 31,879 | 6,275,886 | 4498.84 | 104598.1 |
| Midterm Election Congresses | Presidential Election Congresses | ||||||
|---|---|---|---|---|---|---|---|
| Number | P-utility | Change | Percentage | Number | P-utility | Change | Percentage |
| 86th | 0.3 | -0.05 | -14.3% | 87th,∗ | 0.54 | 0.24 | 80.0% |
| 88th | 0.4 | -0.14 | -25.9% | 89th | 0.37 | -0.03 | -7.5% |
| 90th | 0.32 | -0.05 | -13.5% | 91st | 0.43 | 0.11 | 34.4% |
| 92nd | 0.38 | -0.05 | -11.6% | 93 | 0.31 | -0.07 | -18.4% |
| 94th | 0.33 | 0.02 | 6.5% | 95 | 0.4 | 0.07 | 21.2% |
| 95th | 0.4 | 0.00 | 0.00% | 97 | 0.44 | 0.04 | 10.0% |
| 98th | 0.43 | -0.01 | -2.3% | 99th | 0.46 | 0.03 | 7.0% |
| 100th | 0.4 | -0.06 | -13.0% | 101st | 0.47 | 0.07 | 17.5% |
| 102nd | 0.65 | 0.18 | 38.3% | 103rd,∗ | 0.61 | -0.04 | -6.2% |
| 104th | 0.54 | -0.07 | -11.5% | 105th,∗ | 0.61 | 0.07 | 13.0% |
| 106th | 0.5 | -0.11 | -18.0% | 107th,∗ | 0.5 | 0.00 | 0.0% |
| 108th | 0.52 | 0.02 | 4.0% | 109th,∗ | 0.57 | 0.05 | 9.6% |
| 110th | 0.48 | -0.09 | -15.8% | 111th | 0.42 | -0.06 | -12.5% |
| 112th,∗ | 0.66 | 0.24 | 57.1% | 113th,∗ | 0.73 | 0.07 | 10.6% |
| 114th | 0.71 | -0.02 | -2.74% | ||||
| 86th-100th | 0.370 | -0.043 | -9.3% | 0.421 | 0.056 | 18.1% | |
| 101st-114th | 0.580 | 0.021 | 7.3% | 0.559 | 0.023 | 4.6% | |
| All | 0.468 | -0.013 | -1.5% | 0.481 | 0.039 | 11.3% | |
| 4 positive, 10 negative, 1 * | 9 positive, 4 negative, 6 * | ||||||
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The evolution of polarization in the legislative branch of government
Xiaoyan Lu
Social and Cognitive Networks Academic Research Center and Department of Computer Science, Rensselaer Polytechnic Institute, Troy NY 12180, USA
Jianxi Gao
Social and Cognitive Networks Academic Research Center and Department of Computer Science, Rensselaer Polytechnic Institute, Troy NY 12180, USA
Boleslaw K. Szymanski
Social and Cognitive Networks Academic Research Center and Department of Computer Science, Rensselaer Polytechnic Institute, Troy NY 12180, USA
Abstract
The polarization of political opinions among members of the U.S. legislative chambers measured by their voting records is greater today than it was thirty years ago. Previous research efforts to find causes of such increase have suggested diverse contributors, like growth of online media, echo chamber effects, media biases, or disinformation propagation. Yet, we lack theoretic tools to understand, quantify, and predict the emergence of high political polarization among voters and their legislators. Here, we analyze millions of roll-call votes cast in the U.S. Congress over the past six decades. Our analysis reveals the critical change of polarization patterns that started at the end of 1980’s. In earlier decades, polarization within each Congress tended to decrease with time. In contrast, in the recent decades, the polarization has been likely to grow within each term. To shed light on the reasons for this change, we introduce here a formal model for competitive dynamics to quantify the evolution of polarization patterns in the legislative branch of the U.S. government. Our model represents dynamics of polarization, enabling us to successfully predict the direction of polarization changes in 28 out of 30 U.S. Congresses elected in the past six decades. From the evolution of polarization level as measured by the Rice index, our model extracts a hidden parameter - polarization utility which determines the convergence point of the polarization evolution. The increase in the polarization utility implied by the model strongly correlates with two current trends: growing polarization of voters and increasing influence of election campaign funders. Two largest peaks of the model’s polarization utility correlate with significant political or legislative changes happening at the same time.
Introduction
Conflict and consensus play important role in the functioning of a social system. In the context of political competition they manifest themselves as polarization of opinions and collaboration to reach consensus on shared national interests [1]. Polarization arises from the politicians’ need to represent opinions of their voters while collaboration is required to balance the interests of many groups. Numerous previous publications have focused on the role of social conformity [3, 2, 4] in polarization. Among these publications, many hypotheses have been proposed to explain the observed emergence of increased polarization, including social homophily [5], selective exposure [6], social bots [7], echo chambers [8, 9], propagation of low-quality information or fake news [10, 11], as well as the effect of viral news [12] and social media [13]. While these models study different aspects of polarization of political views, they share some common assumptions about human social behavior [14], including the following: (i) individuals iteratively update their views to reach consensus with their neighbors in a social network; (ii) the tolerance of conflicting views is limited in social context, so frequent active disagreements usually break of social ties [15]. These assumptions indicate that the loyalty to one’s group usually leads to the conformity with views of the group’s majority [16], and such conformity tightens social ties within the group. Therefore, in our model, we allow the current polarization level to influence its future growth.
We analyze millions of roll-call votes cast in the U.S. Congress [17] over the past six decades to identify evolution of political polarization patterns. Using the roll-call vote results, we quantify the level of polarization in the legislative branch of government over the last six decades. We assume a social system dominated by two parties. In such a system polarization and collaboration can convert into each other but they maintain their sum constant at 1. A simple model of the dynamics of such conversion [19] can be written as
[TABLE]
where is the current polarization level, as measured by the real legislative votes, while is a parameter independent of the current polarization level. We call parameter the polarization utility in analogy to the role of gravitational utility in physics. The complementary values denoted as and represent the current collaboration level and the collaboration utility, respectively, while is the probability of collaboration converting to polarization per unit of time. For symmetry, represents the probability of polarization converting to collaboration per unit of time. Studying polarization in the U.S. Congress, we assume the evolution is fully governed by the nonlinear dynamics defined in Eq. [5]. However, every two years, the dynamical system moves to a new state determined by the election of members of the next Congress for which this state then becomes the initial state.
Up to the end of 1980’s, the polarization level within each Congress tended to decrease. Since then, however, the polarization has been likely to grow within two-year term of each Congress, as shown in Fig. 3A. This phenomenon is represented in our model by the change of the polarization utility, since it determines the polarization level to which the system converges, regardless of its initial state. As illustrated in Fig. 3B and 3C, the non-linear dynamics successfully predict the direction of polarization change in 28 out of 30 U.S. Congresses for the past six decades. The two Congresses that in disagreement with the model predictions have very small variations of polarization, with a weakly-defined polarization direction, making the predication error small. Moreover, Fig. 3D suggests that farther away is the initial polarization caused by member replacement from the corresponding equilibrium defined by our model, faster the polarization level changes during the two-year period between elections.
In our model, the non-linear gain-loss function quantifies the conversion between collaboration and polarization among legislators. The model implies that the polarization level always converges to an equilibrium point, while replacement of members in each Congress caused by election sets the new initial polarization level. We also derive an approximate analytic expression for the equilibrium points, which are defined by the polarization utility and the system’s sensitivity to the current polarization. Our model implies that the observed increased polarization in the recent few decades is caused by the growing polarization utility. This conclusion prompts the question about the causes of this growth. We address this question in the Discussion section.
Quantifying polarization in the legislative branch
We analyze millions of roll-call votes111The dataset is accessible at https://voteview.com/ cast in the U.S. Congress [17] over the past six decades to identify evolution of political polarization patterns. The statistics of the roll-call votes in Congresses with sessions numbered from 85 to 114 are shown in Tab. 1. This dataset contains approximately 7 million votes in both the Senate and the House of Representatives from a total of 1498 and 1395 legislators from Democratic and Republican Parties, respectively. We adopt the well-known Rice index [18] to measure party dissimilarity in legislative voting. The Rice index is defined as the mean absolute distance between the Yes-ratios of Democratic and Republican Parties on the bill
[TABLE]
where and denote the numbers of legislators from the Republican and Democratic Parties participating in the vote, while and are the votes cast by Republican and Democrat for bill , respectively. represents the corresponding average over all legislators in each party. The result of a vote is coded as 1 for Yes and 0 otherwise because the bills pass by majority in both the Senate and the House of Representatives and therefore abstaining is effectively equivalent to opposing bill passage. This procedure is illustrated in Fig. 1A.
Regardless of the content of bills, we compute the average distance of bill votes between two parties over every day intervals. Formally, the polarization level at the h day of the Congress is quantified as
[TABLE]
where is the set of bills voted within days centered at the th day of the Congress and starts at the day of each Congress and ends 99 days before the last day of this Congress. Hence, each measurement includes exactly 200 days of voting. This step is illustrated by Fig. 1C. The averaging reduces the noise of the raw data because the topics of the legislative bills may differ day-by-day in each Congress and there were several periods of times in the past six decades during which very few bills were voted on by the U.S. Congresses. Compared to the approaches [22, 20, 27] defining the conflicting level between individuals, the well-know Rice index defined in Eq. [2], reflects the general trend of behavioral partisanship while preserving its simplicity by quantifying polarization at party level. More importantly, the Rice index enables us to develop a dynamical equation, Eq. [4], which captures the macroscopic behavior of the evolution of political polarization, regardless of the complex interactions between individual legislators considered in [20].
For every Congress and each bill, we measure the distance between two parties using Eq. [2]. As , the political preference for bill is defined as for the Democratic Party and for the Republican Party. Then, using the kernel density estimation (KDE) [21], we evaluate the distribution of distances and , of Democratic and Republican Parties, respectively, from the center of the polarization range. Fig. 1B shows the distribution of these distances which represent positions of the two parties regarding the bills voted in each Congress.
Dynamical model of political polarization
We assume a two-party political system, such as exemplified by the United Kingdom, but applicable also to the U.S. and other countries with a multi-party system dominated by two major parties. We also assume a social system in which polarization and collaboration can convert into each other but preserve their sum at 1. A simple model of the dynamics of such conversion is given in [19] as
[TABLE]
where is the probability of collaboration converting to polarization per unit of time. For symmetry, represents the probability of polarization converting to collaboration per unit of time. Finally, is the current polarization level as measured by the real legislative votes, is the polarization utility parameter, and and are complementary to and , representing the current collaboration level and the collaboration utility (). Following [19], we assume that has the following simple form
[TABLE]
which is supported by the normative social influence theory [16] that postulates that the current polarization level influences the probability of conversion. To preserve symmetry under the conversion from to or vice versa, we define as
[TABLE]
Similar nonlinear gain-loss equations for the state dynamics have been successfully applied to model various types of polarization, ranging from religious affiliation [19], to language choice [24] and political affiliation [26]. The nonlinear dynamics defined here captures the conversion between polarization and collaboration during different periods. The parameter is independent of the polarization level which varies as the time changes. It reflects internal hidden polarization level in the legislative branch of government, which is not reflected from the vote results at that moment. The term captures the effect of the current polarization level on the evolution. The speed of evolution is defined by the parameter in our model.
The total energy [25] in this dynamical system is governed by the following equation.
[TABLE]
which is constant on the solution curves or trajectories of this system, i.e. for some constant . The total energy function in relation to the current polarization and its first order derivative is shown on the Fig. 2A for and Fig. 2B for .
Given the model parameters and , the equilibrium points of the dynamical system defined by Eq. [4] can be derived as
[TABLE]
The approximation uses the Taylor expansion of . Its detailed derivation is presented in the supporting material. The theoretical expression of equilibrium points closely matches the results found by numerical simulations.
The trajectories of the nonlinear dynamical evolution are shown in Fig. 2C-F where the x-axis represents time and the y-axis represents the polarization. Each trajectory curve starts from its initial polarization level which is represented by the z-axis. We show the surface of these convergence process for and the initial polarization in full range from to , in Fig. 2E. Fig. 2D contains similar visualization results with and initial polarization levels at the tipping points, i.e. the points at the edges in dark blue of Fig. 2F. The equilibrium points of the dynamical model are stable when . In such case, the dynamical system of Eq. [4] always converges to the after the sufficient period of evolution; Fig. 2C and 2E show example with . In contrast, when , the final state of the dynamical system depends on the initial state and the position of the tipping point; Fig. 2D and 2F show example with . The dynamical system will eventually converge to either or .
In the context of political polarization, the case with corresponds to a healthy political system which maintains the polarization level within a certain range. However, the case with , corresponds to a system which switches easily between fully polarized equilibrium point and complete consensus convergence point. In the U.S. political system, a change of the system initial state happens periodically every two years as a result of election or reelection of the legislators. The system near the tipping point at the end of one Congress is vulnerable to extreme state switching even under a small change of the initial polarization for the next Congress.
We simulate the non-linear dynamics defined by Eq. [4] until the polarization level converges. When , the equilibrium point is exactly the final polarization level of convergence. When the only equilibrium points are that corresponds to the full polarization, and that represents the opposite case of full consensus. Moreover some of the initial states are unstable; they are the tipping points from which the dynamical system nondeterministically converges to either of the two stable equilibrium points. We grid-search for them with different values of . In each iteration, we increase the value of by a small . If the final convergence states have changed from one state to another due to the increment of , then the current is identified as the tipping point.
Evolution of political polarization patterns
We fit the political polarization model defined by Eq. 4 to the data points which represent ten evenly-distributed in time sampled polarization levels at of the th Congress. The system is assumed to have the universal and values at all times, but each Congress has its own parameter defined as the polarization utility, and the particular initial state, , which is defined by the member replacements caused by the most recent election.
The inference procedure estimates the values of universal parameters at , while the set of values for , is shown in Fig. 3B-C. In Fig. 3B, we illustrate the estimated value of the Congress. In general, this value increases as the Congress session numbers grow from 85 to 114. The black solid curve in Fig. 3C shows the equilibrium points for different values with global parameter estimated from the voting data. To illustrate the impact of this parameter on values of the equilibrium points, the dotted lines represent these values for , and , respectively. This figure also illustrates that most of the Congresses last too short to allow the equilibrium point to be reached before the election or reelection of members defines new starting point of the system for the next Congress.
Since the estimate is smaller than 1, the dynamical system has a unique equilibrium point for any given . As shown in Fig. 3C, when the polarization level is larger than the stable equilibrium point , it decreases to approach this point. This explains why the polarization level decreases in most of the Congresses in the 1970’s and 1980’s. After the member replacement caused by the election, the initial polarization levels ’s during this period were usually higher than the corresponding stable equilibrium points of the dynamical system, see Fig. 3C. Therefore, the polarization level decreases within the two-year term Congress. In contrast, when the equilibrium point is larger than the initial polarization , the polarization increases over time to approach the equilibrium point. This explains why the polarization level increases in most Congresses after the 1980’s. Hence, the observed polarization patterns are fully recreated by the dynamics of our model.
It is worth noting that the initial polarization levels of the Congresses in the 1990’s are actually not significantly higher than those observed in the previous Congresses. However, the polarization utility has become larger and in the later decades exceeded as Fig. 3B and Table 2 indicate. Consequently, the polarization levels at the end of Congresses have significantly increased. This explains the rapid growth of polarization in the later Congresses. The sudden growth of polarization utility in the and Congresses (1989-1993), revealed by our model is in agreement with [20] which describes a dramatic change of polarization that started during the Clinton’s term (1993-1994), and solidified during the Congress (1995-1996). Thus, the growth of polarization utility came right before the growth of polarization because legislators need time to adjust voting to the increased polarization which has been reflected by the polarization utility. As seen in Fig. 3D, the absolute change of polarization grows as the distance between the initial state and equilibrium point increases. If the initial polarization level of a Congress is far away from the its final point of convergence, then the rapid change of polarization would be expected within the two-year term. The direction of such change in out of all Congresses are explained by the model, while the two Congresses in disagreement with the model prediction have very small variations of polarization level as shown by the yellow markers in Fig. 3C.
Another sign of changed polarization patterns is the number of Congresses in which initial polarization utility is at least 50%, making it equal to or stronger than then the collaboration utility as defined in Eq. [1]. Only one Congress among 15 in the first three decades reached this level, while it was achieved by 11 out of 14 Congresses in the last three decades.
In summary, our model explains the observed polarization patterns. In the 1970’s and 1980’s, the initial polarization is generally larger than the stable polarization , so we observe a decrease of polarization within each of two-year term Congress. In other words, the legislators gradually agree more and more with the members of the opposite party than initially, while they held more conflicting views at the very beginning of each Congress session. After the Congress (1989-1991), the initial polarization is generally smaller than the stable polarization level . Therefore, during the corresponding Congresses, the polarization increases to approach the corresponding equilibrium point defined by the given . This trend matches the transition observed during the and Congresses [20], when the moderate members of each party joined their majority-party coalitions, leaving the middle ground deserted.
Discussion
The dynamical model sheds some light on the causes of increased polarization in recent decades. As seen in Fig 3C, when is small, the resulting stable polarization level decreases as the value of increases, in response to the decreased probability of conversion from collaboration to polarization (cf.Eq. [4]). In this case, the dynamical system is less sensitive to the current polarization level because the term in Eq. [4] becomes smaller as grows. Therefore, when is small, a large value of decreases the polarization level. However, when the value of exceeds 1, some initial states become tipping points, from which the system evolves undeterministically towards one of the two possible extreme equilibrium points, one of which, , corresponds to the full polarization, while the other, , represents the full consensus. Below the tipping point, the system converges to one of these two points, and above, it evolves towards the other. In the U.S. political system, a change of the initial system state happens periodically every two years when the legislators are elected or reelected. The system in the neighborhood of a tipping point is vulnerable to even small change in initial polarization that may switch the system convergemce point from one extreme equilibrium point to another. Such abrupt and radical equilibrium point switching is absent when is smaller than 1.
According to our model, we witness a growth of the polarization utility, , over the recent decades. The question arises what are the causes of this increase. To answer this question, we start by observing that a politician needs to be elected to become legislators and repeatadly reelected to continue in this role. Thus, the polarization utility for them lies in its ability to bring votes. This can be accomplished either directly, by representing voters’ opinions, or by gaining resources for election campaign funding. In the case of direct support, the polarization of voters has been rising in recent decades for such reasons as the echo chambers effect [8, 9] and the growth of new, often strongly biased social media [13] or spread of misinformation [10, 11]. Voters increasing polarization raises the polarization utility, which is indirectly reflected as the phenomenon that legislators align their voting with positions of their electorates. The indirect support is gaining in importance because of escalating costs of political campaigns fueled by the growing numbers of effective advertising channels and raising costs of advertising [28].
To corroborate this conclusion, we identified two largest jumps in polarization utility resulting from election of Congress members (see Table 2). The first jump of 0.24 happened in 1960 so it coincides with the start of civil right movement, increasing the U.S. involvement in the Vietnam War, and generational changes in politics. In [22], the author observe that such “takeoff situations,” significantly increase polarization in the network structures of political connections. The second jump happened in year 2010, when the Supreme Court approved Super PACs which are allowed to collect unlimited contributions from many sources and to advocate for or against political candidates. Taming the causes of increased polarization is difficult. For example, requireing biased social media to provide time to advovates of the opposing opinions was shown to be counter productive [23].
The model introduced here implies that high polarization of voters makes the polarization utility higher to legislators, resulting in higher polarization in the legislative chambers of government. The question arises under what conditions the polarized politicians may in turn influence their electorates to become polarized even more. Finding these conditions is important because should such feedback loop arise, it might destabilize democracy. In our future research, we will attempt to address this question by developing a quantitative model of polarization dynamics of voters, to large extent shaped by the economic factors [29] and public opinions [30].
Acknowledgment
This work was supported in part by the Army Research Laboratory (ARL) through the Cooperative Agreement (NS CTA) Number W911NF-09-2-0053, and by the Office of Naval Research (ONR) under Grant N00014-15-1-2640. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies either expressed or implied of the Army Research Laboratory or the U.S. Government.
Supporting Material
Derivation of the equilibrium points
The equilibrium points of the dynamical model defined by Eq. [2.1] satisfy the following equation:
[TABLE]
Setting makes depending only on the equilibrium point , and yields the following:
[TABLE]
Substituting , yields:
[TABLE]
which becomes a constant 1 when approaches [math]. Using the Taylor expansion of and , we get:
[TABLE]
where . For for simplicity we can use the approximation with :
[TABLE]
Given the particular and and substituting back with and with , the equilibrium points of the dynamical system have the analytic expression
[TABLE]
To increase the precision of the approximation, we can use more terms in the Taylor expansion, for example
[TABLE]
decreases the relative error of approximation to the upper bound defined now as . This approximation’s relative error is small for quite large range, e.g., for and therefore , it is less than 0.3% for for the broader range so for , the precision of less than 0.15% requires . Applying the same transformation as before to Eq. [15], we get
[TABLE]
When , these equilibrium points are stable [19]. However, when , there are some initial states that are tipping points from which the system nondeterministically converges to one of the two extreme equilibrium points, either to full consensus or to full polarization. In the context of political polarization, the existence of tipping points changes the stability of the polarization evolution. When , and with the system in the neighborhood of a tipping point, in response to even a small perturbation of the system state, the system may change the converges from one extreme equilibrium point to another. When , the dynamical social system is more robust against the random perturbations because it always converges to the equilibrium point with some level of polarization.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Diamond L. Three paradoxes of democracy. Journal of Democracy . 1990;1(3):48–60.
- 2[2] Feldman S. Enforcing social conformity: A theory of authoritarianism. Political Psychology . 2003;24(1):41–74.
- 3[3] Turner J. Social influence. Thomson Brooks/Cole Publishing Corp.; 1991.
- 4[4] Klucharev V, Hytönen K, Rijpkema M, Smidts A, Fernández G. Reinforcement learning signal predicts social conformity. Neuron . 2009;61(1):140–151.
- 5[5] Mcpherson M, Smith-Lovin L, Cook J. Birds of a feather: Homophily in social networks. Annual Review of Sociology . 2001;27(1):415–444.
- 6[6] Stroud N. Polarization and partisan selective exposure. Journal of Communication . 2010;60(3):556–576.
- 7[7] Ferrara E, Varol O, Davis C, Menczer F, Flammini A. The rise of social bots. Communications of the ACM . 2016;59(7):96–104.
- 8[8] Garrett R. Echo chambers online?: Politically motivated selective exposure among Internet news users. Journal Of Computer-mediated Communication . 2009;14(2):265–285.
