Twists and Turns in the US-North Korea Dialogue: Key Figure Dynamic Network Analysis using News Articles
Sooahn Shin, Hyein Yang, and Jong Hee Park

TL;DR
This paper introduces a novel network analysis method to study key figure interactions in U.S.-North Korea relations using news article co-occurrence data, revealing predictive insights into diplomatic shifts.
Contribution
It develops a dynamic network analysis approach combining co-occurrence data with Bayesian hidden Markov models to identify structural changes linked to diplomatic events.
Findings
Network structure changes predict key diplomatic moments
Co-occurrence networks reflect key figure interactions
Method offers new insights into international relations dynamics
Abstract
In this paper, we present a method for analyzing a dynamic network of key figures in the U.S.-North Korea relations during the first two quarters of 2018. Our method constructs key figure networks from U.S. news articles on North Korean issues by taking co-occurrence of people's names in an article as a domain-relevant social link. We call a group of people that co-occur repeatedly in the same domain (news articles on North Korean issues in our case) "key figures" and their social networks "key figure networks." We analyze block-structure changes of key figure networks in the U.S.-North Korea relations using a Bayesian hidden Markov multilinear tensor model. The results of our analysis show that block structure changes in the key figure network in the U.S.-North Korea relations predict important game-changing moments in the U.S.-North Korea relations in the first two quarters of 2018.
| Name | Date | Summary | |
|---|---|---|---|
| Regime 1 | Nuclear Button | 01-0102-04 | Highest tension between U.S. and North Korea over a possible preemptive strike against North Korea’s nuclear facilities |
| Regime 2 | Winter Olympic | 02-0503-04 | The Winter Olympics in South Korea and North Korea’s participation |
| Regime 3 | Summit Announcement | 03-0503-11 | President Trump’s acceptance of Kim Jong-un’s summit letter |
| Regime 4 | Appointment of Pompeo | 03-1203-18 | President Trump appoints Mike Pompeo as the Secretary of State |
| Regime 5 | High-level Talks | 03-1906-03 | U.S.-North Korea High-level Talks |
| Regime 6 | Summit Eve | 06-0406-10 | Working-level discussion at Panmunjom for U.S.-North Korea summit |
| Regime 7 | Singapore Summit | 06-1106-17 | U.S.-North Korea summit in Singapore |
| Source | Date | Content | Figures mentioned in the article |
|---|---|---|---|
| Fox News | 2018.1.2 | North Korea team at Olympics should prompt US boycott, Graham says. South Korea has offered to hold high-level talks with rival North Korea next week …. Tuesday’s offer came a day after North Korean leader Kim Jong Un said in his New Year’s address that he was willing to send a delegation to the Pyeongchang Winter Olympics, …. But the prospect of a North Korean team at the Winter Games drew a blistering response Monday from U.S. Sen. Lindsey Graham, R-S.C., who proposed that if North Korea attends the Olympics, then the United States should not. …In 2014, Graham also pitched a boycott of the Winter Olympics in Sochi, Russia, objecting then to the prospect of Moscow offering asylum to NSA whistleblower Edward Snowden …Sung-Yoon Lee, a Tufts University Fletcher School professor and North Korea expert, told the Boston Herald that over the last 25 years the U.S. and its allies “have a less well-developed game plan and no real strategy.” | Lindsey Graham, Kim Jong Un, Edward Snowden, Sung-Yoon Lee |
| New York Times | 2018.1.2 | North Korea’s leader, Kim Jong-un, had suggested on Monday that the countries open dialogue on easing military tensions …President Trump responded somewhat cautiously to Mr. Kim’s overture early Tuesday, …Mr. Trump, referring to Mr. Kim, said: “Will someone from his depleted and food starved regime please inform him that I too have a Nuclear Button, but it is a much bigger & more powerful one than his, and my Button works!” …Speaking at the United Nations on Tuesday, the United States Ambassador, Nikki R. Haley, appeared to dismiss the potential for bilateral negotiations between North and South Korea. …Heather Nauert, the State Department spokeswoman, said the Trump administration was still assessing whether the United States supported direct talks between South Korea and North Korea that excluded the United States. Cho Myoung-gyon, the South’s point man on the North, …since President Moon Jae-in’s conservative predecessor, the impeached President Park Geun-hye, shut down a joint industrial complex in the North Korean town of Kaesong in early 2016. | Kim Jong Un, Trump, Nikki R. Haley, Heather Nauert, Moon Jae-in, Park Geun-hye, Cho Myoung-gyon |
| Name | Degree | Name | Degree | Name | Degree | Name | Degree |
|---|---|---|---|---|---|---|---|
| Kim Jong-un | 2447 | Ronald Reagan | 96 | Gina Haspel | 48 | Cory Gardner | 34 |
| Donald Trump | 2394 | Ivanka Trump | 90 | Rod Rosenstein | 48 | Joe Hagin | 34 |
| Moon Jae-in | 1025 | Chung Eui-yong | 85 | Nancy Pelosi | 47 | Michael J. Green | 33 |
| Mike Pompeo | 636 | Paul Ryan | 85 | Stephen K. Bannon | 47 | Robert Menendez | 33 |
| Mike Pence | 387 | Justin Trudeau | 82 | Christopher R. Hill | 46 | Wilbur Ross | 33 |
| John Bolton | 353 | Richard M. Nixon | 73 | Larry Kudlow | 46 | Peter Navarro | 32 |
| Barack Obama | 339 | Rudolph W. Giuliani | 72 | Marco Rubio | 46 | Suh Hoon | 32 |
| Xi Jinping | 339 | Kim Dae-jung | 71 | Roh Moo-hyun | 46 | Kim Dong Chul | 31 |
| George W. Bush | 324 | Michael Cohen | 71 | Choe Son-hui | 44 | Kim Sang-deok | 31 |
| Shinzo Abe | 241 | James Comey | 64 | John McCain | 44 | Ri Son Gwon | 31 |
| Rex Tillerson | 240 | Chuck Schumer | 63 | John Roberts | 41 | Jeffrey Lewis | 30 |
| Kim Jong-il | 228 | Dennis Rodman | 63 | Kang Kyung-wha | 41 | John Delury | 30 |
| Kim Yo Jong | 195 | Steven Mnuchin | 63 | Sung Y. Kim | 40 | Michael Flynn | 30 |
| Otto Warmbier | 162 | Mitch McConnell | 62 | Melania Trump | 39 | Adam Schiff | 29 |
| Kim Yong Chol | 160 | Joseph Yun | 60 | Park Geun-hye | 39 | Kim Jong Nam | 29 |
| Jim Mattis | 157 | Lindsey O. Graham | 59 | H.W. Bush | 38 | Rand Paul | 29 |
| Bill Clinton | 144 | Kim Yong Nam | 57 | Madeleine K. Albright | 38 | Taro Kono | 29 |
| Sarah Huckabee Sanders | 142 | Emmanuel Macron | 56 | Cho Myoung-gyon | 37 | Yoon Young-chan | 29 |
| Kim Il-sung | 131 | Heather Nauert | 55 | Saddam Hussein | 37 | Ma Ying-jeou | 28 |
| Robert Mueller | 128 | Jeff Sessions | 54 | Ji Seong-ho | 36 | Joel Wit | 27 |
| Hillary Clinton | 127 | Jared Kushner | 52 | Ri Sol Ju | 36 | Kim Hak Song | 27 |
| Vladimir Putin | 126 | Angela Merkel | 50 | Ri Yong Ho | 36 | Bruce Klingner | 26 |
| H.R. McMaster | 107 | Bob Corker | 50 | Bernie Sanders | 35 | Foster Klug | 26 |
| John F. Kelly | 106 | Jimmy Carter | 50 | Kim Eui-kyeom | 35 | Harry Harris | 26 |
| Victor Cha | 106 | Nikki R. Haley | 49 | Scott Pruitt | 35 | Jo Myong-rok | 26 |
| Robert Lighthizer | 26 | ||||||
| Sue Mi Terry | 26 |
| Break Number | |
|---|---|
| -15090.85 | |
| -13970.58 | |
| -13865.45 | |
| -13135.31 | |
| -13118.15 | |
| -13119.40 | |
| -12684.86 | |
| -12841.46 | |
| -12541.92 | |
| -12578.19 | |
| -12655.21 |
| Week | Starting Date | Ending Date |
|---|---|---|
| Week 1 | January 1, 2018 | January 7, 2018 |
| Week 2 | January 8, 2018 | January 14, 2018 |
| Week 3 | January 15, 2018 | January 21, 2018 |
| Week 4 | January 22, 2018 | January 28, 2018 |
| Week 5 | January 29, 2018 | February 4, 2018 |
| Week 6 | February 5, 2018 | February 11, 2018 |
| Week 7 | February 12, 2018 | February 18, 2018 |
| Week 8 | February 19, 2018 | February 25, 2018 |
| Week 9 | February 26, 2018 | March 4, 2018 |
| Week 10 | March 5, 2018 | March 11, 2018 |
| Week 11 | March 12, 2018 | March 18, 2018 |
| Week 12 | March 19, 2018 | March 25, 2018 |
| Week 13 | March 26, 2018 | April 1, 2018 |
| Week 14 | April 2, 2018 | April 8, 2018 |
| Week 15 | April 9, 2018 | April 15, 2018 |
| Week 16 | April 16, 2018 | April 22, 2018 |
| Week 17 | April 23, 2018 | April 29, 2018 |
| Week 18 | April 30, 2018 | May 6, 2018 |
| Week 19 | May 7, 2018 | May 13, 2018 |
| Week 20 | May 14, 2018 | May 20, 2018 |
| Week 21 | May 21, 2018 | May 27, 2018 |
| Week 22 | May 28, 2018 | June 3, 2018 |
| Week 23 | June 4, 2018 | June 10, 2018 |
| Week 24 | June 11, 2018 | June 17, 2018 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComputational and Text Analysis Methods · Complex Network Analysis Techniques · Korean Peninsula Historical and Political Studies
Twists and Turns in the US-North Korea Dialogue:
Key Figure Dynamic Network Analysis using News Articles
Sooahn Shin, Hyein Yang, and Jong Hee Park
Seoul National University
**Abstract
**In this paper, we present a method for analyzing a dynamic network of key figures in the U.S.-North Korea relations during the first two quarters of 2018. Our method constructs key figure networks from U.S. news articles on North Korean issues by taking co-occurrence of people’s names in an article as a domain-relevant social link. We call a group of people that co-occur repeatedly in the same domain (news articles on North Korean issues in our case) “key figures” and their social networks “key figure networks.” We analyze block-structure changes of key figure networks in the U.S.-North Korea relations using a Bayesian hidden Markov multilinear tensor model. The results of our analysis show that block structure changes in the key figure network in the U.S.-North Korea relations predict important game-changing moments in the U.S.-North Korea relations in the first two quarters of 2018.
Keywords: news articles, key figure network, hidden Markov multilinear tensor model
1 Motivation
News articles contain factual and interpretative information about political events and hence are a highly valuable source of textual data for the study of political science (Druckman, 2005; Gerber, Karlan and Bergan, 2009; Kim, 2018; Moeller et al., 2014; Moy et al., 2004; Gentzkow and Shapiro, 2010). There are two additional aspects of news articles that need to be stressed in political science research. The first is its sequential nature. Articles are generated sequentially, closely following everyday political events. Thus, the rise and fall of political issues or turning points in political events can be tracked and predicted by analyzing news articles as time series text data. The second, a less well-recognized than the first, aspect of news articles is that they contain valuable information about social networks among a wide range of actors such as academics, non-academic experts, lobbyists, think-tanks, private individuals, and politicians. Thus, news articles on a specific issue provide a rich source of dynamic network analysis on political actors involved in the public discourse or policy-decision on the issue.
The goal of this paper is to present a simple hybrid method that takes advantage of these two aspects of news articles to understand dynamics of political events. The case in our attention is the U.S.-North Korea relations in the first two quarters of 2018. During the entire period of 2017, North Korea had threatened the U.S. that North Korea could launch a nuclear attack on “the heart of the United States” if the U.S. attempts a regime change in North Korea. The aggressive tone in the often hostile exchanges further escalated in early 2018. In the New Year address of 2018, Kim Jung Un mentioned a nuclear button under his desk and President Trump replied by mentioning a bigger nuclear button under his finger. After the Winter Olympics, however, both sides withdrew provocative remarks and in March, President Trump accepted an invitation to the U.S.-North Korea summit, which was delivered by a South Korean envoy. Nevertheless in May, President Trump announced the cancellation of the summit, which he retracted only a week later. In June, the two leaders finally met in Singapore and had the first summit since the Korean War.
In this paper, we aim to understand dynamics of the U.S.-North Korea relations by analyzing dynamics of latent social networks among key figures in the U.S.-North Korea relations. Our method proceeds in the following order. First, we collect news articles containing the word “Korea” from the official sites of 4 major U.S.-based news providers — New York Times, Washington Post, Wall Street Journal, and Fox News — and build an initial corpus.111We chose these four news providers for two reasons. First, Wall Street Journal , New York Times, and Washington Post are chosen because they are leading daily newspapers in the U.S., holding a strong international reputation in covering a wide range of global issues. Their daily circulations are 1,180,460, 597,955, and 313.156, respectively as of 2017 (Pew Research Center, “Newspapers Fact Sheet” http://www.journalism.org/fact-sheet/newspapers/). Second, we added a television news channel, Fox News, to this list because of its special status under the Trump administration. More specifically, President Trump repeatedly endorsed Fox News for their “fair” coverage of his presidency (Trump, Donald (@realDonaldTrump), 12:33 PM - Nov 1, 2018) (Gaffey, 2017). Second, we extract from this initial corpus co-occurrence information of key figures in news articles and construct co-occurrence tensor (i.e. a array of by networks) of key figures. Last, we apply a Bayesian hidden Markov multilinear tensor model (Sohn and Park, 2017; Park and Sohn, 2018a) to the constructed co-occurrence tensor to identify structural changes in key figure networks.
This hybrid approach can be applied to any type of sequential text data containing proper network-specific (i.e. node and link) information and combined with other types of network methods such as community detection or latent space modeling. We call this hybrid approach Key Figure Dynamic Network Analysis (KF-DNA). The results of our analysis show that block structure changes in the key figure network in the U.S.-North Korea relations predict important turning points in the U.S.-North Korea relations during the first two quarters of 2018.
2 Key Figure Dynamic Network Analysis Method
Our proposed method (KF-DNA) can be summarized in the following three steps:
Construction of an initial corpus on U.S.-North Korea relations from news articles of four major US news agencies 2. 2.
Construction of co-occurrence tensor (i.e. a array of by networks) of key figures in news articles 3. 3.
Bayesian hidden Markov multilinear tensor analysis of co-occurrence tensor.
2.1 Construction of initial corpus
The main dataset of this study is news articles from four major U.S. news agencies — New York Times, Washington Post, Wall Street Journal, and Fox News — published between January 1, 2018 and June 16, 2018. We first scraped all news articles containing “Korea” between January 1, 2018 and June 16, 2018 from the websites of four major U.S. news agencies. Then, we performed elementary pre-processing operations on the scraped articles. For instance, we excluded irrelevant contents such as advertisements, photographs, book reviews, and video clips without textual information. We also removed duplicate news articles posted more than once, only keeping the original articles. There remained 2,951 news articles after pre-processing.
2.2 Construction of co-occurrence tensor
Using the initial corpus of Korea-related news articles, we construct a co-occurrence tensor of key figures. Unlike citation network analysis (Price, 1965; Newman, 2001) in which node sets are easily identifiable, identification of “key figures” is one of the most challenging tasks, considering that researchers in general do not know who the key figures are in a particular issue. We tried to solve this problem by first identifying a name in an article, factoring in the variant spellings of names, the absolute frequency and the frequency over the time-period of study. To identify a name, we used a list of U.S. surnames provided by the U.S. Census Bureau (https://www2.census.gov) and a list of Korean surnames from Statistics Korea (http://kostat.go.kr) to identify people’s names in the initial corpus. We paid close attention to spelling variations arising from anglicization, typos, and the presence or the absence of middle names and made appropriate adjustments.222For example, North Korean leader Kim Jong-un appears as “Kim Jong Un”,“Kim Jung Un”, “Kim Jung Eun”, “Mr. Kim,” or “Leader Kim.” We considered a name a part of “key figures” if it was mentioned at least ten times in the corpus. We further put a threshold on names based on the frequency consistency. That is, we chose the names that show up at least a quarter of the entire period. In the end, there remained 34 names of key figures of the U.S.-North Korea relations.
The next step was to construct an co-occurrence tensor of the 34 key figures. Given the six-month window, we decided to aggregate information by week. We counted the frequency of co-occurrence of the names of the key figures on weekly basis. Figure 1 shows the structure of the key figure network data, where , , , denote, repectively, the th potential key figure, the th article of the th week,the number of articles in th week, and a people co-occurrence matrix at week .
The first matrix in Figure 1 indicates key figure-article matrix having each key figure in each row and each article in each column. Note that each entry in the matrix takes either [math] (no-occurrence) or (occurrence). The second matrix is a transpose of the first matrix. Multiplying these two matrices produces a co-occurrence matrix of all the key figures. From this matrix, we extract the co-occurrence of the selected key figures and construct .
2.3 Bayesian hidden Markov multilinear tensor analysis
Sohn and Park (2017) and Park and Sohn (2018a) presented a Bayesian hidden Markov multilinear tensor method (HMTM) for analyzing block structure changes in longitudinal network data. The method extends Hoff (2015)’s Bayesian multilinear tensor model into change-point analysis. The HMTM first corrects degree information in longitudinal network data in order to filter confounding information of the baseline expectation of associations among pairs of nodes when the quantity of our interest lies in the discovery of latent block structures (Peixoto, 2013). For degree-correction, we use a principal eigen matrix , consisting of the principal eigenvalue () and its associated eigenvector: . Now, let denote a hidden state variable ( for ) and denote a by transition matrix where is the th diagonal element of . Then, a HMTM with breaks is
[TABLE]
where is the initial probability () and is a Beta distribution. The core part of the HMTM is the decomposition of longitudinal network data into regime-dependent where represents regime-dependent latent node positions and represents time-varying network generation rules.333The algorithms are available at NetworkChange (Park and Sohn, 2018b), which is an open-source R package. A brief discussion of HMTM is available in Supplementary Material.
3 Results
Table 1 reports a descriptive summary of seven regimes, which is in a chronological order of events, uncovered by our change-point analysis.444It turns out that the six break model is the most reasonable choice given the data and the chosen model. Readers are advised to consult the Supplementary Material for detailed discussions on break number detection using log marginal likelihoods regarding this choice. The change-point analysis captures important turning points of the U.S.-North Korea relations during the first two quarters of 2018. Based on our reading of the case, we label each regime Nuclear Button, Winter Olympic, Summit Announcement, Appointment of Pompeo, High-level Talks, Summit Eve, and Singapore Summit.
Regime 1 corresponds to the period of the highest tension between two countries. During this period, the Trump administration was allegedly considering a preventive attack on North Korea’s nuclear facilities (so-called bloody nose operation). Regime 2 points to a period of the Winter Olympics during which North Korea attempted several rounds of dialogues with South Korea and the U.S. Regime 3 covers a period of the warm relationship between North Korea and the U.S., which started from Kim Jong-un’s letter which suggested a summit with President Trump. Regime 4 represents the period when President Trump fired Rex Tillerson and replaced him as Mike Pompeo. Regime 5 covers high-level talks between U.S.and North Korea. Regime 6 corresponds to working-level discussion between U.S. and North Korea regarding summit. Finally, Regime 7 covers the week of the U.S.-North Korea summit in Singapore.
Figure 2 shows the network topology of regime changes in the key figure networks. We highlight several interesting patterns.
First, Jim Mattis, Rex Tillerson, and H.R. McMaster very often co-occur during the Nuclear Button regime. During this period, H.R. McMaster was reported to be one of the most active proponents of a preventive attack on North Korea – so-called “bloody nose operation” – while Rex Tillerson and Jim Mattis allegedly opposed a preventive attack on North Korea within the National Security Council.
The second notable pattern in Figure 2 is the co-occurrence network of U.S. Vice president Mike Pence and Kim Yo Jong during Regime 2, with the latter being the younger sister of Kim Jong-un who visited the 2018 Winter Olympics opening ceremony in Pyeongchang, South Korea as a special envoy of Kim Jong-un. Mike Pence also visited the 2018 Winter Olympics and there was a speculation that they might hold a meeting during their stay in South Korea, which reportedly did not happen.
The third notable pattern is that names of former U.S. presidents (ex. George W. Bush, Barack Obama, and Bill Clinton) very often co-occur. During the sample period, many news articles compared the Trump administration’s approach to North Korea with the approaches of previous U.S. administrations.
A strong link between Mike Pompeo and Rex Tillerson during Regime 4 was due to the taking office of Mike Pompeo for the Secretary of State replacing Rex Tillerson. From then on, Mike Pompeo has become a central figure in the U.S.-North Korea relationship. John Bolton who replaced H.R. McMaster as national security adviser shows a similar pattern with H.R. McMaster but the number of their co-appearances is much smaller than the duo of Pompeo-Tillerson.
The center and right panels in the second row of Figure 2 (Regime 5 and Regime 6) show that Xi Jinping became more important during these periods. Since Kim Jong-un’s surprise visit to China on March 11, President Trump had complained that China interfered in U.S.-North Korea talks.555For example, on May 18, 2018, President Trump said “It could very well be that he[Xi Jinping]’s influencing Kim Jong-un. We’ll see what happens.” South China Morning Post, “Donald Trump says North Korea could have been ‘influenced’ by Xi Jinping to turn on US ahead of talks with Kim Jong-un” May 18, 2018. Various sources reported that Trump canceled the summit to send North Korea a message that China should not meddle with the US-North Korea dialogue.
Lastly, Robert Mueller’s strong links to other key figures in Regime 1 are due to the co-occurrence of the U.S.-North Korea issues with the Russia investigation by Special Counsel Robert Mueller. However, the two issues appear separately in news articles after Regime 1 as both issues became important issues. Accordingly, Robert Mueller’s links to other key figures became weaker after Regime 1.
4 Conclusion
In this paper, we presented a simple method for analyzing a dynamic network of key figures in the U.S.-North Korea relations by taking co-occurrence of people’s names in an article as a domain-relevant social link. We called a group of people that co-occur repeatedly in the same domain the “key figures” and their corresponding social networks the “key figure networks.” Then, we analyzed block-structure changes of the key figure networks in the U.S.-North Korea relations using a Bayesian hidden Markov multilinear tensor model.
The results of our analysis showed that block structure changes in the key figure network in the U.S.-North Korea relations are highly consistent with important turning points in the U.S.-North Korea relations during the first two quarters of 2018. We also found that the rise and fall of key figures in the key figure network closely reflect the fluctuations of their importance or relevance in each phase. Our method can be applied to other text data that contains information of latent social links among important political actors. One example that we have been investigating is the UN General Debate Corpus. This data contains speeches of country representatives that address important international or country-specific issues.
There are many directions for future developments of our method. One direction is to distinguish the nature of co-occurrence links. For example, the nature of co-occurrence links could be positive, negative, or directional. Also, we could build a bipartite network between terms (or phrases) and key figures. Some key figures appear more frequently with certain terms than others. Advanced text analysis methods such as word embeddings (Pennington, Socher and Manning, 2014) or structural topic model (Roberts, Stewart and Airoldi, 2016) combined with various network analysis methods will allow us to uncover important latent social networks from political text data.
News Articles and Key Figures
Table 2 shows an example of news articles and key figures mentioned in the article.
A summary of the pre-processed data is shown in Figure 3.
Descriptive Information of Key Figure Networks
Figure 4 displays key figure networks from January 1, 2018 to June 17, 2018 by aggregating key figure networks on a weekly basis. We chose 15 weeks for better display in the paper.
Figure 5 shows the degree centrality scores of the 34 key figures in the U.S.-North Korea relationship. Dark colors indicate high degree centrality scores with light colors indicating the opposite. This clearly shows the rise and fall of some key figures. For example, the degree centrality scores of Rex Tillerson and H.R. McMaster dropped after Week 14 and Week 15 while the degree centrality scores of John Bolton and Mike Pompeo increased after Week 10 and Week 11. However, the degree centrality does not show relational information (i.e. who is connected with whom). In other words, changes in the key figure networks of the U.S.-North Korea relationship must have occurred between other key figures. As such, we drop three key figures (namely, Kim Jong-un, Donald Trump, and Moon Jae-in) from the data for the change-point analysis since Kim Jong-un, Donald Trump, and Moon Jae-in have high degree centrality scores throughout the entire sample period. Figure 6 shows betweenness centrality of key figure networks across 24 weeks.
Table 3 summarizes top 100 of key figures based on the total number of news articles that mentioned each figures.
A Brief Introduction of Hidden Markov Tensor Model
Tensor decomposition is becoming a standard means to analyze longitudinal network datasets (Hoff, 2009, 2011; Rai, Wang and Carin, 2015; Hoff, 2015; Minhas, Hoff and Ward, 2016; Johndrow, Bhattacharya and Dunson, 2017; Han and Dunson, 2018). A longitudinal network data set can be represented as a tensor , which is an array of square matrices . Here informs the dyadic relationship between actors and at time .
HMTM is a dynamic network model using Hoff (2011, 2015)’s multilinear tensor regression model (MTRM), which is a multilayer (i.e. tensor) extension of the latent space approach to network data. MTRM allows us to decompose longitudinal network data into node-specific (or row and column) random effects and time-specific (or layer-specific) random effects.
Following the MTRM, the HMTM decomposes the degree corrected network data at as a bilinear product of latent node positions and dimension weights subject to hidden state changes:
[TABLE]
For prior distributions of and , we follow Hoff (2011)’s hierarchical scheme with two major modifications. First, we orthogonalize each column of using the Gram-Schmidt process (Björck, 1996; Guhaniyogi and Dunson, 2015) in each simulation step. Hoff (2011)’s hierarchical scheme centers rows of around its global mean () using a multivariate normal distribution. This does not guarantee the orthogonality of each latent factor in . The lack of orthogonality makes the model unidentified, causing numerical instability in parameter estimation and model diagnostics (Murphy, 2012; Guhaniyogi and Dunson, 2015).
Second, we use independent inverse-gamma distributions instead of inverse-Wishart distribution for the prior distribution of a variance parameter (). The use of inverse-Wishart distribution for the prior distribution of a variance parameter () comes at a great cost because choosing informative inverse-Wishart prior distributions for and is not easy (Chung et al., 2015) and a poorly specified inverse-Wishart prior distribution has serious impacts on the marginal likelihood estimation. In our trials, the log posterior inverse-Wishart density of and often goes to a negative infinity, failing to impose proper penalties. In HMTM, the off-diagonal covariance of is constrained to be 0, thanks to the Gram-Schmidt process, and the off-diagonal covariance of is close to 0 as measures time-varying weights of independent . Thus, inverse-gamma distributions resolve a computational issue without a loss of information.
The resulting prior distributions of and are matrix-variate normal distributions in which each column vector ( and ) follows a multivariate normal distribution. We first discuss the prior distribution of :
[TABLE]
The prior distributions of are similar to but one difference is that only diagonal elements of are modeled as a multivariate normal distribution:
[TABLE]
Then, we complete the model building by introducing HMM-related prior specifications following Chib (1998):
[TABLE]
where is the initial probability of a non-ergodic Markov chain ().
MCMC Algorithm for Hidden Markov Tensor Model
For each layer, generate by choosing a null model ().
Set the total number of changepoints and initialize (.
Part 1
Step 1
The sampling of regime specific consists of the following three steps for each regime . Let \Psi_{u}=\left(\begin{array}[]{ccc}\psi_{1,u,m}&\ldots&0\\ 0&\psi_{r,u,m}&0\\ 0&\ldots&\psi_{R,u,m}\end{array}\right).
- 1.
. 2. 2.
. 3. 3.
where
[TABLE] 4. 4.
Orthogonalize using the Gram-Schmidt algorithm.
Step 2
The sampling of is done for each regime. Let \Psi_{v}=\left(\begin{array}[]{ccc}\psi_{1,v,m}&\ldots&0\\ 0&\psi_{r,v,m}&0\\ 0&\ldots&\psi_{R,v,m}\end{array}\right).
- 1.
. 2. 2.
. 3. 3.
where
[TABLE]
Step 3
The sampling of from where
[TABLE]
is the number of time units allocated to state and is an element of .
Step 4
The sampling of from .
Part 2
Step 5
Sample recursively using Chib (1998)’s algorithm. The joint conditional distribution of the latent states can be written as the product of numbers of independent conditional distributions:
[TABLE]
Using Bayes’ Theorem, Chib (1998) shows that
[TABLE]
The second part on the right hand side is a one-step ahead transition probability at , which can be obtained from a sampled transition matrix (). The first part on the right hand side is state probabilities given all data, which can be simulated via a forward-filtering-backward-sampling algorithm as shown in Chib (1998).
Step 5-1
During the burn-in iterations, if sampled has a state with single observation, randomly sample with replacement using a pre-chosen perturbation weight ().
Part 3:
Step 6
Sample each row of from the following Beta distribution:
[TABLE]
where is the probability of staying when the state is , and is the number of jumps from state to , and is the number of jumps from state to .
Model Diagnostics
Figure 7 shows that average loss and WAIC prefer a HMTM with six breaks. The approximate log marginal likelihood () shows a decaying pattern as we increase the break number in general. This is a general pattern in mixture models due to the appearance of singleton states (i.e. hidden components with only one observation) in mixture models with a large number of components. We note a kink in the six break model, indicating adding one more break to the five break model improves the model fit while adding more than one break deteriorates the model fit. Note the same pattern in the log likelihoods in Figure 7. Table 4 shows the numerical results of the approximate log marginal likelihood test. For these reasons, we determined that the six break model is most reasonable given the data.
Epoch Converter
Table 5 shows the week number in our analysis and its corresponding dates.
Results
Figure 8 shows regime-specific latent node positions of key figures.
Discussions of Hidden Regimes
Names of former U.S. presidents (ex. George W. Bush, Barack Obama, and Bill Clinton) very often co-occur because many news articles compared the Trump administration’s approach to North Korea with the approaches of previous U.S. administrations. For example, The Washington Post reports on March 19, 2018:
“If he [President Trump] is, in fact, serious about this decision and expects to strike a deal with the North Koreans regarding their growing nuclear arsenal, he should seek the counsel of three people: former presidents Jimmy Carter and Bill Clinton, and former secretary of state Madeleine Albright. … Though none of them were ultimately successful in persuading North Korea to commit to a meaningful long-term weapons deal, they did achieve some positive results, especially regarding the release of imprisoned Americans.”
The Washington Post, “The one thing Donald Trump should do before meeting with Kim Jong Un”, March 19, 2018. Right after the summit, The Washington Post also notes
“When President Bill Clinton struck a landmark deal with North Korea in 1994, the isolated nation agreed to take a variety of specific steps that included freezing and later dismantling its nuclear program, as well as opening its facilities to international inspectors.”
The Washington Post, “Compared with Trump, previous presidents extracted more concessions from N. Korea, experts say”, June 12, 2018.
Xi Jinping became more important during Regime 5 and Regime 6 after Kim Jong-un’s surprise visit to China on March 11. Since then, President Trump had complained that China interfered in U.S.-North Korea talks.666For example, on May 18, 2018, President Trump said “It could very well be that he[Xi Jinping]’s influencing Kim Jong-un. We’ll see what happens.” South China Morning Post, “Donald Trump says North Korea could have been ‘influenced’ by Xi Jinping to turn on US ahead of talks with Kim Jong-un” May 18, 2018. Various sources reported that Trump canceled the summit to send North Korea a message that China should not meddle with the US-North Korea dialogue.
For example, according to The New York Times,
“The [summit cancellation] decision may also fan tensions between the United States and China. Mr. Trump has said he believes North Korea’s tone changed after Mr. Kim met President Xi Jinping in the coastal Chinese city of Dalian in early May. Mr. Trump suggested that Mr. Xi might be using China’s influence over North Korea as leverage in trade negotiations with the United States.
The New York Times, “Trump Pulls Out of North Korea Summit Meeting With Kim Jong-un” May 24, 2018.
And, The Wall Street Journal reports
“Mr. Trump considered canceling the meeting late Wednesday after a senior North Korean envoy ridiculed Vice President Mike Pence, calling him a ”political dummy,” and warned that Pyongyang could inflict on America an ”appealing tragedy that it has never experienced nor even imagined.” …A U.S. intelligence official told The Wall Street Journal there was a notable shift in Mr. Kim’s attitude immediately following his meeting with Mr. Xi. Intelligence officials assessed that Mr. Xi had some influence on that shift in an effort to place pressure on the Trump administration, the official said.”
The Wall Street Journal, “President Donald Trump Cancels North Korea Summit”, May 24, 2018.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1)
- 2Björck (1996) Björck, Ake. 1996. Numerical Methods for Least Squares Problems . SIAM.
- 3Chib (1998) Chib, Siddhartha. 1998. “Estimation and comparison of multiple change-point models.” Journal of econometrics 86(2):221–241.
- 4Chung et al. (2015) Chung, Yeojin, Andrew Gelman, Sophia Rabe-Hesketh, Jingchen Liu and Vincent Dorie. 2015. “Weakly Informative Prior for Point Estimation of Covariance Matrices in Hierarchical Models.” Journal of Educational and Behavioral Statistics 40(2):136–157.
- 5Druckman (2005) Druckman, James N. 2005. “Media Matter: How Newspapers and Television News Cover Campaigns and Influence Voters.” Political Communication 22(4):463–481.
- 6Gaffey (2017) Gaffey, Conor. 2017. “A Short History of Donald Trump’s Relationship with Fox News.” Newsweek ( https://www.newsweek.com/donald-trump-fox-news-576064 ).
- 7Gentzkow and Shapiro (2010) Gentzkow, Matthew and Jesse M Shapiro. 2010. “What Drives Media Slant? Evidence from US Daily Newspapers.” Econometrica 78(1):35–71.
- 8Gerber, Karlan and Bergan (2009) Gerber, Alan S, Dean Karlan and Daniel Bergan. 2009. “Does the Media Matter? A Field Experiment Measuring the Effect of Newspapers on Voting Behavior and Political Opinions.” American Economic Journal: Applied Economics 1(2):35–52.
