Content Analysis in Political Science

View PDF version

 Words Matter in Political Science

Politics, political theory and political change are often expressed through the spoken and written word and political science is influenced by many other disciplines including: economics, history, law, sociology, philosophy and psychology.

Political analysis involves researching news articles, magazines, advertisements, speeches, press releases, social media and much more. The volume of available text has exploded in the digital age. This explosion is partly due to the rapid move to store and distribute documents in electronic text databases. The easiest way to acquire text in this form is from online databases. Lexis/Nexis, Factiva, and ProQuest, for example, facilitate batch downloads of text files. More sources are being added all the time; The U.S. House of Representatives recently launched a new Web site dedicated to the distribution of all current House Resolutions under study. Text data stored on Web sites can also be extracted with automated scraping methods that make acquiring data easier (Jackman, 2006). The most difficult to acquire are texts found in archives or yet-to-be scanned books. But preparing these texts for analysis can be straightforward—using a high-quality scanner and OCR software, it is possible to convert archival materials into computer-readable texts (see the data collection process in Eggers and Hainmueller, 2009).

Why use a Content Analysis Software?

It is extremely time consuming, expensive and in many cases impossible to read each and every document related to one’s research.  Text analytics software makes it possible to systematically import and analyze very large volumes of text documents without spending months of fastidious reading or vast sums on hiring coders. The software gives researchers the flexibility of manual computer assisted, or fully automated coding of documents. It can dramatically assist you in your research by automatically identifying keywords, key phrases, themes, topics, images, speakers and sentiment.

As stated in Grimmer & Stewart, 2013 “Automated content analysis methods have demonstrated performance across a variety of substantive problems and rather than replace humans, computers amplify human abilities” and that “the most productive line of inquiry is to identify the best way to use both human and automated methods for analyzing text.”

We agree and this is why Provalis Research’s solution offers the possibility of combining the computer assisted manual coding of QDA Miner and the automated or semi-automated text analysis techniques of WordStat.

Analyze textual data from many sources

Political scientists have applied automated content analysis across a diverse set of texts. This includes archives of media data (Young & Soroka, 2011); floor speeches in legislatures from across the world (Quinn et al., 2010); presidential, legislator, and party statements (Grimmer, 2010); proposed legislation and bills (Adler & Wilkerson, 2011); committee hearings (Jones, Wilkerson, & Baumgartner ,2009); treaties (Spirling, 2012); newspapers and Twitter feeds (Conway, Kenski, & Wang, 2015); political science papers; and political text from many other sources.

Perform Content Analysis with QDA Miner and WordStat

Exploring large amounts of text data and assigning text to categories is the most common use of text analysis software in political science. For example, WordStat’s text mining abilities such as topic modeling and clustering can automatically identify relevant topics and compare topic frequencies between politicians, political parties or discourse. When we compared topics mentioned during the 2008 US presidential campaign, we saw instantly that “health care” was more frequently mentioned by Democratic candidates than Republican candidates. A crosstab and correspondence analysis plot can be used to compare words, phrases or topics between different candidates and identify those that are more frequently mentioned by a specific politician or group of politicians by the similarity of their speeches.

The content analysis capabilities of WordStat are also frequently used by political researchers. Dictionary methods use the relative frequency of key words and key phrases to measure the presence of each category in texts. One may also apply supervised machine learning methods to replicate the familiar manual coding task, but with a computer. First, human coders are used to classify a subset of documents into a predetermined categorization scheme. Then, this training set is used to train the computer, which then classifies the remaining documents.

Build and Apply Content Analysis Dictionaries

 Using WordStat, you can build dictionaries with key words, key phrases and proximity rules to focus on specific subjects or areas of interest. For example, in analyzing different speeches from different candidates in an election cycle you could build a dictionary related to certain policy discussions you wished to focus on such as foreign policy, economics, domestic policy, the environment, immigration, national security, etc.

One can not only measure what politicians or other actors are talking about but also the tone of their discourse by using or building a sentiment analysis dictionary. In our white paper on Sentiment Analysis with WordStat we discuss the pros and cons of different methods of sentiment analysis and how it has been used by others in different fields.

Transforming text into quantitative data

Importing data: You can import data directly from Email, web survey platforms, Facebook, Twitter, Reddit, reference management tools, RSS feeds, MS Word, RTF, HTML, PDF, EXCEL, MS Access, CSV, SPSS, the document conversion wizard allows you to import from databases such as Lexis/Nexis.

Coding and Annotating: In QDA Miner, documents can be coded and annotated manually or with several computers assistance tools, such as Boolean text searches, query-by-example searches, section retrieval, and several other techniques. The unique cluster retrieval tool is a very efficient way of coding similar tweets, short comments, or responses to open-ended questions. The availability of all these tools gives you the option of performing pure qualitative coding by systematically reading and manually tagging the text or using computer assistance to speed up the process.

Word and Phrase Frequencies: WordStat can process more than 300,000 words per second producing frequency counts of significant words, extract common phrases and produce visual displays such as bar charts, bubble charts, word clouds and more.

Automatically Identify Topics: WordStat’s text mining abilities can quickly identify relevant topics across different speakers or texts to explore what politicians or political discourse may have in common or what sets them apart.

Comparative Analysis: Political scientists commonly place certain texts or text subjects into categories and compare them with other documents, the frequency they occur or what actor is or is not espousing them. For example, one group may be proposing an isolationist policy while another is proposing a more interventionist one.  One party may be pushing free trade while another is advocating higher tariffs.  The software’s ability to compare frequencies of words, phrases or content categories across different sources or find changes over time can help you identify the evolution of these positions overall and for specific actors.

Visual Presentation: You can create presentation quality visual representations with a variety of charts or maps such as bar charts, line charts, word clouds, dendrograms, 2D or 3D multidimensional scaling plots, heatmaps, network graphs, and correspondence plots.

Geocoding and Mapping: Both QDA Miner and WordStat can extract geographic information such as longitude and latitude, postal codes, IP addresses, place names and use that information to plot maps of interactive data points, heatmaps and distribution maps. These tools can help you present your analysis by showing how a particular political concept built over time from one region to another or how strong voting blocks in different areas of a state or regions influenced the outcome of a specific election or waned over time.

Explore what the software can do for you. You can try out all the capabilities of QDA Miner and WordStat by downloading a 30-day trial version from our website provalisresearch.com.

Sample Studies in Political Science Using QDA Miner and WordStat

Hundreds of studies in political science have been written with the assistance of QDA Miner and WordStat. The following are a few selected examples.

Beauregard, P. (2016). Taking Flight or Crashing Down? European Common Foreign Policy and International Crises. Journal of European Integration, 38, 375-392.

Borchers, T., & Miller, J. L. (2014). Bain & Political Capital in the 2012 GOP Primary Debates. American Behavioral Scientist, 58(4), 574-590.

Brandini, S. (2015). A Mixed Methods Analysis of Students’ Views of Politics. Procedia-Social and Behavioral Sciences, 177, 273-277.

Canetti, D., Waismel-Manor, I., Cohen, N., & Rapaport, C. (2014). What Does National Resilience Mean in a Democracy? Evidence from the United States and Israel. Armed Forces & Society, 40(3), 504-520.

Cassese, E. C., Bos, A. L., & Schneider, M. C. (2014). Whose American Government? A Quantitative Analysis of Gender and Authorship in American Politics Texts. Journal of Political Science Education, 10(3), 253-272.

Cogburn, D.L. & Espinoza-Vasquez, F.K. (2011). From networked nominee to networked nation: Examining the impact of Web 2.0 and social media on political participation and civic engagement in the 2008 Obama campaign. Journal of Political Marketing, 10, 189-213.

Conway, B. A., Kenski, K., & Wang, D. (2013). Twitter Use by Presidential Primary Candidates During the 2012 Campaign. American Behavioral Scientist, 57(11), 1596-1610.

Curran, D., & Holtom, P. (2015). Resonating, Rejecting, Reinterpreting: Mapping the Stabilization Discourse in the United Nations Security Council, 2000–14. Stability: International Journal of Security and Development, 4(1), 1-18.

Krašovec, A., & Deželan, T. (2015). The Enduring Low Levels of Europeanization of Slovenian Political Parties: Evidence from Election Manifestos. Politologicky Casopis, 22(2), 127-146.

Lawlor, A. (2015). Local and National Accounts of Immigration Framing in a Cross-national Perspective. Journal of Ethnic and Migration Studies, 41, 918-941.

Myers, N. (2016). Democracy, Rights, Community: Examining Ethical Frameworks for Federal Public Health Emergency Response. Public Integrity, 18(2), 201-226.

Oleinik, A. (2015). The value of freedom: a case study of Ukraine. Southeast European and Black Sea Studies, 15, 239-259.

Paquin, J. (2012). Is Ottawa following Washington’s Lead in Foreign Policy? Evidence from the Arab Spring. International Journal: Canada’s Journal of Global Policy Analysis, 67(4), 1001-1028.

Schäfer, M. S., Scheffran, J., & Penniket, L. (2016). Securitization of media reporting on climate change? A cross-national analysis in nine countries. Security Dialogue, 47(1), 76-96.

Tolley, E. (2015). Racial Mediation in the Coverage of Candidates’ Political Viability: A Comparison of Approaches. Journal of Ethnic and Migration Studies, 41, 963-984.

Wagner, A., Grobelski, T., & Harembski, M. (2015). Is energy policy a public issue? Nuclear power in Poland and implications for energy transitions in Central and East Europe. Energy Research & Social Science. 13, 158-169.

Young, L., & Soroka, S. (2012). Affective News: The Automated Coding of Sentiment in Political Texts. Political Communication, 29(2), 205-231.

Share this page