Assessment of the Validity of Sentiment Analysis as a Tool to Analyze the Emotional Content of Text

Authors: Trisha Malhotra

Abstract:

Sentiment analysis is a recent field of study that computationally assesses the emotional nature of a body of text. To assess its test-validity, sentiment analysis was carried out on the emotional corpus of text from a personal 15-day mood diary. Self-reported mood scores varied more or less accurately with daily mood evaluation score given by the software. On further assessment, it was found that while sentiment analysis was good at assessing ‘global’ mood, it was not able to ‘locally’ identify and differentially score synonyms of various emotional words. It is further critiqued for treating the intensity of an emotion as universal across cultures. Finally, the software is shown not to account for emotional complexity in sentences by treating emotions as strictly positive or negative. Hence, it is posited that a better output could be two (positive and negative) affect scores for the same body of text.

Keywords: Analysis, data, diary, emotions, mood, sentiment.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.3607860

References:

[1] An, S., Ji, L., Marks, M., & Zhang, Z. (2017). Two Sides of Emotion: Exploring Positivity and Negativity in Six Basic Emotions across Cultures. Frontiers in Psychology,8. doi:10.3389/fpsyg.2017.00610.
[2] American Educational Research Association, American Psychological Association &National Council on Measurement in Education. (1999). Statistics for educational and psychological testing. Washington DC: American Educational Research Association.
[3] B. (2016, June 16). Differences between Polarity and Topic-based Sentiment Analysis. https://blog.bitext.com/polarity-topic-sentiment-analysis.
[4] Bing Liu. (2012, May) Sentiment Analysis and Opinion Mining, Morgan & Claypool Publishers.
[5] Kouloumpis, Efthymios& Wilson, Theresa & Moore, Johanna. (2011). Twitter Sentiment Analysis: The Good the Bad and the OMG! ICWSM.
[6] Miyamoto, Yuri & D Ryff, Carol. (2011). Cultural differences in the dialectical and non-dialectical emotional styles and their implications for health. Cognition &emotion. 25. 22-39. 10.1080/02699931003612114
[7] S, P. (2011, January 08). Difference Between Anger and Rage. http://www.differencebetween.net/miscellaneous/difference-between-anger-and-rage/.
[8] Scherer K. R. (1982). Emotion as a process: function, origin, and regulation. Soc. Sci. Inform. 21555–570. 10.1177/053901882021004004.
[9] SimsT., Tsai J. L., Jiang D., Wang Y., Fung H. H., Zhang X. (2015). Wanting to maximize the positive and minimize the negative: implications for mixed affective experience in American and Chinese contexts. J. Pers. Soc. Psychol. 109 292–315. 10.1037/a0039276.