Volume 42 - Article 5 | Pages 133–148  

Traditional versus Facebook-based surveys: Evaluation of biases in self-reported demographic and psychometric information

By Kyriaki Kalimeri, Mariano G. Beiró, Andrea Bonanomi, Alessandro Rosina, Ciro Cattuto

References

Adler, Natalia, Cattuto, Ciro, Kalimeri, Kyriaki, Paolotti, Daniela, Tizzoni, Michele, Verhulst, Stefaan, Yom-Tov, Elad, and Young, Andrew (2019). How search engine data enhance the understanding of determinants of suicide in India and inform prevention: Observational study. Journal of Medical Internet Research 21(1): e10179.

Weblink:
Download reference:

Anderson, Janna and Rainie, Lee (2010). Millennials will make online sharing in networks a lifelong habit.

Download reference:

Araújo, Matheus, Mejova, Yelena, Weber, Ingmar, and Benevenuto, Fabricio (2017). Using Facebook ads audiences for global lifestyle disease surveillance: Promises and limitations. (Paper presented at the 2017 ACM on Web Science Conference, New York, USA, June 21–23, 2017).

Download reference:

Baeza-Yates, Ricardo (2018). Bias on the web. Communications of the ACM 61(6): 54–61.

Weblink:
Download reference:

Baeza-Yates, Ricardo (2013). Big data or right data? (Paper presented at the 7th Albertao Mendelzon International Workshop on Foundations of Data Management, Puebla/Cholula, Mexico, May 21–23, 2013).

Download reference:

Bernardi, Laura and Klärner, Andreas (2014). Social networks and fertility. Demographic Research 30(22): 641–670.

Weblink:
Download reference:

Bonanomi, Andrea, Rosina, Alessandro, Cattuto, Ciro, and Kalimeri, Kyriaki (2018). Social Media Data per lo studio della disoccupazione giovanile italiana: Il progetto LikeYouth.

Download reference:

Bonanomi, Andrea, Rosina, Alessandro, Cattuto, Ciro, and Kalimeri, Kyriaki (2017). Understanding youth unemployment in Italy via social media data. (Paper presented at the 28$^\textth$ IUSSP International Population Conference, Cape Town, South Africa, October 29 – November 3, 2017).

Download reference:

Burke, Moira and Kraut, Robert (2013). Using Facebook after losing a job: Differential benefits of strong and weak ties. (Paper presented at the 2013 Conference on Computer Supported Cooperative Work, San Antonio, United States, February 23–27, 2013).

Weblink:
Download reference:

Burkell, Jacquelyn, Fortier, Alexandre, Wong, Lorraine Yeung Cheryl, and Simpson, Jennifer Lynn (2014). Facebook: Public space, or private space? Information, Communication and Society 17(8): 974–985 ((Lola)).

Weblink:
Download reference:

Cliff, Norman (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin 114(3): 494–509.

Weblink:
Download reference:

Costa Jr, Paul T. and McCrae, Robert R. (1992). The five-factor model of personality and its relevance to personality disorders. Journal of Personality Disorders 6(4): 343–359.

Weblink:
Download reference:

Dubois, Antoine, Zagheni, Emilio, Garimella, Kiran, and Weber, Ingmar (2018). Studying migrant assimilation through Facebook interests. (Paper presented at the International Conference on Social Informatics, St. Petersburg, Russia, September 25–28, 2018).

Weblink:
Download reference:

Gosling, Samuel D., Rentfrow, Peter J., and Swann, William B. (2003). A very brief measure of the Big-Five personality domains. Journal of Research in Personality 37(6): 504–528.

Weblink:
Download reference:

Groves, Robert M. and Lyberg, Lars (2010). Total survey error: Past, present, and future. Public Opinion Quarterly 74(5): 849–879.

Weblink:
Download reference:

Haidt, Jonathan and Joseph, Craig (2004). Intuitive ethics: How innately prepared intuitions generate culturally variable virtues. Daedalus 133(4): 55–66.

Weblink:
Download reference:

Ho, Jeong-Hwa (2015). The problem group? Psychological wellbeing of unmarried people living alone in the Republic of Korea. Demographic Research 32(47): 1299–1328.

Weblink:
Download reference:

Imran, Muhammad, Castillo, Carlos, Diaz, Fernando, and Vieweg, Sarah (2015). Processing social media messages in mass emergency: A survey. ACM Computing Surveys (CSUR) 47(4): 67.

Weblink:
Download reference:

Istituto Giuseppe Toniolo di Studi, Superiori (2017). La condizione giovanile in Italia. Rapporto Giovani. Bologna: Il Mulino.

Download reference:

Kalimeri, Kyriaki, Beiró, Mariano G., Delfino, Matteo, Raleigh, Robert, and Cattuto, Ciro (2019). Predicting demographics, moral foundations, and human values from digital behaviours. Computers in Human Behavior 92: 428–445.

Weblink:
Download reference:

Kalimeri, Kyriaki, G. Beiró, Mariano, Urbinati, Alessandra, Bonanomi, Andrea, Rosina, Alessandro, and Cattuto, Ciro (2019). Human values and attitudes towards vaccination in social media. (Paper presented at The 2019 World Wide Web Conference, New York, United States, May 13–17, 2019).

Weblink:
Download reference:

Kerby, Dave S. (2014). The simple difference formula: An approach to teaching nonparametric correlation. Comprehensive Psychology 3: 11-IT.

Weblink:
Download reference:

Kezer, Murat, Sevi, Barış, Cemalcilar, Zeynep, and Baruh, Lemi (2016). Age differences in privacy attitudes, literacy and privacy management on Facebook. Cyberpsychology: Journal of Psychosocial Research on Cyberspace 10(1).

Weblink:
Download reference:

Law, Edith, Gajos, Krzysztof Z., Wiggins, Andrea, Gray, Mary L., and Williams, Alex (2017). Crowdsourcing as a tool for research: Implications of uncertainty. (Paper presented at the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, Oregon, United States, February 25 – March 1, 2017).

Weblink:
Download reference:

Lazer, David, Pentland, Alex Sandy, Adamic, Lada, Aral, Sinan, Barabasi, Albert Laszlo, Brewer, Devon, Christakis, Nicholas, Contractor, Noshir, Fowler, James, Gutmann, Myron, and King, G. (2009). Life in the network: The coming age of computational social science. Science (New York, N.Y.) 323(5915): 721–723.

Weblink:
Download reference:

Llorente, Alejandro, Garcia-Herranz, Manuel, Cebrian, Manuel, and Moro, Esteban (2015). Social Media Fingerprints of Unemployment. PLOS ONE 10(5): 1-13.

Weblink:
Download reference:

Metaxas, Panagiotis T., Mustafaraj, Eni, and Gayo-Avello, Dani (2011). How (not) to predict elections. (Paper presented at the 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), Boston, United States, October 9–11, 2011).

Weblink:
Download reference:

Mooijman, Marlon, Hoover, Joe, Lin, Ying, Ji, Heng, and Dehghani, Morteza (2018). Moralization in social networks and the emergence of violence during protests. Nature Human Behaviour : 1–389.

Weblink:
Download reference:

Moor, Nienke and Komter, Aafke (2012). Family ties and depressive mood in Eastern and Western Europe. Demographic Research 27(8): 201–232.

Weblink:
Download reference:

Morrison, Philip S. and Clark, William A. V. (2016). Loss aversion and duration of residence. Demographic Research 35(36): 1079–1100.

Weblink:
Download reference:

Murphy, Joe, Hill, Craig A., and Dean, Elizabeth (2013). Social media, sociality and survey research. Hoboken: Wiley Online Library.

Download reference:

Olteanu, Alexandra, Castillo, Carlos, Diaz, Fernando, and Kiciman, Emre (2016). Social data: Biases, methodological pitfalls, and ethical boundaries. 2: 13.

Weblink:
Download reference:

Parr, Nick (2010). Satisfaction with life as an antecedent of fertility: Partner + Happiness = Children? Demographic Research 22(21): 635-662.

Weblink:
Download reference:

Reips, Ulf-Dietrich (2002). Standards for Internet-based experimenting. Experimental Psychology 49(4): 243–256.

Download reference:

Romano, J., Kromrey, J. D., Coraggio, J., and Skowronek, J. (2006). Appropriate statistics for ordinal level data: Should we really be using t-test and Cohen’s d for evaluating group differences on the NSSE and other surveys? (Paper presented at the annual meeting of the Florida Association of Institutional Research, Cocoa Beach, United States,, 2006).

Download reference:

Rossum, Guido (1995). Python Reference Manual.

Download reference:

Ruths, Derek and Pfeffer, Jürgen (2014). Social media for large studies of behavior. Science 346(6213): 1063-1064.

Weblink:
Download reference:

Salganik, Matthew J. (2017). Bit by bit: Social research in the digital age. Princeton: Princeton University Press.

Download reference:

Schober, Michael F., Pasek, Josh, Guggenheim, Lauren, Lampe, Cliff, and Conrad, Frederick G. (2016). Social Media Analyses for Social Measurement. Public Opinion Quarterly 80(1): 180–211.

Weblink:
Download reference:

Sen, Indira, Floeck, Fabian, Weller, Katrin, Weiss, Bernd, and Wagner, Claudia (2019). A Total Error Framework for Digital Traces of Humans. arXiv preprint arXiv:1907.08228 .

Download reference:

Snelson, Chareen L. (2016). Qualitative and Mixed Methods Social Media Research: A Review of the Literature. International Journal of Qualitative Methods 15(1).

Weblink:
Download reference:

Stillwell, David J. and Kosinski, Michal (2004). myPersonality project: Example of successful utilization of online social networks for large-scale social research. American Psychologist 59(2): 93–104.

Download reference:

Teerawichitchainan, Bussarawan Puk, Knodel, John, and Pothisiri, Wiraporn (2015). What does living alone really mean for older persons? A comparative study of Myanmar, Vietnam, and Thailand. Demographic Research 32(48): 1329–1360.

Weblink:
Download reference:

textnormalPew Research, Center (2018). Social Media Fact Sheet [electronic resource]. (Washington, D.C.: Pew Research Center. \textcolorbluepewinternet.org/fact-sheet/social-media/).

Download reference:

Tufekci, Zeynep (2014). Big Questions for Social Media Big Data: Representativeness, Validity and Other Methodological Pitfalls. ICWSM 14: 505–514.

Download reference:

Vespignani, Alessandro (2009). Predicting the behavior of techno-social systems. Science 325(5939): 425–428.

Weblink:
Download reference:

Wilcoxon, Frank (1946). Individual comparisons of grouped data by ranking methods. Journal of Economic Entomology 39(2): 269–270.

Download reference:

Wilson, Robert E., Gosling, Samuel D., and Graham, Lindsay T. (2012). A review of Facebook research in the social sciences. Perspectives on Psychological Science 7(3): 203–220.

Weblink:
Download reference:

Wu, Shaomei, Hofman, Jake M., Mason, Winter A., and Watts, Duncan J. (2011). Who says what to whom on twitter. (Paper presented at the 20th international conference on World wide web, Hyderabad, India, March 28 – April 1, 2011).

Weblink:
Download reference:

Back to the article