Are Personas Done? Evaluating Their Usefulness in the Age of Digital Analytics
DOI:
https://doi.org/10.21153/psj2018vol4no2art737Keywords:
data-driven personas, online analytics, customer segmentationAbstract
In this research, we conceptually examine the use of personas in an age of large-scale online analytics data. Based on the criticism and benefits outlined in prior work and by practitioners working with online data, we formulate the major arguments for and against the use of personas given real-time online analytics data about customers, analyze these arguments, and demonstrate areas for the productive employment of data-driven personas by leveraging online analytics data in their creation. Our key tenet is that data-driven personas are located between aggregated and individual customer statistics. At their best, digital data-driven personas capture the coverage of the customer base attributed to aggregated data representations while retaining the interpretability of individual-level analytics; they benefit from powerful computational techniques and novel data sources. We discuss how digital data-driven personas can draw from technological advancements to remedy the notable concerns voiced by scholars and practitioners, including persona validation, inconsistency problem, and long development times. Finally, we outline areas of future research of personas in the context of online analytics. We argue that to survive in the rapidly developing online customer analytics industry, personas must evolve by adopting new practices.
Downloads
References
An, J, Kwak, H & Jansen, BJ 2017, ‘Personas for Content Creators via Decomposed Aggregate Audience Statistics’, in Proceedings of Advances in Social Network Analysis and Mining (ASONAM 2017), Sydney, Australia.
Ardehaly, EM & Culotta, A 2015, ‘Inferring latent attributes of Twitter users with label regularization’, retrieved 29 October 2018 from http://cs.iit.edu/~culotta/pubs/ehsan15inferring.pdf.
Bleier, A & Eisenbeiss, M 2015, ‘Personalized Online Advertising Effectiveness: The Interplay of What, When, and Where’, Marketing Science, vol. 34, no. 5, retrieved 18 May 2016, from http://pubsonline.informs.org/doi/abs/10.1287/mksc.2015.0930.
Bødker, S, Christiansen, E, Nyvang, T & Zander, P-O 2012, ‘Personas, people and participation: challenges from the trenches of local government’, Proceedings of the 12th Participatory Design Conference: Research Papers - Volume 1 (PDC '12), K Halskov, H Winschiers-Theophilus, Y Lee, J Simonsen, and K Bødker (Eds.). ACM, New York, NY, USA, pp. 91-100. DOI=http://dx.doi.org/10.1145/2347635.2347649.
Boghrati, R, Hoover, J, Johnson, KM, Garten, J & Dehghani, M 2017, ‘Conversation level syntax similarity metric’, Behavior Research Methods, vol. 50, no. 3, pp. 1055-1073, doi: 10.3758/s13428-017-0926-2.
Chapman, CN, Love, E, Milham, RP, ElRif, P & Alford, JL 2008, ‘Quantitative Evaluation of Personas as Information’, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 52, no. 16, pp. 1107–1111.
Chapman, CN & Milham, RP 2006, ‘The Personas’ New Clothes: Methodological and Practical Arguments against a Popular Method’, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, no. 5, pp. 634–636.
Chatwin, RE 2013, ‘An overview of computational challenges in online advertising’, American Control Conference (ACC) 2013, IEEE, pp. 5990–6007, retrieved 29 October 2018 from http://ieeexplore.ieee.org/abstract/document/6580778/.
Clarke, TB & Jansen, BJ 2017, ‘Conversion potential: a metric for evaluating search engine advertising performance’, Journal of Research in Interactive Marketing, vol. 11, no. 2, pp. 142–159.
Cleary, PD 1997, ‘Subjective and Objective Measures of Health: Which is Better When?’, Journal of Health Services Research, vol. 2, no. 1, pp. 3–4.
Cooper, A 1999, The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity. Sams - Pearson Education, Indianapolis, IN.
Del Vecchio, P, Mele, G, Ndou, V & Secundo, G 2017, ‘Creating value from Social Big Data: Implications for Smart Tourism Destinations’, Information Processing & Management. vol. 54, no. 5, pp. 847-860, doi: https://doi.org/10.1016/j.ipm.2017.10.006.
Delfabbro, P 2004, ‘The stubborn logic of regular gamblers: Obstacles and dilemmas in cognitive gambling research’, Journal of Gambling Studies, vol. 20, no. 1, pp. 1–21.
Dichter, E 1964, Handbook of consumer motivations: the psychology of the world of objects. McGraw-Hill.
Dong, J, Kelkar, K & Braun, K 2007, ‘Getting the most out of personas for product usability enhancements’, Usability and Internationalization. HCI and Culture. UI-HCII 2007. Lecture Notes in Computer Science, N Aykin (eds), vol 4559. Springer, Berlin, Heidelberg, doi: https://doi.org/10.1007/978-3-540-73287-7_36.
Fisher, RJ 1993, ‘Social Desirability Bias and the Validity of Indirect Questioning’, Journal of Consumer Research, vol. 20, no. 2, pp. 303–315.
Floyd, IR, Jones, MC & Twidale, MB 2008, ‘Resolving Incommensurable Debates: A Preliminary Identification of Persona Kinds, Attributes, and Characteristics’, Artifact, vol. 2, no. 1, pp. 12–26.
Friess, E 2012, ‘Personas and Decision Making in the Design Process: An Ethnographic Case Study’, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’12, ACM, New York, NY, USA, pp. 1209–1218, retrieved from http://doi.acm.org/10.1145/2207676.2208572.
Goodwin, K 2009, Designing for the Digital Age: How to Create Human-Centered Products and Services. Wiley, Indianapolis, IN.
Graepel, T, Candela, JQ, Borchert, T & Herbrich, R 2010, ‘Web-scale bayesian click-through rate prediction for sponsored search advertising in microsoft’s bing search engine’, in Proceedings of the 27th international conference on machine learning (ICML-10), pp. 13–20, retrieved September 20, 2017, from http://machinelearning.wustl.edu/mlpapers/paper_files/icml2010_GraepelCBH10.pdf.
Gudjónsdóttir, R 2010, Personas and scenarios in use, Skolan för datavetenskap och kommunikation, Kungliga Tekniska högskolan, Stockholm.
Hill, CG, Haag, M, Oleson, A, Mendez, C, Marsden, N, Sarma, A & Burnett, M 2017, ‘Gender-Inclusiveness Personas vs. Stereotyping: Can We Have it Both Ways?’, CHI '17 Proceedings of the 2017 CHI Conference on Human Factors in Computing, pp. 6658–6671, retrieved May 28, 2017, from http://dl.acm.org/citation.cfm?doid=3025453.3025609.
Holtzblatt, K, Wendell, JB & Wood, S 2005, Rapid Contextual Design: A How-to Guide to Key Techniques for User-centered Design, Elsevier.
Howard, TW 2015, ‘Are Personas Really Usable?’, Communication Design Quarterly Review, vol. 3, no. 2, pp. 20–26.
Jansen, BJ, An, J, Kwak, H, Salminen, J & Jung, S-G 2017, ‘Viewed by Too Many or Viewed Too Little: Using Information Dissemination for Audience Segmentation’, Proceedings of the Association for Information Science and Technology, vol. 54, no. 1, pp. 189–196, doi: https://doi.org/10.1002/pra2.2017.14505401021.
Järvinen, J 2016, ‘The use of digital analytics for measuring and optimizing digital marketing performance’, Jyväskylä Studies in Business and Economics 170, retrieved September 8, 2017, from https://jyx.jyu.fi/dspace/handle/123456789/51512.
Järvinen, J & Karjaluoto, H 2015, ‘The use of Web analytics for digital marketing performance measurement’, Industrial Marketing Management, vol. 50, pp. 117–127, https://doi.org/10.1016/j.indmarman.2015.04.009.
Johnson, MD & Selnes, F 2004, ‘Customer portfolio management: toward a dynamic theory of exchange relationships’, Journal of Marketing, vol. 68, no. 2, pp. 1–17.
Jung, S, Salminen, J, An, J, Kwak, H & Jansen, BJ 2018, ‘Automatically Conceptualizing Social Media Analytics Data via Personas’, Proceedings of the Twelfth International AAAI Conference on Web and Social Media (ICWSM 2018), retrieved 29 October 2018 from https://www.aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17810/17089.
Jung, S-G, An, J, Kwak, H, Ahmad, M, Nielsen, L & Jansen, BJ 2017, ‘Persona Generation from Aggregated Social Media Data’, in Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’17, pp. 1748–1755, retrieved 29 October 2018 from http://www.bernardjjansen.com/uploads/2/4/1/8/24188166/jansen_personas_chi2017.pdf.
Jung, S-G, An, J, Kwak, H, Salminen, J & Jansen, BJ 2017, ‘Inferring social media users’ demographics from profile pictures: A Face++ analysis on Twitter users’, in Proceedings of 17th International Conference on Electronic Business, Dubai, retrieved 29 October 2018 from https://aisel.aisnet.org/iceb2017/22/.
Kaartemo, V, Akaka, MA & Vargo, SL 2017, ‘A Service-Ecosystem Perspective on Value Creation: Implications for International Business’, in Value Creation in International Business, Palgrave Macmillan, Cham, pp. 131–149, retrieved 11 February 2018, from https://link.springer.com/chapter/10.1007/978-3-319-39369-8_6.
Krashen, SD 1984, ‘Immersion: Why it works and what it has taught us’, Language and Society, vol. 12, no. 1, pp. 61–64.
Kwak, H, An, J & Jansen, BJ 2017, ‘Automatic Generation of Personas Using YouTube Social Media Data’, Proceedings of the 50th Hawaii International Conference on System Sciences, pp. 833–842, retrieved 29 October 2018 from http://www.bernardjjansen.com/uploads/2/4/1/8/24188166/jansen_personas_hciss2016.pdf.
LeRouge, C, Ma, J, Sneha, S & Tolle, K 2013, ‘User profiles and personas in the design and development of consumer health technologies’, International Journal of Medical Informatics, vol. 82, no. 11, pp. e251-268.
Liapis, A, Holmgård, C, Yannakakis, GN & Togelius, J 2015, ‘Procedural Personas as Critics for Dungeon Generation’, in AM Mora & G Squillero (eds), Applications of Evolutionary Computation, Springer International Publishing, Cham, pp. 331–343, retrieved 14 March 2018 from http://link.springer.com/10.1007/978-3-319-16549-3_27.
Long, F 2009, ‘Real or imaginary: The effectiveness of using personas in product design’, in Proceedings of the Irish Ergonomics Society Annual Conference, Irish Ergonomics Society Dublin.
Ma, J & LeRouge, C 2007, ‘Introducing User Profiles and Personas into Information Systems Development’, AMCIS 2007 Proceedings, retrieved 29 October 2018 from http://aisel.aisnet.org/amc is2007/237.
Marsden, N & Haag, M 2016, ‘Stereotypes and Politics: Reflections on Personas’, in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, pp. 4017–4031, retrieved 18 March 2018, from http://doi.acm.org/10.1145/2858036.2858151.
Massanari, AL 2010, ‘Designing for imaginary friends: information architecture, personas and the politics of user-centered design’, New Media & Society, vol. 12, no. 3, pp. 401–416.
Matthews, T, Judge, T & Whittaker, S 2012, ‘How Do Designers and User Experience Professionals Actually Perceive and Use Personas?’, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’12, pp. 1219–1228, retrieved 29 October 2018 from http://doi.acm.org/10.1145/2207676.2208573.
Mesgari, M, Okoli, C & de Guinea, AO 2018, ‘Creating Rich and Representative Personas by Discovering Affordances’, IEEE Transactions on Software Engineering, doi: 10.1109/TSE.2018.2826537.
Miaskiewicz, T & Kozar, KA 2011, ‘Personas and user-centered design: How can personas benefit product design processes?’, Design Studies, vol. 32, no. 5, pp. 417–430.
Miaskiewicz, T, Sumner, T & Kozar, KA 2008, ‘A latent semantic analysis methodology for the identification and creation of personas’, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1501–1510, retrieved from http://dl.acm.org/citation.cfm?id=1357290.
Miller, GA 1956, ‘The magical number seven plus or minus two: some limits on our capacity for processing information’, Psychological Review, vol. 63, no. 2, pp. 81–97.
Miralles-Pechuán, L, Ponce, H & Martínez-Villaseñor, L 2018, ‘A novel methodology for optimizing display advertising campaigns using genetic algorithms’, Electronic Commerce Research and Applications, vol. 27, pp. 39–51.
Molenaar, L 2017, ‘Data-driven personas: Generating consumer insights with the use of clustering analysis from big data’, Thesis, retrieved 17 March 2018, from http://resolver.tudelft.nl/uuid:12d7f261-20b4-4656-93d7-fed2b437aefb.
Mulder, S & Yaar, Z 2006, The User is Always Right: A Practical Guide to Creating and Using Personas for the Web, New Riders.
Mulken, S van, André, E & Müller, J 1998, ‘The Persona Effect: How Substantial Is It?’, in People and Computers XIII, Springer, London, pp. 53–66, retrieved 28 February 2018, from https://link.springer.com/chapter/10.1007/978-1-4471-3605-7_4.
Nacke, LE, Drachen, A & Göbel, S 2010, ‘Methods for evaluating gameplay experience in a serious gaming context’, International Journal of Computer Science in Sport, vol. 9, no. 2, pp. 1–12.
Nielsen, L 2013, Personas - User Focused Design, Springer Science & Business Media, Springer-Verlag, London.
Nielsen, L, Jung, S-G, An, J, Salminen, J, Kwak, H & Jansen, BJ 2017, ‘Who Are Your Users?: Comparing Media Professionals’ Preconception of Users to Data-driven Personas’, in Proceedings of the 29th Australian Conference on Computer-Human Interaction, OZCHI ’17, pp. 602–606, retrieved 28 January 2018, from http://doi.acm.org/10.1145/3152771.3156178.
Owusu, RA, Mutshinda, CM, Antai, I, Dadzie, KQ & Winston, EM 2016, ‘Which UGC features drive web purchase intent? A spike-and-slab Bayesian Variable Selection Approach’, Internet Research, vol. 26, no. 1, pp. 22–37.
Provan, KG & Milward, HB 1995, ‘A preliminary theory of interorganizational network effectiveness: A comparative study of four community mental health systems’, Administrative Science Quarterly, vol. 40, no. 1, pp. 1–33.
Pruitt, J & Adlin, T 2006, The Persona Lifecycle: Keeping People in Mind Throughout Product Design. Morgan Kaufmann, Boston.
Pruitt, J & Grudin, J 2003, ‘Personas: Practice and Theory’, in Proceedings of the 2003 Conference on Designing for User Experiences, DUX ’03, pp. 1–15, retrieved from http://doi.acm.org/10.1145/997078.997089.
Ronen, R, Yom-Tov, E & Lavee, G 2016, ‘Recommendations meet web browsing: enhancing collaborative filtering using internet browsing logs’, 2016 IEEE 32nd International Conference on Data Engineering (ICDE), pp. 1230–1238, doi: 10.1109/ICDE.2016.7498327.
Rönkkö, K 2005, ‘An Empirical Study Demonstrating How Different Design Constraints, Project Organization and Contexts Limited the Utility of Personas’, in Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences - Volume 08, HICSS ’05, IEEE Computer Society, retrieved 29 October 2018 from http://dx.doi.org/10.1109/HICSS.2005.85.
Rönkkö, K, Hellman, M, Kilander, B & Dittrich, Y 2004, ‘Personas is Not Applicable: Local Remedies Interpreted in a Wider Context’, in Proceedings of the Eighth Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices - Volume 1, PDC 04, pp. 112–120, retrieved 29 October 2018 from http://doi.acm.org/10.1145/1011870.1011884.
Rundle-Thiele, S, Dietrich, T & Kubacki, K 2017, ‘Why We Need Segmentation When Designing Social Marketing Programs’, in Segmentation in Social Marketing, Springer, Singapore, pp. 197–214, retrieved 9 May 2018, from https://link.springer.com/chapter/10.1007/978-981-10-1835-0_13.
Russell, S & Toklu, C 2011, ‘Acquiring and Applying Market Knowledge for Large Software Purchases: Products, Personas, and Programs’, in Knowledge Management for Process, Organizational and Marketing Innovation: Tools and Methods, IGI Global, pp. 195–215.
Saggi, MK & Jain, S 2018, ‘A survey towards an integration of big data analytics to big insights for value-creation’, Information Processing & Management, vol. 54, no. 5, pp. 758–790.
Salminen, J, Jansen, BJ, An, J, Kwak, H & Jung, S-G 2018, ‘Research Roadmap for Automatic Persona Generation: Principles and Open Questions’, Poster presented at The Fifth Machine Learning and Data Analytics (MLDAS 2018) Symposium, Doha, Qatar.
Salminen, J, Jung, S-G, An, J, Kwak, H & Jansen, BJ 2018, ‘Findings of a User Study of Automatically Generated Personas’, in Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA ’18, p. LBW097:1–LBW097:6, retrieved 26 April 2018, from http://doi.acm.org/10.1145/3170427.3188470.
Salminen, J, Milenković, M & Jansen, BJ 2017, ‘Problems of Data Science in Organizations: An Explorative Qualitative Analysis of Business Professionals’ Concerns’, in Proceedings of International Conference on Electronic Business (ICEB 2017), Dubai.
Salminen, J, Nielsen, L, Jung, S-G, An, J, Kwak, H & Jansen, BJ 2018, ‘“Is More Better?”: Impact of Multiple Photos on Perception of Persona Profiles’, in Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI2018), Montréal, Canada.
Salminen, J, Şengün, S, Kwak, H, Jansen, BJ, An, J, Jung, S, Vieweg, S & Harrell, F 2017, ‘Generating Cultural Personas from Social Data: A Perspective of Middle Eastern Users’, in Proceedings of The Fourth International Symposium on Social Networks Analysis, Management and Security (SNAMS-2017), Prague, Czech Republic.
— 2018, ‘From 2,772 segments to five personas: Summarizing a diverse online audience by generating culturally adapted personas’, First Monday, vol. 23, no. 6, retrieved 3 June 2018, from http://firstmonday.org/ojs/index.php/fm/article/view/8415.
Scott, DM 2007, The New Rules of Marketing, John Wiley and Sons, Hoboken, New Jersey.
Sinha, R 2003, ‘Persona Development for Information-rich Domains’, in Extended abstracts of the 2003 Conference on Human Factors in Computing Systems (CHI 2003), Ft. Lauderdale, Florida, USA.
Storey, VC & Song, I-Y 2017, ‘Big data technologies and management: What conceptual modeling can do’, Data & Knowledge Engineering, vol. 108, March 2017, pp. 50–67.
Thoma, V & Williams, B 2009, ‘Developing and Validating Personas in e-Commerce: A Heuristic Approach’, in Human-Computer Interaction – INTERACT 2009, Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, pp. 524–527, retrieved 29 October 2018 from https://link.springer.com/chapter/10.1007/978-3-642-03658-3_56.
Vahlo, J & Koponen, A 2018, ‘Player Personas and Game Choice’, in N Lee (ed), Encyclopedia of Computer Graphics and Games, Springer International Publishing, Cham, pp. 1–6, retrieved March 6, 2018, from http://link.springer.com/10.1007/978-3-319-08234-9_149-1.
Venkataramani, V, Amsden, Z, Bronson, N, Cabrera III, G, Chakka, P, Dimov, P, Ding, H, Ferris, J, Giardullo, A, Hoon, J & others 2012, ‘Tao: how Facebook serves the social graph’, in Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, pp. 791–792, retrieved 29 October 2018 from
http://dl.acm.org/citation.cfm?id=2213957.
Vincent, CJ & Blandford, A 2014, ‘The challenges of delivering validated personas for medical equipment design’, Applied Ergonomics, vol. 45, no. 4, pp. 1097–1105.
Volkova, S, Bachrach, Y & Durme, BV 2016, ‘Mining User Interests to Predict Perceived Psycho-Demographic Traits on Twitter’, in 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService), pp. 36–43, retrieved 29 October 2018 from https://ieeexplore.ieee.org/document/7474353.
Wang, J & Yuan, S 2015, ‘Real-Time Bidding: A New Frontier of Computational Advertising Research’, in Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, WSDM ’15, pp. 415–416, retrieved 28 February 2016, from http://doi.acm.org/10.1145/2684822.2697041.
Zerbino, P, Aloini, D, Dulmin, R & Mininno, V 2018, ‘Big Data-enabled Customer Relationship Management: A holistic approach’, Information Processing & Management, vol. 54, no. 5, pp. 818–846.
Zhang, X, Brown, H-F & Shankar, A 2016, ‘Data-driven Personas: Constructing Archetypal Users with Clickstreams and User Telemetry’, in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, pp. 5350–5359, doi: 10.1145/2858036.2858523.
Downloads
Published
Issue
Section
License
How to Cite
