Geografie 2019, 124, 133-161

How do user-centered design studies contribute to cartography?

Robert RothID

University of Wisconsin, Department of Geography, Madison, USA

Received November 2018
Accepted May 2019


1. ANDERSON, J.R., REDER, L.M., SIMON, H.A. (1996): Situated learning and education. Educational researcher, 25, 4, 5–11. <>
2. ANGEL, J.R., KUNKEL, K.E. (2010): The response of Great Lakes water levels to future climate scenarios with an emphasis on Lake Michigan-Huron. Journal of Great Lakes Research, 36, 51–58. <>
3. BARKHUUS, L., RODE, J.A. (2007): From mice to men-24 years of evaluation in CHI. Paper read at Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.
4. BORKIN, M.K., GAJOS, A., PETERS, D., MITSOURAS, S., MELCHIONNA, F., RYBICKI, C., FELDMAN, PFISTER, H. (2011): Evaluation of artery visualizations for heart disease diagnosis. IEEE transactions on visualization and computer graphics, 17, 12, 2479–2488. <>
5. BRUGGMANN, A., FABRIKANT, S.I. (2016): How does GIScience support spatio-temporal information search in the humanities? Spatial Cognition & Computation, 16, 4, 255–271. <>
6. BUCKINGHAM, T.M.A., ed. (2019): Map Production. <>
7. BUTTENFIELD, B. (1999): Usability evaluation of digital libraries. Science & Technology Libraries, 17, 3/4, 39–59. <>
8. ÇÖLTEKIN, A., HEIL, B., GARLANDINI, S., FABRIKANT, S.I. (2009): Evaluating the effectiveness of interactive map interface designs: a case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36, 1, 5–17. <>
9. CRAMPTON, J.W. (2011): Mapping: A critical introduction to cartography and GIS: John Wiley & Sons.
10. DAVIES, C. (1998): Analysing ‘work’ in complex system tasks: An exploratory study with GIS. Behaviour and Information Technology, 17, 4, 218–230. <>
11. EDSALL, R., PEUQUET, D. (1997): A graphical user interface for the integration of time into GIS. Paper read at Proceedings of the 1997 American congress of surveying and mapping annual convention and exhibition, Seattle, WA.
12. ELWOOD, S., LESZCZYNSKI, A. (2018): Feminist digital geographies. Gender, Place & Culture, 1–16. <>
13. GABBARD, J.L., HIX, D., SWAN, J.E. (1999): User-centered design and evaluation of virtual environments. IEEE Computer Graphics and Applications, 19, 6, 51–59. <>
14. GREENBERG, S., BUXTON, B. (2008): Usability evaluation considered harmful (some of the time). Paper read at Proceedings of the SIGCHI conference on Human factors in computing systems. <>
15. GRIFFIN, A., ÇÖLTEKIN, A., CHRISTOPHE, S. (2018): Reproducibility in cartography. Paper read at International Cartographic Association (ICA) Joint Commission Workshop on Reproducibility in Cartography, 27 April, at Olomouc, Czechia.
16. GRIFFIN, A. L., WHITE, T., FISH, C., TOMIO, B., HUANG, H., SLUTER, C.R., BRAVO, J.V.M., FABRIKANT, S.I., BLEISCH, S., YAMADA, M. (2017): Designing across map use contexts: a research agenda. International Journal of Cartography, 3, Supl. 1, 90–114. <>
17. GRINSTEIN, G., KOBSA, A., PLAISANT, C., SHNEIDERMAN, B., STASKO, J.T. (2003): Which comes first, usability or utility? Paper read at 14ᵗh IEEE Visualization (VIZ ’03), 22–24 October, at Seattle, WA.
18. HAKLAY, M., NIVALA, A.M. (2010): User-centered design. In: Haklay, M. (ed.): Interacting with geospatial technologies. Wiley-Blackwell, West Sussex, UK, 91–106. <>
19. HAYHOE, K., VANDORN, J., CROLEY, T., II, SCHLEGAL, N., WUEBBLES, D. (2010): Regional climate change projections for Chicago and the US Great Lakes. Journal of Great Lakes Research, 36, 7–21. <>
20. ISENBERG, T., ISENBERG, P., CHEN, J., SEDLMAIR, M., MÖLLER, T. (2013): A systematic review on the practice of evaluating visualization. IEEE transactions on visualization and computer graphics, 19, 12, 2818–2827. <>
21. KITCHIN, R., DODGE, M. (2007): Rethinking maps. Progress in Human Geography, 31, 3, 331–344. <>
22. KLIPPEL, A., WEAVER, ROBINSON, A.C. (2011): Analyzing cognitive conceptualizations using interactive visual environments. Cartography and Geographic Information Science, 38, 1, 52–68. <>
23. KOH, L.C., SLINGSBY, A. DYKES, J., KAM, T.S. (2011): Developing and applying a user-centered model for the design and implementation of information visualization tools. Paper read at Information Visualisation, (IV), 15ᵗh International Conference on. <>
24. KOSARA, R., HEALEY, C.G., INTERRANTE, V., LAIDLAW, D.H., WARE, C. (2003): User studies: Why, how, and when? IEEE Computer Graphics and Applications, 4, 20–25. KRUG, S. (2000): Don’t make me think: A common sense approach to web usability. 2ⁿᵈ ed., New Riders Publishing, Berkeley. <>
25. LAM, H., BERTINI, E., ISENBERG, P., PLAISANT, C., CARPENDALE, S. (2012): Empirical studies in information visualization: Seven scenarios. IEEE transactions on visualization and computer graphics, 18, 9, 1520–1536. <>
26. LLOYD, D., DYKES, J. (2011): Human-centered approaches in geovisualization design: Investigating multiple methods through a long-term case study. IEEE transactions on visualization and computer graphics, 17, 12, 2498–2507. <>
27. MACEACHREN, A.M., KRAAK, M.J. (2001): Research challenges in geovisualization. Cartography and Geographic Information Science, 28, 1, 3–12. <>
28. MOLICH, R., NIELSEN, J. (1990): Improving a human-computer dialogue. Communications of the ACM, 33, 3, 338–348. <>
29. MUNZNER, T. (2009): A nested process model for visualization design and validation. IEEE Transactions on Visualization & Computer Graphics, 6, 921–928. <>
30. NIELSEN, J. (1992): The usability engineering life cycle. Computer, 25, 3, 12–22. <>
31. NORMAN, D. (2013): The design of everyday things. Revised and expanded edition: Constellation. Basic books, New York.
32. OOMS, K., SKARLATIDOU, A., eds. (2018): Usability engineering and evaluation. <>
33. PEUQUET, D.J. (1994): It’s about time: A conceptual framework for the representation of temporal dynamics in geographic information systems. Annals of the Association of American Geographers, 84, 3, 441–461. <>
34. POLSON, P.G., LEWIS, C., RIEMAN, J., WHARTON, C. (1992): Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies, 36, 5, 741–773. <>
35. RICKER, B., ROTH, R. (2018): Mobile Maps and Responsive Design. Geographic Information Science & Technology Body of Knowledge:CV 40. <>
36. ROBINSON, A.C., CHEN, J., LENGERICH, E.J., MEYER, H.G., MACEACHREN, A.M. (2005): Combining usability techniques to design geovisualization tools for epidemiology. Cartography and Geographic Information Science, 32, 4, 243–255. <>
37. ROBINSON, A.C., WEAVER, C. (2006): Re-visualization: Interactive visualization of the process of visual analysis. Paper read at Workshop on Visualization, Analytics & Spatial Decision Support at the GIScience conference.
38. ROONEY, C., BEECHAM, R., DYKES, J., WONG, W. (2017): Dynamic Design Documents for supporting applied visualization. IEEE VIS 2017.
39. ROSSON, M.B., CARROLL, J.M. (2002): Scenario-based Design. In: Jacko, J., Sears, A. (eds.): The human-computer interaction handbook: Fundamental evolving technologies and emerging applications, Lawrence Erlbaum Associates, Hillsdale, NJ, 1032–1050.
40. ROTH, R., YOUNG, S., NESTEL, C., SACK, C., DAVIDSON, B., JANICKI, J., KNOPPKEWETZEL, V., MA, F., MEAD, R., ROSE, C. (2018): Global Landscapes: Teaching globalization through responsive mobile map design. The Professional Geographer, 1–17. <>
41. ROTH, R.E., ÇÖLTEKIN, A., DELAZARI, L., FILHO, H.F., GRIFFIN, A., HALL, A., KORPI, J., LOKKA, I., MENDONÇA, A., OOMS, K. (2017): User studies in cartography: opportunities for empirical research on interactive maps and visualizations. International Journal of Cartography, 3, Supl. 1, 61–89. <>
42. ROTH, R.E., FINCH, B.G., BLANFORD, J.I., KLIPPEL, A., ROBINSON, A.C., MACEACHREN, A.M. (2011): Card sorting for cartographic research and practice. Cartography and Geographic Information Science, 38, 2, 89–99. <>
43. ROTH, R.E., HART, D., MEAD, R., QUINN, C. (2017): Wireframing for interactive & webbased geographic visualization: designing the NOAA Lake Level Viewer. Cartography and Geographic Information Science, 44, 4, 338–357. <>
44. ROTH, R.E., MACEACHREN, A.M. (2016): Geovisual analytics and the science of interaction: an empirical interaction study. Cartography and Geographic Information Science, 43, 1, 30–54. <>
45. ROTH, R.E., QUINN, C., HART, D. (2015): The competitive analysis method for evaluating water level visualization tools. In Modern Trends in Cartography, Springer, 241–256. <>
46. ROTH, R.E., ROSS, K.S., FINCH, B.G., LUO, W., MACEACHREN, A.M. (2013): Spatiotemporal crime analysis in US law enforcement agencies: Current practices and unmet needs. Government Information Quarterly, 30, 3, 226–240. <>
47. ROTH, R.E., ROSS, K.S., MACEACHREN, A.M. (2015): User-centered design for interactive maps: A case study in crime analysis. ISPRS International Journal of Geo-Information, 4, 1, 262–301. <>
48. SEDLMAIR, M., MEYER, M., MUNZNER, T. (2012): Design study methodology: Reflections from the trenches and the stacks. IEEE Transactions on Visualization & Computer Graphics, 12, 2431–2440. <>
49. SLOCUM, T., CLIBURN, D., FEDDEMA, J., MILLER, J. (2003): Evaluating the usability of a tool for visualizing the uncertainty of the future global water balance. Cartography and Geographic Information Science, 30, 4, 299–317. <>
50. SLUTER, C.R., VAN ELZAKKER, C.P., IVÁNOVÁ, I. (2017): Requirements elicitation for geoinformation solutions. The Cartographic Journal, 54, 1, 77–90. <>
51. SPARKE, M. (2012): Introducing globalization: Ties, tensions, and uneven integration: John Wiley & Sons.
52. ŠTĚRBA, Z., ŠAŠINKA, Č., STACHOŇ, Z., KUBÍČEK, P., TAMM, S. (2014): Mixed research design in cartography: a combination of qualitative and quantitative approaches. Kartographische Nachrichten, 64, 5, 262–269.
53. TOLOCHKO, R.C. (2016): Contemporary professional practices in interactive web map design, University of Wisconsin, Madison.
54. TSOU, M.H., CURRAN, J.M. (2008): User-centered design approaches for web mapping applications: A case study with USGS hydrological data in the United States. In: International perspectives on maps and the Internet. Springer, 301–321. <>
55. VAN ELZAKKER, C., OOMS, K., KENT, A., VUJAKOVIC, P. (2017): Understanding map uses and users. In The Routledge Handbook of Mapping and Cartography, Routledge, 79–91. <>
56. VAN ELZAKKER, C.P., WEALANDS, K. (2007): Use and users of multimedia cartography. In Multimedia cartography, Springer, 487–504. <>
57. WHITE, T. (2017): From Existing Practices to Best Practices: Improving the Quality and Consistency of Participant Assessment Methods in Cartographic User Studies, Geography, Kansas.
front cover

ISSN 1212-0014 (Print) ISSN 2571-421X (Online)