Have a personal or library account? Click to login
Exploratory Computation in Digital Humanities: A Qualitative Evaluation Framework Cover

Exploratory Computation in Digital Humanities: A Qualitative Evaluation Framework

Open Access
|Mar 2026

References

  1. Alvarado Rojas, A., & Twyman, M. (2025). Cultural data markets: Interpreting the popularity of public datasets. New Media & Society. 10.1177/14614448251359631
  2. Bartz-Beielstein, T., Doerr, C., Berg, D. van den, Bossek, J., Chandrasekaran, S., Eftimov, T., Fischbach, A., Kerschke, P., Cava, W. L., Lopez-Ibanez, M., Malan, K. M., Moore, J. H., Naujoks, B., Orzechowski, P., Volz, V., Wagner, M., & Weise, T. (2020). Benchmarking in optimization: Best practice and open issues. arXiv. 10.48550/arXiv.2007.03488
  3. Becker, H. S. (1996). The epistemology of qualitative research. In Ethnography and human development: Context and meaning in social inquiry (pp. 5371). The University of Chicago Press.
  4. Bender, E. M., & Koller, A. (2020). Climbing towards NLU: On meaning, form, and understanding in the age of data. In D. Jurafsky, J. Chai, N. Schluter, & J. Tetreault (Eds.), Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 51855198). Association for Computational Linguistics. 10.18653/v1/2020.acl-main.463
  5. Benotto, G. (2021). Can an author style be unveiled through word distribution? Digital Humanities Quarterly, 15(1). https://dhq.digitalhumanities.org/vol/15/1/000539/000539.html
  6. Broussard, M. (2018). Artificial unintelligence: How computers misunderstand the world. MIT Press. 10.7551/mitpress/11022.001.0001
  7. Buolamwini, J., & Gebru, T. (2018). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of the 1st Conference on Fairness, Accountability and Transparency (PMLR 2018), USA, 81, 7791. https://proceedings.mlr.press/v81/buolamwini18a.html
  8. Campolo, A. (2021). “Thinking, judging, noticing, feeling”: John W. Tukey against the mechanization of inferential knowledge. KNOW: A Journal on the Formation of Knowledge, 5(1), 83111. 10.1086/713021
  9. Campolo, A., & Crawford, K. (2020). Enchanted determinism: Power without responsibility in artificial intelligence. Engaging Science, Technology, and Society, 6, 119. 10.17351/ests2020.277
  10. Charmaz, K. (2005). Grounded theory in the twenty first century: Applications for advancing social justice studies. In N. K. Denzin & Y. S. Lincoln (Eds.) The handbook of qualitative research (3rd ed., pp. 507535). Sage Publications Ltd.
  11. Clement, T. (2016). Where is methodology in digital humanities? In L. F. Klein & M. K. Gold (Eds.) Debates in the Digital Humanities (pp. 153175). University of Minnesota Press. 10.5749/j.ctt1cn6thb.17
  12. Clement, T., & Acker, A. (2019). Data cultures, culture as data – Special issue of cultural analytics. Journal of Cultural Analytics. 10.22148/16.035
  13. Collins, H. M., & Evans, R. (2002). The third wave of science studies: Studies of expertise and experience. Social Studies of Science, 32(2), 235296. 10.1177/0306312702032002003
  14. Denton, R., Hanna, A., Amironesei, R., Smart, A., Nicole, H., & Scheuerman, M. K. (2020). Bringing the people back in: Contesting benchmark machine learning datasets. arXiv. 10.48550/arXiv.2007.07399
  15. Dobson, J. (2021). Interpretable outputs: Criteria for machine learning in the humanities. Digital Humanities Quarterly, 15(2). https://dhq.digitalhumanities.org/vol/15/2/000555/000555.html
  16. Dombrowski, Q. (2021). Rolling the dice on project management. IDEAH, 2(2). 10.21428/f1f23564.0f419bf4
  17. Fu, K., Gurth, T., Laidlaw, D. H., & Nguyen, C. A. (2026). Visual exploration of a historical Vietnamese corpus of captioned drawings: A case study. IEEE Computer Graphics and Applications. 10.1109/MCG.2026.3660122
  18. Gibbs, F., & Owens, T. (2013). The hermeneutics of data and historical writing. In J. Dougherty & K. Nawrotzki (Eds.), Writing History in the Digital Age (pp. 159170). University of Michigan Press. 10.2307/j.ctv65sx57.18
  19. Haraway, D. (1988). Situated knowledges: The science question in feminism and the privilege of partial perspective. Feminist Studies, 14(3), 575599. 10.2307/3178066
  20. Harding, S. (1992). After the neutrality ideal: Science, politics, and “strong objectivity.” Social Research, 59(3), 567587. https://www.jstor.org/stable/40970706
  21. Irani, L., Vertesi, J., Dourish, P., Philip, K., & Grinter, R. E. (2010). Postcolonial computing: A lens on design and development. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, USA, 13111320. 10.1145/1753326.1753522
  22. Joyeux-Prunel, B. (2024). Digital humanities in the era of digital reproducibility: Towards a fairest and post-computational framework. International Journal of Digital Humanities, 6(1), 2343. 10.1007/s42803-023-00079-6
  23. Kamberelis, G., & Dimitriadis, G. (2005). Focus groups: Strategic articulations of pedagogy, politics and inquiry. In N. K. Denzin & Y. S. Lincoln (Eds.), Collecting and interpreting qualitative materials (3rd ed., pp. 887907). Sage Publications Ltd.
  24. Kommers, C., Ahnert, R., Antoniak, M., Benetos, E., Benford, S., Bunz, M., Caramiaux, B., Concannon, S., Disley, M., Dobson, J., Du, Y., Duéñez-Guzmán, E., Francksen, K., Gius, E., Gray, J., Heuser, R., Immel, S., So, R., Leigh, S., … Hemment, D. (2025). Computational hermeneutics: Evaluating generative AI as a cultural technology. Social Science Research Network. 10.2139/ssrn.5409144
  25. Kraus, F., Blumenröhr, N., Götzelmann, G., Tonne, D., & Streit, A. (2024). A gold standard benchmark dataset for digital humanities. Proceedings of the 19th International Workshop on Ontology Matching (OM 2024) co-located with the 23rd International Semantic Web Conference (ISWC 2024), USA, 117. 10.5445/ir/1000178023
  26. Lazer, D. M. J., Pentland, A., Watts, D. J., Aral, S., Athey, S., Contractor, N., Freelon, D., Gonzalez-Bailon, S., King, G., Margetts, H., Nelson, A., Salganik, M. J., Strohmaier, M., Vespignani, A., & Wagner, C. (2020). Computational social science: Obstacles and opportunities. Science, 369(6507), 10601062. 10.1126/science.aaz8170
  27. Leonelli, S. (2018). Rethinking reproducibility as a criterion for research quality. In Research in the History of Economic Thought and Methodology: Including a aymposium on Mary Morgan: Curiosity, Imagination, and Surprise (Vol. 36B, pp. 129146). Emerald Publishing Limited. 10.1108/S0743-41542018000036B009
  28. Munzner, T. (2009). A nested model for visualization design and validation. IEEE Transactions on Visualization and Computer Graphics, 15(6), 921928. 10.1109/TVCG.2009.111
  29. Pankowska, P., Mendrik, A., Emery, T., & Garcia-Bernardo, J. (2023). Accelerating progress in the social sciences: The potential of benchmarks. OSF Preprints. 10.31235/osf.io/ekfxy
  30. Peng, R. D. (2011). Reproducible research in computational science. Science, 334(6060), 12261227. 10.1126/science.1213847
  31. Poirier, L. (2021). Reading datasets: Strategies for interpreting the politics of data signification. Big Data & Society, 8(2). 10.1177/20539517211029322
  32. Posner, M. (2014, April 17). How did they make that? The video! Miriam Posner. https://miriamposner.com/blog/how-did-they-make-that-the-video/
  33. Prescott, A. (2023). Bias in big data, machine learning and AI: What lessons for the digital humanities? Digital Humanities Quarterly, 17(2). https://dhq.digitalhumanities.org/vol/17/2/000689/000689.html
  34. Pustu-Iren, K., Sittel, J., Mauer, R., Bulgakowa, O., & Ewerth, R. (2020). Automated visual content analysis for film studies: Current status and challenges. Digital Humanities Quarterly, 14(4). https://dhq-static.digitalhumanities.org/pdf/000518.pdf
  35. Ringler, H. (2024). Computation and hermeneutics: Why we still need interpretation to be (computational) humanists. In Computational Humanities (pp. 317). University of Minnesota. https://dhdebates.gc.cuny.edu/read/computational-humanities-5c64bbab-d7ca-41be-8f87-f26117a9a20f/section/cdccb7af-e7cd-4225-932a-f12da4214b1a#ch01
  36. Risam, R. (2019). New digital worlds: Postcolonial digital humanities in theory, praxis, and pedagogy. Northwestern University Press. 10.2307/j.ctv7tq4hg
  37. Risam, R., & Gil, A. (2022). Introduction: The questions of minimal computing. Digital Humanities Quarterly, 16(2). https://dhq-static.digitalhumanities.org/pdf/000646.pdf
  38. Sawyer, S., & Jarrahi, M. H. (2014). Sociotechnical approaches to the study of information systems. In Computing Handbook (3rd ed.). Chapman and Hall/CRC. 10.1201/b16768-7
  39. Sedlmair, M., Meyer, M., & Munzner, T. (2012). Design study methodology: Reflections from the trenches and the stacks. IEEE Transactions on Visualization and Computer Graphics, 18(12), 24312440. 10.1109/TVCG.2012.213
  40. Segessenmann, J., Stadelmann, T., Davison, A., & Dürr, O. (2023). Assessing deep learning: A work program for the humanities in the age of artificial intelligence. AI and Ethics, 5(1), 132. 10.1007/s43681-023-00408-z
  41. Siemens, L. (2016). Project management and the digital humanist. In C. Crompton, R. J. Lane, & R. Siemens (Eds.), Doing Digital Humanities: Practice, Training, Research. (pp. 343357). Routledge. 10.4324/9781315707860
  42. Sim, S. E., Easterbrook, S., & Holt, R. C. (2003). Using benchmarking to advance research: A challenge to software engineering. Proceedings of the 25th International Conference on Software Engineering (ICSE 2003), USA, 7483. 10.1109/ICSE.2003.1201189
  43. Tukey, J. W. (1977). Exploratory data analysis. Addison-Wesley.
  44. Varela, M. E. (2021). Theater as data: Computational journeys into theater research. University of Michigan Press.
  45. Weber, L. M., Saelens, W., Cannoodt, R., Soneson, C., Hapfelmeier, A., Gardner, P. P., Boulesteix, A.-L., Saeys, Y., & Robinson, M. D. (2019). Essential guidelines for computational method benchmarking. Genome Biology, 20, Article 125. 10.1186/s13059-019-1738-8
  46. Zhan, J. (2021). Call for establishing benchmark science and engineering. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 1(1), Article 100012. 10.1016/j.tbench.2021.100012
DOI: https://doi.org/10.5334/johd.500 | Journal eISSN: 2059-481X
Language: English
Submitted on: Dec 13, 2025
|
Accepted on: Feb 24, 2026
|
Published on: Mar 24, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2026 Cindy Anh Nguyen, Alejandro Alvarado Rojas, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.