Research map
Automated essay scoring: the key papers, mapped
Automated essay scoring has been studied since the late 1990s, from early statistical systems such as e-rater and Bayesian scoring to neural networks, BERT and transformer models, with recurring comparisons against human raters and, recently, tests of ChatGPT and other language models as scorers. This map shows 40 papers on the topic from OpenAlex, grouped by what they study and linked to the papers closest to them in content.
- 40 papers, 1998–2024
- 2 topic groups
- Updated
// the papers
The papers, by topic group
Each group gathers papers that study similar questions. Within a group, the most-cited papers come first.
Group 1
Educational Technology and Assessment
21 papers · 1998–2024
Scoring systems and their use in assessment: e-rater, Bayesian and unsupervised scorers, comparisons with human scoring, nonnative English speakers, medical education, and AI language models, including ChatGPT on dental examinations.
- 1Exploring the potential of using an AI language model for automated essay scoring (opens in a new tab)
Atsushi Mizumoto, Masaki Eguchi · 2023
Research Methods in Applied Linguistics
855citations - 2An automated essay scoring systems: a systematic literature review (opens in a new tab)
Dadi Ramesh, Suresh Kumar Sanampudi · 2021
Artificial Intelligence Review
692citations - 3AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0 (opens in a new tab)
Yigal Attali, Jill C. Burstein · 2004
ETS Research Report Series
641citations - 4Automated Essay Scoring: A Cross-disciplinary Perspective (opens in a new tab)
Mark D. Shermis, Jill C. Burstein · 2003
Routledge eBooks
515citations - 5Automated Essay Scoring Using Bayes' Theorem (opens in a new tab)
Lawrence M. Rudner, Tahung Liang · 2002
Open Access Journals at BC (Boston College)
260citations - 6Automated essay scoring for nonnative English speakers (opens in a new tab)
Jill C. Burstein, Martin S. Chodorow · 1999
113citations - 7Automated essay scoring and the future of educational assessment in medical education (opens in a new tab)
Mark J. Gierl, Syed Latifi, Hollis Lai et al. · 2014
Medical Education
98citations - 8Reliability of ChatGPT in automated essay scoring for dental undergraduate examinations (opens in a new tab)
Bernadette Quah, Lei Zheng, Timothy Jie Han Sng et al. · 2024
BMC Medical Education
91citations - 9The E-rater® Automated Essay Scoring System (opens in a new tab)
Jill C. Burstein, Joel Tetreault, Nitin Madnani · 2015
Routledge eBooks
90citations - 10Automated Essay Scoring Versus Human Scoring: A Comparative Study (opens in a new tab)
Jinhao Wang, Michelle Brown · 2007
The Journal of Technology, Learning and Assessment (Boston College)
80citations - 11Enriching Automated Essay Scoring Using Discourse Marking. (opens in a new tab)
Jill C. Burstein, Karen Kukich, Susanne Wolff et al. · 1998
75citations - 12Toward More Substantively Meaningful Automated Essay Scoring (opens in a new tab)
Anat Ben-Simon, Randy Elliot Bennett · 2007
Open Access Journals at BC (Boston College)
62citations - 13An Unsupervised Automated Essay Scoring System (opens in a new tab)
Yen‐Yu Chen, Chien‐Liang Liu, Tao-Hsing Chang et al. · 2010
IEEE Intelligent Systems
60citations - 14Performance of a Generic Approach in Automated Essay Scoring (opens in a new tab)
Yigal Attali, Brent Bridgeman, Catherine S. Trapani · 2010
The Journal of Technology, Learning and Assessment (Boston College)
57citations - 15Beyond Automated Essay Scoring (opens in a new tab)
Karen Kukich · 2000
57citations - 16The Nature of Automated Essay Scoring Feedback (opens in a new tab)
Semire Dikli · 2011
CALICO Journal
55citations - 17Automated essay scoring: A review of the field (opens in a new tab)
Paraskevas Lagakis, Stavros Demetriadis · 2021
International Conference on Computer, Information and Telecommunication Systems
42citations - 18Automated Essay Scoring (opens in a new tab)
Beata Beigman Klebanov, Nitin Madnani · 2022
Synthesis lectures on human language technologies
41citations - 19Automated Essay Scoring Systems (opens in a new tab)
Dirk Ifenthaler · 2022
Handbook of Open, Distance and Digital Education
36citations - 20Validity of Automated Essay Scoring Systems (opens in a new tab)
Mark D. Shermis, Jill C. Burstein · 2003
Routledge eBooks
22citations - 21A Review of Automated Essay Scoring (opens in a new tab)
Shili Ge · 2008
Jiefangjun Waiyu Xueyuan xuebao
4citations
Group 2
Topic Modeling
19 papers · 2005–2024
Machine-learning models for scoring: neural and discourse-aware networks, BERT fine-tuning and transformers, string kernels, domain adaptation, two-stage learning, biased ratings, and surveys of the state of the art.
- 1A Neural Approach to Automated Essay Scoring (opens in a new tab)
Kaveh Taghipour, Hwee Tou Ng · 2016
Conference on Empirical Methods in Natural Language Processing (EMNLP)
583citations - 2Automated Essay Scoring: A Survey of the State of the Art (opens in a new tab)
Zixuan Ke, Vincent Ng · 2019
International Joint Conference on Artificial Intelligence
287citations - 3Flexible Domain Adaptation for Automated Essay Scoring Using Correlated Linear Regression (opens in a new tab)
Peter Phandi, Kian Ming A. Chai, Hwee Tou Ng · 2015
Conference on Empirical Methods in Natural Language Processing (EMNLP)
178citations - 4On the Use of Bert for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation (opens in a new tab)
Yongjie Wang, Chuang Wang, Ruobing Li et al. · 2022
Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
157citations - 5Should You Fine-Tune BERT for Automated Essay Scoring? (opens in a new tab)
Elijah Mayfield, Alan W. Black · 2020
Workshop on Innovative Use of NLP for Building Educational Applications
155citations - 6Automated essay scoring with string kernels and word embeddings (opens in a new tab)
Mădălina Cozma, Andrei M. Butnaru, Radu Tudor Ionescu · 2018
Proceedings of the conference - Association for Computational Linguistics. Meeting
139citations - 7A review of deep-neural automated essay scoring models (opens in a new tab)
Masaki Uto · 2021
Behaviormetrika
138citations - 8Language models and Automated Essay Scoring (opens in a new tab)
Pedro Uria Rodriguez, Jafari, Amir, Christopher M. Ormerod · 2019
arXiv (Cornell University)
134citations - 9Automated Essay Scoring by Maximizing Human-Machine Agreement (opens in a new tab)
Hongbo Chen, Ben He · 2013
Conference on Empirical Methods in Natural Language Processing (EMNLP)
131citations - 10Neural Automated Essay Scoring Incorporating Handcrafted Features (opens in a new tab)
Masaki Uto, Yikuan Xie, Maomi Ueno · 2020
International Conference on Computational Linguistics
125citations - 11Automated Essay Scoring Using Transformer Models (opens in a new tab)
Sabrina Ludwig, Christian Mayer, Christopher Hansen et al. · 2021
Psych
90citations - 12Automated Essay Scoring with Discourse-Aware Neural Models (opens in a new tab)
Farah Nadeem, Nguyễn Văn Huy, Yang Liu et al. · 2019
Workshop on Innovative Use of NLP for Building Educational Applications
88citations - 13Automated Essay Scoring in the Presence of Biased Ratings (opens in a new tab)
Evelin Carvalho Freire de Amorim, Márcia Cançado, Adriano Veloso · 2018
Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
85citations - 14Automated Essay Scoring based on Two-Stage Learning (opens in a new tab)
Jiawei Liu, Yang Xu, Zhu, Yaguang · 2019
arXiv (Cornell University)
78citations - 15Constrained Multi-Task Learning for Automated Essay Scoring (opens in a new tab)
Ronan Cummins, Meng Zhang, Ted Briscoe · 2016
Proceedings of the conference - Association for Computational Linguistics. Meeting
75citations - 16Parameters driving effectiveness of automated essay scoring with LSA (opens in a new tab)
Fridolin Wild, Christina Stahl, Gerald Stermsek et al. · 2005
Open Research Online - ORO (The Open University)
74citations - 17An Empirical Analysis of BERT Embedding for Automated Essay Scoring (opens in a new tab)
Majdi Beseiso, Saleh Alzahrani · 2020
International Journal of Advanced Computer Science and Applications
69citations - 18Domain-Adaptive Neural Automated Essay Scoring (opens in a new tab)
Yue Cao, Hanqi Jin, Xiaojun Wan et al. · 2020
International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
57citations - 19Automated Essay Scoring: A Reflection on the State of the Art (opens in a new tab)
Shengjie Li, Vincent Ng · 2024
Conference on Empirical Methods in Natural Language Processing (EMNLP)
32citations
// your topic
Map your own research topic
Type a topic, a paper title or a DOI, and the Literature Matrix builds a map like this one from real papers. It is included in Pro plans.
// keep exploring
Related topic maps
Sources and method
Where the data comes from
Titles, authors, venues and citation counts come from OpenAlex, an open catalogue of scholarly works (CC0). This snapshot was taken on November 15, 2026; newer papers and citations are not in it yet.
How the map is made
Each paper is read by SPECTER2, a model trained on scientific writing, and linked to the papers closest to it in content. Groups are named after the OpenAlex topic most of their papers share. How the Literature Matrix works
Spotted a problem?
A wrong detail, an important paper missing, or your own work shown in a way you would like changed? Tell us and we will look at it.
This map is a starting point, not a literature review: it shows a sample of the papers OpenAlex returns for this topic and can miss important work. Read the papers themselves before you cite them.