Publications: Assessment and Comparative Judgement

My work is largely focused on teaching, learning, and assessment in technology and engineering education. I am particularly interested in the role of spatial ability in learning, the use of adaptive comparative judgement in educational assessment, and meta-research with the aim of improving research practices broadly within technology and engineering education research. Full texts of my publications are currently available on my ResearchGate profile. If you cannot find a full text, please email me and I will provide one.

You can use the below buttons to filter between all publications and those relating to my three primary areas of research interest.

All publications Spatial ability Comparative judgement Research credibility

Methodological development of comparative judgement

  • Investigating the impact of comparison difficulty and judge fatigue on the feasibility of comparative judgement for technology education
    Buckley, J., & Zhu, C. (2025). The 42nd International Pupils’ Attitudes Towards Technology Conference Proceedings 2025. Montreal, Canada: Université de Sherbrooke.

  • An open-source adaptive comparative judgement app for technology education research and practice: Alpha version
    Buckley, J. (2024). Journal of Technology Education, 36(1), 58-82. https://doi.org/10.21061/jte.v36i1.a.4

  • Simulating adaptive comparative judgement sessions to determine the effect of judge disagreement on reliability
    Buckley, J., & Lin, T.-J. (2024). The 41st International Pupils’ Attitudes Towards Technology Conference Proceedings 2024. Nanjing, China: Nanjing Normal University.

  • Modelling approaches to combining and comparing independent adaptive comparative judgement ranks
    Buckley, J., Seery, N., & Kimbell, R. (2023). The 40th International Pupils’ Attitudes Towards Technology Conference Proceedings 2023. Liverpool, UK: Liverpool John Moores University.

  • Assessing performance: The technical challenges in developing and validating “ACJ-Steady State”
    Buckley, J., & Canty, D. (2022). PATT2022: PATT on the Edge: Technology, Innovation, and Education. Newfoundland & Labrador, Canada: Memorial University.

  • A review of the valid methodological use of adaptive comparative judgement in technology education research
    Buckley, J., Seery, N., & Kimbell, R. (2022). Frontiers in Education, 7(787926), 1-6. https://doi.org/10.3389/feduc.2022.787926

Conceptual and applied framing of comparative judgement

  • Using teachers’ judgements of quality to establish performance standards across schools, communities, and nations
    Seery, N., Kimbell, R., & Buckley, J. (2022). Frontiers in Education, 7(806894), 1-8. https://doi.org/10.3389/feduc.2022.806894

  • A conceptual framework for the assessment of learning in technology classroom based assessments
    Canty, D., Seery, N., Buckley, J., & Dunbar, R. (2021). Techne Series: Research in Sloyd Education and Craft Sciences, 28(2), 213-220. https://journals.oslomet.no/index.php/techneA/article/view/4334

  • A conceptual framework for the assessment of learning in technology classroom based assessments
    Canty, D., Seery, N., Buckley, J., & Dunbar, R. (2021). PATT2021: Technology in Our Hands. Creative Pedagogy and Ambitious Teacher Education. Rauma, Finland: University of Turku.

  • Comparative judgement: An overview
    Hartell, E., & Buckley, J. (2021). In A. Marcus Quinn, & T. Hourigan (Eds.), Handbook for Online Learning Contexts: Digital, Mobile and Open (pp. 289-307). Springer. https://doi.org/10.1007/978-3-030-67349-9_20

  • Inducting ITE students in assessment practices through the use of comparative judgement
    Canty, D., Seery, N., & Buckley, J. (2019). In S. Pule (Ed.), PATT2019: Developing a Knowledge Economy through Technology and Engineering Education. Msida, Malta: University of Malta.

  • Integrating assessment and design activity in engineering education: A proposed synthesis of adaptive comparative judgement and the CDIO framework
    Hyland, T., Buckley, J., Seery, N., Gordon, S., & Canty, D. (2018). Engineering Design Graphics Journal, 82(2), 1-16. https://www.edgj.org/index.php/EDGJ/article/view/683

  • Assessing design activity in engineering education: A proposed synthesis of adaptive comparative judgement and the CDIO framework
    Hyland, T., Buckley, J., Seery, N., Gordon, S., & Canty, D. (2018). Proceedings of the ASEE Engineering Design Graphics Division 72nd Mid-Year Conference. Montego Bay, Jamaica: ASEE.

Applications of comparative judgement for assessment and measurement

  • A holistic look at creativity: Evaluating pupils’ creative design ideation and prototypes through comparative judgment
    Zhu, C., Buckley, J., Klapwijk, R., Spandaw, J., & de Vries, M. (2025). International Journal of Technology and Design Education. https://doi.org/10.1007/s10798-025-10027-w

  • Using adaptive comparative judgement to holistically assess creativity of design solutions: A comparison of first-year students and educators judgements
    Reid, C., Sorby, S., Raju, G., Buckley, J., & Seery, N. (2023). In Proceedings of the 130th ASEE Annual Conference and Exposition. Baltimore, Maryland: American Society for Engineering Education.

  • An exploration into the criteria used in assessing design activities with adaptive comparative judgment in technology education
    Buckley, J., Canty, D., & Seery, N. (2022). Irish Educational Studies, 41(2), 313-331. https://doi.org/10.1080/03323315.2020.1814838

  • Integrating learners into the assessment process using adaptive comparative judgement with an ipsative approach to identifying competence based gains relative to student ability levels
    Seery, N., Buckley, J., Delahunty, T., & Canty, D. (2019). International Journal of Technology and Design Education, 29(4), 701-715. https://doi.org/10.1007/s10798-018-9468-x

  • Illustrating educational development through ipsative performance in design based education
    Seery, N., Delahunty, T., Canty, D., & Buckley, J. (2017). In M. de Vries, L. Litowitz, & S. Warner (Eds.), PATT2017: Technology & Engineering Education – Fostering the Creativity of Youth Around The Globe. Philadelphia, USA: Millersville University of Pennsylvania.

  • The validity and reliability of adaptive comparative judgements in the assessment of graphical capability
    Seery, N., Buckley, J., Doyle, A., & Canty, D. (2016). In J. Birchman (Ed.), ASEE Engineering Design Graphics Division 71st Mid-Year Conference (pp. 104-109). Nashua, New Hampshire: Proceedings of ASEE.

Broader assessment scholarship

  • Features of quality and assessment standards in newly reformed Irish Junior Cycle technology education
    Buckley, J., Seery, N., Canty, D., & Dunbar, R. (2023). In S. Bartholomew, M. Hoepfl, & P. J. Williams (Eds.), Standards-Based Technology and Engineering Education: 63rd Yearbook of the Council on Technology and Engineering Teacher Education (pp. 219-233). Springer Nature. https://doi.org/10.1007/978-981-99-5704-0_14