Project-based assessment in university web application courses is widely used because it shows how students integrate skills and knowledge across development. However, in large cohorts, project assessment becomes time-intensive and it is difficult to keep evaluation consistent across students. Automated support can reduce workload, but may limit instructors' agency during the assessment. To understand instructors' challenges and needs, we conducted semi-structured interviews followed by a sketching exercise with seven university instructors who regularly assess web application projects as part of the final exam. By analyzing data from both activities, we derived four themes and related implications. Key themes include critical thinking as the boundary for acceptable GenAI use and instructors' preference for instructor-in-the-loop tools that automate pre-checks and extract evidence to drive oral questioning. These findings can inform the development of systems that can support instructors in assessing web application projects at scale while keeping them in control of decisions.

Investigating Web Project Assessment in an AI World / Russo, Francesca; Saenz, Juan Pablo; De Russis, Luigi. - (In corso di stampa). ( Conference on Human Factors in Computing Systems Barcelona (ESP) April 13–17, 2026).

Investigating Web Project Assessment in an AI World

Russo, Francesca;Saenz, Juan Pablo;De Russis, Luigi
In corso di stampa

Abstract

Project-based assessment in university web application courses is widely used because it shows how students integrate skills and knowledge across development. However, in large cohorts, project assessment becomes time-intensive and it is difficult to keep evaluation consistent across students. Automated support can reduce workload, but may limit instructors' agency during the assessment. To understand instructors' challenges and needs, we conducted semi-structured interviews followed by a sketching exercise with seven university instructors who regularly assess web application projects as part of the final exam. By analyzing data from both activities, we derived four themes and related implications. Key themes include critical thinking as the boundary for acceptable GenAI use and instructors' preference for instructor-in-the-loop tools that automate pre-checks and extract evidence to drive oral questioning. These findings can inform the development of systems that can support instructors in assessing web application projects at scale while keeping them in control of decisions.
In corso di stampa
File in questo prodotto:
File Dimensione Formato  
chi26d-sub5956-cam-i61.pdf

accesso aperto

Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: Creative commons
Dimensione 4.61 MB
Formato Adobe PDF
4.61 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3008077