Using artificial intelligence tools for automating the assessment of future computer science teachers' work

This paper examines the problem of automated testing of modified programming tasks for future computer science teachers. It is recommended that GitHub Copilot be used to generate tests based on the code. This approach makes it possible to solve the following tasks: reducing the time and effort requ...

Full description

Saved in:
Bibliographic Details
Main Authors: Oleksandr M. Spazhev, Oksana V. Klochko
Format: Article
Language:deu
Published: Academy of Cognitive and Natural Sciences 2025-01-01
Series:Освітній вимір
Subjects:
Online Access:https://acnsci.org/journal/index.php/ed/article/view/801
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832595624922447872
author Oleksandr M. Spazhev
Oksana V. Klochko
author_facet Oleksandr M. Spazhev
Oksana V. Klochko
author_sort Oleksandr M. Spazhev
collection DOAJ
description This paper examines the problem of automated testing of modified programming tasks for future computer science teachers. It is recommended that GitHub Copilot be used to generate tests based on the code. This approach makes it possible to solve the following tasks: reducing the time and effort required for manual checking of programming tasks completed by students; promoting better assimilation of the material of the relevant disciplines by students; promoting the development and improvement of students' skills in algorithmisation and programming; compliance by students with academic integrity; effective use of GitHub Copilot to generate baseline tests to test modified programming assignments completed by students; ensuring the flexibility and scalability of the approach to the development of various training courses in programming; development of students' software product testing skills. In the process of research, we found the following disadvantages of using the GitHub Copilot system for generating basic tests: GitHub Copilot does not always generate perfect code or tests; for complex tasks, GitHub Copilot may require additional correction of the generated code. Therefore, it is important to check and refine the generated tests carefully, if necessary. Therefore, at the moment, we recommend using GitHub Copilot as a template generator for writing tests. The proposed approach is a promising solution for facilitating the verification of modified programming tasks and increasing the effectiveness of the education process of future informatics teachers. The conducted research opens up new prospects for effective improvement of the verification of modified tasks performed by students and the generation of tests for verification. In particular, the integration of the proposed system based on GitHub Copilot with learning management systems (LMS) and automated task verification systems. Another area of research could be exploring the possibilities of using other tools for generating tests instead of GitHub Copilot or combining them in order to obtain better results.
format Article
id doaj-art-80d1aaec85094716a6c2169db1360ec2
institution Kabale University
issn 2708-4604
2708-4612
language deu
publishDate 2025-01-01
publisher Academy of Cognitive and Natural Sciences
record_format Article
series Освітній вимір
spelling doaj-art-80d1aaec85094716a6c2169db1360ec22025-01-18T10:18:42ZdeuAcademy of Cognitive and Natural SciencesОсвітній вимір2708-46042708-46122025-01-0110.55056/ed.801Using artificial intelligence tools for automating the assessment of future computer science teachers' workOleksandr M. Spazhev0https://orcid.org/0009-0004-5456-1783Oksana V. Klochko1https://orcid.org/0000-0002-6505-9455Vinnytsia Mykhailo Kotsiubynskyi State Pedagogical UniversityVinnytsia Mykhailo Kotsiubynskyi State Pedagogical University This paper examines the problem of automated testing of modified programming tasks for future computer science teachers. It is recommended that GitHub Copilot be used to generate tests based on the code. This approach makes it possible to solve the following tasks: reducing the time and effort required for manual checking of programming tasks completed by students; promoting better assimilation of the material of the relevant disciplines by students; promoting the development and improvement of students' skills in algorithmisation and programming; compliance by students with academic integrity; effective use of GitHub Copilot to generate baseline tests to test modified programming assignments completed by students; ensuring the flexibility and scalability of the approach to the development of various training courses in programming; development of students' software product testing skills. In the process of research, we found the following disadvantages of using the GitHub Copilot system for generating basic tests: GitHub Copilot does not always generate perfect code or tests; for complex tasks, GitHub Copilot may require additional correction of the generated code. Therefore, it is important to check and refine the generated tests carefully, if necessary. Therefore, at the moment, we recommend using GitHub Copilot as a template generator for writing tests. The proposed approach is a promising solution for facilitating the verification of modified programming tasks and increasing the effectiveness of the education process of future informatics teachers. The conducted research opens up new prospects for effective improvement of the verification of modified tasks performed by students and the generation of tests for verification. In particular, the integration of the proposed system based on GitHub Copilot with learning management systems (LMS) and automated task verification systems. Another area of research could be exploring the possibilities of using other tools for generating tests instead of GitHub Copilot or combining them in order to obtain better results. https://acnsci.org/journal/index.php/ed/article/view/801automated work checkingmodified tasksprogramming GitHub Copilot future computer science teachers educational process
spellingShingle Oleksandr M. Spazhev
Oksana V. Klochko
Using artificial intelligence tools for automating the assessment of future computer science teachers' work
Освітній вимір
automated work checking
modified tasks
programming
GitHub Copilot
future computer science teachers
educational process
title Using artificial intelligence tools for automating the assessment of future computer science teachers' work
title_full Using artificial intelligence tools for automating the assessment of future computer science teachers' work
title_fullStr Using artificial intelligence tools for automating the assessment of future computer science teachers' work
title_full_unstemmed Using artificial intelligence tools for automating the assessment of future computer science teachers' work
title_short Using artificial intelligence tools for automating the assessment of future computer science teachers' work
title_sort using artificial intelligence tools for automating the assessment of future computer science teachers work
topic automated work checking
modified tasks
programming
GitHub Copilot
future computer science teachers
educational process
url https://acnsci.org/journal/index.php/ed/article/view/801
work_keys_str_mv AT oleksandrmspazhev usingartificialintelligencetoolsforautomatingtheassessmentoffuturecomputerscienceteacherswork
AT oksanavklochko usingartificialintelligencetoolsforautomatingtheassessmentoffuturecomputerscienceteacherswork