ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems
The integration of artificial intelligence (AI) in education has significantly transformed learning environments, particularly through the use of large language models (LLMs) such as ChatGPT. While these tools show promise in supporting science and technology education, their effectiveness in solvin...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universitas Pendidikan Mandalika (UNDIKMA)
2025-04-01
|
| Series: | Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram |
| Subjects: | |
| Online Access: | https://e-journal.undikma.ac.id/index.php/prismasains/article/view/15824 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850083019746967552 |
|---|---|
| author | Ni Nyoman Sri Putu Verawati Wahyudi Wahyudi Nina Nisrina Muhammad Asy'ari |
| author_facet | Ni Nyoman Sri Putu Verawati Wahyudi Wahyudi Nina Nisrina Muhammad Asy'ari |
| author_sort | Ni Nyoman Sri Putu Verawati |
| collection | DOAJ |
| description | The integration of artificial intelligence (AI) in education has significantly transformed learning environments, particularly through the use of large language models (LLMs) such as ChatGPT. While these tools show promise in supporting science and technology education, their effectiveness in solving domain-specific problems, such as Newtonian mechanics, remains under-explored. This study aims to evaluate the capability of ChatGPT in solving essay-type physics problems involving Newton’s Laws of Motion, with a specific focus on force analysis. Using a content-based qualitative evaluation method, the research was conducted in three stages: development and validation of conceptual physics problems, submission of these problems to ChatGPT, and assessment of the AI-generated responses by expert reviewers. The problem used in this study required decomposition of forces on an inclined plane under idealized, frictionless conditions. ChatGPT's responses were evaluated across three dimensions: scientific accuracy, logical coherence, and contextual relevance. The findings indicate that while ChatGPT was able to provide structured and numerically accurate responses, it lacked depth in reasoning and failed to explicitly articulate physical assumptions and validation steps, such as analyzing counteracting gravitational forces. These limitations point to the model's partial conceptual understanding and highlight the need for human oversight. The study concludes that ChatGPT holds potential as a supplementary learning aid, particularly for reinforcing procedural knowledge. However, its use must be carefully integrated into instructional contexts that promote critical thinking and conceptual verification. Recommendations are offered for its pedagogical implementation, along with a call for further research into AI's role in physics education. |
| format | Article |
| id | doaj-art-4e716d1b930d45e2bbbb52af07c059d2 |
| institution | DOAJ |
| issn | 2338-4530 2540-7899 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Universitas Pendidikan Mandalika (UNDIKMA) |
| record_format | Article |
| series | Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram |
| spelling | doaj-art-4e716d1b930d45e2bbbb52af07c059d22025-08-20T02:44:23ZengUniversitas Pendidikan Mandalika (UNDIKMA)Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram2338-45302540-78992025-04-0113233534710.33394/j-ps.v13i2.158246836ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force ProblemsNi Nyoman Sri Putu Verawati0Wahyudi Wahyudi1Nina Nisrina2Muhammad Asy'ari3(Scopus ID: 57193126887); Department of Physics Education, Universitas MataramDepartment of Physics Education, Universitas MataramDepartment of Physics Education, Universitas MataramUniversitas Pendidikan MandalikaThe integration of artificial intelligence (AI) in education has significantly transformed learning environments, particularly through the use of large language models (LLMs) such as ChatGPT. While these tools show promise in supporting science and technology education, their effectiveness in solving domain-specific problems, such as Newtonian mechanics, remains under-explored. This study aims to evaluate the capability of ChatGPT in solving essay-type physics problems involving Newton’s Laws of Motion, with a specific focus on force analysis. Using a content-based qualitative evaluation method, the research was conducted in three stages: development and validation of conceptual physics problems, submission of these problems to ChatGPT, and assessment of the AI-generated responses by expert reviewers. The problem used in this study required decomposition of forces on an inclined plane under idealized, frictionless conditions. ChatGPT's responses were evaluated across three dimensions: scientific accuracy, logical coherence, and contextual relevance. The findings indicate that while ChatGPT was able to provide structured and numerically accurate responses, it lacked depth in reasoning and failed to explicitly articulate physical assumptions and validation steps, such as analyzing counteracting gravitational forces. These limitations point to the model's partial conceptual understanding and highlight the need for human oversight. The study concludes that ChatGPT holds potential as a supplementary learning aid, particularly for reinforcing procedural knowledge. However, its use must be carefully integrated into instructional contexts that promote critical thinking and conceptual verification. Recommendations are offered for its pedagogical implementation, along with a call for further research into AI's role in physics education.https://e-journal.undikma.ac.id/index.php/prismasains/article/view/15824chatgpt, newton’s laws of motion, physics education, artificial intelligence in learning, qualitative evaluation |
| spellingShingle | Ni Nyoman Sri Putu Verawati Wahyudi Wahyudi Nina Nisrina Muhammad Asy'ari ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram chatgpt, newton’s laws of motion, physics education, artificial intelligence in learning, qualitative evaluation |
| title | ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems |
| title_full | ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems |
| title_fullStr | ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems |
| title_full_unstemmed | ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems |
| title_short | ChatGPT in Physics Education: A Content-Based Analysis on Newtonian Force Problems |
| title_sort | chatgpt in physics education a content based analysis on newtonian force problems |
| topic | chatgpt, newton’s laws of motion, physics education, artificial intelligence in learning, qualitative evaluation |
| url | https://e-journal.undikma.ac.id/index.php/prismasains/article/view/15824 |
| work_keys_str_mv | AT ninyomansriputuverawati chatgptinphysicseducationacontentbasedanalysisonnewtonianforceproblems AT wahyudiwahyudi chatgptinphysicseducationacontentbasedanalysisonnewtonianforceproblems AT ninanisrina chatgptinphysicseducationacontentbasedanalysisonnewtonianforceproblems AT muhammadasyari chatgptinphysicseducationacontentbasedanalysisonnewtonianforceproblems |