Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data
Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Si...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
University of Calgary
2025-01-01
|
| Series: | Teaching & Learning Inquiry: The ISSOTL Journal |
| Subjects: | |
| Online Access: | https://journalhosting.ucalgary.ca/index.php/TLI/article/view/79359 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832582628247601152 |
|---|---|
| author | Mirjam Sophia Glessmer Rachel Forsyth |
| author_facet | Mirjam Sophia Glessmer Rachel Forsyth |
| author_sort | Mirjam Sophia Glessmer |
| collection | DOAJ |
| description |
Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to answer this confidently based on published literature, which depicts both very positive as well as highly cautionary accounts. To fill this gap, we experiment with the use of chatbot style GenAI (namely ChatGPT 4, ChatGPT 4o, and Microsoft Copilot) to support or conduct qualitative analysis of survey and interview data from a SoTL project, which had previously been analysed by experienced researchers using thematic analysis. At first sight, the output looked plausible, but the results were incomplete and not reproducible. In some instances, interpretations and extrapolations of data happened when it was clearly stated in the prompt that the tool should only analyse a specified dataset based on explicit instructions. Since both algorithm and training data of the GenAI tools are undisclosed, it is impossible to know how the outputs had been arrived at. We conclude that while results may look plausible initially, digging deeper soon reveals serious problems; the lack of transparency about how analyses are conducted and results are generated means that no reproducible method can be described. We therefore warn against an uncritical use of GenAI in qualitative analysis of SoTL data.
|
| format | Article |
| id | doaj-art-05703102b056443db1e467053d5b138e |
| institution | Kabale University |
| issn | 2167-4779 2167-4787 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | University of Calgary |
| record_format | Article |
| series | Teaching & Learning Inquiry: The ISSOTL Journal |
| spelling | doaj-art-05703102b056443db1e467053d5b138e2025-01-29T13:10:35ZengUniversity of CalgaryTeaching & Learning Inquiry: The ISSOTL Journal2167-47792167-47872025-01-011310.20343/teachlearninqu.13.4Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL DataMirjam Sophia Glessmer0https://orcid.org/0000-0003-2270-0561Rachel Forsyth1https://orcid.org/0000-0001-7401-2870Lund UniversityLund University Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to answer this confidently based on published literature, which depicts both very positive as well as highly cautionary accounts. To fill this gap, we experiment with the use of chatbot style GenAI (namely ChatGPT 4, ChatGPT 4o, and Microsoft Copilot) to support or conduct qualitative analysis of survey and interview data from a SoTL project, which had previously been analysed by experienced researchers using thematic analysis. At first sight, the output looked plausible, but the results were incomplete and not reproducible. In some instances, interpretations and extrapolations of data happened when it was clearly stated in the prompt that the tool should only analyse a specified dataset based on explicit instructions. Since both algorithm and training data of the GenAI tools are undisclosed, it is impossible to know how the outputs had been arrived at. We conclude that while results may look plausible initially, digging deeper soon reveals serious problems; the lack of transparency about how analyses are conducted and results are generated means that no reproducible method can be described. We therefore warn against an uncritical use of GenAI in qualitative analysis of SoTL data. https://journalhosting.ucalgary.ca/index.php/TLI/article/view/79359Generative AIqualitative analysisresearch methodsacademic development |
| spellingShingle | Mirjam Sophia Glessmer Rachel Forsyth Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data Teaching & Learning Inquiry: The ISSOTL Journal Generative AI qualitative analysis research methods academic development |
| title | Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data |
| title_full | Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data |
| title_fullStr | Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data |
| title_full_unstemmed | Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data |
| title_short | Superficially Plausible Outputs from a Black Box: Problematising GenAI Tools for Analysing Qualitative SoTL Data |
| title_sort | superficially plausible outputs from a black box problematising genai tools for analysing qualitative sotl data |
| topic | Generative AI qualitative analysis research methods academic development |
| url | https://journalhosting.ucalgary.ca/index.php/TLI/article/view/79359 |
| work_keys_str_mv | AT mirjamsophiaglessmer superficiallyplausibleoutputsfromablackboxproblematisinggenaitoolsforanalysingqualitativesotldata AT rachelforsyth superficiallyplausibleoutputsfromablackboxproblematisinggenaitoolsforanalysingqualitativesotldata |