Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT
AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to mitigate qualitative research workload. In this study, we conducted semi-structured interviews with 17 participants and held a co-design session with 13 qualitative researchers to develo...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-05-01
|
| Series: | Computers in Human Behavior: Artificial Humans |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2949882125000283 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850111189657321472 |
|---|---|
| author | He Zhang Chuhao Wu Jingyi Xie Yao Lyu Jie Cai John M. Carroll |
| author_facet | He Zhang Chuhao Wu Jingyi Xie Yao Lyu Jie Cai John M. Carroll |
| author_sort | He Zhang |
| collection | DOAJ |
| description | AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to mitigate qualitative research workload. In this study, we conducted semi-structured interviews with 17 participants and held a co-design session with 13 qualitative researchers to develop a framework for designing prompts specifically crafted to support junior researchers and stakeholders interested in leveraging AI for qualitative research. Our findings indicate that improving transparency, providing guidance on prompts, and strengthening users' understanding of LLMs' capabilities significantly enhance their ability to interact with ChatGPT. By comparing researchers' attitudes toward LLM-supported qualitative analysis before and after the co-design process, we reveal that the shift from an initially negative to a positive perception is driven by increased familiarity with the LLM's capabilities and the implementation of prompt engineering techniques that enhance response transparency and, in turn, foster greater trust. This research not only highlights the importance of well-designed prompts in LLM applications but also offers reflections for qualitative researchers on the perception of AI's role. Finally, we emphasize the potential ethical risks and the impact of constructing AI ethical expectations by researchers, particularly those who are novices, on future research and AI development. |
| format | Article |
| id | doaj-art-c00a441a58d342e5b3a3356a3ea3c3ea |
| institution | OA Journals |
| issn | 2949-8821 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Computers in Human Behavior: Artificial Humans |
| spelling | doaj-art-c00a441a58d342e5b3a3356a3ea3c3ea2025-08-20T02:37:39ZengElsevierComputers in Human Behavior: Artificial Humans2949-88212025-05-01410014410.1016/j.chbah.2025.100144Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPTHe Zhang0Chuhao Wu1Jingyi Xie2Yao Lyu3Jie Cai4John M. Carroll5College of Information Sciences and Technology, The Pennsylvania State University, Westgate Building, University Park, PA, 16803, USA; Corresponding author.College of Information Sciences and Technology, The Pennsylvania State University, Westgate Building, University Park, PA, 16803, USACollege of Information Sciences and Technology, The Pennsylvania State University, Westgate Building, University Park, PA, 16803, USACollege of Information Sciences and Technology, The Pennsylvania State University, Westgate Building, University Park, PA, 16803, USA; The School of Information, University of Michigan, MI, 48109, USACollege of Information Sciences and Technology, The Pennsylvania State University, Westgate Building, University Park, PA, 16803, USA; The Pervasive Human Computer Interaction Laboratory, Department of Computer Science and Technology, Tsinghua University, Future Internet Technology Research Center (FIT), Haidian District, Beijing, 100084, ChinaCollege of Information Sciences and Technology, The Pennsylvania State University, Westgate Building, University Park, PA, 16803, USAAI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to mitigate qualitative research workload. In this study, we conducted semi-structured interviews with 17 participants and held a co-design session with 13 qualitative researchers to develop a framework for designing prompts specifically crafted to support junior researchers and stakeholders interested in leveraging AI for qualitative research. Our findings indicate that improving transparency, providing guidance on prompts, and strengthening users' understanding of LLMs' capabilities significantly enhance their ability to interact with ChatGPT. By comparing researchers' attitudes toward LLM-supported qualitative analysis before and after the co-design process, we reveal that the shift from an initially negative to a positive perception is driven by increased familiarity with the LLM's capabilities and the implementation of prompt engineering techniques that enhance response transparency and, in turn, foster greater trust. This research not only highlights the importance of well-designed prompts in LLM applications but also offers reflections for qualitative researchers on the perception of AI's role. Finally, we emphasize the potential ethical risks and the impact of constructing AI ethical expectations by researchers, particularly those who are novices, on future research and AI development.http://www.sciencedirect.com/science/article/pii/S2949882125000283ChatGPTQualitative analysisPrompt designLarge language modelsAI-Assisted researchEthical considerations |
| spellingShingle | He Zhang Chuhao Wu Jingyi Xie Yao Lyu Jie Cai John M. Carroll Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT Computers in Human Behavior: Artificial Humans ChatGPT Qualitative analysis Prompt design Large language models AI-Assisted research Ethical considerations |
| title | Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT |
| title_full | Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT |
| title_fullStr | Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT |
| title_full_unstemmed | Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT |
| title_short | Harnessing the power of AI in qualitative research: Exploring, using and redesigning ChatGPT |
| title_sort | harnessing the power of ai in qualitative research exploring using and redesigning chatgpt |
| topic | ChatGPT Qualitative analysis Prompt design Large language models AI-Assisted research Ethical considerations |
| url | http://www.sciencedirect.com/science/article/pii/S2949882125000283 |
| work_keys_str_mv | AT hezhang harnessingthepowerofaiinqualitativeresearchexploringusingandredesigningchatgpt AT chuhaowu harnessingthepowerofaiinqualitativeresearchexploringusingandredesigningchatgpt AT jingyixie harnessingthepowerofaiinqualitativeresearchexploringusingandredesigningchatgpt AT yaolyu harnessingthepowerofaiinqualitativeresearchexploringusingandredesigningchatgpt AT jiecai harnessingthepowerofaiinqualitativeresearchexploringusingandredesigningchatgpt AT johnmcarroll harnessingthepowerofaiinqualitativeresearchexploringusingandredesigningchatgpt |