Clause complexing in research-article abstracts: Comparing human- and AI-generated texts

The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generate...

Full description

Saved in:
Bibliographic Details
Main Author: Leong Alvin Ping
Format: Article
Language:English
Published: Sciendo 2023-12-01
Series:ExELL (Explorations in English Language and Linguistics)
Subjects:
Online Access:https://doi.org/10.2478/exell-2023-0008
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832576282733314048
author Leong Alvin Ping
author_facet Leong Alvin Ping
author_sort Leong Alvin Ping
collection DOAJ
description The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended.
format Article
id doaj-art-6ff01cc46d2c4616bbe26b71801502fb
institution Kabale University
issn 2303-4858
language English
publishDate 2023-12-01
publisher Sciendo
record_format Article
series ExELL (Explorations in English Language and Linguistics)
spelling doaj-art-6ff01cc46d2c4616bbe26b71801502fb2025-01-31T08:34:31ZengSciendoExELL (Explorations in English Language and Linguistics)2303-48582023-12-011129913210.2478/exell-2023-0008Clause complexing in research-article abstracts: Comparing human- and AI-generated textsLeong Alvin Ping01Nanyang Technological University, SingaporeThe ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended.https://doi.org/10.2478/exell-2023-0008abstractsclause complexinggenerative aibardchatgptpoe assistant
spellingShingle Leong Alvin Ping
Clause complexing in research-article abstracts: Comparing human- and AI-generated texts
ExELL (Explorations in English Language and Linguistics)
abstracts
clause complexing
generative ai
bard
chatgpt
poe assistant
title Clause complexing in research-article abstracts: Comparing human- and AI-generated texts
title_full Clause complexing in research-article abstracts: Comparing human- and AI-generated texts
title_fullStr Clause complexing in research-article abstracts: Comparing human- and AI-generated texts
title_full_unstemmed Clause complexing in research-article abstracts: Comparing human- and AI-generated texts
title_short Clause complexing in research-article abstracts: Comparing human- and AI-generated texts
title_sort clause complexing in research article abstracts comparing human and ai generated texts
topic abstracts
clause complexing
generative ai
bard
chatgpt
poe assistant
url https://doi.org/10.2478/exell-2023-0008
work_keys_str_mv AT leongalvinping clausecomplexinginresearcharticleabstractscomparinghumanandaigeneratedtexts