Using GPTZero to Combat Plagiarism with ChatGPT

The use of ChatGPT for plagiaristic purposes has been the fear of many educators since the AI tool was released in November of 2022. To combat this issue, Princeton University student Edward Tian has created software he believes to be the solution. Tian’s app, GPTZero, was developed in December of 2022 when the coder took it upon himself to create an app that can determine if a body of text has been created by a human or AI. Tian created the app to protect individuals in the midst of a changing technological landscape stating, “I think it is important for people to bet on independent parties to build the safeguards for their technologies.”

The technology works by measuring two factors: perplexity and burstiness. Perplexity refers to the degree of randomness present in a text. Human-created work often uses language in a more chaotic, disorganized way than AI. Hence, the more random a body of text is, the more likely it is to be human-generated. Burstiness is the second factor that refers to the complexity and diversity of sentence and language structure within a text. AI-generated material is much more uniform in style than human-created text. When individuals write, they vary their structure which creates natural “bursts” throughout the writing. AI has not been able to effectively emulate this ability. Thus, using these mechanisms in tandem, GPTZero is able to effectively determine if a text is AI generated with 98% accuracy.

While 98% effective, many have criticized GPTZero for its inability to distinguish texts that are a mix of human and AI-created. Tian emphasizes the limitations of his app stating that he doesn’t want anyone “making definitive decisions” in regard to the app’s ability to predict AI-generated work. Tian simply seeks to preserve the integrity of authentic composition by thwarting ChatGPT’s potential misuse.

 Kayley Horton, Tutoring Coordinator
kayley@testprepchicago.com
(312) 848-1266

Chat GPT

As technology evolves, it has become nearly impossible to discern artificial intelligence from authentic human work. This presents a particular problem for educators as students are more likely than ever to use technology in lieu of completing their own schoolwork. Chat GPT is an artificial intelligence program at the forefront of this issue. Educators are wary of this AI because it is available widely and has the ability to answer questions, write essays, and even code effectively.

However, while Chat GPT is often effective it is not foolproof. After testing its limits, Zurich-based data scientist Teresa Kubacka found that when presented with misinformation Chat GPT had no ability to determine inauthenticity. After asking the AI to write about a made-up phenomenon, Chat GPT went on to produce a work of equal nonsensical value, citing nonexistent sources and falsifying publications. This is yet another reason educators are trying to quell the spread of misinformation and safeguard students against academic dishonesty.

To disrupt the onslaught of AI-centered cheating, schools have taken measures to minimize student exposure to this technology. Recently, New York City schools have banned access to Chat GPT on all school-operated networks and computers. Seattle schools have also restricted access to Chat GPT as well as other websites used to forge classwork. In addition, many schools have also gone to lengths to invest in technology that is able to recognize AI-generated work. It is hoped that these changes will promote academic integrity by discouraging students from presenting AI-generated work as their own.

Kayley Horton, Tutoring Coordinator
kayley@testprepchicago.com
(312) 848-1266

Sources:

https://www.nytimes.com/2023/01/12/technology/chatgpt-schools-teachers.html
https://www.npr.org/2022/12/19/1143912956/chatgpt-ai-chatbot-homework-academia
https://apnews.com/article/what-is-chat-gpt-ac4967a4fb41fda31c4d27f015e32660