Congrats to Vanderbuilt University for coming to this (now obvious) conclusion:
"we do not believe that AI detection software is an effective tool that should be used."
OpenAI has withdrawn its own deeply flawed AI detection tool. Turnitin should do the same. 4% false positve rate (if it even is that low) is simply not good enough. And can impugn the innocent.

#ai #detection #education #TurnItIn

https://www.vanderbilt.edu/brightspace/2023/08/16/guidance-on-ai-detection-and-why-were-disabling-turnitins-ai-detector/

"Since our release, we discovered real-world use is yielding different results from our lab" - doh! Of course it is!

https://www.turnitin.com/blog/ai-writing-detection-update-from-turnitins-chief-product-officer

'Real-world use' is an open system; your lab controls for a closed system. Academic writing is an open system so why would your tests yield anything valid, reliable, generalisable or replicable?

Profit-driven #EdTech that creates the problems and then sells us back the solutions to the rot they they spread is nauseating.

#AcWri #Turnitin #plagiarism

#AcademicMastodon

Could you share recent published research, commentary (eg blogs), informed opinion, good/bad practice on #Turnitin, including references to its claims to detect AI use in student writing (which I think it then retracted - I saw a publication on this but didn’t save it and now can’t find it)?

I’m asking because many institutions still subscribe, defer, and default to it and I'm not sure I fully understand why.

Thx
#AcWri #AcademicIntegrity #ArtificialIntelligence #plagiarism

Pondering past bright ideas that bubbled up from good intentions and then popped abruptly on contact with reality...

Once upon a time, there was just a whole heap of academic misconduct. This came to light through a little software tool I made (similar to #MOSS if you've heard of that), which compares student code submissions to one another.

This made a lot of people very angry.

One suggestion, for the future, was to provide a facility for students to submit their code to the tool, to get academic integrity feedback beforehand. The good-intentioned panel of senior academics was thinking about #Turnitin, of course. (We didn't use Turnitin because it's basically unusable for code submissions.)

This initially-non-negotiable edict disappeared without trace, possibly because people eventually succumbed to the reality that the tool _compares_ submissions, and can't do anything with just one submission at a time.

Moreover, if it could function as desired, it would just provide a way for misconduct to be obfuscated to avoid detection. Some students at the time had tried to argue that they'd stumbled unwittingly into committing academic misconduct by accident, and, oh, if only they'd been able to check beforehand! Senior people believed this.

I still harbour some faint, perverse desire to be able to argue this in person. Oh well.

One thing that makes me wonder/worry and confuses me is that when I'm talking to other students and they mention similarity in essays that mine is much lower than theirs (theirs is avg 20%s and mine single percentiles) even though i add quotes etc. I'm not sure if that is a bad thing or a good thing. but it is definitaly a thing.
#university #AcademicMastadon #TurnItIn #AcademicWriting

EDUCAUSE Demo Day is on April 27. Join your peers in #HigherEd/@EdTech to learn about tools to support digital learning initiatives and transform the overall teaching and learning experience.

Featured technologies include: #CambPressAssess, #CidiLabs, #pluralsight, #SakaiLMS, #Turnitin, #TopHat

https://bit.ly/3mEil9U

The cat and mouse game between old school exams paired with anti cheating software vs ai has just begun!

#chatgpt #turnitin #education #teachers #students #exams #edtech

https://reddit.com/r/ChatGPT/comments/12r08t8/turnitins_ai_detection_is_going_to_make_schools_a/

#Turnitin was already a very problematic technology before they published their “AI score” but now we can punish students based on a completely opaque, unauditable and unaccountable algorithm. #ai #llm #chatgpt #edtech #education #technology

I am now having the #ai #ethics talk with my colleagues because we are using #turnitin to assess whether students have used AI and I find it very very problematic. #technology #education #edtech #chatgpt

Just noticed that 'Turn it In' the plagirism detection software has added a beta "AI writing detection" score to student assignments.

This is what us markers see (I'm teaching Design Foundations at AdelaideUni).

Further background on Turnitin’s AI 'Writing Detection' Capabilities:

https://www.turnitin.com/products/features/ai-writing-detection

Seems the juries still out on how much we let or encourage students to engage/avoid these tools and what score is appropriate 🤷‍♂️.

#chatGPT #academicmastodon #plagarism #AI #turnitin

🔍 **Descubrimiento sorprendente: El detector ChatGPT de Turnitin podría afectar a estudiantes inocentes** 😲

Recientemente, el *Washington Post* publicó un artículo sobre el nuevo detector ChatGPT de Turnitin y los resultados son sorprendentes. La herramienta fue probada con la colaboración de cinco estudiantes de secundaria y demostró no siempre ser precisa.

#ChatGPT #Turnitin #Educación #Inteligencia
https://www.washingtonpost.com/technology/2023/04/01/chatgpt-cheating-detection-turnitin/

“The university is focusing on educating students around responsible and appropriate use. Our goal is to help students understand how generative AI can be used ethically and responsibly in their learning and assessment, and how it may be used effectively in their current or future careers,”
https://www.smh.com.au/education/university-cheats-on-notice-after-launch-of-chatgpt-detection-software-20230403-p5cxpc.html
#GenerativeAI #ChatGPT #Turnitin #Assessment

@petersuber @academicchatter
I worry about this, too - I've been in so many contested discussions with fellow assessors re. #TurnItIn to know that although it's an expected part of healthy academic development to *improve* (if the conditions are right), the daggers of suspicion are are built into the educative system: why are we in a situation where well-intentioned & diligent students are forced to write badly to avoid suspicion? #AcWri

It's sick. #Assessment & #HigherEducation must change.

Update. This fear is coming true.

We tested a new ChatGPT-detector for teachers. It flagged an innocent student.
https://www.washingtonpost.com/technology/2023/04/01/chatgpt-cheating-detection-turnitin/

"Five high school students helped our tech columnist test a #ChatGPT detector coming from #Turnitin to 2.1 million teachers. It missed enough to get someone in trouble."

#AI #NotHypothetical #Plagiarism

Is ChatGPT the End of Writing? Turnitin Believes It Could Actually Boost Students' Writing Instruction -- THE Journal

https://thejournal.com/articles/2023/03/27/turnitin-wants-to-help-educators-meet-the-moment-of-chatgpt.aspx #ai #chatgpt #turnitin #education #teaching #learning #k12 #school

@mssprovenance

Oh what fun! This is something that novice users of text-comparison software miss. They only look at the number reported, not the results. I've tried to talk the software companies into losing the number, but they say their customers insist on having it....

Notice that the software they are using does not use correct English ("Risk of the plagiarism") and has a logo that is quite similar to the one #Turnitin uses:

TurnItIn is so dumb.

It marked 25% of my most recent Business Communication assignment - a 5-page "research paper" about Large Language Model Artificial Intelligence - as "plagiarized".

That 25% was the References page. Ugggh.

#TurnItIn #Dumb

Turnitin AI Writing Detector to Be Available as Soon as April -- THE Journal https://thejournal.com/articles/2023/02/13/turnitin-ai-writing-detector-to-be-available-as-soon-as-april.aspx

#turnitin #ai #writing #plagarism #schools #education #teaching #learning #k12

Anti-Plagiarism Service Turnitin Is Building a Tool To Detect ChatGPT-Written Essays https://news.slashdot.org/story/23/01/23/2325221/anti-plagiarism-service-turnitin-is-building-a-tool-to-detect-chatgpt-written-essays?utm_source=feedly1.0mainlinkanon&utm_medium=feed #turnitin @edutooter #edchat #edtech Yes. We need to reconsider what we are teaching since we live in a world where #AI exists. #edutooter #edutooters

TurnItIn is developing a AI writing and ChatGPT detection capability for teachers.

https://www.turnitin.com/blog/sneak-preview-of-turnitins-ai-writing-and-chatgpt-detection-capability/

#AI #ChatGPT #Writing #TurnItIn