Connect with us

Technology

University examiners fail to spot ChatGPT answers in real-world test

Published

on

University examiners fail to spot ChatGPT answers in real-world test

Exams taken in person make it harder for students to cheat using AI

Trish Gant / Alamy

Ninety-four per cent of university exam submissions created using ChatGPT weren’t detected as being generated by artificial intelligence, and these submissions tended to get higher scores than real students’ work.

Peter Scarfe at the University of Reading, UK, and his colleagues used ChatGPT to produce answers to 63 assessment questions on five modules across the university’s psychology undergraduate degrees. Students sat these exams at home, so they were allowed to look at notes and references, and they could potentially have used AI although this wasn’t permitted.

Advertisement

The AI-generated answers were submitted alongside real students’ work, and accounted for, on average, 5 per cent of the total scripts marked by academics. The markers weren’t informed that they were checking the work of 33 fake students – whose names were themselves generated by ChatGPT.

The assessments included two types of questions: short answers and longer essays. The prompts given to ChatGPT began with the words “Including references to academic literature but not a separate reference section”, then copied the exam question.

Across all modules, only 6 per cent of the AI submissions were flagged as potentially not being a student’s own work – though in some modules, no AI-generated work was flagged as suspicious. “On average, the AI responses gained higher grades than our real student submissions,” says Scarfe, though there was some variability across modules.

Advertisement

“Current AI tends to struggle with more abstract reasoning and integration into information,” he adds. But across all 63 AI submissions, there was an 83.4 per cent chance that the AI work outscored that of the students.

The researchers claim that their work is the largest and most robust study of its kind to date. Although the study only checked work on the University of Reading’s psychology degree, Scarfe believes it is a concern for the whole academic sector. “I have no reason to think that other subject areas wouldn’t have just the same kind of issue,” he says.

“The results show exactly what I’d expect to see,” says Thomas Lancaster at Imperial College London. “We know that generative AI can produce reasonable sounding responses to simple, constrained textual questions.” He points out that unsupervised assessments including short answers have always been susceptible to cheating.

The workload for academics expected to mark work also doesn’t help their ability to pick up AI fakery. “Time-pressured markers of short answer questions are highly unlikely to raise AI misconduct cases on a whim,” says Lancaster. “I am sure this isn’t the only institution where this is happening.”

Advertisement

Tackling it at source is going to be near-impossible, says Scarfe. So the sector must instead reconsider what it is assessing. “I think it’s going to take the sector as a whole to acknowledge the fact that we’re going to have to be building AI into the assessments we give to our students,” he says.

Topics:

Source link

Advertisement
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Servers computers

Smallest Work Home Network Server Rack – DIY Mod Guide | First Aid Cabinet

Published

on

Smallest Work Home Network Server Rack - DIY Mod Guide | First Aid Cabinet



Looking for a neat place to store your switches? In this guide we chuck our huge oversized server rack and downsize into a first aid kit.

BUY NOW
First Aid Cabinet: https://vtudio.com/a/?a=first+aid+cabinet
Server Rack: https://vtudio.com/a/?a=server+rack
Netgear POE+ Switch: https://vtudio.com/a/?a=netgear+poe+8+port
Netgear XS716E Switch: https://vtudio.com/a/?a=netgear+xs716e
8 Bay NAS: https://vtudio.com/a/?a=qnap+tvs-872xt

COMPANION VIDEOS
12RU Server Rack: https://youtu.be/vnaM16668Yc
Netgear 10GBe Switch Review: https://youtu.be/stAHeDI6OFs
OWC 10GBe Adapter Review: https://youtu.be/sezu90wWwiU
QNAP NAS Review: https://youtu.be/bqxsLoo4jhY
IronWolf Review: https://youtu.be/kHTHL9W2A5I
Netgear POE+ Switch: https://youtu.be/xWr0iMcXEiQ

EXECUTIVE PRODUCERS
Vijaya Fernando: https://youtube.com/channel/UCHMRyJUGkyVFugl4tNQKvsA/
HomeGrownCanadian: https://youtube.com/channel/UCP2FrmHtee3AtQJUxnyzWnQ/
Aaron Patrick – The QuickBooks Chap: https://youtube.com/channel/UCo-Tl3tGYrFuOas623Ku3Lg

Advertisement

JOIN THE SHOW
Thanks for your support and if would like to help us produce more videos, please join us at: https://vtudio.com/a/?support

MUSIC
Ethan Meixsell – Run

FILMING TOOLS
https://vtudio.com/tools

Links to products often include an affiliate tracking code which allow us to earn fees on purchases you make through them. .

source

Advertisement
Continue Reading

Technology

Apple may release an iPad-like smart home display next year

Published

on

Apple may release an iPad-like smart home display next year

Apple is preparing to take a fresh run at the smart home that starts with a rumored smart display that it may release next year. That’s according to Bloomberg’s Mark Gurman, who writes in his Power On newsletter today that the display will use a new operating system, called homeOS, that’s based on the Apple TV’s tvOS (much like the software that drives HomePods now.)

Gurman reports that the display will run Apple apps like Calendar, Notes, and Home, and that Apple has tested prototypes with magnets for wall-mounting. And it will support Apple Intelligence — something Apple’s HomePods don’t currently do.

Another recent rumor suggested that a “HomeAccessory” device coming soon would be square-shaped, and that users might be able to use hand gestures from afar to control it, as 9to5Mac wrote earlier this week. And MacRumors has reported on apparent code references to the device and homeOS.

A display like this sounds more down-to-Earth than Apple’s robotic screen idea. It could also be less fiddly and hopefully less expensive than trying to use an iPad as a dedicated smart home controller (I’ve tried; it’s not a great experience!) We’ll find out if and when it launches — which doesn’t sound terribly far off.

Advertisement

Source link

Continue Reading

Technology

Google Maps, Street View, and Google Earth all get major updates – including a time travel feature

Published

on

Google Earth

There are some major updates to Google Maps, Street View, and Google Earth to know about – and the new and upgraded features should prove helpful in all kinds of ways for users of Google’s mapping tools.

The updates are outlined in a blog post by Google, and first up we’ve got the addition of historical imagery on Google Earth, going back as far as 80 years in some places. Some of this imagery has previously been available in the paid-for, Pro version of the software, but it’s now going to be accessible for all users across the web and mobile.

Source link

Continue Reading

Servers computers

VEVOR 18U Open Frame Server Rack

Published

on

VEVOR 18U Open Frame Server Rack



#Intel #augusttech #augusttech9

Subscribe for more! https://bit.ly/3s6OINL

Features – VEVOR 20U Open Frame Server Rack, 23”-40” Adjustable Depth, Free Standing or Wall Mount Network Server Rack, 4 Post AV Rack with Casters, Holds All Your Networking IT Equipment AV Gear Router Modem

Amazon: https://amzn.to/3Smga6S

Advertisement

//– GEAR –//
Camera – https://amzn.to/3TChd1U
WebCam – https://amzn.to/3CNCjU8
Microphone – https://amzn.to/3MRr0yL
Monitor 1 – https://amzn.to/3EUH7cN — https://ebay.us/NnDRrF
Monitor 2 – https://amzn.to/3ySLTE7
Processor Intel 10th Gen Core i5- https://amzn.to/3CM1jLx
External Sound Card – https://amzn.to/3EUDiEL
Mixing Console – https://amzn.to/3gkRJaS
USB-C Mini Dock – https://amzn.to/3CPjlfX

// FOLLOW ME ON SOCIAL //
Website ► https://www.augusttech.org/
Facebook ► https://www.facebook.com/augusttech9
Twitter ► https://twitter.com/augusttech9
Instagram ► https://www.instagram.com/augusttech9/

// DISCLAIMERS //
The links for the devices are an affiliate advertising program for us to earn advertising fees by advertising and linking to www.amazon.com.

#augusttech9 #windows11 #tech .

source

Advertisement
Continue Reading

Technology

See the solitary structures that once helped aircraft stay on course

Published

on

See the solitary structures that once helped aircraft stay on course
New Scientist. Science news and long reads from expert journalists, covering developments in science, technology, health and the environment on the website and the magazine.

VOR NVS is on the edge of the village of Navas del Rey, Spain

Ignacio Evangelista

These solitary structures were once a key pillar of aviation navigation, but, due to their remote locations, today they are little known. Photographer Ignacio Evangelista’s starkly beautiful shots shine a light on the beacons, dubbed VORs (very high-frequency omnidirectional range stations), and their role in carving out routes in the sky for aircraft.

New Scientist. Science news and long reads from expert journalists, covering developments in science, technology, health and the environment on the website and the magazine.

VOR CMA

Ignacio Evangelista

Advertisement

Essentially giant antennas, VORs beam out radio signals from secluded spots to allow planes to fix their location and stay on course by flying from VOR to VOR. The signals can be thought of as “breadcrumbs”, says Evangelista. The isolation is necessary to avoid interference in broadcasts between VORs.

Stations like the ones pictured here are a dying breed, as they are increasingly being decommissioned in favour of satellite-based GPS. But although GPS may be a more accurate means of navigation, VORs offer a back-up during events like solar storms or GPS interference, without which there could be a great deal of chaos, says Evangelista.

New Scientist. Science news and long reads from expert journalists, covering developments in science, technology, health and the environment on the website and the magazine.

VOR BRY

Ignacio Evangelista

Advertisement

Because their locations are publicly available, anyone can seek out a remaining VOR simply by using GPS – a “curious technological pirouette”, as Evangelista puts it. This set him on course to document some of the more photo-worthy stations before they disappear for good.

Pictured from the top, the first two stations are in Spain – VOR NVS is on the edge of the village of Navas del Rey, 50 kilometres from Madrid, while VOR CMA is 1.5 km from the village of Calamocha. The last, VOR BRY, is on the edge of French village Bray-sur-Seine.

Advertisement

 

Topics:

Source link

Advertisement
Continue Reading

Servers computers

Why Use Blade Server Systems?

Published

on

Why Use Blade Server Systems?



Learn how blade server systems and blade switches from BLADE Network Technologies are changing the data center. .

source

Continue Reading

Trending

Copyright © 2024 WordupNews.com