Attention: You are using an outdated browser, device or you do not have the latest version of JavaScript downloaded and so this website may not work as expected. Please download the latest software or switch device to avoid further issues.

News > The House > GENERATIVE ARTIFICIAL INTELLIGENCE

GENERATIVE ARTIFICIAL INTELLIGENCE

Dr Ilia Shumailov and Professor Yarin Gal recently co-authored a research paper exploring the potential limitations of Artificial Intelligence 'large language models' (LLMs) such as OpenAI’s ChatGPT.
14 Aug 2024
The House
Dr Ilia Shumailov and Professor Yarin Gal
Dr Ilia Shumailov and Professor Yarin Gal

While many advances in LLMs have been hailed as success stories – for instance the ability of Google’s Gemini to generate texts and images – these models have been trained on human-produced content. When such models instead begin to use data that has itself been generated using Artificial Intelligence, quality is compromised. Indeed it can, ultimately, lead to 'model collapse':

'Model collapse is a degenerative process affecting generations of learned generative models, in which the data they generate end up polluting the training set of the next generation.Being trained on polluted data, they then mis-perceive reality.'

Shumailov, I., Shumaylov, Z., Zhao, Y. et al. 'AI models collapse when trained on recursively generated data', Nature 631, 755–759 (2024). 

The article is available here.

Professor Yarin Gal is Tutor in Computer Science at Christ Church and Dr Ilia Shumailov was, until recently, a Junior Research Fellow at the college. The article was written in collaboration with PhD student, Zakhar Shumaylov, and Professor Ross Anderson – both of the University of Cambridge – along with Dr Yiren Zhao, Imperial College, London, and Professor Nicolas Papernot, University of Toronto. 

SIMILAR STORIES

Professor Alexander Kuo has received a Recognition of Distinction from the University of Oxford and becomes Professor of Politics at the Department of Politics and International Re… More...

Christ Church will be holding a memorial service for Dr Ron Truman on 30 January 2027 at 2pm in the Cathedral, with refr… More...

Entries are open for the 2027 Tower Poetry Competition! This year's theme is 'The Deep'. Students aged from 16 to 18, wh… More...

Graduate Lucas Colley (2022, Computer Science & Philosophy) has been awarded the Hoare Prize for the best overall perfor… More...

Over the summer, 30 students from 22 colleges spent eight weeks turning early ideas into ventures as part of StEP – Oxfo… More...

Have your say