How the sounds we hear help us predict how things feel

Published by  News archive

On 24th Aug 2022

Researchers at the University of East Anglia have made an important discovery about the way our brains process the sensations of sound and touch.


A new study published today shows how the brain’s different sensory systems are all closely interconnected – with regions that respond to touch also involved when we listen to specific sounds associated with touching objects.

They found that these areas of the brain can tell the difference between listening to sounds such as such as a ball bouncing, or the sound of typing on a keyboard.

It is hoped that understanding this key area of brain function may in future help people who are neurodiverse, or with conditions such as schizophrenia or anxiety. And it could lead to developments in brain-inspired computing and AI.

Lead researcher Dr Fraser Smith, from UEA’s School of Psychology, said: “We know that when we hear a familiar sound such as a bouncing a ball, this leads us to expect to see a particular object. But what we have found is that it also leads the brain to represent what it might feel like to touch and interact with that object.

“These expectations can help the brain process sensory information more efficiently.”

The research team used an MRI scanner to collect brain imaging data while 10 participants listened to sounds generated by interacting with objects - such as bouncing a ball, knocking on a door, crushing paper, or typing on a keyboard.

Using a special imaging technique called functional MRI (fMRI), they measured brain activity throughout the brain.

They used sophisticated machine learning analysis techniques to test whether the activity generated in the earliest touch areas of the brain (primary somatosensory cortex) could tell apart sounds generated by different types of object interaction (bouncing a ball, verses typing on a keyboard).

They also performed a similar analysis for control sounds, similar to those used in hearing tests, to rule out that just any sounds can be discriminated in this brain region.

Researcher Dr Kerri Bailey said: “Our research shows that parts of our brains, which were thought to only respond when we touch objects, are also involved when we listen to specific sounds associated with touching objects.

“This supports the idea that a key role of these brain areas is to predict what we might experience next, from whatever sensory stream is currently available.

Dr Smith added: “Our findings challenge how neuroscientists traditionally understand the workings of sensory brain areas and demonstrate that the brain’s different sensory systems are actually all very interconnected.

“Our assumption is that the sounds provide predictions to help our future interaction with objects, in line with a key theory of brain function – called Predictive Processing.

“Understanding this key mechanism of brain function may provide compelling insights into mental health conditions such as schizophrenia, autism or anxiety and in addition, lead to developments in brain-inspired computing and AI.”

This study was led by UEA, in collaboration with researchers at Aix-Marseille University (France) and Maastricht University (Netherlands).

‘Decoding sounds depicting hand-object interactions in primary somatosensory cortex’ is published in the journal Cerebral Cortex on August 24, 2022.

Latest News

 
Two people eating a range of Mediterranean dishes.
31 Mar 2023

Could a Mediterranean diet improve your mood?

Researchers at UEA are launching a study to see whether following a Mediterranean diet for just five days could improve people’s mental health.

Read more >
 
Steven Fry
30 Mar 2023

Stephen Fry Travel Awards to help fund University of East Anglia students’ American dreams

Acclaimed British writer, actor and comedian Stephen Fry is launching the Stephen Fry Travel Awards in American Studies with the University of East Anglia (UEA),...

Read more >
 
A grey horse with a red halter and blue coat standing in a field, with the Black Beauty new book edition being held out in front of it.
30 Mar 2023

UEA Publishing Project launch new edition of Black Beauty to raise money for horse sanctuary

UEA is publishing a special edition of Black Beauty in collaboration with Redwings Horse Sanctuary, which will raise funds to help the horses, ponies, donkeys...

Read more >
 
A baby's feet with medical monitoring equipment.
29 Mar 2023

Probiotics and breast milk support health of premature babies

Probiotic supplements could save the lives of premature babies and help them develop a healthy microbiome – according to new research involving the University of...

Read more >
Are you searching for something?
 
A baby's feet with medical monitoring equipment.
29 Mar 2023

Probiotics and breast milk support health of premature babies

Probiotic supplements could save the lives of premature babies and help them develop a healthy microbiome – according to new research involving the University of...

Read more >
 
Left to right - UEA and PNU campus
29 Mar 2023

Researchers and students from Norwich and Ukraine unite to research the impacts of war on nature and the environment

A new project, funded by £131,000 from Universities UK International (UUK), will see academics from University of East Anglia (UEA) and Vasyl Stefanyk...

Read more >
 
A column of smoke rising from a power plant.
29 Mar 2023

“Critical tool” launched to track national contributions to climate change

Read more >
 
A man holds a credit card as he types on a laptop.
28 Mar 2023

How repeated questions could put you at risk of cyber crime

People reveal more personal information when you ask them the same questions a second time – according to new research from the University of East Anglia.

Read more >
 
Prof David Maguire
27 Mar 2023

University of East Anglia appoints new Vice-Chancellor

UEA is very pleased to announce that Professor David Maguire has been appointed as the University’s new Vice-Chancellor, joining in May 2023.

Read more >
 
A group of people in a meeting.
27 Mar 2023

INCREASE VS project helps thousands of people into employment and entrepreneurship

New research led by the University of East Anglia (UEA) shows that large infrastructure projects must also offer sustainable, local investment in deprived...

Read more >