Author Topic: AI software reveals the inner workings of short-term memory  (Read 48 times)

Offline Chip (OP)

  • Server Admin
  • Hero Member
  • *****
  • Administrator
  • *****
  • Join Date: Dec 2014
  • Location: Australia
  • Posts: 5918
  • Reputation Power: 0
  • Chip has hidden their reputation power
  • Gender: Male
  • Last Login:Today at 07:31:22 AM
  • Deeply Confused Learner
Source: https://neurosciencenews.com/ai-short-term-memory-14203/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+neuroscience-rss-feeds-neuroscience-news+%28Neuroscience+News+Updates%29

Summary:

A recurrent neural network algorithm demonstrates short-term synaptic plasticity can support short term maintenance of information, providing the memory delay period is sufficiently short.

Research by neuroscientists at the University of Chicago shows how short-term, working memory uses networks of neurons differently depending on the complexity of the task at hand.

The researchers used modern artificial intelligence (AI) techniques to train computational neural networks to solve a range of complex behavioral tasks that required storing information in short term memory. The AI networks were based on the biological structure of the brain and revealed two distinct processes involved in short-term memory. One, a “silent” process where the brain stores short-term memories without ongoing neural activity, and a second, more active process where circuits of neurons fire continuously.

The study, led by Nicholas Masse, PhD, a senior scientist at UChicago, and senior author David Freedman, PhD, professor of neurobiology, was published this week in Nature Neuroscience.

“Short-term memory is likely composed of many different processes, from very simple ones where you need to recall something you saw a few seconds ago, to more complex processes where you have to manipulate the information you are holding in memory,” Freedman said. “We’ve identified how two different neural mechanisms work together to solve different kinds of memory tasks.”

Active vs silent memory

Many daily tasks require the use of working memory, information that you need to do something in the moment but are likely to forget later. Sometimes you actively remember something on purpose, like when you’re doing a math problem in your head or trying to remember a phone number before you have a chance to write it down. You also passively absorb information that you can recall later even if you didn’t make a point of remembering it, like if someone asks if you saw a particular person in the hallway.

Neuroscientists have learned a lot about how the brain represents information held in memory by monitoring the patterns of electrical activity coursing through the brains of animals as they perform tasks that require the use of short-term memory. They can then monitor the activity of brain cells and measure their activity as the animals perform the tasks.

But Freedman said he and his team were surprised that during certain tasks that required information to be held in memory, their experiments found neural circuits to be unusually quiet. This led them to speculate that these “silent” memories might reside in temporary changes in the strength of connections, or synapses, between neurons.

The problem is that it’s impossible using current technology to measure what’s happening in synapses during these “silent” periods in a living animal’s brain. So, Masse, Freedman and their team have been developing AI approaches that use data from the animal experiments to design networks that can simulate how the neurons in a real brain connect with each other. Then they can train the networks to solve the same kinds of tasks studied in the animal experiments.

During experiments with these biologically inspired neural networks, they were able to see two distinct processes at play during short-term memory processing. One, called persistent neuronal activity, was especially evident during more complex, but still short-term, tasks. When a neuron gets an input, it generates a brief electrical spike in activity. Neurons form synapses with other neurons, and as one neuron fires it triggers a chain reaction to make another neuron fire. Usually, this pattern of activity stops when the input is gone, but the AI model showed that when performing certain tasks, some circuits of neurons would continue firing even after an input was removed, like a reverberation or echo. This persistent activity appeared to be especially important for more complex problems that required information in memory to be manipulated in some way.

During experiments with these biologically inspired neural networks, they were able to see two distinct processes at play during short-term memory processing. The image is in the public domain.

The researchers also saw a second process that explained how the brain could keep information in memory without persistent activity, as they had observed in their brain recording experiments. It’s similar to the way the brain stores things in long-term memory by making complex networks of connections among many neurons. As the brain learns new information, these connections are strengthened, rerouted, or removed, a concept known as plasticity. The AI models showed that during the silent periods of memory, the brain can use a short-term form of plasticity in the synaptic connections between neurons to remember information temporarily.

Both of these forms of short-term memory last from a few seconds up to a few minutes. Some of the information used in working memory may end up in long-term storage, but most of it fades away with time.

“It’s like writing something with your finger on a fogged-up mirror instead of writing it with a permanent marker,” Masse said.

Complementary fields of research

The study demonstrates how valuable AI has become to the study of neuroscience, and how the two fields inform each other. Freedman said that artificial neural networks are often more intelligent and easier to train on complex tasks when they are modeled after the real brain. This also makes biologically-inspired AI networks better platforms for testing ideas about functions of the real brain functions.

“These two fields are really benefitting one another,” he said. “Insights from neuroscience experiments are helping create smarter AI and studying circuits in artificial networks is helping answer fundamental questions about the brain.”
Over 90% of all computer problems can be traced back to the interface between the keyboard and the chair !

Tags:
 

Related Topics

  Subject / Started by Replies Last post
0 Replies
1453 Views
Last post August 28, 2015, 07:08:24 PM
by Chip
6 Replies
2941 Views
Last post December 03, 2015, 04:27:47 AM
by Opi-ette
12 Replies
4610 Views
Last post September 14, 2015, 09:44:29 AM
by Mr.Apothecary
13 Replies
4487 Views
Last post October 08, 2015, 04:57:07 AM
by dysmorphic
27 Replies
7959 Views
Last post December 09, 2015, 09:41:25 PM
by Snout
1 Replies
1396 Views
Last post November 22, 2015, 02:41:15 AM
by puppy
1 Replies
1401 Views
Last post March 18, 2017, 08:54:31 PM
by Lolleedee
0 Replies
381 Views
Last post May 02, 2018, 07:10:00 AM
by Chip
1 Replies
385 Views
Last post October 21, 2018, 02:59:59 PM
by Chip
0 Replies
43 Views
Last post June 12, 2019, 01:31:27 PM
by Chip




TERMS AND CONDITIONS

In no event will d&u or any person involved in creating, producing, or distributing site information be liable for any direct, indirect, incidental, punitive, special or consequential damages arising out of the use of or inability to use d&u. You agree to indemnify and hold harmless d&u, its domain founders, sponsors, maintainers, server administrators, volunteers and contributors from and against all liability, claims, damages, costs and expenses, including legal fees, that arise directly or indirectly from the use of any part of the d&u site.


TO USE THIS WEBSITE YOU MUST AGREE TO THE TERMS AND CONDITIONS ABOVE



Founded December 2014