Bulletin of the American Physical Society
APS March Meeting 2024
Monday–Friday, March 4–8, 2024; Minneapolis & Virtual
Session M28: Neurodynamical Models of Cognition
8:00 AM–11:00 AM,
Wednesday, March 6, 2024
Room: 101I
Sponsoring
Units:
GSNP DSOFT DBIO
Chair: Jason Kim, Cornell University
Abstract: M28.00012 : Diffusion RNN: Extracting Low-Dimensional Structures in Data as Quasi-stable Manifolds
10:36 AM–10:48 AM
Presenter:
Toni J Liu
(Cornell University)
Authors:
Toni J Liu
(Cornell University)
Jason Z Kim
(Cornell University)
A hallmark of intelligence is discerning simple patterns in complex, noisy environments. How can a disordered, autonomous neural system identify low-dimensional structures in noisy, high-dimensional data? We introduce Diffusion RNN (Recurrent Neural Network), a neural-dynamical model that extracts hierarchies of low-dimensional manifolds from observed data. This model learns from data a reverse-time Langevin process that iteratively filters noise from a Gaussian cloud initialized at time T, revealing the learned data distribution at time 0. Unlike generative AI diffusion models, diffusion RNNs are fully recurrent and can operate beyond time 0. When run in negative time, they produce nonlinear manifolds - such as 2D shells, 1D skeletons, and 0D fixed points - that summarize the higher-dimensional data. These structures could serve as coarse maps for navigating complex memory and concept landscapes. Our results also show that a single Diffusion RNN can adaptively manipulate these low-dimensional manifolds to interpolate and extrapolate between multiple target distributions. Lastly, we link the hierarchy of learned manifolds to the separation of time scales in RNN dynamics and evaluate the robustness of Diffusion RNN as a nonlinear dimensionality reduction method.
Follow Us |
Engage
Become an APS Member |
My APS
Renew Membership |
Information for |
About APSThe American Physical Society (APS) is a non-profit membership organization working to advance the knowledge of physics. |
© 2024 American Physical Society
| All rights reserved | Terms of Use
| Contact Us
Headquarters
1 Physics Ellipse, College Park, MD 20740-3844
(301) 209-3200
Editorial Office
100 Motor Pkwy, Suite 110, Hauppauge, NY 11788
(631) 591-4000
Office of Public Affairs
529 14th St NW, Suite 1050, Washington, D.C. 20045-2001
(202) 662-8700