Thanks for your article. The references section was interesting. I'll add to the discussion a 2018 Nature letter: "Vector-based navigation using grid-like representations in artificial agents" https://www.nature.com/articles/s41586-018-0102-6 and a 2024 Nature article "Modeling hippocampal spatial cells in rodents navigating in 3D environments" https://www.nature.com/articles/s41598-024-66755-x And a simulation in Github from 2018 https://github.com/google-deepmind/grid-cells People have been looking at spacial awareness in neurology for quite a while. (In terms of the timeframe of recent developments in LLMs).
Vector-based navigation using grid-like representations in artificial agents
Andrea Banino, Caswell Barry, Benigno Uria
Show all 26 authors
Charles Blundell, Timothy Lillicrap, Piotr Mirowski, Alexander Pritzel, Martin J. Chadwick, Thomas Degris, Joseph Modayil, Greg Wayne, Hubert Soyer, Fabio Viola, Brian Zhang, Ross Goroshin, Neil Rabinowitz, Razvan Pascanu, Charlie Beattie, Stig Petersen, Amir Sadik, Stephen Gaffney, Helen King, Koray Kavukcuoglu, Demis Hassabis, Raia Hadsell, Dharshan Kumaran
2018 · Nature
- HN score
- 0
- Mentions
- 3
- Readers
- 3
- Months
- 3
In the conversation
Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels
3 selected excerpts · 3 total mentions
You might enjoy this paper[0] which shows that recurrent position encodings recover grid cell representations and maps to path integration found in a popular model of the hippocampus. This isn't terribly surprising since RNNs have shown this before[1, 2] but its an interesting connection. [0] https://arxiv.org/abs/2112.04035 [1] https://arxiv.org/abs/1803.07770 [2] https://www.nature.com/articles/s41586-018-0102-6
This paper is amazing, and exactly what I was thinking of posting in response to that part of the article. The amount of research Deepmind is putting out is astonishing, and even if you are paying attention it's hard to keep up with it all. Here are just a few papers I've been looking at from the last few months, maybe none of them are advancements on the level of AlphaGo & Zero but they still show significant progress in a wide variety of…
Read the full comment
areas. https://arxiv.org/abs/1802.10542 https://arxiv.org/abs/1802.07740 https://www.nature.com/articles/s41586-018-0102-6 https://arxiv.org/abs/1804.09401 https://arxiv.org/abs/1805.06370 https://arxiv.org/abs/1802.03006 https://arxiv.org/abs/1804.08617 https://arxiv.org/abs/1802.01561 And there are many others besides these, not to mention all the significant research being done by everyone else who isn't at Deepmind. The authors idea that interest and development of these topics is dying down or that Deepmind is running out of meaningful research to do just seems uninformed.
Keep following the thread.
More in Other researchMore from the same topics.
Geophysical constraints on the reliability of solar and wind power worldwide
Dan Tong, David J. Farnham, Lei Duan +4
Abstract If future net-zero emissions energy systems rely heavily on solar and wind resources, spatial and temporal mismatches between resource availability and electricity demand may challenge system reliability.
How to improve R&D productivity: the pharmaceutical industry's grand challenge
Steven M. Paul, Daniel S. Mytelka, Christopher T. Dunwiddie +4