> It seems to me like KANs should be able to find expressions like these given experimental data. Perhaps, but this is not something unique to KANs: any symbolic regression method can (at least in theory) find such simple expressions. Here is an example of such type of work (using non-KAN neural networks): https://www.science.org/doi/10.1126/sciadv.aay2631 Rephrasing: just because you can reach simple expressions with symbolic regression methods based on neural networks (or KANs) does not necessarily imply that neural networks (or KANs) are inherently interpretable (particularly once you start stacking multiple layers).
AI Feynman: A physics-inspired method for symbolic regression
Silviu-Marian Udrescu, Max Tegmark
2020 · Science Advances
- HN score
- 0
- Mentions
- 3
- Readers
- 3
- Months
- 3
From the abstract
Our physics-inspired algorithm for symbolic regression is able to discover complex physics equations from mere tables of numbers.
Metadata: Crossref. Abstracts retain their original authors’ rights.
In the conversation
Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels
3 selected excerpts · 3 total mentions
In order for that not to happen (uninterpretable ML models) some research on symbolic distillation, aka symbolic regression https://arxiv.org/abs/2006.11287 https://www.science.org/doi/10.1126/sciadv.aay2631
There's a subfield called symbolic regression that considers this problem. https://www.science.org/doi/10.1126/sciadv.aay2631 The Kepler equation is relatively simple compared to other equations re-discovered by ML.
Keep following the thread.
More in PhysicsMore from the same topics.
Dissolving the Fermi Paradox
Anders Sandberg, Eric Drexler, Toby Ord
The Fermi paradox is the conflict between an expectation of a high {\em ex ante} probability of intelligent life elsewhere in the universe and the apparently lifeless universe we in fact observe.
Understanding deep learning requires rethinking generalization
Chiyuan Zhang, Samy Bengio, Moritz Hardt +2
Despite their massive size, successful deep artificial neural networks can exhibit a remarkably small difference between training and test performance.
Copy-and-Patch Compilation: A fast compilation algorithm for high-level languages and bytecode
Haoran Xu, Fredrik Kjolstad
Fast compilation is important when compilation occurs at runtime, such as query compilers in modern database systems and WebAssembly virtual machines in modern browsers.
The Ghost in the Quantum Turing Machine
Scott Aaronson
In honor of Alan Turing's hundredth birthday, I unwisely set out some thoughts about one of Turing's obsessions throughout his life, the question of physics and free will.