Learning Intuitive Physics and One-Shot Imitation Using State-Action-Prediction Self-Organizing Maps

Stetter, Martin and Lang, Elmar W. (2021) Learning Intuitive Physics and One-Shot Imitation Using State-Action-Prediction Self-Organizing Maps. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021: 5590445. ISSN 1687-5265, 1687-5273

Full text not available from this repository. (Request a copy)

Abstract

Human learning and intelligence work differently from the supervised pattern recognition approach adopted in most deep learning architectures. Humans seem to learn rich representations by exploration and imitation, build causal models of the world, and use both to flexibly solve new tasks. We suggest a simple but effective unsupervised model which develops such characteristics. The agent learns to represent the dynamical physical properties of its environment by intrinsically motivated exploration and performs inference on this representation to reach goals. For this, a set of self-organizing maps which represent state-action pairs is combined with a causal model for sequence prediction. The proposed system is evaluated in the cartpole environment. After an initial phase of playful exploration, the agent can execute kinematic simulations of the environment's future and use those for action planning. We demonstrate its performance on a set of several related, but different one-shot imitation tasks, which the agent flexibly solves in an active inference style.

Item Type: Article
Uncontrolled Keywords: INFERENCE; PRINCIPLE; MEMORY
Subjects: 500 Science > 530 Physics
500 Science > 570 Life sciences
Divisions: Biology, Preclinical Medicine > Institut für Biophysik und physikalische Biochemie > Prof. Dr. Elmar Lang
Depositing User: Dr. Gernot Deinzer
Date Deposited: 01 Sep 2022 06:55
Last Modified: 01 Sep 2022 06:55
URI: https://pred.uni-regensburg.de/id/eprint/47147

Actions (login required)

View Item View Item