Real2Sim with AOgmaNeo

Note: The interactive demo may take a bit to load! Real2Sim Use W/S to move the arm up/down, and A/D to move the arm left/right. Try moving the marble in the track! Here is a (interactive!) demo of our latest implementation of Sparse Predictive Hierarchies (SPH) called AOgmaNeo (to learn more about it, there is…

Tutorial: RL with OgmaNeo2

In our last tutorial, we covered prediction using OgmaNeo2. We will now cover how to perform reinforcement learning using OgmaNeo2. Actions as Predictions In OgmaNeo2, actions are treated as a type of prediction, and are used in a similar fashion. One can view the sequence of actions taken as just another stream to predict. Of…

A Tutorial on OgmaNeo2

It’s about time we make a tutorial on OgmaNeo2. This tutorial will focus on the Python bindings, PyOgmaNeo2 – which more or less mirrors the C++ API. We will show you how to create a (very) simple “wavy line prediction” example, from which you will learn the key concepts of OgmaNeo2. What is OgmaNeo2? In…

Acting without Rewards

Hello, While we continue to work on improving our reinforcement learning (RL) (on two new demos!), here is some information on what else we have tried aside from reinforcement learning for performing tasks with agency. For now regular old RL performs better than what I am about to describe, but perhaps at some point this…

OgmaNeo2 and Reinforcement Learning

OgmaCast
OgmaCast
OgmaNeo2 and Reinforcement Learning
/

It’s been a long time coming, but we finally have proper reinforcement learning support for OgmaNeo2! Along with this release, we have some new demos to share as well as some explanation of how the new reinforcement learning system works. Before we get started with explanation and demos, here is the repository: https://github.com/ogmacorp/OgmaNeo2 (use the…