Tutorial: RL with OgmaNeo2

In our last tutorial, we covered prediction using OgmaNeo2. We will now cover how to perform reinforcement learning using OgmaNeo2. Actions as Predictions In OgmaNeo2, actions are treated as a type of prediction, and are used in a similar fashion. One can view the sequence of actions taken as just another stream to predict. Of…

A Tutorial on OgmaNeo2

It’s about time we make a tutorial on OgmaNeo2. This tutorial will focus on the Python bindings, PyOgmaNeo2 – which more or less mirrors the C++ API. We will show you how to create a (very) simple “wavy line prediction” example, from which you will learn the key concepts of OgmaNeo2. What is OgmaNeo2? In…

Acting without Rewards

Hello, While we continue to work on improving our reinforcement learning (RL) (on two new demos!), here is some information on what else we have tried aside from reinforcement learning for performing tasks with agency. For now regular old RL performs better than what I am about to describe, but perhaps at some point this…

OgmaNeo2 and Reinforcement Learning

It’s been a long time coming, but we finally have proper reinforcement learning support for OgmaNeo2! Along with this release, we have some new demos to share as well as some explanation of how the new reinforcement learning system works. Before we get started with explanation and demos, here is the repository: https://github.com/ogmacorp/OgmaNeo2 (use the…

EOgmaNeo vs. RNN: Simple Sequence Task

Hello! While working on some more bombastic demos, we decided to do a straight-up comparison between LSTM/GRU based recurrent neural networks and our fast online learning library, EOgmaNeo. We will compare RNNs and EOgmaNeo on a simple sequence task: Sequence copying. I know, I know, lame! But, (perhaps selfishly) I think the results are interesting…

Source Code for “Self Driving Car Learns Online and On-board on Raspberry Pi 3”

Hello! In the previous post, we demonstrated a self-driving model car that performed all processing on-board on a Raspberry Pi 3. We have now released the code for the car and associated tools. The following repositories are available on GitHub: EOgmaNeo – the primary library containing our super-fast online learning technology! EOgmaDrive – a description…