15-494 Cognitive Robotics

Partial Cube Detection

Ting-Yu Lan, tingyula@andrew.cmu.edu
Carrie Yuan, jiayiy@andrew.cmu.edu

Image

Introduction

Cozmo has built-in cube detection. However, it can only recognize a cube if the whole cube is vizible. In this project, we aim to recognize partial cube via neural network. Our code allows Cozmo to recognize partial cube, and turn to face the cube.

In order to turn to a cube, Cozmo needs to know if the cube is in the left edge or right edge. Therefore, we only use half of Cozmo's the camera view. We built a neural network on top of it, to classify if the half image contains a cube or not. If there is a cube, then turn to that direction. Since we only use half of the camera view, we highly reduce the computation cost.