Missile Route Planning using Image based GPS Localization
Collaborators: Fahd Rafi, Saad M. Khan
  1. Introduction
  2. Algorithmic Steps
  3. Simulation
  4. Related Links

Introduction

Currently, most cruise missiles use terrain reference navigation for aided INS (Inertial Navigation System). In this approach, the terrain information of a pre-determined area is digitized and is saved in a database. During the mission planning the targeteer defines a special trajectory for the missile to follow in order to hit the target. During the missile flight, the Radar Terrain Sensor (RTS) and Reference Altitude Sensor (RAS) on the missile can provide an accurate information for its current position and attitude. With the help of terrain contour matching algorithm, the differential correction is computed to control the flying missile. Upon reaching close to the target, the missile switches to a terminal guidance system to choose the point of impact. The point of impact is often pre-programmed by the GPS. In case of moving targets, a Digital Scene Matching Area Correlation module is used to find the target in the images obtained by the on-board camera.

In this project, we explored the possibility of using image based approach to geo-locate the missile in the absence of GPS information. Such a situation often arises when the GPS signal is disabled through a deployment of GPS jammers. The proposed approach is based on the method developed for `Where am I - ICCV 2005' challenge contest. The approach requires a number of reference images (with known GPS locations), using which our approach will be able to locate the GPS of the current image transmitted by the on-board camera.

Algorithmic Steps

 In this section, for the sake of completion, we describe the algorithm for geo-locating the missile. For a detailed description of the algorithm, see the Related Links section at the bottom of the page. The steps are:
  1. Find feature correspondence between the image obtained from the on-board camera, and the reference images using the SIFT matching algorithm. Pick two reference images that return the highest number of matches.
  2. Find the image triplet (two reference images and image from the on-board camera) that has the best pair-wise matching among all groups of reference images.
  3. Using the computed correspondences, find the fundamental matrices between each pair of three images.
  4. Given three fundamental matrices, compute the internal parameters K of the camera and corresponding essential matrices.
  5. Apply Homography test for the image pairs to test for zero translation case.
  6. Apply triangulation to image triplets (two reference images and one current image) to recover the GPS.

Simulation

 The algorithm is tested in a simulation setting. A collection of images (1000) is used to construct the scenario. These images were taken at the UCF campus, and their distribution over the testing area is shown in the figure. Few of these images were marked as the reference images. The trajectory of the missile is simulated by selecting the start location and the target location (GPS). The missile is then steered through the testing area by computing the GPS at each time instant, and making the missile to move in the direction that minimizes the distance to the target. A sanpshot of the simulation software, developed in Matlab, is shown in the figure.

Distribution of the complete collection of images over the testing site.


Related Links
  1. ICCV 2005 Challenge Contest - Where Am I
  2. Asaad Hakeem, Roberto Vezzani, Mubarak Shah, and Rita Cucchiara, Estimating Geospatial Trajectory of a Moving Camera, ICPR 2006.