Mobile Augmented Reality System

2015 Engineering Design Project (LZ01)

---

Faculty Lab Coordinator

L. Guan

Faculty Advisor

Same as FLC

Topic Category

Software

Preamble

Augmented reality (AR) is a live view of a real-world environment which is augmented by computer-generated virtual objects. The critical challenge in AR is the seamless integration of the virtual objects into the real scene. In this project, students are required to develop a mobile AR system by addressing the challenge using the image processing and computer vision techniques.

Objective

This project aims to develop and implement a cloud-based mobile AR system to track the camera pose in real time and deliver virtual objects from cloud servers to mobile users.

Partial Specifications

The mobile AR system to is able to: (i) run on iOS platform for iPhone or iPad;
(ii) recognize the registered image; (iii) estimate and track camera pose in
real time.

Suggested Approach

1. Study the literature on image recognition, camera calibration, and graphics rendering;
2. Develop a cloud-based mobile AR prototype with Open Source Computer Vision (OpenCV) library, Xcode, and Unity game engine;
3. Test the prototype.

Group Responsibilities

This project will be done by a group of three students. It is expected that all three students are involved in all aspects of the project. The students will study the techniques/algorithms in camera calibration, image recognition, and graphics rendering. Also, the students will learn practical programming skills in C++ and objective-C, and get familiar with Open Source Computer Vision (OpenCV) library, iOS software development, and Unity game engine. The students are required to submit the demo and project report by the end of the project.

Student A Responsibilities

To recognize the registered images and collaborate with other students to develop the prototype.

Student B Responsibilities

To track and estimate camera pose and collaborate with other students to develop the prototype.

Student C Responsibilities

To render virtual models and collaborate with other students to develop the prototype.

Course Co-requisites

Basics of Multimedia Systems