ForK - Building bridges between state-of-the-art research and creative media

Research project at a glance

Departments and Instituts

Department of Computer Science Institute of Visual Computing (IVC)

Funding type

Publicly funded research

Period

01.09.2016 to 31.08.2019

Website

IVC project page

Project manager at H-BRS

Project Description

The latest developments in research are often not directly applicable for the media and creative industries, since the prototypical implementations are often operated using special software and hardware environments that are not designed for common platforms. In contrast, usage of web technology is basically a standard in the media and creative industries.

For this reason, the ForK project aims to develop a process which makes the transition from current research implementations to mobile web technologies as simple as possible. A (partially) automated conversion chain is modeled and examined, in which a machine-oriented programming language such as C++ is transferred to the browser-based programming language Javascript using the transpiler Emscripten. In particular, aspects of the two programming languages, which have an influence on a successful conversion, will be examined.

The Institute of Visual Computing is developing a research prototype from the area of Augmented Reality which will be used to continuously test and optimize the transition process defined by the project partners.

Results

The scalable research prototype which is being developed at the H-BRS can handle various aspects from the field of augmented reality.

This involves the following components:

Camera calibration
3D point cloud reconstruction of a captured scene using structure-from-motion.
A tracking system which uses reference information to find the position and orientation of a camera.

Large parts of the implemented library could be transformed to JavaScript. We used the resulting JavaScript library to create several web demos using the transpiled functionality.