Search Space

Search Space is an interactive installation that reconstructs text messages by using genetic algorithms. The messages are being processed through a large body of generic text that resonates to search terms. Like a reversed echo chamber, the system gradually alters and adapts to incoming information until the closest possible state is achieved.

PROJECT PLATFORM YEAR

Search Space Interactive Installation, Internet 2015

TECHNIQUE

Visualization, Text Analysis, Programming

Projection Mapping

A projection mapping for the angled architecture of the CMC building.

PROJECT PLATFORM YEAR

Projection Mapping Architecture 2014

TECHNIQUE

Mapping and calibration, 3D animation

Gesture-Driven Image Browsers

The series of exhibitions and studies refers to the human body as a navigational tool for next generation interactive surfaces at the scale of the human body and larger. The employed gesture-based interaction methodologies and the graphical user interface enable multiple users to browse simultaneously within a real space inherited by virtual information objects without the need for additional physical devices (intangible interaction). The project involves a series of interactive studies, developed with the aim of putting the human body in the centre of a rich media environment. It explores the potential of interconnecting human motion with immanent structural features of digital media. By extending the dynamic of human motion into virtual space, the self-awareness of controlling a physical body adapts to a situation-based awareness of controlling and navigating through digital information.

PROJECT PLATFORM YEAR

Dynamic Image Browser Interactive Application 2014/15

TECHNIQUE

Gesture Tracking, Visualization, Programming

Nonlinear Sequencer

Nonlinear Sequencer is an interactive audiovisual installation. It transforms body gestures into a visualized sound cluster. The space that surrounds the user turns into a musical score. Each movement affects the arrangement score. The installation dissolves the linearity of a musical score into a dynamic structure, shaped by body gestures and movements.

PROJECT PLATFORM YEAR

Nonlinear Sequencer Interactive Installation 2012

TECHNIQUE

Programming, Motion Tracking, Audio-Visual Processing

Virtual Embodiment

The video shows a series of experiments in which the user is being translated into a virtual representation. The aim was to explores how visual perception and cognition adapts to such situations, especially if the geometrical and spacial features of the virtual environment and the self-representation reaching a certain degree of abstraction. The first study shows an out-of-body experience during a VR session. Later, the virtual representation of the user will be multiplied and played back by voice commands and gestures.

PROJECT PLATFORM YEAR

Virtual Embodiment Head Mounted Display 2014/15

TECHNIQUE

3D Scanning, Visualization, Motion Tracking, Voice Recognition, Programming,

3D Camera and Object Reconstruction

While walking around in my neighbourhood I did some shots of the Victoria Park and the buildings close by. Then, extracted the camera movement and some rough point clouds and used it to transfer the solid appearance of the scenery into thin textured strings. The image analysis worked fine, even with a shaky camera.

PROJECT PLATFORM YEAR

3D Camera and Object Reconstruction Video 2012

TECHNIQUE

Image Processing, 3D Reconstruction

Transformation, Movement

The media of a dancer is the body. Gestures, movements, and expressions are determinated through the consciousness of the physical form. What will happen, if the physical form transforms into a different media, shape, timescale and visual appearance? To control the behaviour of the new Gestalt, the dancer has to transform his own movement likewise. The process of metamorphosis is the core of the six experiments on media and performing arts. Usually, the empty space surrounding the dancer remains invisible. Some experiment extend the movements of the actor into his environment without showing his actual body.

PROJECT PLATFORM YEAR

Transformation, Movement Theatre 2012

TECHNIQUE

Kinect sensor, visual programming

Audio Visual Instruments

Six generative Audio Visual Instruments.

PROJECT PLATFORM YEAR

Audio Visual Instruments Intermedia 2014

TECHNIQUE

Programming

Motion Transmission

Some quick studies on controlling robotic movements. Transferring the motion of my arm to a three degree of rotation motion of sticks, or to the movement of a Delta Bot.

PROJECT PLATFORM YEAR

Motion Transmission Robotic/mechanic structure 2012

TECHNIQUE

Kinect sensor, Arduino, motors, object contruction, programming

Dynamic Textiles

I became interested in dynamic architecture and flexible fabrics. For this experiment, I used four motors to bend two flexible plastic sticks which are connected by a flexible fabric.

PROJECT PLATFORM YEAR

Dynamic Textiles Mixed Media 2012

TECHNIQUE

Arduino, object contruction, programming

3D Printing

Some experiments with the low-budget 3D printer I bought. I created some 3D objects using generative functions and tested this different shapes/sizes.

PROJECT PLATFORM YEAR

3D Printing 12x12 inch 2012

TECHNIQUE

3D modelling, generative design,

3D Anamorphoses

For this study I created an 3D algorithm that deforms a 3d object in a way that it appears undistorted on a curved mirror surface. After printing out the deformed bodies, they look undistorted in the mirrored image onto the metal sphere in the centre.

PROJECT PLATFORM YEAR

3D Anamorphoses 12x12 inch 2012

TECHNIQUE

3D printing, distortion calculation

Hybrid Typeface

The hybrid typeface is casting different character shadows from two angles.

PROJECT PLATFORM YEAR

Hybrid Typeface Table 2012

TECHNIQUE

3D printing/modelling, light

Servo Snake

A test on how precise motors and electronics can be engineered within 3d printed design.

PROJECT PLATFORM YEAR

Servo Snake Ground 2012

TECHNIQUE

3D printing/modelling, Arduino, motors, programming

Architectural ReMapping

As an example for the Remapping Hong Kong course, I used the inspiring Daniel Libeskind architecture of our schools building and mapped typography on the façade (simulation).

PROJECT PLATFORM YEAR

Architectural ReMapping Video 2012

TECHNIQUE

Camera extraction, 3D recontruction