3D interaction exam – Mikkel Aarup Vinther

The first attempts at 3D drawing.

Project Context

The central aim of this project was to display our abilities to work as a team in using novel technologies in research. We were presented with multiple interactive tools from VR and AR to 3D stereo visuals, and were tasked in learning to develop research tools to use in generating knowledge. The team took on different roles, I worked with programming, implementation and puzzle design.

The project went through multiple stages, as we tested possibilities and limitations out. My tasks as programmer were allocated to developing the non-vr client, which included using a modified wii-remote for the player controller, as well as minor systems for the different puzzles. In addition to this, I worked with client synchronization on a local network using UDP protocols to update the two clients on actions taken, thus making a shared gamespace possible.

Maj 2025

Initial Brainstorm

We approached the project through a brainstorm focused around the different available tools. Due to previous assignments we decided to explore drawing in 3D space intending to research how people draw when given different digital tools. The intent was to use accelerometers in a wii-remote to help draw digitally in 3D space and pit the experience against drawing in VR.

Progress during this phase was slow due to other large projects running in tandem.

Prototyping

At the start of June we began quickly developing prototypes of the different input modalities. My role was finding a way to read the accelerometer inputs as instructions for drawing. I quickly became apparent that input in this way would be too cumbersome for any intensional drawing to be possible. This revelation prompted us to rethink our project creating the necessity for us to reframe and restructure what we could.

June 9th - June 10th 2025

Reorientation

In order to avoid starting from scratch we retooled the working parts of our prototype. These elements were the environmental assets and VR controls. From this we decided to focus on communication through drawing, letting the players see and be able to manipulate the world in different ways.

The new project would include a player with the ability to manipulate the world, and a player in VR who would be invisible, but able to draw in the world. The two players would be tasked with solving puzzles that only the vr player could fully see.

Development

Having reframed the project, my responsibility became figuring out how to network the two clients, so that they could share a common game space. The solution was to create two different scenes, which would mirror player and item positions as well as drawings. Data was transferred over local networks through UDP messages.

June 19th - June 20th 2025

Applying the tool for testing

We ran three tests using the tool. Separating the two subjects so that the only form of communication between them was through drawings and movement. Testers were prompted to explain their thought processes as they played which were noted down and after the test both players were gathered for a semistructured group interview in order to have them reflect on each other’s actions.

Multi Modal Testing Tool

3D Interaction Exam Project

Goal

Problem

Solution

Project Context

Maj 2025

Initial Brainstorm

Prototyping

June 1st - June 9th 2025

June 9th - June 10th 2025

Reorientation

Development

June 11th - June 18th 2025

June 19th - June 20th 2025

Applying the tool for testing