Blog

As the title says, in 2022 I want to create an exhibition unlike anything I have seen before. It's about adding an extra layer of immersion to the viewing experience. I have thought this process through in two steps:

• the first was to make a phone app using augmented reality technology to make the phone recognize a painting when you shoot towards it. Then the phone would display a digital layer over the footage, which would make the character in the painting move;
• step two was to make the painting interactive. In other words, the user of the app will be able to use certain gestures on the phone screen, while shooting at the painting, to influence what happens to the painting. Basically, we have added the dimension of time. The idea behind the picture is revealed during the interaction.
• step three would be much more complex than that. Making each person's experience unique.

The first 2 steps are exemplified in the following videos. The technology works, there is nothing rigged.

Here is the phone screen recorded while running my app. All it does is detect the painting and overlay the 2d animation, matching and spatially aligning the digital layer.

Next I present a demonstration with an interactive painting. This time the digital layer is 3d. It can be manipulated with your finger on the phone screen. The project is a work in progress.

My paintings are done digitally and then printed on canvas. The exhibition I want to create will include several such paintings, each with its own story. Visitors to the exhibition will download an app to view the paintings in this way.

Ersin