Argumented Vjing AR-VJ

Argumented Vjing AR-VJ from Martins Dabolins on Vimeo.

Vestards Šimkus un Mārtiņš Dāboliņš "Mana pirmā skatuve"
Full Video: https://vimeo.com/363789345

NEXT VJ content creation technique.
VJ-ing is changing!
Augmented reality audiovisual performance.

This performance was part of a donation campaign, organized to raise awareness for music school renovation.

As artists, we wanted to inspire people to be fearless and experiment with talents, to bring peoples' thoughts to another realm, where magic can happen right in front of your eyes. Let the sound lead you through space! We believe this is how sounds today.

Classical VJ-ing is transforming into new fully interactive visuals, where the performer and all his surroundings (floor, walls, etc.) are captured in 3D. Now spatial capture is possible with the stereo and depth cameras like a (ZED, Kinect, Realsense, etc.) This generative nature makes visuals unique.
With the help of this data, we can now play with physics, for example, where objects are colliding with the environment and we can detect the direction of the light to match it with the digital lights and to compose a more realistic image.

Of course, the most important part is the graphical engine. Unreal Engine makes all this possible having all the needed features built into it (UE4).