Extended Reality 101: A Beginners Guide to XR for Artists

What is XR?

XR stands for extended reality or cross reality. It is an umbrella term that consists of virtual reality (VR), augmented reality (AR), and mixed reality (MR). 

Virtual Reality

Virtual reality in itself is an artform. The digital environment utilizes artistic rendering and can allow users to experience any environment imaginable. You Should Have Stayed Home is a play written and performed by Tommy Taylor in which audience members experience a re-creation of the 2010 G20 protests in virtual reality. This gives audiences a new perspective of the events as they become immersed in the storyworld rather than looking at it on a stage. It is these transformative capabilities that give artists greater means to manipulate their art and creates an immersive environment for audiences. Another example of virtual reality application for artists is the ability to create art in a virtual world. Artist Anna Zhilyaeva creates stunning immersive art by painting in virtual reality. https://www.youtube.com/watch?v=1VJXa96GcJU 

Augmented Reality

Virtual reality is perhaps the most well-known form of extended reality. It is a simulated virtual environment, most commonly accessed using a headset with visual and auditory capabilities. The headset is placed over the user’s head like a helmet and a screen with images of the virtual reality covers the users eyes. Most virtual reality equipment also consists of motion controllers to enable the user to move around in the virtual space. 

Augmented reality is a form of XR in which our senses of the real world are enhanced with technology. The key difference between virtual reality and augmented reality is that virtual reality generates a digital environment whereas augmented reality only enhances one’s current environment. Oftentimes, this is done by utilizing the camera of a phone or tablet and having images on the user’s device interact with the camera images of the real world. A popular example of augmented reality is the app Pokémon Go. In this game, users look through the camera of their cell phone to find Pokémon creatures which appear to be interacting with the real world.

Augmented reality is changing the way spectators view and interact with art. Ontario Tech company Impossible Things created an app called ReBlink which allows users to experience the pieces at the Art Gallery of Ontario in a new way. When looking at a piece of artwork through a device’s camera, the image would appear to come to life. Users could interact with the art by moving their camera around the art in different ways. Watch a compilation video of this project here: https://vimeo.com/223223058 

Mixed Reality

Mixed reality is where the real world and virtual world meet and interact. It is often seen as the spot in between virtual reality and augmented reality because the user wears a headset and sees and interacts with both the real and virtual world. 

Currently, mixed reality is often used for educational purposes. For example, students can wear a Virtual Reality headset and see a 3D image appear in the real world in front of them. They can then interact with this image and manipulate it to further study it. This impacts the way students learn about art and can give them the opportunity to experience works of art from Starry Night to the Scream right in their classroom.