Building for VR: Developing for Google Cardboard

For our Final Creative Coding project we had to create a program using Processing. This app could be for any platform. With such an open brief; I decided to take this as an opportunity to try something new. Having recently gotten a google cardboard of my own, I was eager to get to grips with how it worked and have a go at building for it myself.

 

I used the Ketai library as it has a range of tools for mobile – accelerometer, gyroscope, as well as Face Detection and a bunch of other cool features.

First things first i experimented with View ports. To do this, I built a basic video viewer. It uses two view ports, one for left and right, to simulate how my app will work. I used it to play a video – one at a slight delay – to simulate a (kind of) 3D effect and to test how the device would handle it!

doublevideo

Double Video Test, with a video of my ducks!

Next I made a basic app to read in data from the phone’s sensors. Using the Ketai library, I wrote a short sketch to read in and display the data on the device’s screen.

Next i made a very basic shape. A coloured cube created completely in processing. Nothing too exciting; just a starting point.

viewports

Cube test with viewports.

Then i brought it all together. Taking the Cube and the Ketai input code i made earlier, I made a tester app.

The Next step was to bring in a secondary viewport and set apart the two cameras to give the 3D illusion – not an easy task! Getting the distances and slight differences in angles between the two was quite difficult to achieve – it required a lot of trial and error!

The next step was to replace the cube with something a little more interesting – A quick low-poly model made in blender.

Although only a basic app, it does have a lot of potential for expansion, such as going on to create a much more advanced model viewer app or even a full VR game!

Advertisements

Deconstruction Part 4: Finals

9822 pixel sort

Pixel Sorted Image of teignmouth beach – Sorted by White

6023pixsort

Pixel sorted image sorted by light

IMG_5955nppgl

Datamashed .PNG image

Untitled-1

Datamoshed .AVI file

small

Cachemashing – Truncated image ‘repaired’ by Photoshop (5)

IMG_9088etrunk

Cachemashing – Truncated image ‘repaired’ by photohop (CS6)

Deconstruction Part 2: Stepping it Up

Step 1: Pixel Sorting

Pixel Sorting does prettymuch exactly what it says on the tin.

The first example is sorted by black, the second white, and the third is a mix of datamoshing and sorting by white.

6023pixsort 9822 pixel sort 9088pixsortmash

These were made using Free-use open source code (In processing) – the link for this can be found in “see also” section of this post!

Step 2: Cachemashing

Cachemashing is a fairly difficult effect to achieve, but can have some striking results!

But why is it so difficult? well.. it involves exploiting a bug in a specific version of Photoshop. That is insanely hard to find. near impossible. the key word here being “Near”.

9088eb 9822eb

As quoted from the game Antichamber: “If you never stop trying, you will get there eventually”


Noteable Artists:

Kim Asendorf: http://kimasendorf.com/

https://josephkes.wordpress.com/tag/glitch-art/

http://www.donrelyea.com/blog/tag/cachemash/

http://vade.info/

http://www.recyclism.com/

http://vimeo.com/user2202559

http://phillipstearns.wordpress.com/

http://rosa-menkman.blogspot.co.uk/


See also: 

Pixel Sorting: http://prostheticknowledge.tumblr.com/post/32963838252/kim-asendorfs-pixel-sorting-code-is-now/

http://phillipstearns.wordpress.com/glitch-art-resources/awesome collection of glitch art resources and tutorials!

http://schaik.com/png/pngcsum.htmlPNG checksum corrector! 

http://squidinkmagazine.tumblr.com/post/65490664688/pixel-sorting-a-guide-to-databending-withindepth description of pixel sorting for the interested!

Deconstruction Part 1: Smack my Glitch Up

 Deconstruction. Destruction. Glitch Art. Where do i start?

After having already completed a project on glitch art and surveillance, inspired by NSA leaks, for College (see: Here and Here for examples) I couldn’t help but think to myself.. piece of cake!

..but i was wrong!

after all my previous experimentation, i felt like just repeating myself would be “cheating”. so, how can i do it differently? How can i push the boundaries?

As my old graphics tutor used to say, “starting with the cliche can be a great way to move away from it”

So..here goes nothing!

Step One: Back to basics

The “simple glitch”. Databending/Datamoshing. Hands-on messy fun, arguably every glitch-artist’s first technique.

One way of doing this is simply opening a file in Notepad++ (or similar editor) and going wild… within limits of course 😦 You don’t want to damage the header or footer! One way of “sidestepping” this, however, is to go with Raw formats.

It is also important to note that the file type you use can greatly change the outcome of your databending

For copyright reasons, i have used my own photography for these experiments.

IMG_5831e1save2blog   IMG_6023small2blog   5955nppglblog

The first image is an example of a typical datamoshing outcome using Notepad++, The second is made using Notepad with little to no user input, and the third using a .png file. Spot the difference!

A with any kind of glitching, though, things can go wrong easily and quickly. Breaking the file a little too much is a regular occurrence!

Step Two: From the ground up.

Stepping it up a little using Sonification. It does exactly what it says on the tin!

Here i am using Audacity, but there is a wide range of editors you can use!

…And just for fun, here’s a Spectrogram of photoshop!

PSspect

Step 3: Glitchception

Opening Programs in Programs…

First up: Photoshop and InDesign…

Ps     InDesignblog

…And here is a leftover cache file from a previous particle physics experiment in Blender!

7460blendparticlesblog


Noteable Glitch artists:

Alessandro Canova

Antonio Roberts

Sabato Visconti

Daniel Temkin

Eelco den Heijer- Evolving Glitch Art

http://blog.animalswithinanimals.com/


See also: 

http://tellab.home.xs4all.nl/dynamics.html – “The WordPad Glitch as a metaphor for abstract expressionism.”

http://gli.tc/h/

http://www.liscentric.com/

http://www.reddit.com/r/glitch_art/ – Reddit, but not for procrastination?! what is this sorcery?

Deconstruction Part 0: Anatomy of a Glitch

Glitch Art: An introduction

Above are some works from my 2013 glitch project entitled “surveillance”. The project was a comment on the recent NSA leaks that, at the time, was a ‘hot topic’. Since the given brief was on “Appropriation”, I focused on using “Recycled” media.

In a similar light, this project will reflect the non-permanency of digital media.


Articles and Discussion:

Glitch Art: The Joy of Exposing Hyperreality By Josh Jarrett

“glitch art is about “trying to find the soul of a machine” through breaking down the barriers of hyperrealism in order to expose machine constructed reality for exactly what it is.”
http://jjarr.wordpress.com/2012/09/23/glitch-art-the-joy-of-exposing-hyperreality/

ASCII Glitch Graphics + Abstract Expressionism & Color Field = TAD by Rozita Fogelman

A gallery of assorted forms of glitch art

https://theartstack.com/movement/ASCIIGlitchGraphics+AbstractExpressionism&ColorField=TAD%5Btech+art+design%5D

Non-Object Oriented Art: Glitch && Human/Computer Interaction by Daniel Temkin, 2014

“The glitch aesthetic may be rooted in the look of malfunction, but when it comes to actual practice, there’s often not much glitch in glitch art.”

This article talks about Glitch art and Computer logic – and the relationship between the two and asks “When is a glitch really a glitch, and not a logical result of the system”

http://nooart.org/post/73353953758/temkin-glitchhumancomputerinteraction

Not so GIFted by Cathryn Ploehn

A criticism of Glitch art – Art, or just a fad?

http://www.morehshin.com/fall12emac4326/tag/glitch/

Exploration of Glitch Art – Interpretation and meaning by Andrew Foresman

 ” If the purpose of glitch art is purely aesthetics then unintentional bugs may not be enough to fulfill that role.”

http://scadglitchart.blogspot.co.uk/2012/11/interpretation-and-meaning.html


Glitch Artists:

Cory Arcangel – http://www.coryarcangel.com/things-i-made/

David Szauder Aka Pixelnoizz – http://pixelnoizz.wordpress.com/