GMU:Critical VR Lab II/Kristin Jakubek: Difference between revisions

== Collaborative Concept ==  

== Sound concept ==

The project is based on the poem ‘twist’- as spoken/presented by the poet herself- the style of which will be analysed and relayed through a Data Patch in the visual programming software Pure Data.  

The set-up of the patches follows the question: (how) Do small shifts in rhythm, tempo, pauses (and pitch) create a unique auditory experience? This generative sound experience is designed to be nuanced and slightly different every time it is played/performed by the algorithm. Just as it would be performed as spoken word by the human poet.  

The data patch will identify pauses in the poem and randomise them. Hence, pulling words further apart, splitting them in two, or pushing them closer together, creating new sound-word-hybrids in the process, which will be based on the internal logic of the spoken poem as it was originally performed. In effect, this might leave a moment longer to understand, or make it a second harder to catch up with what is being said. Words that carry more weight because of their emphasised intonation might be pitched even lower, or inverse, their emphasis might be lifted completely. Sentences that are spoken quickly might be made even quicker or slowed.  

By playing with these parameters of spoken word the poem is given a unique performative rhythm each time it is heard, which will (re-)shape the poem itself and influence the comprehensibility for the listener. In the process this will reveal to what degree these elements of spoken language play with language and cognition within the poetic genre.  

== Visual concept ==  

''dry asphalt


A conversation between two people? or an internal monologue?  A network of selves? A blurring, twisting, twitching back and forth between these selves.  

Visual concept outline:  

== Process: Integration of Pure Data ==

== Process ==  

I used a range of different photogrammetry softwares:  

For mobile, quick and relatively small/compact models I used the Trnio app, which uses approx. 80 pictures, which was sufficient for static captures: the street renderings.  

Metashape is a great photogrammetry software that creates very detailed point clouds and a realistic texture on the model. However, once creating a dense mesh the solid form (sans texture) has many irregularities and a very ‘bumpy’ surface, most probably resulting from the micro-movements of the models. This results in requiring a lot of cleaning up of the models afterwards.   

My personal preference is Agisofts Recap Photo (which sadly only runs on Windows). The software also sends the images to an external  server were the models are created quickly. The way the software deals with ‘irregularities’ or missing information results in very organic colour transitions and fluid, soft shapes. Also the way the texture is displayed in the 3D viewport is ideal.

This is one of my main objectives inside VR - to create tangible, almost touchable textures and move further away from the ‘game’ look.  

The models are cleaned up and sculpted in Cinema4D.  

== Inside Unity ==

'''Viewer as guided/flying camera'''  

'''Body-street-scapes'''

The intensity of the external spaces is increased by working with simulating weather conditions that invoke sensory memories of a heatwave, the smell of hot pavement or cooling summer rain on the asphalt.  A blurring, wavering heat distortion effect, a damp fog or wet puddles on the pavement.