Chromasound – Final

Chromasound – Final

For this final project, I created an Interactive Virtual Reality experience. Below is the project process.

Began with researching lighting artists and large scale projects involving sound.

  • Olifar Elfasson
  • James Turell
  • Douglas Wheeler
  • Robert Morris

In addition, to learning about individuals through their own experiences using a survey. I got to gain a sense of how people engage with sound in their everyday life.

I also looked into concepts such as:

  • Reflective memory
  • Repetitive memory
  • Synethesia
  • Color Theory

Which expanded into the resources at the end of this presentation.

 

 

Notes + Sketches

Logo/Marketing Designs

These Design Ideas Utilize:

  • sound waves
  • VR Glasses (cardboard version)
  • wave
  • depth
  • texture
  • contrast
  • little color

Color Frequency

 

Design Proposal

Notes from the presentation:

  • Try putting texture on sphere – video as a texture on the sphere – to make it more visually appealing
  • Look up Red color sound therapy youtube video
  • Look up Maze Unity tutorial youtube videos
  • Look up – Color TED https://www.ted.com/talks/neil_harbisson_i_listen_to_color – good inspiration

Layout Design Iterations 

The Maze:

 

The Vibration Wave:

Inspiration for Sound Vibration-

Unity Design –

Sound Bites – 

Here are some examples of the sound bites. Some were compiled from my experience observing different spaces around Manhattan and Brooklyn and others are sounds sourced from Youtube online based on various preferences/responses from a survey completed by individuals based on sound and color.

These are only a few examples of many. I used my own recordings or sounds from Youtube’s Free Audio Library https://www.youtube.com/audiolibrary/music

 

Meeting with professor Matt Whitman:

– Notes –

  • What would people hear before they go into the space?

recordings of the live experience

recordings of people staying their preferences

  • forms of inspiration I should look into – ruins, corridors, mazes, MoMa Ps1 or Bruce Nauman at MoMA, spatial context, stimulated space, Douglas Wheeler – lighting, Red Bull interactive environment in New York, test bed gallery at The New School, Robert Morris – eye box, look up VR for the deaf
  • what is the scale?
  • Layered Experience – build up – chambers of experience
  • synesthesia
  • memory location in the brain
  • what are peoples expectations?
  • “color jockey”
  • how does their body interact with the space?

sitting?

  • tape, exclusive to the VR participants space
  • vibrations, induction, bone induction
  • Dresden Bombing Sound Vibration Installation
  • Travel through an object?
  • What are the mechanics behind sound?
  • sitting on a speaker?
  • Whats the title? – an artists statement
  • Protocinema
  • Inspiration: Mutoscope, Kinetescope
  • Spectacle vs Private

Survey

For getting the final sound bites and sound sequences together, I needed to get more information from individuals. Especially since individual preference was what I am addressing in the work, I realized that I needed to actually get sound preferences from people. So I created two surveys. One, was an in class response from the Integrated Design Studio members. Then, the second was a Google Form survey that was circulated around friends, friends of friends, colleagues, and family.

First Survey: 

Second Survey: 

Chromasound Survey 2 

 

For the presentation, we was able to present an alternative critique with 5 industry professionals and 10 peers from the IDP 1 Program/Class this semester. We used the Social Justice Hub’s gathering space on Monday December 10, 2018 from 12:30PM – 2:00PM for majority of critics in person and others we presented with a video. The second presentation is held in the 3:50-6:30PM Media course with Zohar Kafir and students.

 

Chromasound

Chromasounds

Chromasound Film Sequence

Watch here:

https://vimeo.com/305524505

As a result of the presentations, and simply reflecting on my experience, I gained a lot of knowledge from this challenging project. I also learned that I am actually very interested in the illustrating visual narratives – aka using Virtual Reality to communicate a story. Here are some of the results from the professors and visiting artists that reviewed my work.

The New School Faculty Professors Critique –

Matt Whitman – voice record 

Aviva Shulem – voice record 

Zohar Kafir – via email 

“I could really sense the fluctuations of the “room color” even without looking at the video specifically. so the sonic rhythmic cycles you created work really well to illustrate a curious soundscape.
I would suggest maybe playing with the ambience of the “center room” which might serve as a good “reset space” between the various rooms.
Sound design can play so many roles in this piece, so integrating it as almost a “physical competent” will be a powerful one.
Interactivity wise, It made me very curious to actually experience the piece and we have to keep in mind that this is one of the ground rules of interactive design—
The actual experience of the work is much different then viewing it. like watching someone interact with a certain piece but not doing it your self…
Since this is something that we did not get to explore, the questions of how would a user feel within the environment and what options are you offering them beyond the navigation into the rooms is still unknown and it something you can decide how to pursue after you test and learn how this actually feels…I think keeping it simple is a key, organic/intuitive navigation which is user controlled will lend its self to the ambience you wish to achieve.
The environment design is intriguing and the circular spaces are very effective, if you decide to further work on this I would advise to really play with the light/ higher polygon count in the model so the walls are softer and emit a stronger sense of a James Turrell installation.. much softer on the edges, with dynamic ambience which can be achieved by subtly animating pulsating lights possibly? This will require of course much more light/texturing work, but its part of the CG magic that can be achieved!
Hope this helps to frame some of your thinking of the project, even though technically frustrating you achieved so much”

In reflection,

I learned a lot from this project – especially the difficulty with using Unity and understanding the software. I was challenged, but gained a better understanding of Virtual Reality and also the exciting process of seeing a project from ideation to being fully realized, which was very satisfying. I wish it could be in a virtual reality form, versus a video. Perhaps, in the future I could still convert the project into a VR form. In regards to the presentation, I wish I made the poster larger so the video felt more larger than life – or was more inviting to the viewer. I also think the interaction could have benefitted from more direct instruction before Chromasound began.

 Resources

2. http://pdpseven.wixsite.com/sound-color/app-cxpd  

resource for sound frequency/notes to color sequence.

3.

https://www.youtube.com/watch?v=MPEc-OWdT4Y 

VR Art Gallery Design on Unity

4.

https://www.youtube.com/watch?v=3khBcfXH__c 

Making a Maze in Unity

5.

https://medium.com/@cyport/building-a-deaf-vr-experience-81d9f9b1d68d 

VR Experience for those who are deaf or hard of hearing

6.

https://fellowsblog.ted.com/i-am-a-deaf-artist-redefining-sound-4437f20297a3

Deaf TED-Fellow redefining how you can hear sound

7.

https://www.youtube.com/watch?v=2Euof4PnjDk 

Artist Christine Sun Kim talks about the music of sound

8.

https://www.youtube.com/watch?v=X-wiqY2TzT0 

for creating the color blending on Premiere

9.

https://www.davidzwirner.com/exhibitions/doug-wheeler

Images of artist Douglas Wheeler’s Exhibition

10.

http://www.melafoundation.org/dream02.htm 

Dream House environmental installation based on sound and color

11.

https://www.flutopedia.com/sound_color.htm

Detailed information on color theory in relationship to sound, outlets that allow you to calculate the color yourself.

12.

http://www.marcodebiasi.info/en/a-historical-perspective-on-the-relationship-between-sound-and-colour/

History of color theory and scholar discoveries

13.

https://en.wikipedia.org/wiki/Chromesthesia

I know it’s wiki but… it helps! The scientific term for sound-to-color synesthesia which makes people refer sounds to color or an experience automatically and involuntarily

14.

http://www.roundhouse.org.uk/blog/2014/08/nick-ryan-introduces-synaesthesia-/

artist/composer Nick Ryan created a symphonic and visual art piece relating to synesthesia

15.

https://vimeo.com/125711284

Nick Ryan created a piece on the sound of red wine.

16.

http://www.people.vcu.edu/~djbromle/color-theory/color01/Relationship-color-sound-joe_goldsmith.html

More color research

Skip to toolbar