Interactive exploration of a hierarchical spider web structure with sound

Abstract 3D spider webs exhibit highly intricate fiber architectures and owe their outstanding performance to a hierarchical organization that spans orders of magnitude in length scale from the molecular silk protein, to micrometer-sized fibers, and up to cm-scale web. Similarly, but in a completely...

Full description

Bibliographic Details
Main Authors: Su, Isabelle (Author), Hattwick, Ian (Author), Southworth, Christine (Author), Ziporyn, Evan (Author), Bisshop, Ally (Author), Mühlethaler, Roland (Author), Saraceno, Tomás (Author), Buehler, Markus J. (Author)
Format: Article
Language:English
Published: Springer International Publishing, 2022-02-22T14:24:41Z.
Subjects:
Online Access:Get fulltext
LEADER 02441 am a22002293u 4500
001 140553
042 |a dc 
100 1 0 |a Su, Isabelle  |e author 
700 1 0 |a Hattwick, Ian  |e author 
700 1 0 |a Southworth, Christine  |e author 
700 1 0 |a Ziporyn, Evan  |e author 
700 1 0 |a Bisshop, Ally  |e author 
700 1 0 |a Mühlethaler, Roland  |e author 
700 1 0 |a Saraceno, Tomás  |e author 
700 1 0 |a Buehler, Markus J.  |e author 
245 0 0 |a Interactive exploration of a hierarchical spider web structure with sound 
260 |b Springer International Publishing,   |c 2022-02-22T14:24:41Z. 
856 |z Get fulltext  |u https://hdl.handle.net/1721.1/140553 
520 |a Abstract 3D spider webs exhibit highly intricate fiber architectures and owe their outstanding performance to a hierarchical organization that spans orders of magnitude in length scale from the molecular silk protein, to micrometer-sized fibers, and up to cm-scale web. Similarly, but in a completely different physical manifestation, music has a hierarchical structure composed of elementary sine wave building blocks that can be combined with other waveforms to create complex timbres, which are then arranged within larger-scale musical compositions. Although apparently different, spider webs and music have many similarities, as we point out in this work. Here, we propose an intuitive and interactive way to explore and visualize a 3D Cyrtophora citricola spider web geometry that has been digitally modeled with micron-scale details from full-scale laboratory experiments. We use model-based sonification to translate the web architecture into sound, allowing for aural perception and interpretation of its essential topological features. We implement this sonification using Unity3D and Max/MSP to create an interactive spider web environment in which a user travels through a virtual spider web. Each silk fiber in their field of view is sonified using different sine waves. Together, the sonified fibers create new and more complex timbres that reflects the architecture of 3D spider webs. These concepts are implemented into a spider web-based instrument for live performances, art installations and data exploration. It provides an unprecedented and creative way to immerse the composer, audience and user in an immersive multimedia experience generated by the complexity of a 3D spider web. 
546 |a en 
655 7 |a Article 
773 |t Journal on Multimodal User Interfaces