Monday, October 17, 2011
Tuesday, June 7, 2011
Monday, June 6, 2011
Language of Praise
Working on the Prana Musical Controller this quarter has been a very rewarding experience. While I think there are probably years worth of work, practice, and further development in this project, this quarter I have had the opportunity to begin the process of learning how to perform with my breath.
I remain very excited about this project for a few reasons. First, as a composer who used to very much enjoy performing, I am thrilled by the opportunity to make music in real-time. It's something that I've missed without even realizing how much I've missed it, and its been empowering to find my own instrument for expression.
Second, I really love that while the PMC is unique in many ways, it is based on something that is a fundamental shared experience between all humans, (and all animals as well). In reading about the practice of Pranayama, I was struck by one of B.K.S. Iyengar's comments about breath. He says, effectively, that breath is the one universal--he says that there are many people who can't see, who can't hear, who can't walk, and on and on. But without breath, there is no life. It is fascinating, to me, to explore this life-force in a musical context.
Third, I feel that the PMC has the potential to address the disconnect sometimes felt in digital instruments between the controller and sounds, because it is using the acoustic sound of the breath, and the physical motion of breathing in conjunction with one another to create the sound. The potential for disconnect in digital musical controllers is huge, and one of a few reasons why I haven't worked on one before. I am particularly excited, therefore, in the potential for this project going forward.
I remain very excited about this project for a few reasons. First, as a composer who used to very much enjoy performing, I am thrilled by the opportunity to make music in real-time. It's something that I've missed without even realizing how much I've missed it, and its been empowering to find my own instrument for expression.
Second, I really love that while the PMC is unique in many ways, it is based on something that is a fundamental shared experience between all humans, (and all animals as well). In reading about the practice of Pranayama, I was struck by one of B.K.S. Iyengar's comments about breath. He says, effectively, that breath is the one universal--he says that there are many people who can't see, who can't hear, who can't walk, and on and on. But without breath, there is no life. It is fascinating, to me, to explore this life-force in a musical context.
Third, I feel that the PMC has the potential to address the disconnect sometimes felt in digital instruments between the controller and sounds, because it is using the acoustic sound of the breath, and the physical motion of breathing in conjunction with one another to create the sound. The potential for disconnect in digital musical controllers is huge, and one of a few reasons why I haven't worked on one before. I am particularly excited, therefore, in the potential for this project going forward.
Performance Scenario(s)
I can envision a number of different performance scenarios for this project, and hope to have an opportunity to explore at least some of them in the future. Below are a few of my ideas, as well as some approaches suggested in critique, and by colleagues:
-Original concept: Traditional concert performance, with performer on stage, wearing PMC, and speakers surrounding the audience. The sounds would be composed of three layers of breathing sounds: a completely pre-composed layer, a highly manipulated layer, created with buffers recorded in real-time during performance, and a real-time amplification/modification of breathing sounds.
-Keeping the identical musical context, it was suggested that placing the performer in a small room, opposite a loudspeaker, might highlight the element of opposition/struggle between the performer and the instrument they are trying to control with their breath. Aside from technical issues of feedback, I find this suggestion very interesting, and may pursue this either in addition to or instead of the original concept.
-I would like to explore a context in which the breath itself is actually visible, whether this is in a temperature-controlled indoor space, or outside. I'm also interested in exploring the possibility of capturing this on film and manipulating it in real-time. Currently I don't have the background to explore this direction.
The following are not specific performance scenarios, but are other directions in which I may take this project:
-While I am currently working on the project as the performer, as well as the creator, I am interested in bringing the the PMC to other performative contexts. Specifically, I would like to continue my research with dancers and possibly actors. Also, I want to do some research with musicians (vocalists and wind instrumentalists, of course, but also string instrumentalists and others).
-I'd like to consider breath in people of different ages or stages of life. I'm interested in researching breath and illness as well as breath and healing. I would like to explore the breath and the invisible breathing patterns that emerge between two people together in a room, or in a whole room full of people. Finally I would like to look at ritual communal breathing, and possibly even explore a concerto-like context with an 'orchestra' or chorus of breathers and a soloist using the PMC.
-Original concept: Traditional concert performance, with performer on stage, wearing PMC, and speakers surrounding the audience. The sounds would be composed of three layers of breathing sounds: a completely pre-composed layer, a highly manipulated layer, created with buffers recorded in real-time during performance, and a real-time amplification/modification of breathing sounds.
-Keeping the identical musical context, it was suggested that placing the performer in a small room, opposite a loudspeaker, might highlight the element of opposition/struggle between the performer and the instrument they are trying to control with their breath. Aside from technical issues of feedback, I find this suggestion very interesting, and may pursue this either in addition to or instead of the original concept.
-I would like to explore a context in which the breath itself is actually visible, whether this is in a temperature-controlled indoor space, or outside. I'm also interested in exploring the possibility of capturing this on film and manipulating it in real-time. Currently I don't have the background to explore this direction.
The following are not specific performance scenarios, but are other directions in which I may take this project:
-While I am currently working on the project as the performer, as well as the creator, I am interested in bringing the the PMC to other performative contexts. Specifically, I would like to continue my research with dancers and possibly actors. Also, I want to do some research with musicians (vocalists and wind instrumentalists, of course, but also string instrumentalists and others).
-I'd like to consider breath in people of different ages or stages of life. I'm interested in researching breath and illness as well as breath and healing. I would like to explore the breath and the invisible breathing patterns that emerge between two people together in a room, or in a whole room full of people. Finally I would like to look at ritual communal breathing, and possibly even explore a concerto-like context with an 'orchestra' or chorus of breathers and a soloist using the PMC.
Fabrication Revisions
The current version of the PMC is problematic in a few ways:
-Aesthetic brings unintentional narrative into work
-Design restricts performer to specific body-type
-Many layers of cloth make PMC somewhat tricky to put on/take off, and makes it a -temperature-specific item
-Sensor placement is fixed/limited access to technology after shirt is sewn
Above is an image that represents the general direction I will be investigating for my redesign. I would like the PMC to be something that can be worn over clothing, and to be adjustable to different body types. The new form may differ from this harness in that it might have two belts (upper and lower) around the torso, and perhaps only one shoulder strap.
Narrative Qualities of Breath
I think it is somewhat impossible to avoid, in a piece about breathing, engaging with implied narrative qualities of breath. I am still thinking about precisely what narrative I might want to imply, and how to do so. I do think that using some of these qualities of breath could be successfully used as triggers for various musical events and/or parameter-range changes.
Sunday, June 5, 2011
Arduino Code
Short and sweet code to send sensor values from LilyPad to SuperCollider:
int message = 0;
int numSensors = 6; //number of analog sensors used
int sensorVal;
int sensorIn = 0;
void setup()
{
Serial.begin(9600);
}
void loop()
{
for(int a=0; a
sensorVal = analogRead(a); //read sensor values at a
Serial.write(sensorVal/4);
}
Serial.write(message); //send message so SC can distinguish between serial values
}
int message = 0;
int numSensors = 6; //number of analog sensors used
int sensorVal;
int sensorIn = 0;
void setup()
{
Serial.begin(9600);
}
void loop()
{
for(int a=0; a
sensorVal = analogRead(a); //read sensor values at a
Serial.write(sensorVal/4);
}
Serial.write(message); //send message so SC can distinguish between serial values
}
Tuesday, May 24, 2011
Latest fabrication photos
I'm going to be redesigning the PMC over the summer so that it is no longer built into a shirt, but rather is a separate device to be worn over a shirt. I've discovered that shirt design is inconvenient, so I'm looking forward to the redesign.
Monday, May 23, 2011
Code/Programming Issues
The code issues for this project fall into one of two related categories:
1. Gathering data from the stretch sensors
2. Processing the breathing sounds gathered in real-time from the stethoscope, based on the data gathered from the stretch sensors
In order to gather the data from the stretch sensors, I need to ensure an active and accurate BlueTooth connection from the computer to the LilyPad. I then need to provide information to enable SuperCollider to distinguish the serial data from the LilyPad's pins A0-A5. This will be achieved by having each pin send a short message with each serial message, that acts as an ID-tag.
The processing of the breathing sounds to create an interesting and complex spectrum of pitch, timbre, rhythm and harmony is particularly challenging because the processes used to achieve these sounds need to be as efficient, and ideally as simple as possible. Often in composing NRT tape pieces I will apply a process to a sound, create a new AIF file, and then apply a new process, or another iteration of the same process to the sound, in order to achieve a desired effect. In real-time, this iterative process is not feasible, and so I will need to find other ways to achieve a musically rich processing of sounds.
Part of what makes this even more challenging, relates to the design of the PMC, and ultimately the mapping between the human-interface and computer-controlled sound output:
1. There are very few stretch sensors (6, total) which must control a wide variety of processes.
2. Manipulating the stretch sensors in a very specific way is challenging because of the nature of breathing: the performer must breathe, and their body will move to some extent with each breath. Aside from code issues, this will create a somewhat, though not entirely unique relationship between performer and instrument: the performer must "fight" their own body to achieve specific musical results.
3. The input data from the stretch sensors is very subtle, and in order to achieve a range of data, one has to grossly exaggerate the variation of breath patterns, making the most shallow breath even more shallow, and the deepest breath even deeper.
1. Gathering data from the stretch sensors
2. Processing the breathing sounds gathered in real-time from the stethoscope, based on the data gathered from the stretch sensors
In order to gather the data from the stretch sensors, I need to ensure an active and accurate BlueTooth connection from the computer to the LilyPad. I then need to provide information to enable SuperCollider to distinguish the serial data from the LilyPad's pins A0-A5. This will be achieved by having each pin send a short message with each serial message, that acts as an ID-tag.
The processing of the breathing sounds to create an interesting and complex spectrum of pitch, timbre, rhythm and harmony is particularly challenging because the processes used to achieve these sounds need to be as efficient, and ideally as simple as possible. Often in composing NRT tape pieces I will apply a process to a sound, create a new AIF file, and then apply a new process, or another iteration of the same process to the sound, in order to achieve a desired effect. In real-time, this iterative process is not feasible, and so I will need to find other ways to achieve a musically rich processing of sounds.
Part of what makes this even more challenging, relates to the design of the PMC, and ultimately the mapping between the human-interface and computer-controlled sound output:
1. There are very few stretch sensors (6, total) which must control a wide variety of processes.
2. Manipulating the stretch sensors in a very specific way is challenging because of the nature of breathing: the performer must breathe, and their body will move to some extent with each breath. Aside from code issues, this will create a somewhat, though not entirely unique relationship between performer and instrument: the performer must "fight" their own body to achieve specific musical results.
3. The input data from the stretch sensors is very subtle, and in order to achieve a range of data, one has to grossly exaggerate the variation of breath patterns, making the most shallow breath even more shallow, and the deepest breath even deeper.
Equipment List
To capture breath-movements:
-LilyPad microcontroller and BlueTooth Silver Mate to capture data and send wirelessly to a computer.
-Stretch sensors to detect breath-related movements of the body.
-Conductive thread to connect stretch sensors, LilyPad microcontroller, etc.
-Skin-tight shirt (stretch sensors will be sewn directly onto this layer).
-Extra cloth or shirts for additional layers of PMC, in order to avoid the unintentional crossing of conductive thread.
-Additional thread and fabric paint to cover fraying ends of conductive thread, etc.
-Pre-made outer-layer shirt, to house the LilyPad and BlueTooth, and for aesthetic purposes.
To capture breathing sounds:
-Stethoscope, with tube cut short
-Small microphone
-Heat-shrink wrap & electrical tape, to connect stethoscope and microphone
To process sounds and create musical piece:
-Computer running SuperCollider, with external soundcard, hooked up to two speakers. Ultimately I may like to work with a four or eight speaker setup, and to use a mixing board, as well, but this will be in later iterations of the project.
-LilyPad microcontroller and BlueTooth Silver Mate to capture data and send wirelessly to a computer.
-Stretch sensors to detect breath-related movements of the body.
-Conductive thread to connect stretch sensors, LilyPad microcontroller, etc.
-Skin-tight shirt (stretch sensors will be sewn directly onto this layer).
-Extra cloth or shirts for additional layers of PMC, in order to avoid the unintentional crossing of conductive thread.
-Additional thread and fabric paint to cover fraying ends of conductive thread, etc.
-Pre-made outer-layer shirt, to house the LilyPad and BlueTooth, and for aesthetic purposes.
To capture breathing sounds:
-Stethoscope, with tube cut short
-Small microphone
-Heat-shrink wrap & electrical tape, to connect stethoscope and microphone
To process sounds and create musical piece:
-Computer running SuperCollider, with external soundcard, hooked up to two speakers. Ultimately I may like to work with a four or eight speaker setup, and to use a mixing board, as well, but this will be in later iterations of the project.
Research Methodology
The remaining research is going to be primarily into the development of the response and mapping of the PMC. The steps I will take (and am in the process of completing) are as follows:
1. Create an initial score of what I envision the final aural outcome of the project to be.
2. Bring sounds of breathing into SuperCollider and see what processes I can apply to the sounds and what transformations of the sounds I can achieve.
3. Modify the original score in order to take into account the results of the previous step.
4. Come up with a state diagram that determines how the data from the stretch sensors helps achieve the desired score.
5. Practice the piece, wearing the PMC, and see if the desired effect is achieved.
6. Modify the state diagram and code to improve mapping and human-computer interaction as necessary.
7. Repeat steps 5 & 6 until desired effect is achieved.
8. Practice piece with final mappings, working on enhancing subtlety of piece with breath control.
1. Create an initial score of what I envision the final aural outcome of the project to be.
2. Bring sounds of breathing into SuperCollider and see what processes I can apply to the sounds and what transformations of the sounds I can achieve.
3. Modify the original score in order to take into account the results of the previous step.
4. Come up with a state diagram that determines how the data from the stretch sensors helps achieve the desired score.
5. Practice the piece, wearing the PMC, and see if the desired effect is achieved.
6. Modify the state diagram and code to improve mapping and human-computer interaction as necessary.
7. Repeat steps 5 & 6 until desired effect is achieved.
8. Practice piece with final mappings, working on enhancing subtlety of piece with breath control.
More Fabrication Images
The following are images of the under-layers of the PMC. These show the stretch sensors with conductive thread connecting the grounds, and connecting the opposite ends through resistors, to power. These ends will also connect to A0-A5 on the LilyPad to send changes in resistance to the computer, through BlueTooth. The LilyPad is on the top-most layer of the shirt, which is not pictured here, yet.
Thursday, April 28, 2011
Mechanics/Fabrication Issues
I am in the early stages of creating a prototype of the PMC.
Initial objectives:
1. Effective sensor placement for useful breathing data.
2. Comfortable design for lengthy performances, easy on/off.
3. Minimize noise, maximize accurate data.
4. If possible, create haptic response system for performer.
5. Aesthetically pleasing and efficient design.
1. Effective sensor placement for useful breathing data.
The current design's sensor placement is based both on book-study of the respiratory system and on self-observation of breath-related body movements. As you inhale, the ribcage expands to the sides; since the right lung is slightly larger than the left lung due to the location of the heart, and is divided into three rather than two lobes, the right side of the torso is equipped with two sensors, and the left with only one. The diaphragm moves involuntarily with the breath, and a sensor is placed to capture this movement. While many technical studies of breath suggest that shoulders should not move, in observation of casual breathing it was clear that shoulders regularly move in breath patterns. Therefore, a sensor is placed to capture this vertical motion. Finally, the expansion across the upper back seemed worth capturing, so a sensor is placed between the shoulder blades.
2. Comfortable design for lengthy performances, easy on/off.
The challenge in the comfort of the design is that in order to enable the stretch sensors to gather accurate breath-movement data, at least one layer of the shirt must be skin tight. This has potential comfort-ramifications in both the physical and psychological realms, depending on the performer's comfort or lack thereof with wearing exposing clothing. In my design for the PMC, the issue of psychological comfort is addressed by creating a multi-layer design in which the top-layer is not form-fitting. The issue of physical comfort is addressed in a somewhat less satisfactory manner. The shirt has 4 layers, and will therefore be not only tight, but hot. This makes the ideal performance space somewhere that is cold, or at least cool. I will attempt to address these issues better in future revisions. Putting the shirt on, or taking it off, is not quite as easy as would be ideal, but it could be worse. I achieved a somewhat easier on/off by sewing together lots of key places in the layering of the shirts.
3. Minimize noise, maximize accurate data.
Minimizing noise is actually relatively simple in the PMC design, because both the changes in resistance provided by the stretch sensors, and the movement of the body during inhalation and exhalation, is relatively subtle. Therefore, the nature of the instrument inherently minimizes noise. Maximizing accurate data is more of an issue, due to the subtle nature of the instrument. Because of this, three of six stretch sensors (those placed on the side-body, at various places on the rib-cage), have been doubled-over in the shirt design, to double the changes in resistance with each movement. Two of the remaining three are placed in locations where it is easy for the body to exaggerate movements as necessary (the shoulder and between the shoulder blades). The remaining stretch sensor is placed on the front-body, between the bottom right and left ribcage. This stretch sensor will likely register the least amount of changes in resistance, but this is by design--this means that it can be used to trigger things only as desired, and with an exaggerated effort by the performer.
4. If possible, create haptic response system for performer.
This particular element will not be explored in this iteration of the project. Because a person can feel their own breathing, if they focus their attention, this seemed less important, and possibly redundant. The concept will be revisited in future versions, and a final decision will be made as to its usefulness and importance.
5. Aesthetically pleasing and efficient design.
The design that is visible to the audience is relatively efficient. While I find it aesthetically pleasing as well, some feedback has indicated that it may have more sci-fi/fantasy connotations than I desired. The placement of the stretch sensors made it very difficult to create an efficient path for all of the various strands of conductive thread, and therefore I settled for simply an *accurate* design. Layering helped keep the accuracy, and ended up being the most efficient course of action that I could determine.
Other Issues:
For the physical controller, I imagined that the trickiest element would be incorporating stretch sensors into the textile so that they moved; if each end of the sensors was not properly anchored, the data-change from the sensors would be limited or absent.
My initial sketches followed the following logic:
Knit fabrics are stretchy and will move with the sensor; this material should be placed underneath each stretch sensor. Woven fabrics, on the other hand, do not stretch, and make good anchors for the ends of the sensors. The woven fabrics need to also be anchored around the body, so that they do not simply move with the rest of the fabric.
In my first attempt to resolve this issue I designed a dual-layer shirt which incorporates knit fabric as the base, with a vest-like woven fabric anchoring top-layer. The hope is that the material will be firm enough, if wrapped around the entire torso, to provide the necessary anchor for the sensors.
I subsequently discovered that the anchoring was not as much of an issue as I had envisioned, and was able to use a knit tank-top as the base on which I sewed all of the stretch sensors.
Regarding the stethoscope-microphone, I was able to appropriate a cloth belt, on which I affixed the stethoscope, and in this manner I can attach the mic around the neck of the performer.
Initial objectives:
1. Effective sensor placement for useful breathing data.
2. Comfortable design for lengthy performances, easy on/off.
3. Minimize noise, maximize accurate data.
4. If possible, create haptic response system for performer.
5. Aesthetically pleasing and efficient design.
1. Effective sensor placement for useful breathing data.
The current design's sensor placement is based both on book-study of the respiratory system and on self-observation of breath-related body movements. As you inhale, the ribcage expands to the sides; since the right lung is slightly larger than the left lung due to the location of the heart, and is divided into three rather than two lobes, the right side of the torso is equipped with two sensors, and the left with only one. The diaphragm moves involuntarily with the breath, and a sensor is placed to capture this movement. While many technical studies of breath suggest that shoulders should not move, in observation of casual breathing it was clear that shoulders regularly move in breath patterns. Therefore, a sensor is placed to capture this vertical motion. Finally, the expansion across the upper back seemed worth capturing, so a sensor is placed between the shoulder blades.
2. Comfortable design for lengthy performances, easy on/off.
The challenge in the comfort of the design is that in order to enable the stretch sensors to gather accurate breath-movement data, at least one layer of the shirt must be skin tight. This has potential comfort-ramifications in both the physical and psychological realms, depending on the performer's comfort or lack thereof with wearing exposing clothing. In my design for the PMC, the issue of psychological comfort is addressed by creating a multi-layer design in which the top-layer is not form-fitting. The issue of physical comfort is addressed in a somewhat less satisfactory manner. The shirt has 4 layers, and will therefore be not only tight, but hot. This makes the ideal performance space somewhere that is cold, or at least cool. I will attempt to address these issues better in future revisions. Putting the shirt on, or taking it off, is not quite as easy as would be ideal, but it could be worse. I achieved a somewhat easier on/off by sewing together lots of key places in the layering of the shirts.
3. Minimize noise, maximize accurate data.
Minimizing noise is actually relatively simple in the PMC design, because both the changes in resistance provided by the stretch sensors, and the movement of the body during inhalation and exhalation, is relatively subtle. Therefore, the nature of the instrument inherently minimizes noise. Maximizing accurate data is more of an issue, due to the subtle nature of the instrument. Because of this, three of six stretch sensors (those placed on the side-body, at various places on the rib-cage), have been doubled-over in the shirt design, to double the changes in resistance with each movement. Two of the remaining three are placed in locations where it is easy for the body to exaggerate movements as necessary (the shoulder and between the shoulder blades). The remaining stretch sensor is placed on the front-body, between the bottom right and left ribcage. This stretch sensor will likely register the least amount of changes in resistance, but this is by design--this means that it can be used to trigger things only as desired, and with an exaggerated effort by the performer.
4. If possible, create haptic response system for performer.
This particular element will not be explored in this iteration of the project. Because a person can feel their own breathing, if they focus their attention, this seemed less important, and possibly redundant. The concept will be revisited in future versions, and a final decision will be made as to its usefulness and importance.
5. Aesthetically pleasing and efficient design.
The design that is visible to the audience is relatively efficient. While I find it aesthetically pleasing as well, some feedback has indicated that it may have more sci-fi/fantasy connotations than I desired. The placement of the stretch sensors made it very difficult to create an efficient path for all of the various strands of conductive thread, and therefore I settled for simply an *accurate* design. Layering helped keep the accuracy, and ended up being the most efficient course of action that I could determine.
Other Issues:
For the physical controller, I imagined that the trickiest element would be incorporating stretch sensors into the textile so that they moved; if each end of the sensors was not properly anchored, the data-change from the sensors would be limited or absent.
My initial sketches followed the following logic:
Knit fabrics are stretchy and will move with the sensor; this material should be placed underneath each stretch sensor. Woven fabrics, on the other hand, do not stretch, and make good anchors for the ends of the sensors. The woven fabrics need to also be anchored around the body, so that they do not simply move with the rest of the fabric.
In my first attempt to resolve this issue I designed a dual-layer shirt which incorporates knit fabric as the base, with a vest-like woven fabric anchoring top-layer. The hope is that the material will be firm enough, if wrapped around the entire torso, to provide the necessary anchor for the sensors.
I subsequently discovered that the anchoring was not as much of an issue as I had envisioned, and was able to use a knit tank-top as the base on which I sewed all of the stretch sensors.
Regarding the stethoscope-microphone, I was able to appropriate a cloth belt, on which I affixed the stethoscope, and in this manner I can attach the mic around the neck of the performer.
Initial Sketches for breath-sensing shirt
This is my first attempt to sketch the breath sensing shirt as I envision it.
This is the beginning stages of an early prototype for the sensor.
Sunday, April 10, 2011
This is a slightly less rough, but still relatively rough draft
(New version as of Thursday April 14)
I will be editing this further in the future.
This paper provides a broad historical context for the Prana Musical Controller (PMC). First, the paper explores the biological and artistic history of the role of breath in music, the technical study and practice of breathing--both by musicians and practitioners of Pranayama--and the uses of breath in music and art from the 20th century onwards. The second part of the paper addresses research in areas including human-computer interaction in realtime performance, digital music controllers, wearable biofeedback sensors and textile technology.
Part I:
BREATH & MUSIC: AN EXPLORATION OF BIOLOGICAL & ARTISTIC ORIGINS
Breath and the biological origins of Music
Music began with breath. While the development of string instruments physically enables a musician to play music without thinking about the breath, the voice is the most innate instrument; vocal cords cannot vibrate without breath. Furthermore, research has indicated that evolutionary developments that enabled greater breath control in our ancestors were likely in service of both the development of spoken language and song [1].
The importance of breath in music is intuitive for most, but is particularly so for vocalists and wind instrumentalists. These musicians devote significant amounts of energy towards the practice and study of breathing techniques; breath is also a key factor in a vocalist’s or wind instrumentalist’s artistic interpretation of a piece. So whereas in speech our breathing patterns are typically passive and reflexive, in music our breaths are active, carefully planned and calculated for specific musical effect.
Pranayama
While many wind musicians have developed various breathing exercises as a means to an end, Pranayama, one of the eight stages of yoga, is a practice of breathing techniques that is traditionally independent of any performative goals. It is a very subtle but powerful practice, engaging the mind and body together.
While the goal of traditional Pranayama is not performative, the practice is similar, in some ways, to the practice of a musical instrument. The attention to detail, the focus, the repetition, dedication and self-observation are all core elements that these two practices share.
However similar the core elements of these two practices, though, the approach to breathing in Pranayama is quite different than it is for a wind player. In music, the goal of the wind player is to achieve a certain depth of inspiration as quickly as possible in support of the long expirations required by musical phrases. In Pranayama, on the other hand, the importance placed on details of inspirations and expirations and the approach to their execution change depending on the technique being practiced.
These nuances of breath lend themselves to musical interpretation. While not limiting the performer solely to traditional Pranayama practice, the Prana Musical Controller aims to capture the subtleties of breathing as practiced by the performer, and exploit them for performative means. The PMC therefore takes the act of Pranayama out of its traditional context and places it in a Westernized cultural context--that of the traditional concert hall performance. The PMC is therefore inspired both by the innate connection between breath and music, and also by the idea of drawing from the art of Pranayama to a create a musical practice devoted specifically to breath control.
BREATH IN CONTEMPORARY MUSIC & ART
Breath in 20th century music
The emphasis on breath in musical performance is not new. Prior to the 20th century, western classical music traditionally left issues of breathing--where and how to breathe--up to the performer. Beginning in the 20th century, however, some composers started to give explicit performance instructions regarding the breath. These instructions implied the composers’ recognition of the breath as a musical act, and fall into a few specific categories: dramatic audible breaths or implied breaths, (sharp inhalations, sighs, etc.), explicit directions on the timing of breaths, (including the use of breath as its own timing mechanism), and the absence of audible breaks for breaths using circular breathing.
Luciano Berio is a 20th century composer whose work provides a fertile study ground for looking at the role of breath in music. His Sequenzas, in particular, as virtuosic works for solo performers, provide a few useful examples for further study.
In Berio’s Sequenza III for female voice, performative breaths punctuate the musical structure. In his performance instructions, Berio designates a backwards arrow with a circle in the middle as “breathing in, gasping”. These gasps happen rather infrequently in the score. When they do occur, they are always placed together in short groupings, and are often designated by evocative markings such as “frantic” or “gasping”. Berio designates a plus symbol as a “breathy tone, almost whispered,” and sometimes asks for “whispered, unvoiced sounds”, which are arguably breath-like in nature. All of these qualities of breath are clearly used to evoke various emotional qualities.
Berio’s Sequenza V for Trombone also gives explicit breathing instructions. Whereas the performer can determine his own breath placement in the A section, in the B section, Berio writes:
...everything written between bar lines constitutes a breath unit: it must be performed in one breath, either exhaling or inhaling (<--o--). Consequently in section B, although the notation is still proportional, the length of each breath unit determines the overall speed. It is expected, for each performer and at each performance, the length of the breath units to be different. The transition between inhaling and exhaling must always occur without noticeable interruptions so that throughout section B there is no break in sound....
What is particularly interesting about this example is that while the breath itself is required to be inaudible to the audience, the breath capacities of each performer in each performance situation directly affect the timing of the entire section. This effect is slightly different than that of Berio’s Sequenza XII for bassoon, which provides another interesting example of engaging the role of breath in our perception of time. Here, the use of circular breathing distorts the listener’s sense of the passage of time. The phrase continues on seamlessly, almost suspending time.
While Berio’s Sequenzas provide very interesting insights into the use of breath in compositions in the 20th century, he is by no means the only composer to approach the topic. Composers engage in the topic with even the simplest instructions, such as instructing a performer to take as few breaths as possible in a section [2] (Nina Perlove, 1998). Alternatively, they might approach the concept of breath more directly, as Mauricio Kagel did with his work Atem (breath). Here, as the title suggests, the breath is the inspirational basis for an entire work [3].
Jonathan Harvey is a contemporary British composer whose Buddhism is reflected in the spiritual nature of much of his work. He recognizes the importance of breath in all music, as indicated in his discussion of the inspiration for his orchestral work, 80 breaths for Tokyo:
Breathing, in one form or another, is behind all music. However distant, breathing always has a relationship to music. Yoga students use it to master the body, Buddhists to master the mind, and therapies of all sorts realise that one must step back from one’s habitual ignoring of the act of breathing in order to become more deeply aware. When a large body of people breathe in synchrony the effect is ritualistic, whether it be sacred or a political demonstration. Neurologists are finding powerful neuronal synchrony in many human rites and social events. 80 Breaths for Tokyo is partly the result of the practice of Zen breathing, and partly the result of listening to slow music and enjoying its power over the mind and body. The orchestra somehow mirrors the infinitely variable, infinitely subtle and coloured ambiguity of breath. [4]
Electro-acoustic music
One might wonder why, when breath has been such an underlying force in music, arguably for its entire existence, it is only in the 20th century that Western classical composers began to ask performers to explicitly manipulate their breathing for performative purposes. Without having done any official research into the topic, intuitively it seems that the advance of recording and amplification technologies would play a role in peaking interest in the topic.
Typically, in our daily experience of sound, we have a source, (an object that creates the sound), and an environment, (a space in which the sound is created). The technology of recording has enabled composers to take a sound out of context--eliminating for the listener both the object that created the sound and the place in which it was recorded. But, because we cannot ever completely extract our concert listening habits from the influence of our daily listening experience, as audiences of electro-acoustic music, we are constantly using our aural imaginations to fill-in contextual gaps. (Suk-Jun Kim, 2010)
In this vein, the use of breath sounds in tape pieces is particularly interesting. Tape music, as a genre, literally takes the human body out of music, in that it removes the live performer. Breath is ultimately are associated with the human body. Using breath sounds in tape pieces, therefore, is one method by which a composer might attempt to retain the sense of the human body in music both in spite and because of the technology we embrace as electro-acoustic composers.
Berio’s Visage is a particularly famous example of a pivotal work in electronic music. In juxtaposing recordings of Cathy Berberian’s vocalizations (including breaths) with electronic sounds, Berio explores an interesting dichotomy of the natural and mechanical worlds.
Out of Breath (2000) by Paul Koonce Interiors and Interplays (1994) by Erik Mikael Karlsson provide two more recent examples of pieces using breath sounds. In Out of Breath, the development of breath sounds resonating through a flute suggested to one listener the concept of a flutist, uncertain at first, growing more confident as she sonically explores a space which unexpectedly resonates her instrument. In Interiors and Interplays, after more than 5 minutes of music has passed the introduction of breath sounds provides a sense of body where before there was none. (Suk-Jun Kim, 2010)
Breath in other art forms
While thus far our discussion has centered around uses of breath and breathing in sound compositions, the theme of breath has been taken up by artists in other fields as well. Two different approaches will be discussed here: breath as control input in multimedia experience, and abstract exploration of the concept of breath. Clearly these are not mutually exclusive paradigms, however they will be explored independently in the context of a few different works.
Canadian artist Char Davies’ works Osmose (1995) and Ephémère (1998) are both examples in which the breath of the person experiencing the artwork is used as a control input. In these works, the interface consists of a head-mounted stereoscopic display and real-time tracking based on breath and balance through which the viewer explores a virtual 3D world.
Poet, author and playwright Samuel Beckett’s Breath (1969) is an extremely short stage work with no dialogue. The curtain rises to show a stage with trash strewn about. After five seconds, a short, faint infant’s cry is heard, followed by a long (10-second) inhalation. After another 5-second pause, there is a 10-second exhalation and a repetition of the initial cry. The curtain closes. As one possible interpretation, William Hutchings points to the work’s similarity to Gustav Freytag’s pyramidical structure, which he wrote about in Die Technik des Dramas in 1863:
The initial pause and first cry representing birth...
The inhalation, a symbol of growth and development...
The pause while the breath is held is the climax...
The exhalation--a metaphor for the entropic decline of the body with advancing age...
The reiterated cry, the “catastrophe” or “resolution” of the play, and a final silence before the curtain descends.
(Hutchings, 1986)
A number of artists have also created film versions of Beckett’s Breath, including Damien Hirst.
Both Davies’ and Beckett’s approach to breath in their respective works provide an interesting context in which to explore different elements of the PMC. The idea of navigating space (in this case musical space) with breath may be a particularly fruitful area for further exploration. Beckett’s metaphorical use of a single breath to represent a life-cycle may provide a potential guide for one approach to the underlying structure of a one composition specifically written for the PMC.
Part II:
BREATH & TECHNOLOGY, MAKING BREATH INTO AN INSTRUMENT
Historical examples of research in creating new digital instruments
As a musical controller, the creation of the PMC will be informed by prior research in the field of real-time human-computer interaction in general, and more specifically that of the creation of new digital instruments.
While it is tempting to think of an instrument as a simple tool with a single outcome, it is important to realize that performer, instrument and performance environment--including the performance space and culture--are dynamically interconnected and work together to create a specific musical outcome. Keeping the same instrument while changing either of the two other characteristics can result in a wildly different musical outcome (Simon Waters, 2007). The PMC is currently being designed for a specific performer,(the author). It draws on the Eastern tradition of Pranayama, but is placed firmly in the performance hall tradition of Western classical music. That having been said, if a different performer were to use the PMC they would likely succeed in molding it to a number of different purposes. [5]
Body in performance
With the advance of technology and the creation of tape music came a shift away from the innate connection between the human body and sound generation in performance. ‘As previously discussed, tape music concerts provide a window into some of the performative issues around music detached from body; music is traditionally experienced both visually and aurally, enabling the audience to connect through ‘kinesthetic empathy and vicarious performance’ (Bahn, Hahn, Trueman, 2001) as well as simple auditory awareness.
Where the connection between music and body is important for an audience, it is essential for a performer. The performer traditionally engages with her instrument not only through the auditory evaluation of the sound she produces, but through haptic sensations. Sensitivity to the haptic/sonic feedback loop is an essential skill for instrumental musicians. (Bahn, Hahn, Trueman, 2001). Rebelo adds:
Haptic sensation recognizes the micro-fabric of performative space. It is with negotiation of subtlety and the recognition of threshold conditions that the performer participates in an instrumental space. At a physio-acoustic level, we can talk about the feedback loop system that is present when playing a wind instrument, for example. The player constantly adapts and configures throat position, vocal cavity and breath depending on the resistance of the tube, mouthpiece or reed. (Rebelo, 2006)
A case study: Pikapika
Pikapika is a performance piece inspired by Japanese Anime created collaboratively by Curtis Bahn and Tomie Hahn. The piece uses a custom made digital interface built into the costume worn by Hahn, the performer. Speakers are mounted to her arms and back so that sounds emanate directly from her body as a result of her movements. Accelerometers on her hands and feet as well as force sensors on her hands enable her wireless communication with a computer running Max/MSP. While breath is not specifically used as an input here, Bahn, Hahn and Trueman do address its impact on their work:
The voice, so centrally located in the body, would seem immune to the impact of electronic instruments. The voice is inextricably tied to breath, while breath is tied to sentience, existence, and intension. It can be “felt” via kinetic empathy between performers, implying a lived experience of a mutually created sonic environment. In our work, the voice has served as an instrument and as a model for the construction of composed instruments, both in a literal sense (via sampling) and in a more general musical sense, guiding our improvisations and our mappings of physical input to sonic output. In turn, we have found in the performing of these composed instruments that the instruments themselves deeply impact how we speak and breathe. (Bahn, Hahn, Trueman, 2001)
For the purposes of the PMC their work provides two particular points of interest: 1. The way in which a performer and a human-computer interface might communicate and gradually result in a shift in the performer’s natural state of breathing. 2. The use of body-mounted speakers, both as a way to localize sound so that it emanates directly from the performer’s body, and also so that it gives the performer immediate haptic feedback.
VPFI
Particularly relevant to the PMC is the work of John Bowers, Simon Waters and others around Virtual/Physical Feedback Instruments (VPFI). The common thread in these types of instruments is that they incorporate a virtual element as well as a physical element that together create some sort of feedback loop. Often, the physical instrument excites the virtual instrument which then affects the output of the physical instrument, and so on. (Waters, 2007) While a potentially very fruitful mode of human-computer interaction, in the case of the PMC there are obvious issues with this model. The breath being internal, and not an external instrument, intuitively it would seem that the loop is never able to start. The coupling of the acoustic and the digital, however, is very interesting, and of potential use as a model for the PMC; the acoustic instrument--the sound of the breath, can be somehow affected by input to the sensors monitoring breath depth and rate.
Mapping
In traditional acoustic instruments the performance interface is inherently tied to the acoustic output. In digital instruments, most often the performance interface exists independently from the sound generator. The art of mapping the performance interface to the sound generator is one that defines the character of the instrument. Research indicates that mapping decisions have a great impact on the quality of the experience of the performer.
One researcher came across a Theremin that was accidentally wired incorrectly such that to make sound one had to constantly keep their hand(s) in motion. Excited by the high level of interaction and sustained interest in those that played with the Theremin, the researcher set out to create a number of experiments in which musical controllers were set up to either require constant energy from the performer to sustain sound--as is the case with acoustic instruments--or not. Overwhelmingly, participants found the former set up to be more engaging. Breath as a control fits very well into this type of mapping. With the PMC the inspirations and expirations can be thought of as the up bows and down bows of a stringed instrument. What will be interesting to explore is how natural pauses in the breathing process are impacted by the performer’s musical goals--sustaining a constant motion from inhale through exhale and back is actually quite challenging.
In the same experiment, the researcher tested two different approaches to mapping: the first, which did not need constant energy input from the user, used a simple one-to-one mapping in which a single fader controlled pitch, and another amplitude. The second mapping required one fader to move continuously to generate sound. This fader also controlled amplitude and had a subtle affect on pitch as well. A second fader had most of the control over the pitch. In all of the test subjects, the time spent exploring the mapping, and the relative engagement of the subjects was much greater in the latter example than the former. (Hunt, Wanderley & Paradis, 2003)
John Bowers’ study of simple design interfaces with complex results is related to the above study. Using interfaces with limited inputs, he achieves interesting musical results in a variety of manners:
Using ‘algorithmically mediated data’ so that there is a layer of manipulation beyond direct manipulation.
Limited input devices control multiple parameters, like acoustic instruments.
‘Dynamic adaptive interfaces’ create mappings that change over the course of time.
‘Anisotropic interaction space’: an input interface that is somewhat predictable, but has unpredictable elements that force a performer to react in real time.
(Waters, 2007)
Given the PMC’s simple interface consisting only of stretch sensors built into clothing to detect breath, this and similar research will provide particularly interesting models and ideas for further research.
Biofeedback clothing technologies
Much research has been done with goal of sensing bodily functions using comfortable, wearable textile technologies as there is a demonstrated need for such devices for use in medicine. Common issues in the creation of effective clothing-technology include comfort for long-term wear, flexibility, durability and washability, as well accuracy in readings in a wide variety of contexts (Dunne, Smith). All of these issues are relevant to the PMC, but especially relevant is the concern for the comfort of the wearer. Many types of wearable biofeedback sensors rely on direct contact with the skin, or skin-tight clothing to achieve accurate results. The PMC may not need skin-tight clothing, but the clothing will have to be tight enough to allow for accurate breath-readings. One prior study used a foam sensor built into one small area of clothing to sense breath. (Dunne, et al.) If the stretch sensors planned for this project make the shirt excessively uncomfortable, foam sensors may be explored as an alternative.
Conclusion
Breath is an important theme in both music and art. The concept and sound of breath carries a lot of weight, both in terms of its symbolic and metaphorical nature. In music, in particular, the breath has played a central and developmental role. The PMC attempts to engage the performer and audience in an explorative dialogue on the nature and musical potentials of the breath.
[1] It is difficult to say with certainty when music was first made by human beings. The first instruments were simple percussion instruments and flutes; of these, ancient bone flutes survived, but it is likely that earlier instruments have decomposed over time. Even more complicated to discern is the first usage of the human voice for song--unlike instruments, the voice doesn’t leave behind any fossils or remnants. But some of the same clues that have led researches to hypothesize about the timing of the development of language provide useful insights into the same for song. (Fitch, 2006)
Modern humans and Neanderthals have an expanded thoracic vertebral canal enabling a greater amount of breath control as compared to their evolutionary ancestors. While various theories exist for this evolutionary development, the most convincing of these is that the development is directly related to human speech. Breath control is a necessary component in expressive communication because it enables the utterance of long phrases with only short, linguistically meaningful pauses for inspirations. (MacLarnon & Hewitt, 1999)
The ties between language and music are well documented and center around syntactical relationships involving sentence structure in language and phrase structure in music. (Patel, 2003) Given this inherent relationship, biological developments that were pertinent for the evolution of language were therefore just as relevant to that of music.
[2] In Brian Ferneyhough’s work for Piccolo, Superscriptio, the composer marks optional breath locations, but instructs the performer to take as few as possible.
[3] Atem is as much a theater work as it is a piece of music. It is essentially an unspoken narrative about an aged wind musician trying to play a musical phrase “while on the verge of expiring”. (http://www.mondayeveningconcerts.org/notes/022210.html)
[4] http://www.fabermusic.com/news/story/jonathan-harvey-takes-80-breaths-for-tokyo.aspx?ComposerId=297
[5] There are a number of different contexts that I’d like to explore in the future. These include interactions with dancers (an early version has been tested) and an installation in which attendants’ breath is monitored.
And the bibliography (in progress)
Bibliography
MacLarnon, Ann M., and Gwen P. Hewitt. "The Evolution of Human Speech: The Role of Enhanced Breathing Control." American Journal of Physical Anthropology 109.3. 1 July 1999. Web. Apr. 2011.
Fitch, W. Tecumseh. "The Biology and Evolution of Music: A Comparative Perspective." Science Direct (2006). Web. Apr. 2011.
Patel, Aniruddh D. "Language, Music, Syntax and the Brain." Nature Neuroscience (2003). Web. Apr. 2011
Iyengar, B. K. S. Light on Pranayama: the Yogic Art of Breathing. New York: Crossroad, 2005. Print.
Iyengar, B.K.S. Light on Yoga: Yoga Dipika. New Delhi: HarperCollins, 2009. Print.
Berio, Luciano. Sequenza III, V, XII. Universal Edition. Print.
Mauricio Kagel, Atem.
Performance Ecosystems: Ecological approaches to musical interaction
Hunt, Andy , Wanderley, Marcelo M. and Paradis, Matthew(2003) 'The Importance of Parameter Mapping in Electronic Instrument Design', Journal of New Music Research, 32: 4, 429 — 440
Haptic Sensation and Instrumental Transgression
BIO-FEEDBACK CLOTHING TECHNOLOGIES
Printing Electric Circuits onto Nonwoven Conformal Fabrics
Second-Skin Sensing: A Wearability Challenge
Garment-Based Body Sensing Using Foam Sensors
IMPLEMENTATIONS: SCIENCE OF BREATHING AND MAPPING IMPLICATIONS
The Science of the Singing Voice (LIBRARY BOOK)
I will be editing this further in the future.
This paper provides a broad historical context for the Prana Musical Controller (PMC). First, the paper explores the biological and artistic history of the role of breath in music, the technical study and practice of breathing--both by musicians and practitioners of Pranayama--and the uses of breath in music and art from the 20th century onwards. The second part of the paper addresses research in areas including human-computer interaction in realtime performance, digital music controllers, wearable biofeedback sensors and textile technology.
Part I:
BREATH & MUSIC: AN EXPLORATION OF BIOLOGICAL & ARTISTIC ORIGINS
Breath and the biological origins of Music
Music began with breath. While the development of string instruments physically enables a musician to play music without thinking about the breath, the voice is the most innate instrument; vocal cords cannot vibrate without breath. Furthermore, research has indicated that evolutionary developments that enabled greater breath control in our ancestors were likely in service of both the development of spoken language and song [1].
The importance of breath in music is intuitive for most, but is particularly so for vocalists and wind instrumentalists. These musicians devote significant amounts of energy towards the practice and study of breathing techniques; breath is also a key factor in a vocalist’s or wind instrumentalist’s artistic interpretation of a piece. So whereas in speech our breathing patterns are typically passive and reflexive, in music our breaths are active, carefully planned and calculated for specific musical effect.
Pranayama
While many wind musicians have developed various breathing exercises as a means to an end, Pranayama, one of the eight stages of yoga, is a practice of breathing techniques that is traditionally independent of any performative goals. It is a very subtle but powerful practice, engaging the mind and body together.
While the goal of traditional Pranayama is not performative, the practice is similar, in some ways, to the practice of a musical instrument. The attention to detail, the focus, the repetition, dedication and self-observation are all core elements that these two practices share.
However similar the core elements of these two practices, though, the approach to breathing in Pranayama is quite different than it is for a wind player. In music, the goal of the wind player is to achieve a certain depth of inspiration as quickly as possible in support of the long expirations required by musical phrases. In Pranayama, on the other hand, the importance placed on details of inspirations and expirations and the approach to their execution change depending on the technique being practiced.
These nuances of breath lend themselves to musical interpretation. While not limiting the performer solely to traditional Pranayama practice, the Prana Musical Controller aims to capture the subtleties of breathing as practiced by the performer, and exploit them for performative means. The PMC therefore takes the act of Pranayama out of its traditional context and places it in a Westernized cultural context--that of the traditional concert hall performance. The PMC is therefore inspired both by the innate connection between breath and music, and also by the idea of drawing from the art of Pranayama to a create a musical practice devoted specifically to breath control.
BREATH IN CONTEMPORARY MUSIC & ART
Breath in 20th century music
The emphasis on breath in musical performance is not new. Prior to the 20th century, western classical music traditionally left issues of breathing--where and how to breathe--up to the performer. Beginning in the 20th century, however, some composers started to give explicit performance instructions regarding the breath. These instructions implied the composers’ recognition of the breath as a musical act, and fall into a few specific categories: dramatic audible breaths or implied breaths, (sharp inhalations, sighs, etc.), explicit directions on the timing of breaths, (including the use of breath as its own timing mechanism), and the absence of audible breaks for breaths using circular breathing.
Luciano Berio is a 20th century composer whose work provides a fertile study ground for looking at the role of breath in music. His Sequenzas, in particular, as virtuosic works for solo performers, provide a few useful examples for further study.
In Berio’s Sequenza III for female voice, performative breaths punctuate the musical structure. In his performance instructions, Berio designates a backwards arrow with a circle in the middle as “breathing in, gasping”. These gasps happen rather infrequently in the score. When they do occur, they are always placed together in short groupings, and are often designated by evocative markings such as “frantic” or “gasping”. Berio designates a plus symbol as a “breathy tone, almost whispered,” and sometimes asks for “whispered, unvoiced sounds”, which are arguably breath-like in nature. All of these qualities of breath are clearly used to evoke various emotional qualities.
Berio’s Sequenza V for Trombone also gives explicit breathing instructions. Whereas the performer can determine his own breath placement in the A section, in the B section, Berio writes:
...everything written between bar lines constitutes a breath unit: it must be performed in one breath, either exhaling or inhaling (<--o--). Consequently in section B, although the notation is still proportional, the length of each breath unit determines the overall speed. It is expected, for each performer and at each performance, the length of the breath units to be different. The transition between inhaling and exhaling must always occur without noticeable interruptions so that throughout section B there is no break in sound....
What is particularly interesting about this example is that while the breath itself is required to be inaudible to the audience, the breath capacities of each performer in each performance situation directly affect the timing of the entire section. This effect is slightly different than that of Berio’s Sequenza XII for bassoon, which provides another interesting example of engaging the role of breath in our perception of time. Here, the use of circular breathing distorts the listener’s sense of the passage of time. The phrase continues on seamlessly, almost suspending time.
While Berio’s Sequenzas provide very interesting insights into the use of breath in compositions in the 20th century, he is by no means the only composer to approach the topic. Composers engage in the topic with even the simplest instructions, such as instructing a performer to take as few breaths as possible in a section [2] (Nina Perlove, 1998). Alternatively, they might approach the concept of breath more directly, as Mauricio Kagel did with his work Atem (breath). Here, as the title suggests, the breath is the inspirational basis for an entire work [3].
Jonathan Harvey is a contemporary British composer whose Buddhism is reflected in the spiritual nature of much of his work. He recognizes the importance of breath in all music, as indicated in his discussion of the inspiration for his orchestral work, 80 breaths for Tokyo:
Breathing, in one form or another, is behind all music. However distant, breathing always has a relationship to music. Yoga students use it to master the body, Buddhists to master the mind, and therapies of all sorts realise that one must step back from one’s habitual ignoring of the act of breathing in order to become more deeply aware. When a large body of people breathe in synchrony the effect is ritualistic, whether it be sacred or a political demonstration. Neurologists are finding powerful neuronal synchrony in many human rites and social events. 80 Breaths for Tokyo is partly the result of the practice of Zen breathing, and partly the result of listening to slow music and enjoying its power over the mind and body. The orchestra somehow mirrors the infinitely variable, infinitely subtle and coloured ambiguity of breath. [4]
Electro-acoustic music
One might wonder why, when breath has been such an underlying force in music, arguably for its entire existence, it is only in the 20th century that Western classical composers began to ask performers to explicitly manipulate their breathing for performative purposes. Without having done any official research into the topic, intuitively it seems that the advance of recording and amplification technologies would play a role in peaking interest in the topic.
Typically, in our daily experience of sound, we have a source, (an object that creates the sound), and an environment, (a space in which the sound is created). The technology of recording has enabled composers to take a sound out of context--eliminating for the listener both the object that created the sound and the place in which it was recorded. But, because we cannot ever completely extract our concert listening habits from the influence of our daily listening experience, as audiences of electro-acoustic music, we are constantly using our aural imaginations to fill-in contextual gaps. (Suk-Jun Kim, 2010)
In this vein, the use of breath sounds in tape pieces is particularly interesting. Tape music, as a genre, literally takes the human body out of music, in that it removes the live performer. Breath is ultimately are associated with the human body. Using breath sounds in tape pieces, therefore, is one method by which a composer might attempt to retain the sense of the human body in music both in spite and because of the technology we embrace as electro-acoustic composers.
Berio’s Visage is a particularly famous example of a pivotal work in electronic music. In juxtaposing recordings of Cathy Berberian’s vocalizations (including breaths) with electronic sounds, Berio explores an interesting dichotomy of the natural and mechanical worlds.
Out of Breath (2000) by Paul Koonce Interiors and Interplays (1994) by Erik Mikael Karlsson provide two more recent examples of pieces using breath sounds. In Out of Breath, the development of breath sounds resonating through a flute suggested to one listener the concept of a flutist, uncertain at first, growing more confident as she sonically explores a space which unexpectedly resonates her instrument. In Interiors and Interplays, after more than 5 minutes of music has passed the introduction of breath sounds provides a sense of body where before there was none. (Suk-Jun Kim, 2010)
Breath in other art forms
While thus far our discussion has centered around uses of breath and breathing in sound compositions, the theme of breath has been taken up by artists in other fields as well. Two different approaches will be discussed here: breath as control input in multimedia experience, and abstract exploration of the concept of breath. Clearly these are not mutually exclusive paradigms, however they will be explored independently in the context of a few different works.
Canadian artist Char Davies’ works Osmose (1995) and Ephémère (1998) are both examples in which the breath of the person experiencing the artwork is used as a control input. In these works, the interface consists of a head-mounted stereoscopic display and real-time tracking based on breath and balance through which the viewer explores a virtual 3D world.
Poet, author and playwright Samuel Beckett’s Breath (1969) is an extremely short stage work with no dialogue. The curtain rises to show a stage with trash strewn about. After five seconds, a short, faint infant’s cry is heard, followed by a long (10-second) inhalation. After another 5-second pause, there is a 10-second exhalation and a repetition of the initial cry. The curtain closes. As one possible interpretation, William Hutchings points to the work’s similarity to Gustav Freytag’s pyramidical structure, which he wrote about in Die Technik des Dramas in 1863:
The initial pause and first cry representing birth...
The inhalation, a symbol of growth and development...
The pause while the breath is held is the climax...
The exhalation--a metaphor for the entropic decline of the body with advancing age...
The reiterated cry, the “catastrophe” or “resolution” of the play, and a final silence before the curtain descends.
(Hutchings, 1986)
A number of artists have also created film versions of Beckett’s Breath, including Damien Hirst.
Both Davies’ and Beckett’s approach to breath in their respective works provide an interesting context in which to explore different elements of the PMC. The idea of navigating space (in this case musical space) with breath may be a particularly fruitful area for further exploration. Beckett’s metaphorical use of a single breath to represent a life-cycle may provide a potential guide for one approach to the underlying structure of a one composition specifically written for the PMC.
Part II:
BREATH & TECHNOLOGY, MAKING BREATH INTO AN INSTRUMENT
Historical examples of research in creating new digital instruments
As a musical controller, the creation of the PMC will be informed by prior research in the field of real-time human-computer interaction in general, and more specifically that of the creation of new digital instruments.
While it is tempting to think of an instrument as a simple tool with a single outcome, it is important to realize that performer, instrument and performance environment--including the performance space and culture--are dynamically interconnected and work together to create a specific musical outcome. Keeping the same instrument while changing either of the two other characteristics can result in a wildly different musical outcome (Simon Waters, 2007). The PMC is currently being designed for a specific performer,(the author). It draws on the Eastern tradition of Pranayama, but is placed firmly in the performance hall tradition of Western classical music. That having been said, if a different performer were to use the PMC they would likely succeed in molding it to a number of different purposes. [5]
Body in performance
With the advance of technology and the creation of tape music came a shift away from the innate connection between the human body and sound generation in performance. ‘As previously discussed, tape music concerts provide a window into some of the performative issues around music detached from body; music is traditionally experienced both visually and aurally, enabling the audience to connect through ‘kinesthetic empathy and vicarious performance’ (Bahn, Hahn, Trueman, 2001) as well as simple auditory awareness.
Where the connection between music and body is important for an audience, it is essential for a performer. The performer traditionally engages with her instrument not only through the auditory evaluation of the sound she produces, but through haptic sensations. Sensitivity to the haptic/sonic feedback loop is an essential skill for instrumental musicians. (Bahn, Hahn, Trueman, 2001). Rebelo adds:
Haptic sensation recognizes the micro-fabric of performative space. It is with negotiation of subtlety and the recognition of threshold conditions that the performer participates in an instrumental space. At a physio-acoustic level, we can talk about the feedback loop system that is present when playing a wind instrument, for example. The player constantly adapts and configures throat position, vocal cavity and breath depending on the resistance of the tube, mouthpiece or reed. (Rebelo, 2006)
A case study: Pikapika
Pikapika is a performance piece inspired by Japanese Anime created collaboratively by Curtis Bahn and Tomie Hahn. The piece uses a custom made digital interface built into the costume worn by Hahn, the performer. Speakers are mounted to her arms and back so that sounds emanate directly from her body as a result of her movements. Accelerometers on her hands and feet as well as force sensors on her hands enable her wireless communication with a computer running Max/MSP. While breath is not specifically used as an input here, Bahn, Hahn and Trueman do address its impact on their work:
The voice, so centrally located in the body, would seem immune to the impact of electronic instruments. The voice is inextricably tied to breath, while breath is tied to sentience, existence, and intension. It can be “felt” via kinetic empathy between performers, implying a lived experience of a mutually created sonic environment. In our work, the voice has served as an instrument and as a model for the construction of composed instruments, both in a literal sense (via sampling) and in a more general musical sense, guiding our improvisations and our mappings of physical input to sonic output. In turn, we have found in the performing of these composed instruments that the instruments themselves deeply impact how we speak and breathe. (Bahn, Hahn, Trueman, 2001)
For the purposes of the PMC their work provides two particular points of interest: 1. The way in which a performer and a human-computer interface might communicate and gradually result in a shift in the performer’s natural state of breathing. 2. The use of body-mounted speakers, both as a way to localize sound so that it emanates directly from the performer’s body, and also so that it gives the performer immediate haptic feedback.
VPFI
Particularly relevant to the PMC is the work of John Bowers, Simon Waters and others around Virtual/Physical Feedback Instruments (VPFI). The common thread in these types of instruments is that they incorporate a virtual element as well as a physical element that together create some sort of feedback loop. Often, the physical instrument excites the virtual instrument which then affects the output of the physical instrument, and so on. (Waters, 2007) While a potentially very fruitful mode of human-computer interaction, in the case of the PMC there are obvious issues with this model. The breath being internal, and not an external instrument, intuitively it would seem that the loop is never able to start. The coupling of the acoustic and the digital, however, is very interesting, and of potential use as a model for the PMC; the acoustic instrument--the sound of the breath, can be somehow affected by input to the sensors monitoring breath depth and rate.
Mapping
In traditional acoustic instruments the performance interface is inherently tied to the acoustic output. In digital instruments, most often the performance interface exists independently from the sound generator. The art of mapping the performance interface to the sound generator is one that defines the character of the instrument. Research indicates that mapping decisions have a great impact on the quality of the experience of the performer.
One researcher came across a Theremin that was accidentally wired incorrectly such that to make sound one had to constantly keep their hand(s) in motion. Excited by the high level of interaction and sustained interest in those that played with the Theremin, the researcher set out to create a number of experiments in which musical controllers were set up to either require constant energy from the performer to sustain sound--as is the case with acoustic instruments--or not. Overwhelmingly, participants found the former set up to be more engaging. Breath as a control fits very well into this type of mapping. With the PMC the inspirations and expirations can be thought of as the up bows and down bows of a stringed instrument. What will be interesting to explore is how natural pauses in the breathing process are impacted by the performer’s musical goals--sustaining a constant motion from inhale through exhale and back is actually quite challenging.
In the same experiment, the researcher tested two different approaches to mapping: the first, which did not need constant energy input from the user, used a simple one-to-one mapping in which a single fader controlled pitch, and another amplitude. The second mapping required one fader to move continuously to generate sound. This fader also controlled amplitude and had a subtle affect on pitch as well. A second fader had most of the control over the pitch. In all of the test subjects, the time spent exploring the mapping, and the relative engagement of the subjects was much greater in the latter example than the former. (Hunt, Wanderley & Paradis, 2003)
John Bowers’ study of simple design interfaces with complex results is related to the above study. Using interfaces with limited inputs, he achieves interesting musical results in a variety of manners:
Using ‘algorithmically mediated data’ so that there is a layer of manipulation beyond direct manipulation.
Limited input devices control multiple parameters, like acoustic instruments.
‘Dynamic adaptive interfaces’ create mappings that change over the course of time.
‘Anisotropic interaction space’: an input interface that is somewhat predictable, but has unpredictable elements that force a performer to react in real time.
(Waters, 2007)
Given the PMC’s simple interface consisting only of stretch sensors built into clothing to detect breath, this and similar research will provide particularly interesting models and ideas for further research.
Biofeedback clothing technologies
Much research has been done with goal of sensing bodily functions using comfortable, wearable textile technologies as there is a demonstrated need for such devices for use in medicine. Common issues in the creation of effective clothing-technology include comfort for long-term wear, flexibility, durability and washability, as well accuracy in readings in a wide variety of contexts (Dunne, Smith). All of these issues are relevant to the PMC, but especially relevant is the concern for the comfort of the wearer. Many types of wearable biofeedback sensors rely on direct contact with the skin, or skin-tight clothing to achieve accurate results. The PMC may not need skin-tight clothing, but the clothing will have to be tight enough to allow for accurate breath-readings. One prior study used a foam sensor built into one small area of clothing to sense breath. (Dunne, et al.) If the stretch sensors planned for this project make the shirt excessively uncomfortable, foam sensors may be explored as an alternative.
Conclusion
Breath is an important theme in both music and art. The concept and sound of breath carries a lot of weight, both in terms of its symbolic and metaphorical nature. In music, in particular, the breath has played a central and developmental role. The PMC attempts to engage the performer and audience in an explorative dialogue on the nature and musical potentials of the breath.
[1] It is difficult to say with certainty when music was first made by human beings. The first instruments were simple percussion instruments and flutes; of these, ancient bone flutes survived, but it is likely that earlier instruments have decomposed over time. Even more complicated to discern is the first usage of the human voice for song--unlike instruments, the voice doesn’t leave behind any fossils or remnants. But some of the same clues that have led researches to hypothesize about the timing of the development of language provide useful insights into the same for song. (Fitch, 2006)
Modern humans and Neanderthals have an expanded thoracic vertebral canal enabling a greater amount of breath control as compared to their evolutionary ancestors. While various theories exist for this evolutionary development, the most convincing of these is that the development is directly related to human speech. Breath control is a necessary component in expressive communication because it enables the utterance of long phrases with only short, linguistically meaningful pauses for inspirations. (MacLarnon & Hewitt, 1999)
The ties between language and music are well documented and center around syntactical relationships involving sentence structure in language and phrase structure in music. (Patel, 2003) Given this inherent relationship, biological developments that were pertinent for the evolution of language were therefore just as relevant to that of music.
[2] In Brian Ferneyhough’s work for Piccolo, Superscriptio, the composer marks optional breath locations, but instructs the performer to take as few as possible.
[3] Atem is as much a theater work as it is a piece of music. It is essentially an unspoken narrative about an aged wind musician trying to play a musical phrase “while on the verge of expiring”. (http://www.mondayeveningconcerts.org/notes/022210.html)
[4] http://www.fabermusic.com/news/story/jonathan-harvey-takes-80-breaths-for-tokyo.aspx?ComposerId=297
[5] There are a number of different contexts that I’d like to explore in the future. These include interactions with dancers (an early version has been tested) and an installation in which attendants’ breath is monitored.
And the bibliography (in progress)
Bibliography
MacLarnon, Ann M., and Gwen P. Hewitt. "The Evolution of Human Speech: The Role of Enhanced Breathing Control." American Journal of Physical Anthropology 109.3. 1 July 1999. Web. Apr. 2011.
Fitch, W. Tecumseh. "The Biology and Evolution of Music: A Comparative Perspective." Science Direct (2006). Web. Apr. 2011.
Patel, Aniruddh D. "Language, Music, Syntax and the Brain." Nature Neuroscience (2003). Web. Apr. 2011
Iyengar, B. K. S. Light on Pranayama: the Yogic Art of Breathing. New York: Crossroad, 2005. Print.
Iyengar, B.K.S. Light on Yoga: Yoga Dipika. New Delhi: HarperCollins, 2009. Print.
Berio, Luciano. Sequenza III, V, XII. Universal Edition. Print.
Mauricio Kagel, Atem.
Performance Ecosystems: Ecological approaches to musical interaction
Hunt, Andy , Wanderley, Marcelo M. and Paradis, Matthew(2003) 'The Importance of Parameter Mapping in Electronic Instrument Design', Journal of New Music Research, 32: 4, 429 — 440
Haptic Sensation and Instrumental Transgression
BIO-FEEDBACK CLOTHING TECHNOLOGIES
Printing Electric Circuits onto Nonwoven Conformal Fabrics
Second-Skin Sensing: A Wearability Challenge
Garment-Based Body Sensing Using Foam Sensors
IMPLEMENTATIONS: SCIENCE OF BREATHING AND MAPPING IMPLICATIONS
The Science of the Singing Voice (LIBRARY BOOK)
Sunday, April 3, 2011
Timeline
Week 1: Conceptual
-Initial conceptual framework
-Ordering initial parts
-Timeline for overall piece
-Initial research/begin compiling bibliography
-Begin practicing Pranayama (to be continued weekly)
Weeks 2 & 3: Research
-Historical/contextual research
-Technological research
-Begin categorizing different types of breaths, and thinking about ways to store relevant breath information for use
-Research on new musical instruments: begin thinking about what changes in sounds will be affected by which different breathing characteristics.
-Research different applications of bio-sensors in clothing, and other manifestations of technology in clothing
-Begin working on sounds
-Meet with textile expert to discuss design considerations and begin testing materials.
Weeks 4 & 5: Designing
-Get the rest of the relevant materials, take measurements, make drawings
-Make mock prototype (no real sensors, etc.) with cheap materials
-Test technical framework separately from aesthetic implementation
Weeks 6 & 7: Creating
-Build actual clothing piece
-Test/troubleshoot any technical issues
Weeks 8 & 9: Refining & evaluating
-Refine sound/structure of piece
-Refine breathing inputs--amplify if necessary
-Reflect on initial implementation of piece
-Evaluate deficiencies
-Return to research and develop project further
Week 10: Practicing and Documentation, further reflections
-Practice for performance
-Document both practice and performance
-Consider further possibilities for future installations
Exam Week:
Performance
-Initial conceptual framework
-Ordering initial parts
-Timeline for overall piece
-Initial research/begin compiling bibliography
-Begin practicing Pranayama (to be continued weekly)
Weeks 2 & 3: Research
-Historical/contextual research
-Technological research
-Begin categorizing different types of breaths, and thinking about ways to store relevant breath information for use
-Research on new musical instruments: begin thinking about what changes in sounds will be affected by which different breathing characteristics.
-Research different applications of bio-sensors in clothing, and other manifestations of technology in clothing
-Begin working on sounds
-Meet with textile expert to discuss design considerations and begin testing materials.
Weeks 4 & 5: Designing
-Get the rest of the relevant materials, take measurements, make drawings
-Make mock prototype (no real sensors, etc.) with cheap materials
-Test technical framework separately from aesthetic implementation
Weeks 6 & 7: Creating
-Build actual clothing piece
-Test/troubleshoot any technical issues
Weeks 8 & 9: Refining & evaluating
-Refine sound/structure of piece
-Refine breathing inputs--amplify if necessary
-Reflect on initial implementation of piece
-Evaluate deficiencies
-Return to research and develop project further
Week 10: Practicing and Documentation, further reflections
-Practice for performance
-Document both practice and performance
-Consider further possibilities for future installations
Exam Week:
Performance
Abstract/Conceptual Overview
Breath, both physically and conceptually, is a fundamental element of all music. However, it is rarely engaged with as such in theoretical analysis, and, in performance, it is typically considered only in a supportive role. Prana[1] is a musical control device that engages the breath as the primary means of communication of musical ideas, enabling both performer and audience to reconnect with breath as the basis of the musical phrase.
Technically speaking, Prana is a custom-made shirt fit with stretch sensors that surround the performer’s entire upper torso. The performer manipulates her breath patterns to engage with the sounds that her breath triggers, shaping a composition through the subtlest of movements. Prana, therefore, is not an instrument in itself, but instead enables the direct use of the body--specifically the breath--as instrument.
While Prana has many potential applications[2], the interest in this context lies in part in the virtuosity of the breath. Typically, virtuosity in musical performance impresses and entertains the audience with seemingly impossible feats of speed, endurance and dexterity. Here, the virtuosity[3] is in the subtlety, the ability of the performer to sustain intense concentration and a slow control of the breath. To gain a true appreciation for the most basic element of the performance, therefore, the audience must be highly engaged. The reward for sustained attention is a more intimate connection between performer and audience, an intense awareness of the performer’s internal state of being--the ability to sense her focus and her energy through the observation of the nature of her breath--and a newfound appreciation of the body’s internal rhythms.
[1] Prana is Sanskrit for life-force or energy. In yoga, one hears of prana most often in the context of Pranayama, which is the practice of stretching, extending and of restraint and control of the breath. In this project, Prana refers to a breath sensor control device and its paired algorithms.
[2] In early experiments, a simplified version of the breath sensor was worn by dancers. In this context, breathing patterns are either unconscious, or are controlled only in a limited manner. While this application merits further research, with more sophisticated sensors, and a more detailed approach to analysis of incoming data, part of the desire to pursue the current approach is to create a more conscious and dynamic control of the sound.
[3] Virtuosity cannot be achieved in the space of time in which one prepares for a single performance, but rather over a lifetime of study and practice. As used here it refers to a performance ideal rather than reality. It is hoped, though, that as the performer practices, engaging over time with the sounds triggered by various qualities of breath, that she will gradually learn something not only about the digital instrument, but also about the unique nature of her own breath.
Initial test of breathing belt with dancer improvisation.
The breathing belt.
Technically speaking, Prana is a custom-made shirt fit with stretch sensors that surround the performer’s entire upper torso. The performer manipulates her breath patterns to engage with the sounds that her breath triggers, shaping a composition through the subtlest of movements. Prana, therefore, is not an instrument in itself, but instead enables the direct use of the body--specifically the breath--as instrument.
While Prana has many potential applications[2], the interest in this context lies in part in the virtuosity of the breath. Typically, virtuosity in musical performance impresses and entertains the audience with seemingly impossible feats of speed, endurance and dexterity. Here, the virtuosity[3] is in the subtlety, the ability of the performer to sustain intense concentration and a slow control of the breath. To gain a true appreciation for the most basic element of the performance, therefore, the audience must be highly engaged. The reward for sustained attention is a more intimate connection between performer and audience, an intense awareness of the performer’s internal state of being--the ability to sense her focus and her energy through the observation of the nature of her breath--and a newfound appreciation of the body’s internal rhythms.
[1] Prana is Sanskrit for life-force or energy. In yoga, one hears of prana most often in the context of Pranayama, which is the practice of stretching, extending and of restraint and control of the breath. In this project, Prana refers to a breath sensor control device and its paired algorithms.
[2] In early experiments, a simplified version of the breath sensor was worn by dancers. In this context, breathing patterns are either unconscious, or are controlled only in a limited manner. While this application merits further research, with more sophisticated sensors, and a more detailed approach to analysis of incoming data, part of the desire to pursue the current approach is to create a more conscious and dynamic control of the sound.
[3] Virtuosity cannot be achieved in the space of time in which one prepares for a single performance, but rather over a lifetime of study and practice. As used here it refers to a performance ideal rather than reality. It is hoped, though, that as the performer practices, engaging over time with the sounds triggered by various qualities of breath, that she will gradually learn something not only about the digital instrument, but also about the unique nature of her own breath.
Initial test of breathing belt with dancer improvisation.
The breathing belt.
Subscribe to:
Posts (Atom)