I'm going to be redesigning the PMC over the summer so that it is no longer built into a shirt, but rather is a separate device to be worn over a shirt. I've discovered that shirt design is inconvenient, so I'm looking forward to the redesign.
Tuesday, May 24, 2011
Latest fabrication photos
I'm going to be redesigning the PMC over the summer so that it is no longer built into a shirt, but rather is a separate device to be worn over a shirt. I've discovered that shirt design is inconvenient, so I'm looking forward to the redesign.
Monday, May 23, 2011
Code/Programming Issues
The code issues for this project fall into one of two related categories:
1. Gathering data from the stretch sensors
2. Processing the breathing sounds gathered in real-time from the stethoscope, based on the data gathered from the stretch sensors
In order to gather the data from the stretch sensors, I need to ensure an active and accurate BlueTooth connection from the computer to the LilyPad. I then need to provide information to enable SuperCollider to distinguish the serial data from the LilyPad's pins A0-A5. This will be achieved by having each pin send a short message with each serial message, that acts as an ID-tag.
The processing of the breathing sounds to create an interesting and complex spectrum of pitch, timbre, rhythm and harmony is particularly challenging because the processes used to achieve these sounds need to be as efficient, and ideally as simple as possible. Often in composing NRT tape pieces I will apply a process to a sound, create a new AIF file, and then apply a new process, or another iteration of the same process to the sound, in order to achieve a desired effect. In real-time, this iterative process is not feasible, and so I will need to find other ways to achieve a musically rich processing of sounds.
Part of what makes this even more challenging, relates to the design of the PMC, and ultimately the mapping between the human-interface and computer-controlled sound output:
1. There are very few stretch sensors (6, total) which must control a wide variety of processes.
2. Manipulating the stretch sensors in a very specific way is challenging because of the nature of breathing: the performer must breathe, and their body will move to some extent with each breath. Aside from code issues, this will create a somewhat, though not entirely unique relationship between performer and instrument: the performer must "fight" their own body to achieve specific musical results.
3. The input data from the stretch sensors is very subtle, and in order to achieve a range of data, one has to grossly exaggerate the variation of breath patterns, making the most shallow breath even more shallow, and the deepest breath even deeper.
1. Gathering data from the stretch sensors
2. Processing the breathing sounds gathered in real-time from the stethoscope, based on the data gathered from the stretch sensors
In order to gather the data from the stretch sensors, I need to ensure an active and accurate BlueTooth connection from the computer to the LilyPad. I then need to provide information to enable SuperCollider to distinguish the serial data from the LilyPad's pins A0-A5. This will be achieved by having each pin send a short message with each serial message, that acts as an ID-tag.
The processing of the breathing sounds to create an interesting and complex spectrum of pitch, timbre, rhythm and harmony is particularly challenging because the processes used to achieve these sounds need to be as efficient, and ideally as simple as possible. Often in composing NRT tape pieces I will apply a process to a sound, create a new AIF file, and then apply a new process, or another iteration of the same process to the sound, in order to achieve a desired effect. In real-time, this iterative process is not feasible, and so I will need to find other ways to achieve a musically rich processing of sounds.
Part of what makes this even more challenging, relates to the design of the PMC, and ultimately the mapping between the human-interface and computer-controlled sound output:
1. There are very few stretch sensors (6, total) which must control a wide variety of processes.
2. Manipulating the stretch sensors in a very specific way is challenging because of the nature of breathing: the performer must breathe, and their body will move to some extent with each breath. Aside from code issues, this will create a somewhat, though not entirely unique relationship between performer and instrument: the performer must "fight" their own body to achieve specific musical results.
3. The input data from the stretch sensors is very subtle, and in order to achieve a range of data, one has to grossly exaggerate the variation of breath patterns, making the most shallow breath even more shallow, and the deepest breath even deeper.
Equipment List
To capture breath-movements:
-LilyPad microcontroller and BlueTooth Silver Mate to capture data and send wirelessly to a computer.
-Stretch sensors to detect breath-related movements of the body.
-Conductive thread to connect stretch sensors, LilyPad microcontroller, etc.
-Skin-tight shirt (stretch sensors will be sewn directly onto this layer).
-Extra cloth or shirts for additional layers of PMC, in order to avoid the unintentional crossing of conductive thread.
-Additional thread and fabric paint to cover fraying ends of conductive thread, etc.
-Pre-made outer-layer shirt, to house the LilyPad and BlueTooth, and for aesthetic purposes.
To capture breathing sounds:
-Stethoscope, with tube cut short
-Small microphone
-Heat-shrink wrap & electrical tape, to connect stethoscope and microphone
To process sounds and create musical piece:
-Computer running SuperCollider, with external soundcard, hooked up to two speakers. Ultimately I may like to work with a four or eight speaker setup, and to use a mixing board, as well, but this will be in later iterations of the project.
-LilyPad microcontroller and BlueTooth Silver Mate to capture data and send wirelessly to a computer.
-Stretch sensors to detect breath-related movements of the body.
-Conductive thread to connect stretch sensors, LilyPad microcontroller, etc.
-Skin-tight shirt (stretch sensors will be sewn directly onto this layer).
-Extra cloth or shirts for additional layers of PMC, in order to avoid the unintentional crossing of conductive thread.
-Additional thread and fabric paint to cover fraying ends of conductive thread, etc.
-Pre-made outer-layer shirt, to house the LilyPad and BlueTooth, and for aesthetic purposes.
To capture breathing sounds:
-Stethoscope, with tube cut short
-Small microphone
-Heat-shrink wrap & electrical tape, to connect stethoscope and microphone
To process sounds and create musical piece:
-Computer running SuperCollider, with external soundcard, hooked up to two speakers. Ultimately I may like to work with a four or eight speaker setup, and to use a mixing board, as well, but this will be in later iterations of the project.
Research Methodology
The remaining research is going to be primarily into the development of the response and mapping of the PMC. The steps I will take (and am in the process of completing) are as follows:
1. Create an initial score of what I envision the final aural outcome of the project to be.
2. Bring sounds of breathing into SuperCollider and see what processes I can apply to the sounds and what transformations of the sounds I can achieve.
3. Modify the original score in order to take into account the results of the previous step.
4. Come up with a state diagram that determines how the data from the stretch sensors helps achieve the desired score.
5. Practice the piece, wearing the PMC, and see if the desired effect is achieved.
6. Modify the state diagram and code to improve mapping and human-computer interaction as necessary.
7. Repeat steps 5 & 6 until desired effect is achieved.
8. Practice piece with final mappings, working on enhancing subtlety of piece with breath control.
1. Create an initial score of what I envision the final aural outcome of the project to be.
2. Bring sounds of breathing into SuperCollider and see what processes I can apply to the sounds and what transformations of the sounds I can achieve.
3. Modify the original score in order to take into account the results of the previous step.
4. Come up with a state diagram that determines how the data from the stretch sensors helps achieve the desired score.
5. Practice the piece, wearing the PMC, and see if the desired effect is achieved.
6. Modify the state diagram and code to improve mapping and human-computer interaction as necessary.
7. Repeat steps 5 & 6 until desired effect is achieved.
8. Practice piece with final mappings, working on enhancing subtlety of piece with breath control.
More Fabrication Images
The following are images of the under-layers of the PMC. These show the stretch sensors with conductive thread connecting the grounds, and connecting the opposite ends through resistors, to power. These ends will also connect to A0-A5 on the LilyPad to send changes in resistance to the computer, through BlueTooth. The LilyPad is on the top-most layer of the shirt, which is not pictured here, yet.
Subscribe to:
Posts (Atom)