Difference between revisions of "Living Instruments"

From Hackuarium
Jump to navigation Jump to search
(added last concert of Vanessa & Oliver)
 
(45 intermediate revisions by 3 users not shown)
Line 1: Line 1:
'''Living Instruments''' is a collaborative project between London-based musician '''[http://www.sergevuille.ch Serge Vuille]''' (under the umbrella of his project [http://www.wespoke.ch/ WeSpoke]) and the DIY biology community of the Swiss-based open laboratory '''[[Hackuarium:About|Hackuarium]]'''.
+
'''Living Instruments''' is a collaborative project between Swiss musician '''[http://www.sergevuille.ch Serge Vuille]''' (under the umbrella of his project [http://www.wespoke.ch/ WeSpoke]) and the DIY science crowd of the community laboratory '''[[Hackuarium:About|Hackuarium]]'''. <br>
  
It is a musical composition for a series of instruments that use bacteria, yeast and other living organisms to generate music. By interacting with the organisms and recording the sounds, gas bubbles, pressure, and movements they generate, the artists can transform data into music, creating a live, semi-improvised musical piece.
+
It is a musical composition for a series of instruments that use bacteria, yeast and other living organisms to generate music. By interacting with the organisms and recording the sounds, gas bubbles, pressure, and movements they generate, the artists can transform data into music, creating a live, semi-improvised musical piece. <br>
  
 +
This page is work-in-progress. It is a living documentation of the project that gets regularly updated. <br>
  
[[File:LI_BourgGeneral_2.png|frameless|right|680px]]
+
[[File:LI_BourgGeneral_2.png|frameless|right|600px]]
[[File:Darmstadt_setting_1.png|frameless|right|680px]]
+
[[File:Darmstadt_setting_1.png|frameless|right|600px]]
  
 
= What =
 
= What =
Line 20: Line 21:
 
* Création d'une œuvre musicale (composition) en utilisant ces instruments
 
* Création d'une œuvre musicale (composition) en utilisant ces instruments
 
* Placer la démarche collaborative dans le contexte DIY, scientifique, et musical
 
* Placer la démarche collaborative dans le contexte DIY, scientifique, et musical
 +
 +
<br>
 +
 +
'''Project Description (2000 characters)''' <br>
 +
 +
The ‘Living Instruments’ project is a live lecture/performance using micro- and other organisms to generate sound. It was created by the collective WeSpoke in the laboratory of the Hackuarium community in Lausanne, Switzerland, by a team of musicians, life scientists and (sound) designers. ‘Living Instruments’ reveals a hidden world, encourages interdisciplinary thinking and presents biology, technology and their relation to sounds as an otherworldly musical experience. The performers slip into the roles of laboratory scientists forming a hybrid setup where the interactions between humans and other living matter generates music through sensors, electronic devices and computers. By applying heat, movement, or algorithmic tracking, performers 'measure' living matter with counters, microscopes and antennas. These sensors are placed at several locations on the 'instruments' and the live recording of data is then turned into sound through synthesisers and music software. The nature of these instruments allows the performers to engage with them very interactively, however without complete control, and the cyclic behaviour of the living pieces creates rich grooves and rhythmic patterns. Enlarged video footage of fermentation, swarming microorganisms, human-moss interactions, traces of radioactive decay and other curiosities of nature are displayed on a large screen behind performers, highlighting the beauty of the dynamics between the scientific process and the musical outcome. the artists can transform data into music, creating a live, semi-improvised musical piece. We Spoke and Hackuarium have been invited to present ‘Living Instruments' in the Kammer Klang series at cafe OTO, London, as well as during the International Summer Course for New Music in Darmstadt, Germany. Various formats of project were also performed in Switzerland at the Kunsthalle Zürich, at Le Bourg in Lausanne, at the Dürrenmatt Centre in Neuchâtel and during the Klang Moor Schopfe festival in Gaïs.
  
 
<br>
 
<br>
Line 25: Line 32:
 
= Who is involved?=
 
= Who is involved?=
  
* [http://www.sergevuille.ch Serge Vuille], musician
+
* Serge Vuille, musician ([http://www.sergevuille.ch personal website])
* [[User:Vlorenzo|Vanesa Lorenzo]], product & media designer
+
* [[User:Vlorenzo|Vanesa Lorenzo]], product & media designer ([https://vlorenzolana.myportfolio.com personal website])
 
* [[User:Luchenry|Luc Henry]], biologist and science communicator
 
* [[User:Luchenry|Luc Henry]], biologist and science communicator
* [http://www.lesfac.ch/artistes/roberttorche.html Robert Torche], sound designer
+
* Robert Torche, sound designer ([https://rottor.weebly.com personal website])
* Oliver Keller, electronics and IT specialist
+
* [[User:ozel|Oliver Keller]], electronics and sensors
 
* We Spoke musicians
 
* We Spoke musicians
  
Line 35: Line 42:
  
 
= When =
 
= When =
 +
 +
[[File:WeSpoke_LeBourg_2016.png|frameless|right|250px]]
 +
[[File:WeSpoke_LeBourg_2018.png|frameless|right|250px]]
 +
 +
The prototypes were presented in the contexte of the N/OD/E Festival "[http://www.node-rdv.ch/laboratoire2016/  Laboratoire Meet & Geek]" on 30.01.16 at Pôle Sud Lausanne.<br>
  
 
The final deliverable was a '''concert/performance''' that took place on February 10th 2016, at the music and performance art venue [http://www.le-bourg.ch Le Bourg], in Lausanne, Switzerland. More information about the event can be found [http://www.wespoke.ch/les-concerts/le-bourg-2-hackuarium/ here].<br>
 
The final deliverable was a '''concert/performance''' that took place on February 10th 2016, at the music and performance art venue [http://www.le-bourg.ch Le Bourg], in Lausanne, Switzerland. More information about the event can be found [http://www.wespoke.ch/les-concerts/le-bourg-2-hackuarium/ here].<br>
Line 42: Line 54:
 
In August 2016, the '''performance''' was part of [http://www.wespoke.ch/ WeSpoke] "[http://www.internationales-musikinstitut.de/en/program2016/330-14-08-2016/1898-we-spoke-en.html carte blanche]" at the [http://www.internationales-musikinstitut.de/en/ International Summer Course for New Music] in Darmstadt, Germany. It was presented as a workshop on "Biochemistry and white noise" on Saturday August 13th at the Lichtenbergschule and performed entirely on Sunday August 14th at the venue [http://www.centralstation-darmstadt.de Centralstation].
 
In August 2016, the '''performance''' was part of [http://www.wespoke.ch/ WeSpoke] "[http://www.internationales-musikinstitut.de/en/program2016/330-14-08-2016/1898-we-spoke-en.html carte blanche]" at the [http://www.internationales-musikinstitut.de/en/ International Summer Course for New Music] in Darmstadt, Germany. It was presented as a workshop on "Biochemistry and white noise" on Saturday August 13th at the Lichtenbergschule and performed entirely on Sunday August 14th at the venue [http://www.centralstation-darmstadt.de Centralstation].
  
EN - The piece was performed at two locations in 2016.<br>
+
== Past Concerts ==
FR - La pièce a été jouée à deux reprises en 2016.<br>
 
  
*10 February: Concert, Le Bourg, Lausanne, Switzerland
+
*10 February 2016: ''Opening Concert'', Le Bourg, Lausanne, Switzerland
*14 August: Concert, [http://www.centralstation-darmstadt.de Centralstation], Darmstadt, Germany
+
*12 February 2016: Workshop/masterclass and performance, Lift conference, Geneva Switzerland
 +
*14 August 2016: Concert, [http://www.centralstation-darmstadt.de Centralstation], Darmstadt, Germany
  
EN - The piece was performed at three locations in 2017.<br>
 
FR - La pièce a été jouée à trois reprises en 2017.<br>
 
  
*3 April 2017: OTO Project - Instruments exhibition and workshop
+
*3 April 2017: OTO project days - [http://www.kammerklang.co.uk/events/spoke-living-instruments-workshops/ Instruments exhibition and workshop]
*4 April 2017: Concert - Kammer Klang series, Cafe OTO, London, UK
+
*4 April 2017: Concert - Kammer Klang series, Cafe OTO, London, UK
*20-21 May 2017: Exhibition and performance during the [http://www.bundesmuseen.ch/cdn/00123/00138/02026/02085/index.html Nuit des Musées] - Centre Dürrenmatt, Neuchâtel, Switzerland
+
*20-21 May 2017: Interactive exhibition and performance during the [http://www.bundesmuseen.ch/cdn/00123/00138/02026/02085/index.html Nuit des Musées] - Centre Dürrenmatt, Neuchâtel, Switzerland
*8 September 2017: Concert - [http://klangmoorschopfe.ch/wespoke/ Klang Moor Schopfe Festival], Gaïs, Switzerland
+
*8 September 2017: Interactive exhibition and Concert - [http://klangmoorschopfe.ch/wespoke/ Klang Moor Schopfe Festival], Gaïs, Switzerland
  
EN - The piece was already performed at one locations in 2018.<br>
 
FR - La pièce a déjà été jouée en 2018.<br>
 
  
 
*31 January 2018: Concert - Le Bourg, Lausanne
 
*31 January 2018: Concert - Le Bourg, Lausanne
 +
*21 October 2018: Concert and workshop - [http://kunsthallezurich.ch/de Kunsthalle Zürich] in the context of the science festival [https://www.grc.uzh.ch/de/focus/exhibition/100-Ways-of-Thinking.html 100 Ways of Thinking] (organised by the [https://www.grc.uzh.ch/de.html Graduate Campus] of the [http://www.uzh.ch/de.html University of Zürich]). More information about the concert is available [http://www.agenda.uzh.ch/myrecord.php?id=38670&reihe=1493&base=http://www.100ways.uzh.ch/de/Veranstaltungen/Specials here].   
 +
 +
 +
*16 March 2019: Workshop and performance - Invited by the BCUL (Library of the University of Lausanne) for their Samedi des bibliothèques : Ramène ta science!
 +
 +
 +
*19 September 2020: Vanessa & Oliver took part in a larger jam session: [https://www.gessnerallee.ch/de/event/120/Caroline_Ann_Baur_Vaness_Heer_Tina_Reden_Other_Planes_of_There Performance Other Planes of There: Speculative Listening Sessions Gessnerallee, Zürich]
 +
*19 November 2020: Vanessa & Oliver performed "My Eyes Are Green" in a dedicated concert evening of the Other Planes of There program. Full recording on [https://soundcloud.com/vanessa-lorenzo-662135359/my-eyes-are-green-other-planes-of-there-lorenzo-keller-19112020 soundcloud]. This improvised live piece was inspired by their work developed within Living Instruments.
 +
 +
 +
= What's Next=
 +
 +
*19 November 2020: Vanessa & Oliver as performance duo in Other Planes of There: Speculative Listening Sessions. Gessnerallee, Zürich.
 +
 +
Stay tuned! And if you want to help us bring Living Instruments to new audiences, please get in touch.
 +
In any case, we will update you on the upcoming residencies and events dedicated to bringing living instruments back to life.
  
 
<br>
 
<br>
  
= What's Next=
+
= Press =
 +
 
 +
The Living Instruments project was in the media on several occasions.<br>
 +
 
 +
Here is a selection:
  
So far, the following tour dates have been confirmed:
+
Le Temps Vidéos- "[https://youtu.be/R6PwLKJsZ7I Musique biologique: orgue à levures et mousse qui chante]" by Aurélie Coulon (12 Feb 2016)
  
*21 October 2018: Concert and workshop - Zürich
+
CLOT Magazine - "[http://www.clotmag.com/serge-vuille-luc-henry Serge Vuille & Luc Henry, artistic experimentation, music, and living systems]" by Diana Cano Bordajandi (19 Oct 2017)
  
More to come! And if you want to help us bring Living Instruments to new audiences, get in touch! In any case, we will update you on the next residence and events dedicated to bringing living instruments to life!
+
RTS radio program Magnétique - "[https://www.rts.ch/play/radio/magnetique/audio/wespoke-et-ses-living-instruments-au-node?id=9247829 WeSpoke et ses "Living Instruments" au N/O/D/E]" (21 Jan 2018)
  
 
<br>
 
<br>
Line 75: Line 103:
 
= Description of the installation =
 
= Description of the installation =
  
The following instruments were used for the [http://www.wespoke.ch/les-concerts/le-bourg-2-hackuarium/ world premiere] performed at the music venue Le Bourg in Lausanne on February 12th 2016, and later at the [http://www.internationales-musikinstitut.de/en/ International Summer Course for New Music] on August 14th 2016.
+
Different combinations of the following instruments were used, from the [http://www.wespoke.ch/les-concerts/le-bourg-2-hackuarium/ world premiere] performed at the music venue Le Bourg in Lausanne on February 12th 2016, until the latest performances. All of them have evolved from prototypes. The descriptions below are trying to describe the latest iteration accurately.
  
 
== Bubble Organ ==
 
== Bubble Organ ==
Line 90: Line 118:
  
 
The following items are necessary for the construction of the Bubble Organ:<br>
 
The following items are necessary for the construction of the Bubble Organ:<br>
*5x Erlenmeyer flasks (1x 10L, 1x 4L, 1x 3L, 1x 2L, 1x 1L, 1x 0.5L)
+
*5x Erlenmeyer flasks (1x 10L, 1x 4L, 1x 3L, 1x 2L, 1x 1L)
*5x S-shaped "Double Bubble" airlocks for beer and wine fermentation
+
*5x rubber/silicon drilled cork for fermenter airlock (Top diameter/Bottom diameter:35/29 mm, 55/47 mm and 65/55 mm depending on Erlenmeyer flask)
 +
*5x [https://www.ebay.co.uk/itm/2-Chamber-Bubbler-Airlock-For-Home-Brew-Beer-And-Wine-Making-Pack-of-2/253186710715?epid=912816345&hash=item3af31a9cbb:g:2MgAAOSwIjNXJJRP S-shaped "Double Bubble" airlocks for beer and wine fermentation] (transparent) fitted with 30mm plastic tubing (8x1.5mm) and various (19x2.5mm) on each side.
 
*5x 1500mm plastic tubing (6x1.5mm)
 
*5x 1500mm plastic tubing (6x1.5mm)
*10x LED
+
*10x White LED
 +
*5x [https://www.ebay.co.uk/sch/i.html?_from=R40&_trksid=m570.l1313&_nkw=Wooden+Clothes+Pegs&_sacat=0 Wooden Clothes Pegs]
 
*1x [https://www.arduino.cc/en/Main/arduinoBoardMega Arduino MEGA] equipped with a [https://www.arduino.cc/en/Main/ArduinoUSBHostShield USB host shield].
 
*1x [https://www.arduino.cc/en/Main/arduinoBoardMega Arduino MEGA] equipped with a [https://www.arduino.cc/en/Main/ArduinoUSBHostShield USB host shield].
 
*1x 12V power supply
 
*1x 12V power supply
*1x USB cable 2m (Arduino to computer)
+
*1x [https://www.ebay.co.uk/itm/5m-USB-2-0-High-Speed-Cable-Long-Printer-Lead-A-to-B-Black-Shielded-Epson-Kodak/400466022477?epid=1671784436&hash=item5d3da2904d:g:cpkAAOSwTQtaFXCx 5m USB 2.0 A to B shielded cable] (computer to Arduino)
 +
*1x [https://www.ebay.co.uk/itm/1m-USB-2-0-High-Speed-Cable-Printer-Lead-A-to-B-Black-Shielded-Epson-Kodak-HP/371542711656?epid=1271502524&hash=item5681abdd68:g:teAAAOSwk1haFXAS 1m USB 2.0 A to B shielded cable] (keyboard to Arduino)
 
*1x [http://www.ionaudio.com/products/details/discover-keyboard-usb ION Discover keyboard USB]
 
*1x [http://www.ionaudio.com/products/details/discover-keyboard-usb ION Discover keyboard USB]
*1x USB cable 1m (keyboard to Arduino)
 
  
 
=== The circuit ===
 
=== The circuit ===
Line 104: Line 134:
 
The controller for this instrument was based on a [https://www.arduino.cc/en/Main/arduinoBoardMega Arduino Mega] equipped with an [https://www.arduino.cc/en/Main/ArduinoUSBHostShield Arduino USB host shield].<br>
 
The controller for this instrument was based on a [https://www.arduino.cc/en/Main/arduinoBoardMega Arduino Mega] equipped with an [https://www.arduino.cc/en/Main/ArduinoUSBHostShield Arduino USB host shield].<br>
  
The complete code can be found [https://github.com/ozel/Living-Instruments-Controller here].
+
=== The software ===
  
=== The software ===
+
The complete Arduino code can be found here: [https://github.com/ozel/Living-Instruments-Controller Living-Instruments-Controller].
  
 
== Tube Log ==
 
== Tube Log ==
 +
 +
A description will be available soon
  
 
== Moss Carpet ==
 
== Moss Carpet ==
 +
 +
[[File:Vanessa_moss_1.png|frameless|right|500px]]
  
 
=== The concept ===
 
=== The concept ===
Line 121: Line 155:
 
This [https://vimeo.com/155696946 video] will give you an idea of the sounds produced by this instrument.
 
This [https://vimeo.com/155696946 video] will give you an idea of the sounds produced by this instrument.
  
Electronic circuit with an active capacitive sensor or anthena: the organic interactive object invites to be touched and reacts to the arousal of physical contact emiting real-time sinuosoidal sound feedback through a serial communication with Pure Data or MaxMsp.  
+
Electronic circuit with an active capacitive sensor or antenna: the organic interactive object invites to be touched and reacts to the arousal of physical contact emitting real-time sinusoidal sound feedback through serial communication with Pure Data or MaxMsp.  
  
 
[https://vimeo.com/89452192 First prototype] First Iteration, magic moss.
 
[https://vimeo.com/89452192 First prototype] First Iteration, magic moss.
  
[https://vimeo.com/169243371 ] Moss growing old, but wise with other living intruments.
+
[https://vimeo.com/169243371 ] Moss growing old, but wise with other living instruments.
  
[[File:Vanessa_moss_1.png|400px]]
+
=== The setup ===
  
=== The setup ===
 
 
Moss
 
Moss
1 receive anthena: Conductive thread or metal wires and 2,2 Mega Ohm resistance (x 2)
+
 
 +
1 receive antenna: Conductive thread or metal wires and 2,2 Mega Ohm resistance (x 2)
  
 
=== The circuit ===
 
=== The circuit ===
  
The controller for this instrument was based on a [https://www.arduino.cc/en/Main/ArduinoBoardUno Arduino Uno].
+
The controller for this instrument was based on a [https://www.arduino.cc/en/Main/ArduinoBoardUno Arduino Uno]. The full instructions are available [https://github.com/Vlorenzolana/Musgofono here]
Full instructions [https://github.com/Vlorenzolana/Musgofono here]
 
  
 
=== The software ===
 
=== The software ===
 
This software uses
 
This software uses
  
/*
+
/*
* CapSense Library   
+
* CapSense Library   
* Paul Badger 2008
+
* Paul Badger 2008
* IMI version for 12 sensors and send to Max/MSP (use regexp to decode)
+
* IMI version for 12 sensors and send to Max/MSP (use regexp to decode)
*/
+
*/
  
 
Full software [https://github.com/Vlorenzolana/Musgofono/blob/master/CapacitiveMOSSPHONE.ino here]
 
Full software [https://github.com/Vlorenzolana/Musgofono/blob/master/CapacitiveMOSSPHONE.ino here]
 +
 +
== Sounds of Radioactivity ==
 +
 +
=== The concept ===
 +
 +
Natural radioactivity surrounds us everywhere on earth and is a truly random process. Certain radioactive elements decay into other elements by releasing energy in the form of elementary particles and other forms of ionizing radiation (alpha, beta, gamma radiation etc.). The timing and amount of released energy can be recorded by sensors that allow to turn this fundamental quantum physics process into rich sound and visuals.
 +
In the concerts, slightly radioactive everyday objects such as vintage uranium glass, potassium salt (KCl, a sodium-free alternative for table salt), old radium watches, and alpine stones from St. Gallen are used to trigger the detectors with sub-atomic particles. The radioactivity of environmental radon gas is demonstrated and collected during concerts with a simple [https://www.sci-hub.st/10.1088/0031-9120/32/2/016 electrostatically charged party balloon]. Apart from those terrestrial sources of particles, muons from cosmic radiation are detected and sonified as well.
 +
 +
=== Hardware & Software ===
 +
 +
In his work at CERN, [[User:ozel|Oliver Keller]] designed different detectors for natural radioactivity and added sonification for this project.
 +
 +
==== iPadPix ====
 +
The initial detector turning radioactivity into sounds, which was part of our concerts from the start, is based on the [https://iopscience.iop.org/article/10.1088/1748-0221/11/11/C11032 iPadPix prototype].
 +
It is a mobile device that visualizes radioactivity from a hybrid pixel detector by means of augmented reality on an iPad mini.
 +
Recorded data is the particle's arrival time, type, and energy. The particle data is sent via WiFi to the iPad for visualization in an [https://github.com/ozel/iPadPix open-source iOS app].
 +
At the same type, the data is sent in parallel to a computer running a [https://github.com/ozel/iPadPix_3D_visualiser receiver program written in Processing] that triggers audio samples and Midi events. The Midi connection is in turn triggering a Korg Volca for percussive sounds and sometimes a larger modular synthesizer.
 +
 +
Sometimes we also explain the instruments in short solo demonstrations, this is the part [https://www.youtube.com/watch?v=FyElHKLltB0 on iPadPix from the very first opening concert in 2016 at Le Bourg, Lausanne.] We kept explanations briefer or skipped them entirely in later performances depending on the framework of the evening.
 +
 +
==== DIY Particle Detetcor ====
 +
 +
By the end of 2019, another rather low-cost [https://github.com/ozel/DIY_particle_detector DIY particle detector] based on cheap silicon photodiodes was added to this project with sonification. The `pulse-recorder.py` script in this repository uses the wonderful [http://ajaxsoundstudio.com/software/pyo/ pyo sound synthesis library] for generating experimental plucked string sounds based on the Karplus-Strong algorithm. The output is also fed into a modular synthesizer for triggering and generation of further sounds.
  
 
== Virtual Soprano ==
 
== Virtual Soprano ==
It detects your face expression and turns it into vocal sounds, like a virtual soprano.
+
 
All documents [https://github.com/Vlorenzolana/Soprano_Face_Recognition here]
+
The Virtual Soprano was used in the first two performances of the Living Instruments, but was abandoned in subsequent versions. A software detects your face expression through a computer's webcam and turns it into vocal sounds, like a virtual soprano. The complete documentation can be found [https://github.com/Vlorenzolana/Soprano_Face_Recognition here]
  
 
== Paramecia Controller ==
 
== Paramecia Controller ==
  
The Paramecia Controller is a setup inspired by  
+
[[File:ParaController_2.png|frameless|right|500px]]
 +
 
 +
The Paramecia Controller is an instrument inspired by a similar module described by Urs Gaudent from [http://www.gaudi.ch/GaudiLabs/ GaudiLabs] (instruction video [https://www.youtube.com/watch?v=r6IdbnS-ieo here]).
 +
 
 +
After several prototypes, the SeePack microscope camera was replaced by a [https://www.logitech.com/en-ch/product/hd-webcam-c270 Logitech C270]. The device was built according to previously described [http://making.do/paramecium/build.html design] (instruction video [https://www.youtube.com/watch?v=gxNpMdqzlc4 here]) except the bottom acrylic glass plate was kept intact (with a piece of black paper underneath it, between the acrylic and the bottom wooden panel). A rubber joint was also added between the two acrylic glass plates (see picture below).
 +
 
 +
'''The first prototype''', used in the first performances looked like that:<br>
 +
 
 +
<gallery mode="nolines">
 +
File:Para_Track1.jpg|The whole device
 +
File:Para_Track2.jpg|The circuit and the joystick
 +
File:Para_Track3.jpg|The chamber
 +
</gallery>
 +
 
 +
'''A second, more robust, version''' was made for the performance in Gaïs in September 2017 and used for the following performances:<br>
 +
 
 +
<gallery mode="nolines">
 +
File:Para_Track4.JPG|The controller
 +
File:Para_Track5.JPG|The chamber
 +
File:Para_Track6.JPG|The joystick
 +
</gallery>
 +
 
 +
=== The circuit ===
 +
 
 +
The circuit is composed of an Arduino UNO, 2 x 2 pairs of cables (1 pair for the joystick and 1 pair for the electrodes). The joystick was the [http://www.play-zone.ch/en/arduino-ps2-daumen-joystick-mit-select-button-breakout-board.html Play-Zone Arduino PS2].<br>
 +
 
 +
=== The software ===
  
[[File:ParaController_1.png|400px]]
+
The complete Arduino code can be found here.
  
 
== Paramecia Bolero ==
 
== Paramecia Bolero ==
 +
 +
The Paramecia Bolero is based on a mini-microscope
 +
 +
=== The software ===
 +
 +
The MaxMSP software patch used is available here.
 +
 +
<br>
 +
 +
== Video ==
 +
 +
=== The Mixer ===
 +
 +
[https://www.musicstore.de/de_CH/CHF/Roland-V-1HD-4-Kanal-Full-HD-Switcher/art-LIG0013335-000?campaign=keyword/CH&ProgramUUID=6HvAqJarLlUAAAFlJkFyjI8W&target=https://www.musicstore.de/de_CH/CHF/Roland-V-1HD-4-Kanal-Full-HD-Switcher/art-LIG0013335-000%3Fcampaign%3Dkeyword/CH%26ProgramUUID%3D6HvAqJarLlUAAAFlJkFyjI8W&gclid=EAIaIQobChMIzPSw1LCX3gIV6rXtCh33rgoPEAAYASAAEgJtJ_D_BwE Roland HD Video Switcher V-1HD]
  
 
= Log =
 
= Log =
  
The details of the preparation are recorded live [https://hackuarium.hackpad.com/Living-instruments-ypKOLnhbBm9 here]<br>
+
== Preparation before "100 Ways of Thinking" ==
  
A budget and shopping list for this project will be shared later on.<br>
+
=== When? ===
 +
 
 +
Friday 7th September-Sunday 9th September 2018
 +
 
 +
=== Who was there? ===
 +
 
 +
* [[User:Luchenry|Luc Henry]]
 +
* [[User:ozel|Oliver Keller]]
 +
* Robert Torche
 +
 
 +
== Final days before first performance ==
  
== Final days 01-08.02.2016 ==
 
 
=== When? ===
 
=== When? ===
Every day 1st-8th February 10am - 8pm (or midnight.. depending on the day) <br>
+
 
 +
Every day 1st-8th February 2016
 +
 
 +
10am - 8pm (or midnight.. depending on the day) <br>
  
 
=== Who was there? ===
 
=== Who was there? ===
Line 176: Line 284:
 
* [[User:Luchenry|Luc Henry]]
 
* [[User:Luchenry|Luc Henry]]
 
* Alain Vuille
 
* Alain Vuille
* Oliver Keller
+
* [[User:ozel|Oliver Keller]]
 
* Robert Torche
 
* Robert Torche
 
* We Spoke musicians (7-8th Feb)
 
* We Spoke musicians (7-8th Feb)
 
=== What? ===
 
 
'''Paramecia controller'''<br>
 
 
After several prototypes, the SeePack microscope camera was replaced by a Logitech C270. The device was built according to previously described [http://making.do/paramecium/build.html design] (instruction video [https://www.youtube.com/watch?v=gxNpMdqzlc4 here]) except the bottom acrylic glass plate was kept intact (with a piece of dark paper underneath). A rubber joint was also added between the two acrylic glass plates (see picture below). The joystick was the [http://www.play-zone.ch/en/arduino-ps2-daumen-joystick-mit-select-button-breakout-board.html Play-Zone Arduino PS2].<br>
 
 
The first prototype, used in the first performances looked like that:<br>
 
 
<gallery mode="nolines">
 
File:Para_Track1.jpg|The whole device
 
File:Para_Track2.jpg|The circuit and the joystick
 
File:Para_Track3.jpg|The chamber
 
</gallery>
 
 
A second version was made for the performance in Gaïs in September 2017.<br>
 
 
Urs from [http://www.gaudi.ch/GaudiLabs/ GaudiLabs] has also described a similar module (instruction video [https://www.youtube.com/watch?v=r6IdbnS-ieo here]).
 
  
 
== N/O/D/E Festival ==
 
== N/O/D/E Festival ==
Line 250: Line 340:
 
* Alain Vuille
 
* Alain Vuille
 
* Gilda Vonlanthen
 
* Gilda Vonlanthen
* Olivier Keller
+
* [[User:ozel|Oliver Keller]]
  
 
=== Building the modules ===
 
=== Building the modules ===
Line 301: Line 391:
 
[[File:MossHunting1.jpg|thumb|none|alt=A]]
 
[[File:MossHunting1.jpg|thumb|none|alt=A]]
 
[[File:12418083 506507846187635 8168903662076309295 n.jpg|thumb|none|alt=A]]
 
[[File:12418083 506507846187635 8168903662076309295 n.jpg|thumb|none|alt=A]]
[[File:Mossphone.jpg|thumb|none|alt=A]]
+
[[File:Mossphone.jpg|thumb|none|link=Special:FilePath/Mossphone.jpg]]
 
'''FacetrackerTree:'''<br>
 
'''FacetrackerTree:'''<br>
 
[[File:HelloFaceTracker2.png|thumb|none|alt=A]]
 
[[File:HelloFaceTracker2.png|thumb|none|alt=A]]
Line 364: Line 454:
  
 
[[File:Living Instrument v1-0 Scheme.jpg|thumb|none|alt=A| This is what the whole setup looks like.]]
 
[[File:Living Instrument v1-0 Scheme.jpg|thumb|none|alt=A| This is what the whole setup looks like.]]
 +
[[File:Living Instrument v1-0 Circuit.jpg|thumb|none|alt=A| A closer look at the circuit.]]
  
 
'''Fermentation cultures:'''<br>
 
'''Fermentation cultures:'''<br>

Latest revision as of 16:17, 5 October 2022

Living Instruments is a collaborative project between Swiss musician Serge Vuille (under the umbrella of his project WeSpoke) and the DIY science crowd of the community laboratory Hackuarium.

It is a musical composition for a series of instruments that use bacteria, yeast and other living organisms to generate music. By interacting with the organisms and recording the sounds, gas bubbles, pressure, and movements they generate, the artists can transform data into music, creating a live, semi-improvised musical piece.

This page is work-in-progress. It is a living documentation of the project that gets regularly updated.

LI BourgGeneral 2.png
Darmstadt setting 1.png

What

EN - This collaboration aims at three goals:

  • To built a set of living instruments that use biological information or organisms as sources of signal.
  • To compose a musical piece (creation) using these instrument and turning their output signal into sound.
  • Place this project in the context of the current state of DIY, science and music.

FR - Cette collaboration a trois buts:

  • Construire des instruments vivants (intégrant le vivant comme source de signal)
  • Création d'une œuvre musicale (composition) en utilisant ces instruments
  • Placer la démarche collaborative dans le contexte DIY, scientifique, et musical


Project Description (2000 characters)

The ‘Living Instruments’ project is a live lecture/performance using micro- and other organisms to generate sound. It was created by the collective WeSpoke in the laboratory of the Hackuarium community in Lausanne, Switzerland, by a team of musicians, life scientists and (sound) designers. ‘Living Instruments’ reveals a hidden world, encourages interdisciplinary thinking and presents biology, technology and their relation to sounds as an otherworldly musical experience. The performers slip into the roles of laboratory scientists forming a hybrid setup where the interactions between humans and other living matter generates music through sensors, electronic devices and computers. By applying heat, movement, or algorithmic tracking, performers 'measure' living matter with counters, microscopes and antennas. These sensors are placed at several locations on the 'instruments' and the live recording of data is then turned into sound through synthesisers and music software. The nature of these instruments allows the performers to engage with them very interactively, however without complete control, and the cyclic behaviour of the living pieces creates rich grooves and rhythmic patterns. Enlarged video footage of fermentation, swarming microorganisms, human-moss interactions, traces of radioactive decay and other curiosities of nature are displayed on a large screen behind performers, highlighting the beauty of the dynamics between the scientific process and the musical outcome. the artists can transform data into music, creating a live, semi-improvised musical piece. We Spoke and Hackuarium have been invited to present ‘Living Instruments' in the Kammer Klang series at cafe OTO, London, as well as during the International Summer Course for New Music in Darmstadt, Germany. Various formats of project were also performed in Switzerland at the Kunsthalle Zürich, at Le Bourg in Lausanne, at the Dürrenmatt Centre in Neuchâtel and during the Klang Moor Schopfe festival in Gaïs.


Who is involved?


When

WeSpoke LeBourg 2016.png
WeSpoke LeBourg 2018.png

The prototypes were presented in the contexte of the N/OD/E Festival "Laboratoire Meet & Geek" on 30.01.16 at Pôle Sud Lausanne.

The final deliverable was a concert/performance that took place on February 10th 2016, at the music and performance art venue Le Bourg, in Lausanne, Switzerland. More information about the event can be found here.

The concert was followed by a workshop/masterclass at the Lift conference on innovation and digital technologies in Geneva, Switzerland, on February 12th 2016. More information about the workshop can be found here.

In August 2016, the performance was part of WeSpoke "carte blanche" at the International Summer Course for New Music in Darmstadt, Germany. It was presented as a workshop on "Biochemistry and white noise" on Saturday August 13th at the Lichtenbergschule and performed entirely on Sunday August 14th at the venue Centralstation.

Past Concerts

  • 10 February 2016: Opening Concert, Le Bourg, Lausanne, Switzerland
  • 12 February 2016: Workshop/masterclass and performance, Lift conference, Geneva Switzerland
  • 14 August 2016: Concert, Centralstation, Darmstadt, Germany




  • 16 March 2019: Workshop and performance - Invited by the BCUL (Library of the University of Lausanne) for their Samedi des bibliothèques : Ramène ta science!



What's Next

  • 19 November 2020: Vanessa & Oliver as performance duo in Other Planes of There: Speculative Listening Sessions. Gessnerallee, Zürich.

Stay tuned! And if you want to help us bring Living Instruments to new audiences, please get in touch. In any case, we will update you on the upcoming residencies and events dedicated to bringing living instruments back to life.


Press

The Living Instruments project was in the media on several occasions.

Here is a selection:

Le Temps Vidéos- "Musique biologique: orgue à levures et mousse qui chante" by Aurélie Coulon (12 Feb 2016)

CLOT Magazine - "Serge Vuille & Luc Henry, artistic experimentation, music, and living systems" by Diana Cano Bordajandi (19 Oct 2017)

RTS radio program Magnétique - "WeSpoke et ses "Living Instruments" au N/O/D/E" (21 Jan 2018)


Description of the installation

Different combinations of the following instruments were used, from the world premiere performed at the music venue Le Bourg in Lausanne on February 12th 2016, until the latest performances. All of them have evolved from prototypes. The descriptions below are trying to describe the latest iteration accurately.

Bubble Organ

The concept

LI Bubbler 1.png

The Bubble Organ is an instrument powered by fermenting yeast cultures.

This video of the first minutes of the performance will give you an idea of the sounds produced by this instrument.

The setup

The following items are necessary for the construction of the Bubble Organ:

The circuit

The controller for this instrument was based on a Arduino Mega equipped with an Arduino USB host shield.

The software

The complete Arduino code can be found here: Living-Instruments-Controller.

Tube Log

A description will be available soon

Moss Carpet

Vanessa moss 1.png

The concept

The moss carpet was designed and realised by Vanesa Lorenzo.

A moss - human interface conceived back in 2013, developed further as an interdisciplinary research about natural bioreporters research project on indicator species, such as moss and lichens, through which we can sense the environment and the climate changes. Mosses are tiny organisms, the first plants emerged from the ocean to conquer the land; unique and delicate native species with slow temporalities of growth which can decipher the secrets of life on Earth. They are pioneer species that can live in very harsh conditions, which can also provide important microhabitats for an extraordinary variety of organisms and plants. The interaction with mossphone has a ludic sound feedback that changes depending on the human that is in contact. When is touched, the human becomes, in a way, part of the same element changing its resistance (capacitive sensor) and this changes are data that is captured to be converted into sound. The result is the illusion that the moss is alive and reacts to our way of touching it, like if it were singing, snarling, murmuring or growling.

This video will give you an idea of the sounds produced by this instrument.

Electronic circuit with an active capacitive sensor or antenna: the organic interactive object invites to be touched and reacts to the arousal of physical contact emitting real-time sinusoidal sound feedback through serial communication with Pure Data or MaxMsp.

First prototype First Iteration, magic moss.

[1] Moss growing old, but wise with other living instruments.

The setup

Moss

1 receive antenna: Conductive thread or metal wires and 2,2 Mega Ohm resistance (x 2)

The circuit

The controller for this instrument was based on a Arduino Uno. The full instructions are available here

The software

This software uses

/*
* CapSense Library  
* Paul Badger 2008
* IMI version for 12 sensors and send to Max/MSP (use regexp to decode)
*/

Full software here

Sounds of Radioactivity

The concept

Natural radioactivity surrounds us everywhere on earth and is a truly random process. Certain radioactive elements decay into other elements by releasing energy in the form of elementary particles and other forms of ionizing radiation (alpha, beta, gamma radiation etc.). The timing and amount of released energy can be recorded by sensors that allow to turn this fundamental quantum physics process into rich sound and visuals. In the concerts, slightly radioactive everyday objects such as vintage uranium glass, potassium salt (KCl, a sodium-free alternative for table salt), old radium watches, and alpine stones from St. Gallen are used to trigger the detectors with sub-atomic particles. The radioactivity of environmental radon gas is demonstrated and collected during concerts with a simple electrostatically charged party balloon. Apart from those terrestrial sources of particles, muons from cosmic radiation are detected and sonified as well.

Hardware & Software

In his work at CERN, Oliver Keller designed different detectors for natural radioactivity and added sonification for this project.

iPadPix

The initial detector turning radioactivity into sounds, which was part of our concerts from the start, is based on the iPadPix prototype. It is a mobile device that visualizes radioactivity from a hybrid pixel detector by means of augmented reality on an iPad mini. Recorded data is the particle's arrival time, type, and energy. The particle data is sent via WiFi to the iPad for visualization in an open-source iOS app. At the same type, the data is sent in parallel to a computer running a receiver program written in Processing that triggers audio samples and Midi events. The Midi connection is in turn triggering a Korg Volca for percussive sounds and sometimes a larger modular synthesizer.

Sometimes we also explain the instruments in short solo demonstrations, this is the part on iPadPix from the very first opening concert in 2016 at Le Bourg, Lausanne. We kept explanations briefer or skipped them entirely in later performances depending on the framework of the evening.

DIY Particle Detetcor

By the end of 2019, another rather low-cost DIY particle detector based on cheap silicon photodiodes was added to this project with sonification. The `pulse-recorder.py` script in this repository uses the wonderful pyo sound synthesis library for generating experimental plucked string sounds based on the Karplus-Strong algorithm. The output is also fed into a modular synthesizer for triggering and generation of further sounds.

Virtual Soprano

The Virtual Soprano was used in the first two performances of the Living Instruments, but was abandoned in subsequent versions. A software detects your face expression through a computer's webcam and turns it into vocal sounds, like a virtual soprano. The complete documentation can be found here

Paramecia Controller

ParaController 2.png

The Paramecia Controller is an instrument inspired by a similar module described by Urs Gaudent from GaudiLabs (instruction video here).

After several prototypes, the SeePack microscope camera was replaced by a Logitech C270. The device was built according to previously described design (instruction video here) except the bottom acrylic glass plate was kept intact (with a piece of black paper underneath it, between the acrylic and the bottom wooden panel). A rubber joint was also added between the two acrylic glass plates (see picture below).

The first prototype, used in the first performances looked like that:

A second, more robust, version was made for the performance in Gaïs in September 2017 and used for the following performances:

The circuit

The circuit is composed of an Arduino UNO, 2 x 2 pairs of cables (1 pair for the joystick and 1 pair for the electrodes). The joystick was the Play-Zone Arduino PS2.

The software

The complete Arduino code can be found here.

Paramecia Bolero

The Paramecia Bolero is based on a mini-microscope

The software

The MaxMSP software patch used is available here.


Video

The Mixer

Roland HD Video Switcher V-1HD

Log

Preparation before "100 Ways of Thinking"

When?

Friday 7th September-Sunday 9th September 2018

Who was there?

Final days before first performance

When?

Every day 1st-8th February 2016

10am - 8pm (or midnight.. depending on the day)

Who was there?

N/O/D/E Festival

What?

Several prototypes of the Living Instruments project were featured at the N/O/D/E digital culture festival.
The 2016 edition was about Algoritmes and Big Data and hosted a theremin annual meet up.
The festival is organised By Association Longueur d’Ondes (coordination & programmation: Coralie Ehinger & Julie Henoch).

Where?

The Meet & Geek Laboratory
2nd floor at "Pole Sud" Cultural Center in Lausanne.

When?

30.01.2016 from 9am to 6pm

Who was there?

Construction weeks 25-29.01.2016

When?

Every day 25th-29th January 10am - 6pm (or midnight.. depending on the day)
Connecting FaceOSC to MaxMSP to tryout sound patterns.

Who was there?

What?

Blubblob Pond
Blob with sea water organisms from a local pet store in a crystal ball, with camera, laser cut structure on transparent polyvinyl and metal screws and nuts. Connected to MaxMSP.
A

Facetracker Tree
Tryouts with soundpatterns.
A

Construction weeks 18-25.01.2016

When?

Every day 11-16th and 18th-25th January 9am - 5pm (or midnight.. depending on the day)

Who was there?

Building the modules

Wiring:

The whole system was wired using twisted-pair cables from Ethernet cables.

To avoid confusion, the 4 types of components were wired using a colour code (see picture below).

A
Colour code used for wiring.

Fermentation cultures:

We used pure brewing yeast cultures growing in YPD medium and feeding on glucose to produce CO2 gas:

  • Starting from 2mL dense culture (from overnight growth from plate) in 250 mL fresh medium.
  • The next day, the dense culture were complemented with 50 mL of 40% glucose solution (not sterile) -> 8% final glucose concentration.
  • The cultures started producing CO2 after 30 min (2 mL CO2 per minute)
  • The cultures could be used after 90 minutes (5 mL CO2 per minute)

Bubble sensors:

Bubble sensors we built using a white LED and a photodiode. The setup was inserted in a wooden clothespin.

An option for the calibration of the sensors was explored based on a tutorial proposed by Arduino.

Microphones:

Microphone/Headphone Amplifier Stereo DIY kit (MK136, Velleman) were purchased from Distrelec and build according to instructions.

Paramecia tracking device:

SeePack microscope camera (see picture below) was mounted on our Carl Zeiss Axiolab E re microscope.

The EasyCapViewer 0.6.2 software was used as a player to record live images.

A
Microscope camera.

Mossphone:

Hunting the moss, building the platform and wiring it to Arduino. Program in IDE Arduino. HOW TO PROGRAM/WIRE TO ARDUINO AND COMMUNICATE WITH MAXMSP soon on Github.

A
A

FacetrackerTree:

A


A device that tracks human expression and a code to translate it to sound patterns. Code on OpenFrameWorks here FaceOSC [2] HOW TO COMMUNICATE WITH MAXMSP soon on Github.

A


Prototyping Week-end 19-21.09.2015

When?

Saturday 19th September 11am - 7pm
Sunday 20th September 10am - 8pm
Monday 21st September 10am - 6pm

Who was there?

Brainstorming Session

We spent those three days brainstorming at UniverCité, trying to design 'instruments' that we could play, based on fermenting yeast cultures.

The 'instruments' we envisage would be driven by living organisms that produce work we can turn into sound. The most obvious example is fermentation (microorganisms eating glucose and rejecting alcohol and CO2) producing a gas that one can use to make bubbles, sounds, etc.

These instruments can fall into 3 categories:

LIVE - AUTONOMOUS AND COMPUTER INTERACTION No need for a human being to work in order to produce a sound from the living organisms activity.

  • Gas producing fermentation broth (Bacteria and yeast) and gas-machine interactions
  • Insects (moths, fruit flies) movement recognition software

LIVE - HUMAN INTERACTION A human subject will read a score written by living organisms and play an 'instrument' according to this score

  • Keyboard and microscopic score -> observe microorganisms in water from local pond -> organisms move in microscope field on "score" slide

RECORDED - COMPUTER INTERACTION A recorded signal from an organism is used as a score and played either directly by a computer or by a human subject.

  • Using for example genomic data (from the organisms used in other 'instruments') to generate sound. This could be simple (ATGC into tunes) or complex (use of amino acids triplex).

Building the first prototype

Together with Serge Vuille, our musician in residence, we designed and built a series of living instrument prototypes.

(Thanks biodesign.cc for the soldering iron!)

Overview of the prototype:

Before we go into too much details, you can check the video!

Now a bit more details. Below you find a picture of the setting, the recipe to produce CO2 from yeast fermentation and a scheme of the bubble detector device.

Tubing set-up:

A. is the 250mL yeast culture producing the CO2.
B. is the electronic circuit that allows our Arduino UNO board to make a variable sound when gas bubbles are going through the glass tube filled with ink-coloured water.
C. is simply a photodiode that will sense white light (from white LEDs) when the bubbles pass by.

A
This is what the whole setup looks like.
A
A closer look at the circuit.

Fermentation cultures:

We used two different types of cultures to produce CO2 gas:

As a test, we used random culture from rotting fruits juice.

  • Blackberries were squashed into a juice and diluted with 1/5 water (40 mL into 160 mL) and the mixture stirred at room temperature. There was an immediate production of CO2 gas.


A
This was the first prototype of bubbler using fermenting blackberries.


To get something more reproducible, we used pure brewing yeast cultures feeding on glucose.

  • The composition of the overnight medium was as follow: 2.5g YE, 5g Peptone, 5g glucose