For a detailed summary of the project, consult the project's CHI conference extended abstract.A tiny subset of collision data from the ATLAS Detector is being generated and streamed in real-time into a sonification engine built atop Python, Pure Data, Ableton, and IceCast. The sonification engine takes data from the collision event, scales and shifts the data (to ensure that the output is in the audible frequency range) and maps the data to different musical scales. From there, a midi stream triggers sound samples according to the geometry and energy of the event properties. The composer has a lot of flexibility regarding how the data from the collision is streamed with respect the geometry of the event, and can set whether or not to discretize the data into beats. The data currently being streamed includes energy deposit data from the hadronic endcap calorimeter and the liquid argon calorimeter, as well as energy from particle tracks and location information from a muon trigger (RPC). You can learn more about the different layers of the ATLAS detector here. Each event currently produces ~30 seconds of unique audio. Some composers have gone further and built their own patches in Max MSP or their own web apps using the processed data streaming out of Python.
This platform provides physics enthusiasts with a new way to experience real-time ATLAS collision data, and musical composers a new way to play with it. It provokes questions about how audio might serve a more practical role in data analysis.
Audio is an effective tool for communicating information. A smoke detector warns of potential fire and a stethoscope helps a medical doctor determine the rhythms of a patient’s heart. Audio is also used when monitoring physics experiments to give information about the status and quality of the equipment and data. For example, an audio cue alerts control room workers when the particle beams in the Large Hadron Collider are dumped.
Sonification has developed into an active area of research. (ICAD Conference). As technology advances, more complicated and subtle information can be communicated using audio, even in real-time. The Quantizer platform allows researchers to sonify and communicate more complex particle physics information to its listeners.
The strength of the Quantizer platform lies in how users can compose aesthetically pleasing music with ease. This gives composers the chance to learn about the physics in the ATLAS data by trying to creatively make use of some of the underlying patterns. Those patterns, if highlighted by the composer in the audio, can then also teach listeners about the physics properties of the collision event.
Composing a musical piece that plays by itself for hours on end without any musician interaction/intervention is a slightly complicated goal; you cannot as easily force separate verses, a chorus, and solos. With these two pieces I focused on music styles where large amounts repetition is common and embraced. There is no beginning, no climax, and no end, just the simple variations of the journey.
Only four parts of the ATLAS detector's data was used to compose the House piece. The guitars are predominantly controlled by two parts of the ATLAS calorimeters. Their rhythms are human composed but the musical notes are mostly determined by the data. The freestyle organs come from the track and RPC data. The minor percussive elements are not dependent on the data but help to fill out the sound. I invite a drummer to overlay a more interesting drum track; to play along with the data from world's highest energy particle accelerator.
One of the major differences between these two pieces and other sonifications is the imposition of timing, and especially the imposition of a beat. Many sonifications let the data determine as many aspects of the music as possible and this often results in music structures that sound very random. There is actually a huge amount of timing structure to the LHC and ATLAS data imposed by the experimenters so I have imposed some timing structure too. Also, this timing takes sonifications from a world of experimental sounds to the more mainstream styles of music.
The ATLAS particle physics data has a lot of patterns in them but the data can seem random to the untrained eye / ear. When composing the House piece I used the non obvious physics patterns in the data to produce some patterns in the music. For example the most probable energies are more closely aligned with the root notes of the music scale. This means that the music will more likely return to a pleasing home-base music note at the end of the bar rather than constantly leaving the listener hanging. Only a small number of physics patterns in the data have been exploited in these two pieces and I look forward to pushing that further in future compositions.
This work attempts to provide a musical metaphor for the collisions and subsequent energy showers that happen in the ATLAS detector using spatial cues to reflect the geometry of each event. Each collision event begins with the colliding protons approaching from the left and right. As particles initially carrying all of the energy of the reaction, they approach with a sound like a truck. At the moment of collision, when they meet in the center, a wavefront of sound begins, made of filtered noise and choir reflecting the total energy of the event and the missing momentum. On top of this ambient sound, each layer of the detector chimes in from the center outward. First, particle tracks warble across the space. Then, calorimeter energy deposits register around the space. Finally, bright plinks emanating from the periphery reflect muon detection by the RPC.____________
Here are some prerecorded audio files generated from ATLAS data on the platform.
Quantizer + Al Blatter live in concert at the 2015 Montreux Jazz festival : The Physics of Music and the Music of Physics. Special thanks to Ellen Walker, our first groupie !
Prerecorded clip from the "Spacey" track using masterclass data that was played at Montreux Jazz Festival: The Physics of Music and the Music of Physics. Composition by Evan Lynch
Happy pop rock: Improvised with minor post-recording edits. Dedicated to Hayley Thompson.
Suitar samba: Improvised with minor post-recording edits. Many thanks to Gina Lupino and Kirk Elliott for helping us get a basic samba beat going. Apologies to Gina and Kirk for what Ewan did to the samba piece after you left. ;)
Funky: Improvised with minor post-recording edits.
Strings: Improvised. Needs to be edited.
Experiment on a blues scale: Improvised. Really needs some editing... For Ewan's dad.
What the Quantizer music sounded like in May 2015:
The ATLAS experiment is pushing the frontiers of knowledge by investigating some of the deepest questions of nature: what are the basic forces that shape universe, are there extra dimensions, and what is the origin of mass? The ATLAS Detector is one of two general-purpose detectors built along the Large Hadron Collider at CERN. The Large Hadron Collider, a 27 km long machine, smashes together particles at amazingly high-energies and the ATLAS detector precisely measures the properties of the particles produced in these collisions. Like a complicated game of connect-the-dots, special software automatically reconstructs the trajectories of the particles ("tracks"). Different detector components serve different tasks, including the identification of particles and reconstruction of their momenta or energy. From the inside out, they include tracking detectors, calorimeters, and a muon spectrometer. Powerful magnets curve the trajectories of charged particles, to make it possible to measure their momenta.
Want to learn more about how to interpret the event display above? Check out this article
We wish to thank the ATLAS experiment for letting us use the data and for their continued support. Thank you to Media Lab composers Evan Lynch and Akito van Troyer for developing some of the creative custom synthesizers and mappings used in this project. Thank you to CERN for the invitation to perform at the Montreux Jazz Festival, and to Al Blatter for his performance collaboration. Thank you to Domenico Vicinanza (Department of Computing and Technology - Anglia Ruskin University, and GEANT Association) for providing design feedback in the project's early stages as well as helping to present the project at different venues, including organising the ICAD workshop. Finally, Thank you to Felix Socher for sharing some of his ATLAS data parsing code.