Introduction
This work continues my exploration of force and its extension, specifically the operation and transformation of forces and the energy of subtle forces. In this project, the relationship between forces is represented by the movement and tension between two floating helium balloons, arranged in a pull and push structure. The balloons are connected by a stretch sensor, with a gyroscope placed in the middle of the line to detect the degree of tilt caused by the tension. Axial and acceleration data are transmitted in real time via OSC communication between an ESP32 and a Raspberry Pi, converting the data into sound processed by Max/MSP to reflect the state between the balloons.
Concept and Background Research
Force is abstract, and minor forces can cause significant ripples in people's minds, referred to as the hidden energy of minor forces. These forces can be materialized and interact with various symbols, thus acquiring socio-cultural contexts. As a result, the concept of force is transformed from a relationship between physical forces to an interaction between objects, space-time, society, and individuals.
Technical Implementation
Sound Section
Due to the selection of a chapel as the exhibition site and the romantic imagery associated with balloons, the sound design is inspired by choir music, with strings chosen as the main timbre. The system uses udpreceive to receive balloon data sent from the ESP32 and OSC-route to parse the data.
Sound Mapping in Three-Dimensional Space
This project focuses on the movement relationships of balloons within a three-dimensional space, where:
Y-axis data (vertical movement) controls pitch, allowing the sound to change with the rise and fall of the balloons, enhancing spatial perception.
X-axis data (horizontal movement) adjusts the timing intervals of note triggers, meaning the sound rhythm fluctuates between fast and slow based on the balloons' relative horizontal positions.
Z-axis data (tilt angle, reflecting height differences) affects harmonic duration, determining the resonance and sustain of the sound.
The combination of X-axis and Z-axis variations shapes the rhythm and depth of the melody, creating a breathing-like musical flow within the space.
Dynamic Adjustment of Background Sound
To enrich the sound layers, the system incorporates a synthesizer to generate electronic background sounds, which envelop the main string melody, creating a deep and immersive soundscape. Additionally:
Data from the stretch sensor directly influences the rhythm and density of the background sound, dynamically adjusting it in response to the changing tension between the balloons.
(This design ensures that the sound not only reflects physical movement but also conveys the subtle tension between the balloons, allowing the music to breathe and expand within the interplay of forces, creating an organic auditory experience.)
