Back in 1988 I published one of the earliest articles on the alignment of translations with their originals (see Sources below). I was not the only one to think of it about that time but I did have one distinction: I proposed a term for it, namely bitext. More precisely bitext was defined as
This technique soon turned out to be of great practical importance because it provided the data required for the statistical machine translation that made MT popular. However, the psychological implication of bitext which had been mentioned in the 1988 article, that is to say the simultaneous presence of the two texts in the working translator’s mind, was overlooked.
ScanScore (see below); moreover ScanScore is reversible. But in this post we are concerned only with human conversion.
The human conversion from notation to sound is not direct. First the notation must be perceived and decoded. Then, more important, it must be converted to muscular code. This code directs the performer’s fingers, lips, feet, etc., and vocal tract in the case of singers. There’s a developmental progression in which the conversion begins consciously but becomes internalised and intuitive with practice. Here’s Werner Goeble’s description of how it works in the case of pianists:
“Pianists achieve extreme levels of virtuosity on their instrument, requiring a combination of talent and decade-long continuous and deliberate practice, training, and experience. As with all musical behaviors, body movements in piano performance are goal directed, aiming at producing intended sounds with utmost precision and accuracy in expressive parameters such as timing, dynamics, timbre, and articulation. Body movements in piano performance may also serve communicative purposes such as to express emotional states or to coordinate with co-performers. Pianists control the timing and chain of velocities of the individual piano hammers by varying the forces applied to the piano key surfaces, as well as to the three pedals through their feet. The key forces are accomplished by coordinating the kinematic chain from their shoulders to the fingertips aligned with feet movements to manipulate the pedals. As kinematic properties such as finger velocity covary with performance parameters (tempo, dynamics, etc.), pianists have to stabilize several parameters of movement kinematics and musical expression simultaneously. The intrinsic way the fingers arrive at the piano key surface, referred to as piano touch (i.e., pressing versus striking a piano key), yields different tactile and other sensory percepts to the pianists themselves and the audiences alike, making this parameter an important one in accomplished piano performance.”
Finally the music arrives at the outcome of the chain of conversions as structured sound. Note that music is not just sound but structured sound. That’s the other half of bi-music. We need to have it in a stable form that can be recorded, stored and processed. One such medium is MIDI files but there are others.
So now we are ready to offer a definition of bi-music. It would be as follows:
Bi-music is music in standard music notation and chunked into bars, coupled with a MIDI or other sound recording of the same music and stored in such a way that retrieving any bar of the notation automatically retrieves also the corresponding MIDI or similar segment; or vice versa.
Would it be of any practical use? Perhaps more to musicologists and copyright lawyers than to musicians. However, when bitext was introduced, though it had a practical purpose it was not immediately obvious how very useful it would be.
Brian Harris. Bi-text, a new concept in translation theory. 1988. Available at https://www.academia.edu/34281085/Bitext_the_original_article_of_1988.
. Movement and touch in piano performance. In B. Müller and S. I. Wolf (Eds.).Handbook of Human Motion, Berlin: Springer, 2017, pp. 1-18. Available from https://www.researchgate.net/publication/314269464_Movement_and_Touch_in_Piano_Performance.
For the Natural Translation Hypothesis and conversion, enter tenets in the Search box on the right.