此研究目的是透過使用Theremin非接觸式電子感應器,來設計一種具有視覺控制的互動式電腦音樂表演藝術系統。非接觸式電子感應器Theremin是俄國的一位電子工程師發明,一種使用天線來感應的裝置,藉著感應表演人手部跟感應天線位置距離變化,改變內部電容值,然後振盪不同的音律。也就是透過手部不同動作的變化,隨著手在空中移動不需接觸,就能演奏出旋律。首先將數位式的Theremin加以改良,設計出一個具備三支天線的數位化Theremin。數位化Theremin的定義為,控制一切的傳輸都是離散數據式。設計方法是使用Arduino電路板一種Microcontroller軟硬體平台介面,將Theremin產生之訊號傳送到電腦,便可結合Processing視覺控制軟體與Max/Msp MaxScore電腦數位音樂軟體搭配JMSL而做出即時的視覺與聽覺上變化。Processing一種以JAVA語法為基礎的程式語言,由MIT Media Lab裡的Aesthetics and Computation Group發展與構想出來,最大特點可以建構圖像視覺互動環境用於影像、藝術、電腦音樂設計、遊戲。有著開放式原始碼的程式並且能夠跨平台式使用,進而搭配Arduino做嵌入式開發連結互動,更能結合Android行動裝置使用。最後根據上述硬體與程式改良設計成一組具備三軸視覺控制的非接觸式Theremin實體,其中包含使用Processing提供立體圖像介面,加上Arduino電路板USB連結到電腦後,與Max/Msp Maxscore與JMSL搭配即時記譜,達到能由單人互動演奏系統,包含旋律、影像互動的完整系統。
The advancement of new interactive computer music technology for the last decade has drawn extensive impact in music education, Performing art and Gaming. Recently, many new media art performance that had used interactive audio-visual elements created un-limited imagination and innovation which attracts many computer music performers to follow. Since then, more and more people from diverse sides have jumped into this area and created many amazing live performance as can be seen in YouTube. It is not long to wait before the new type of music performing or acting will be fascinating prevailed.
In this research we will extend our previous designed Quad-Theremin and use it as the main apparatus to control (Arduino) the audiovisual performance in a group. To reach this goal, we have to enhance the functionality of our Quad-Theremin and the accompanied interactive graphic(Processing)system. The system has to be able to visualize the music score or notation in real-time notation in the classical music score( JMSL Maxscore)so a group of Theremin players can follow the same tune and as well as it can be accompanied by the traditional music instruments. Moreover, the Theremin can also drive the graphic pattern for a kind of new media art presentation. In our designed system, with a given Rhythm stimulated by and interacted with the visual pattern on the screen. We adopt the Max/Msp and the elaborative design of the animation by Processing language.