音樂的表現方法已日趨複雜，互動式元素加入後使得音樂的藝術更加的輝煌，表演者(音樂演奏者、舞者或者是觀眾)已不再是被動與固定的形式或個體。在本研究中，我們將建立一個及時動作控制的互動式的音樂合成，應用於互動式音樂演奏、電影或舞台劇、韻律操及武術教學。其中我們設計了一個改進的Theremin的感應器，不同於傳統Theremin的是，我們的控制還包含了斷音、音色與音樂配速的控制，且”air piano”的彈奏可為主旋律，或者是配樂樂句的演奏，依預先設計好的樂句資料庫，而非單一音符，有類似於即興自由演奏(Ad Lip)但可包含多部合奏，可依一定的預先設定的和弦的進行或預設的對位。音色的設定與樂句的控制是由DSP模組來處理的。其中FM合成與wavetable 合成都將建立。MIDI的 control message則用來操控自行開發的電腦音樂軟體而演奏。此系統亦可將所擷取的資料可輸入MAX/MSP或CPS等互動式音樂程控環境以軟體的方式改變各種效果。最後此系統將與本校舞蹈系、國術系、體育系與音樂系合作，測試此系統的施行性與效果。
Music performance methods are becoming more complex today. The interactive and collaborative involvement of music playing by the on-stage performers or even the audience helps the creation of new music performing art. In this research we will build up a real time gesture and haptic controlled interactive music synthesis for interactive performing art where music are controlled and varied according to performer’s gesture and haptics on stage show. The performer could be either a group of musicians, dancer, Martial art performer etc.. We will re-design an upgraded Theremin which contains a DSP board to control the timbre so that the theremin can generate different instrument sound. The free piano playing is in a haptic way like the way of playing the “air piano”. The playing is not limited to play just the theme with violin like tone but can be in any timbre and could also be extended to a more complex partials which we pre-fabricated in data base according to our own designed software. We also add the staccato and tempo control function by using electronic IC and extra sensors. The tempo is controlled by the p5 glove which generates MIDI control message based on the bending of the fingers while in the same time controlling the volume of the theremin output. Both the MIDI output and the audio output can also be directed to the Max/MSP environment for interactive music performing by software means. Finally the whole system will be demonstrated by cooperation with the Dance department, Music department and Martial Art department to test the feasibility.
