Machine Learning, Statistics, MIDI, Serpent, Music Patterns

Proposed and implemented a stylistic music generation system that is able to capture structure, melody, chord progression and bass styles from one or a few example music, and imitate the styles in a new piece using computational techniques, especially statistics and machine learning methods.

Research Project in CMU, Serpent, Wxwidgets, ZMQ

• HCMP is an emerging computer music system that can perform live music in association with human performers, with goal of creating highly autonomous artificial performers that can fill human roles

• Introduced new features and refactored old modules for HCMP using Serpent, including virtual time map scheduling, track and channel mapping, and automatic accompaniment; features were used in several live performances

• Refactored network module to upgrade from ZeroMQ to new, proprietary media communication protocol "Open Sound Control 2" proposed by advisor 

Python, MIDI, MusicXML

•  Defined first-ever machine-readable symbols for common pipa performance techniques in MusicXML

•  Proposed series of computational models for common pipa performance techniques using "analysis-by-synthesis" method, leading to much more realistic synthesized performances​

Node.js, HTML5/CSS3, PHP

• Upload a photo of any person, then we will make you a new friend by creating interactively animated faces and emotional interaction

• Created various animated facial expressions in real-time according to user instructions, based on Facial Feature Point Detection model

• Operated photo pixels directly on HTML Canvas, so that facial request can be solved in front-end and improved response time dramatically.

• Used Speech Recognition and Affective Computing models to analyze emotion in user's speaking, and response in both facial expression and voice

Three-day Personal Workshop Project, SuperCollider, JavaScript, Open Sound Control, Python

• Developed mobile web app with SuperCollider that lets people use mobile gestures (speeds, ranges, directions) to control melodies (such as ringtones) in real-time as if they were playing musical instruments, adjusting pitch, volume, tempo, accompaniment and special effects etc., allowing group of people to form ringtone orchestra
   

Start-up Project, Dating App, Andriod, Java

• Seeker is an Andriod application to help people find their Mr./Miss Right  and support them date

• Designed special psychological questionnaires and used Collaborative Filtering algorithm to match people

• Designed interesting dating process like advancing in games