Software development forms an important part of the E2-Create project. Software development forms an important link between the project’s research activities and creative applications. Some of the software can be readily used as tools by any users, other software is meant as basis for creative coders to develop their own artworks. At the moment, all software is provided as source code only. Later on, binary releases will be added as well.
Puppeteering AI
Puppeteering AI is a system that creates an artificial dancer whose movements are generated through a combination of interactive control and machine learning. Puppeteering AI explores interactive applications of an autoencoder that has been trained on motion capture recordings of a human dancer.
The source code and data is available on Bitbucket. A description of the research project that led to the development of Puppeteering AI is available on this site.
Raw Music from Free Movements
Raw Music from Free Movements (RAMFEM) is a deep learning architecture that translates pose sequences into audio waveforms. RAMFEM can be applied to any recordings of movement and music, capture their correlations, and subsequently recreate the acoustic characteristics of the music through embodied gestures.
The source code and data is available on Bitbucket. A description of the research project that led to the development of Puppeteering AI is available on this site.
Granular Dance
Granular Dance is a tool that can be trained with motion capture data and then used to generate new dance movement sequences.
The source code and data is available on Bitbucket. A description of the research project that led to the development of Puppeteering AI is available on this site.
Mocap Player
This software is a simple tool for playing motion capture data and simultaneously sending this data via the open sound control (OSC) protocol to a client.
The source code and data is available on Bitbucket. A precompiled version is available for Win64 systems.
Mocap Analysis
This software provides a set of analysis functions for motion capture recordings. The following analysis functions are provided: positional and rotational derivatives (velocity, acceleration, and jerk) and Laban Effort Factors (Flow, Time, Space, Weight). The software receives motion capture data via OSC and sends the analysis results also via OSC. Accordingly, it acts as an in between link between a specific Mocap Player software and any other client software receiving OSC data.
The source code and data is available on Bitbucket. A precompiled version is available for Win64 systems.