In the end, we went for a hybrid combo – if only one hand is present, a simplistic mapping function will be used, and if two hands are present, the left hand will act as an origin and the distance between the left and right hand will be used as the input to the mapping function. Options like only using the positional data from only the right hand, when both hands are present, and discard the left hand's data have crossed our mind too. The other challenge was on how should we interpret the data from the user's two hands. Yet another great anecdote to Occam's razor. Install the tool: pip install blobopera Convert the score file: blobopera recording import input.musicxml output.binary (Take a look at the command-line options) Upload the recording: blobopera recording upload output.binary Visit the generated link with your browser. Eventually, we fell back on a more simplistic mapping algorithm. You can download MusicXML files from MuseScore by using this tool. Unfortunately, this form of algorithm created a less-than-optimal interaction experience that did not work well with everybody. At the start, we accounted for the different heights of the user and allowed for a more adaptive system where the system would 'self zero' based on the user's height. Firstly, the mental model to control such interfaces is different for every users. In Kinetic Touchless 3.0, we had two main interactional challenges. With these two-dimensional data, we are able to remap these coordinates into input signals to control the interaction. The system encased in the conductor stand is able to pick up the left-to-right motion and the up-to-down motion of the user's hands. In Kinetic Touchless 3.0, the interaction has been upgraded to accept two-dimensional data derived from the user's hands. In the first two instalments, the interaction occurs on a one-dimensional level, where the user either moves their hand in-to-out or left-to-right in a linear motion. The main difference is the methodology used to sense and interpret the inputs. "Kinetic Touchless 3.0 retains the essence of its two predecessors – sensing the user's gestural input and providing a touchless interface to the said interactive touchpoint. Update September 20: Kevin Yeo from Stuck Labs has offered us a bit more insight into the project: Kinetic Touchless 3.0 | Touchless Symphony for the Joy of Movement
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |