Skip to content

9552nZ/SmartSheetMusic

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

  • SmartSheetMusic

Resources and Research Papers

Audio Databases

Software Specifications

  • Fully featured software -> too much work possibly
  • Plugin/Module for third party application?
  • Small Objective - be able to precisely locate played combination of tones on a music sheet
  • Big objective - transcribe the played notes into a music sheet

Software Design for Music Sheet Location detection

This is very basic for the moment, just outlining some ideas.

Input

  • Audio stream
  • Music Sheet - in a midi format

Output

  • Point in time location of the audio stream in the midi

Worfklow

Module 1:

  • Input is the the audio stream and the midi
  • At discrete time intervals (buffer size) audio stream is transformed via FFT - that is one snippet
  • Result is compared to the spectrogram of the Midi
  • For each snippet Module 1 outputs a set of possible locations in the Midi (there may be multiple such locations)

Module 2:

  • Inputs to module two are:
    • The last position on the midi
    • Output of Module 1
    • Midi
    • Time
  • Given the last position, the midi structure, the time that has passed since last position and the set of possible new locations find the most probable new location.
  • Output - new position in the midi

Software Design for Transcription

  • Recognise single note
  • Scale up to polyphonic transcription
  • Use notes to convert to midi
  • Find location in a given midi

Hardware specifications

  • Two sheets, fold design
  • 10 to 13 inches e-paper
  • Two microphones
  • Android/App store certified
  • Touch enabled, Pen
  • Speakers
  • Sub 1000$ price

Hardware providers

Displays

Try Kits

Competition

About

Repository for Niko and Alexis to share stuff

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published