Overview:
I need a developer with comprehensive knowledge of audio and sound processing, preferably with an AI and ML background, to create an API service that analyzes and processes a recorded piano piece, providing detailed feedback.

User Flow:
1- The user plays a short piano piece (less than 20 seconds).
2- Our app records the performance.
3- The recorded audio is uploaded to our servers.
4- Your API processes the recording, compares it to an original piece, and provides feedback on the following points:

* Pitch Accuracy: Check if the user played the correct notes.
* Timing/Rhythm: Compare the timing of the notes to see if the user played in rhythm.
* Note Duration: Assess if the notes were held for the correct duration.
* Tempo Consistency: Evaluate if the user maintained a consistent tempo.
* Dynamics: Compare the volume or intensity of the notes.
* Articulation: Check the style of playing (e.g., staccato, legato).
* Consistency: Ensure the user consistently plays the notes as per the original piece.
* The analysis results are sent back to the user, and our app visualizes the feedback.

The user receives a simple score indicating areas needing improvement and areas performed well.

Requirements:
* Expertise in audio and sound processing.
* Experience with AI and machine learning for audio analysis.
* Ability to develop and deploy a scalable API.
* Familiarity with tools and libraries like Librosa, Essentia, TensorFlow, or similar.

Experience with cloud storage solutions like AWS S3 or Google Cloud Storage.

Deliverables:
* A fully functional API capable of processing and analyzing piano recordings.
* Documentation detailing the API endpoints and usage.
Integration guidance for our frontend team.
* Testing and validation to ensure the accuracy and reliability of feedback.

You are free to use any language, any library, any public or paid service ( within reason and financial feasibility).

Budget: $3,000

Posted On: July 21, 2024 07:24 UTC
Category: Full Stack Development
Skills:API Development, Python, C++, Audio & Music Software, Piano, AI Model Development, Audio Engineering, API, Java, JavaScript

Country: Australia

click to apply