
Artificial Intelligence and Design | Duration: 1 week
AI Design
User Experience
Solo Project
Overview
What was the pain point?
Beginner guitar players learning alone often have trouble knowing which strings and notes they’re playing. They frequently need to look down since they haven’t built muscle memory and don’t have an instructor to guide them.
What is the project?
I created an AI tool to help beginner guitar players learn the right notes without looking down. This lets them focus on building muscle memory and improving their skills without needing a teacher.

The Questions

I Bought a Guitar…
…and I struggled learning to play with it. I had no instructors and my learning was mainly through YouTube videos.
Why am I struggling?
Most of the time I couldn't see what string I was plucking or if I was playing the right note. I found out that I wasn't alone in this problem and so I decided to explore more.


What is needed?
For new, self-taught guitarists, it can be tough to keep looking at the guitar to check if they’re playing the right note. This isn’t great for practice since they’re still training their fingers and ears. What is needed is a simple way to check if they’re hitting the right notes without constantly looking at the guitar.
How can I solve this?
I needed a way to know if I was playing the right notes while learning guitar on my own. Since I didn't have any feedback, it was hard to tell. An app that would tell me if I was playing the right note or not (and how to correct) would be a great tool.

The Process


Training the model
I recorded the notes of a song on the guitar. And then using teachable machine AI, I trained the model. The model was trained by playing with the sample size and the epochs.


Building the interface
After getting the code from Teachable Machine, I tested it in p5.js. I then worked on understanding and modifying the code to create the interface with help from ChatGPT. Finally a working site with the AI model was built through a lot of trial and error.


Testing
First, I tested the model to ensure it worked properly. Once the functionality was good, I focused on improving the interface. I adjusted the UX and UI to make it easier to use. I played around with the design, added illustrations, and created a user-friendly layout. I also included visuals to help users know which note to play, with green indicators and sound effects for correct notes.
The Result