GSoC 2025 Project #2 HarmonyHub :: Using Generative AI for adaptive learning in music (350h)

GSoC
1

Mentors: Alberto Acquilino <alberto.acquilino@mail.mcgill.ca>, Mirko d’Andrea <mirko.dandrea@gmail.com>, and Keerthi Reddy Kambham <reddykkeerthi@gmail.com>

Skill level: Advanced

Required skills: Proficiency in Python and JavaScript (experience with Angular and Ionic is a plus); familiarity with generative AI frameworks (e.g., OpenAI GPT, Hugging Face); experience with web development and UI/UX design; knowledge of audio processing libraries, such as Essentia (optional); basic understanding of music theory and notation (optional).

Time Commitment: Full time (350 hours)

Forum for discussion

About: HarmonyHub is an ongoing open-source project that aims to bridge this gap by developing a modular, web-based platform for music education. The platform leverages modern web technologies (Ionic and Angular) to create reusable components and services, enabling a hybrid mobile app that can run in browsers or be deployed as mobile apps for iOS and Android. By integrating generative AI, HarmonyHub will empower music educators to create adaptive, personalized learning experiences for students, making music education more inclusive, diverse, and effective.

The HarmonyHub platform is built using the Ionic framework and Angular, enabling the development of a hybrid mobile app that can run directly in browsers or be deployed as native mobile apps on iOS and Android devices. Its modular architecture allows for reusable components and services, simplifying customization and scalability.

Generative AI will be used to:

  • Assist music teachers in defining exercises for their students.
  • Enable a code-free interface for creating and compiling custom web applications for music education

Aims: This project envisions integrating large language models (LLMs) and Generative

AI to empower music educators with tools for dynamic, adaptive learning. This will enhance student engagement, improve learning outcomes, and provide educators with powerful tools to tailor instruction to individual needs. The project will also contribute to the broader field of adaptive learning by demonstrating how generative AI can be applied to domains with complex, non-textual data like music.

Objectives:

  • Extend HarmonyHub to incorporate Generative AI for adaptive learning, focusing on creating personalized exercises tailored to students’ technical levels, age, and progression speed
  • Develop a user-friendly, code-free interface for teachers to customize and deploy exercises
  • Leverage Generative AI to analyze and enhance existing exercises, making recommendations for refinement based on student performance
  • Enhance inclusivity and diversity in music education by providing tailored learning experiences for students from varied backgrounds and abilities

What can I do before GSoC?

  • Familiarize yourself with the existing HarmonyHub codebase and its modular architecture
  • Explore generative AI frameworks (e.g., OpenAI GPT, Hugging Face) and their applications in adaptive learning
  • Experiment with audio processing libraries (e.g., Essentia, MIDI.js) to understand their potential for music education

Websites: Music Education Interface | Alberto Acquilino and GitHub - albertoacquilino/music-education-interface-ionic

Tech keywords: Generative AI, Adaptive Learning, Music Education, Angular, Ionic, Python, JavaScript, Audio Processing, MIDI

1 Like
2

Hey! am Jeeth Bhavesh Kataria from Ramaiah Institute of Technology .I’m eager to contribute to HarmonyHub: Using Generative AI for Adaptive Learning in Music as my Google Summer of Code project with INCF. As a computer science student with a strong interest in AI and neuroscience, this project excites me by merging generative AI with music education—a domain ripe for innovation. HarmonyHub’s potential to adaptively teach music aligns with INCF’s mission to advance computational tools, especially given music’s deep ties to brain function. My experience with Python, TensorFlow fuels my passion to develop an AI-driven tutor that personalizes learning while exploring its neuroscientific implications. I’m motivated to leverage tools like Magenta or transformers to create engaging, brain-inspired learning experiences. Through GSoC, I aim to enhance HarmonyHub, grow my skills, and contribute to INCF’s open-source community, making music education smarter and more accessible.

3

Hey, I’m Sampreeth, a pre-final year undergraduate student in Computer Science and Engineering. I came across the HarmonyHub project and found it incredibly exciting as it aligns perfectly with my research interests in generative AI and music generation.

I have hands-on experience in machine learning (ML) and deep learning (DL) and have published a paper in Springer on these topics. I have also collaborated with Intel on a project that leveraged advanced deep learning techniques. Currently, I am researching music generation and experimenting with different generative models such as VAEs and GANs to create adaptive and dynamic musical compositions.

From a technical standpoint, I am proficient in Python and JavaScript, with experience integrating APIs in real-world applications. I have also worked with Angular and Ionic, making me familiar with the tech stack used in HarmonyHub. Additionally, I have won three hackathons, where I successfully built and integrated APIs into functional projects, demonstrating my ability to develop scalable and innovative solutions.’

I am eager to contribute to this project by integrating generative AI into music education, enhancing adaptive learning experiences, and building a user-friendly, code-free interface for educators. I look forward to learning more about the project and collaborating with the team!

4

Hello everyone
I am really impressed by the HarmonyHub project—it’s such an inspiring merge of generative AI and music education! I am eager to contribute in the realms of Python/JavaScript development, exploring generative AI frameworks, and enhancing the UI/UX. I would love to work on the development of the platform’s adaptive learning features and support its mission of making music education inclusive and personalized. Also, I have integrated Google’s Flash 2.0 in my project Protochain to develop smart contracts on three different blockchains (Aptos, Polygon, Ethereum) based on user-specific prompts submitted by users.

I am eager to know how I can contribute?

5

hey @arnab1896 !
I wanted to let you know that I’ve successfully solved the multi‐color theme issue on github repo url you mentioned (GitHub - albertoacquilino/music-education-interface-ionic)
here’s the issue link : Improving UI/UX by adding the multi color theme · Issue #9 · albertoacquilino/music-education-interface-ionic · GitHub

although I only know about react and tailwind, IOnic and Angular was bit of a tough concept to digest.

What’s the next step to work in order to discuss this project with you.

6

Are we building the project on the same platform i.e. (https://mei-trumpet.web.app/)
or need to make another platform.
Right now students are interacting with Trumpets. In order to scale this application we need to provide more sound instruments such as : wind instruments ( Flute, Clarinet) and bowed string instruments (Violin, Viola).

Hmmmm…seems interesting !

Resource : https://www.incf.org/sig/harmonyhub-web-based-platform-learning-variable-pitch-musical-instruments

7

Hi,
Thanks for your interest! We are starting the selection process. I recommend interested contributors to work on the application proposal template: GSoC-Proposal-Template - Google Docs

There are also open issues on the repository which are helpful to start getting familiar with the codebase.

Once you have filled the application document, you can reach out to all the mentors via email for feedback.

Best regards,
Alberto

8

Hi Sampreeth,
Thanks for your interest! We are starting the selection process. I recommend interested contributors to work on the application proposal template: GSoC-Proposal-Template - Google Docs

There are also open issues on the repository which are helpful to start getting familiar with the codebase.

Once you have filled the application document, you can reach out to all the mentors via email for feedback.

Best regards,
Alberto

9

Hello everyone,
Thanks for your interest! We are starting the selection process. I recommend interested contributors to work on the application proposal template: GSoC-Proposal-Template - Google Docs

There are also open issues on the repository which are helpful to start getting familiar with the codebase. We will keep revising the pull requests on the go, according to our availabilities.

Once you have filled the application document, you can reach out to all the mentors via email for feedback.

Best regards,
Alberto

10

Hi ,
My name is Ram and I am an ECE graduate. I am very much passionate about AI. And I am looking forward to contribute to this project.

11

Hello , My name is Anuj Tripathi from cse second year . Its my first time open source contribution for gsoc can some give me some advice ??

12

I’m Tharun, a developer passionate about both computer science and music (I’ve completed Grade 2 piano and continue to study). I was excited to discover HarmonyHub’s mission to revolutionize music education through AI and modular design.

My experience aligns well with this project:

  • GSOC 2024: Integrated LLMs into Jupyter kernels (Project Blog)
  • Music theory knowledge + practical piano background

I’d love to contribute to:

  1. The generative AI components for adaptive learning
  2. Audio processing integration

I’m very interested in becoming a long-term contributor. Could we discuss:

  • Current priority areas for the project?
  • How might I start contributing now?
  • Potential mentorship opportunities other than GSoC?

Looking forward to your thoughts!

13

Hello!

My name is Angela Tran, and I am a first-year undergraduate student at Harvard University looking to study Computer Science and Psychology. With my studies, I am looking to go into a field that heavily involves UX/UI and/or AI. I am also extremely interested in music: I played the double bass and cello in my school and local orchestras for eight years, and I love listening to music! I’m also extremely passionate about music education and youth education as a whole, having been involved in service organizations and founding programs to serve local youth. I have a strong basis with Python, Java, and C, and I’ve been actively working with HTML/JavaScript/CSS, React, C++, and Figma for the various campus organizations I’ve been part of. I’m extremely interested to begin working with and incorporating AI into my work, and I think that HarmonyHub is one of the best opportunities to intersect my love for music with my passion for CS! I’ll be submitting my proposal for GSoC shortly, so thank you for taking the time to review that. I’m eager to learn, and I’m excited to have the opportunity to work with everyone!

Best,
Angela

14

Hello @Alberto and @Keerthi_Reddy_Kambha,

A colleague recommended GSoC this summer and this project seems most aligned with my background and previous experience. I previously taught in an after-school music program and completed interdisciplinary research in music pedagogy.

Background:

  • Graduated BMus and MMus in viola performance from uOttawa (2020)
    • Conduct literature review studying transfer effects of after-school music participation and cognitive development
    • 3+ years teaching beginner violin/viola in a classroom setting
  • Computer Programming (diploma), Algonquin College (2024)
  • Artificial Intelligence - Bach. Hons., Durham College (2025-)

Relevant Skills:

  • Familiarity with building LLM agents using frameworks such as CrewAI and griptape.
  • Full stack web development skills using Spring Boot, Django, ReactJS, Jinja, Thymeleaf, Bootstrap, and Tailwind.
  • Beginner mobile design using Android Studio and React Native

This is my first time contributing to open source software, and it would be a privilege to contribute to this project, or a project similar.

15

Hello everyone,

Thanks for your interest in the project! Our recommendation is to write down your ideas in the indicated proposal template and reach out via email to the three mentors with the document attached. We will do our best to give everyone our feedback as soon as possible.

Best,
Alberto

16

Hey!! I am Cherishma , currently a pre final undergraduate pursuing Computer Science with AI/ML as my specialisation. With a strong foundation in Python, JavaScript, and web development , along with hands-on experience in AI-driven healthcare and security applications , I’m excited about the opportunity to contribute to INCF’s mission. My work with TensorFlow, PyTorch, and Scikit-learn , especially in face liveness detection and adaptive learning, has helped me develop the skills needed to build intelligent, real-world solutions. Being actively involved in hackathons and open-source projects , I thrive in collaborative environments and enjoy tackling complex challenges.I’m eager to bring that passion and expertise to this project.