[WIP] Implementation of Vocal Synthesis in LMMS

[SeleDreams]

This WIP pull request must not be merged yet.

I am working on implementing vocal synthesis support to LMMS, I was working at first on a kind of dirty branch where I did a lot of tests that kind of made everything a mess, I am now working on it in a cleaner manner where I am adding my features while keeping as much as possible intact and avoiding to include files that must not be included in the commits (such as voicebanks and build files)

Once the feature finished, here are various additional abilities LMMS will have :

• A new instrument named LMMS Voice will be added, this instrument will allow users to import UTAU voicebanks into LMMS and make them sing.
• The piano roll will have the ability to edit lyrics in vocal notes, there will also be vibrato and portamento, as well as additional settings per vocal note.
• import and export of .ust, .vsqx, .vsq, and other types of vocal synthesis file formats.

This is the current status of the feature in this video (Some code isn't ported to the new branch yet, so just building the code currently in this PR won't achieve the same result)

https://youtu.be/YzU8DfbJJt8

[LmmsBot]

🤖 Hey, I'm @LmmsBot from github.com/lmms/bot and I made downloads for this pull request, click me to make them magically appear! 🎩

macOS

• macOS : lmms-1.3.0-alpha.1.81%2Bg0355a0cfe-mac10.14.dmg (build link)

🤖

{"platform_name_to_artifacts": {"macOS": [{"artifact": {"title": {"title": "", "platform_name": "macOS"}, "link": {"link": "https://12900-15778896-gh.circle-artifacts.com/0/lmms-1.3.0-alpha.1.81%2Bg0355a0cfe-mac10.14.dmg"}}, "build_link": "https://circleci.com/gh/LMMS/lmms/12900?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link"}]}, "commit_sha": "da9afe02a9b9775e48d7deb4ba1ca0f858948ac1"}

[SeleDreams]

huh seems like codefactor is still seeing issues that were fixed in my second commit, maybe the two commits close from each other was too much for it

[SeleDreams]

I'll probably end up fully rewriting it since the previous implementation was kind of hacky

[messmerd]

If OpenUtau could be ported to a CLAP plugin, and if LMMS gained support for per-note parameter automations for CLAP plugins in a potential follow-up PR after #7199 is merged, then that might be a better way to do this.

[SeleDreams]

Last time I worked on openutau's source experimenting with vst support that might be complicated. OpenUtau's rendering system was honestly pretty messy. It might likely be actually easier to make a dedicated clap plugin for utau voices. Le mar. 25 févr. 2025 à 23:02, Dalton Messmer ***@***.***> a écrit :

…

If OpenUtau <https://github.com/stakira/OpenUtau> could be ported to a CLAP plugin, and if LMMS gained support for per-note parameter automations for CLAP plugins in a potential follow-up PR after #7199 <#7199> is merged, then that might be a better way to do this. — Reply to this email directly, view it on GitHub <#5937 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AD4UF4N73L7ATILTTMKEHLT2RTR6XAVCNFSM6AAAAABX3XNFHOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMOBTGM4TIMRVGY> . You are receiving this because you authored the thread.Message ID: ***@***.***> [image: messmerd]*messmerd* left a comment (LMMS/lmms#5937) <#5937 (comment)> If OpenUtau <https://github.com/stakira/OpenUtau> could be ported to a CLAP plugin, and if LMMS gained support for per-note parameter automations for CLAP plugins in a potential follow-up PR after #7199 <#7199> is merged, then that might be a better way to do this. — Reply to this email directly, view it on GitHub <#5937 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AD4UF4N73L7ATILTTMKEHLT2RTR6XAVCNFSM6AAAAABX3XNFHOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMOBTGM4TIMRVGY> . You are receiving this because you authored the thread.Message ID: ***@***.***>