Open source singing synth.

Practical tips for recording, editing, and mastering.

Moderators: MattKingUSA, khz

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Open source singing synth.

Post by onefang »

For various reasons I'm wanting to use a speech synth to do my singing for me. One of those reasons is that the last time I did any performance singing was several decades ago, my voice is very rusty. Everyone else's second hand tobacco smoke seeping into my room isn't helping my asthma nor my singing.

Most of what I have found seems to be based on closed source Windows backends that do the actual singing, used via WINE. Even though there is open source front ends, I don't want that, I want fully open source and Linux.

Festival has a singing mode, but it only works with the low quality voices. I want something better quality. The festival docs keep mentioning flinger for better quality, but that's no longer part of festival.

Are there any other fully open source alternatives for Linux that don't need WINE? For bonus points an Aussie accent voice.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
khz
Established Member
Posts: 1648
Joined: Thu Apr 17, 2008 6:29 am
Location: German
Has thanked: 42 times
Been thanked: 92 times

Re: Open source singing synth.

Post by khz »

Spontaneously Xmonk https://github.com/brummer10/Xmonk.lv2 and XPolyMonk https://github.com/brummer10/XPolyMonk.lv2 from @tramp come to mind. When you play the synthesizer with the Pitch/Mod wheel it starts talking.

Possibly also feasible with Cardinal https://github.com/DISTRHO/Cardinal.

. . . FZ - Does humor belongs in Music?
. . GNU/LINUX@AUDIO ~ /Wiki $ Howto.Info && GNU/Linux Debian installing >> Linux Audio Workstation LAW
  • I don't care about the freedom of speech because I have nothing to say.
User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

A quick look at Xmonk and XPolyMonk and nothing screams "insert lyrics here", the only voice thing I can see is "MODWHEEL CC 0x01 -> vowel parameter". Neither is available in any of the Devuan repos I'm currently feeding from. So I'd have to compile them. I'm OK with that, I am a very experienced computer programmer anyway. So long as I don't have to jump through too many hoops.

Cardinal I already have installed, but again nothing screams "insert lyrics here". But at least I can poke at it to see what it does. Have not used it yet, but I had installed a whole bunch of plugins to try out.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
khz
Established Member
Posts: 1648
Joined: Thu Apr 17, 2008 6:29 am
Location: German
Has thanked: 42 times
Been thanked: 92 times

Re: Open source singing synth.

Post by khz »

Yes.
I can't think of a speech synthesizer with a text input field off the top of my head.

. . . FZ - Does humor belongs in Music?
. . GNU/LINUX@AUDIO ~ /Wiki $ Howto.Info && GNU/Linux Debian installing >> Linux Audio Workstation LAW
  • I don't care about the freedom of speech because I have nothing to say.
User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

Cardinal is a huge complex beastie, and no doubt I'll have fun playing with it. But how is it "Possibly also feasible"? Gimme some clues please.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

Ah in the Tags drop down, there is a "Speech" tag, the only one that is greyed out. lol

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
khz
Established Member
Posts: 1648
Joined: Thu Apr 17, 2008 6:29 am
Location: German
Has thanked: 42 times
Been thanked: 92 times

Re: Open source singing synth.

Post by khz »

Unfortunately, I can't do that.

. . . FZ - Does humor belongs in Music?
. . GNU/LINUX@AUDIO ~ /Wiki $ Howto.Info && GNU/Linux Debian installing >> Linux Audio Workstation LAW
  • I don't care about the freedom of speech because I have nothing to say.
User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

" An alien entity hell-bent on mutilating your audio." lol

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

Cardinal will be lots of fun for a very long time. The closest thing to singing it has is Pink Trombone, basically a mouth simulator, but lots of work to get it to sing actual lyrics.

I'll play with Cardinal later, thanks for pointing it out to me. But I really need to sort out singing soon. Where I type in lyrics, tell it what notes and durations, then get an audio file output.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

Sinsy's source code web site says "Currently, it supports only Japanese." but I want English.

OddVoices source web site says "This project is unstable and in an early stage of development." but at least it says it works under Linux. It sings with an American accent, I want British, Scottish, or Australian.

Utau's Wikipedia site says it only supports Mac and Windows. I did look at it and it's friends before, there's a Linux front end, but as far as I can tell all the voices are Windows, have to be run through WINE, and not open.

Macne's wikipedia says Mac only, which is implied by the name. Again only Japanese.

I'll have a look at OddVoices.

Festival's singing mode is turning into crap. Worked almost OK for the first verse, but the rest get screwed and print errors.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

Compiling OddVoices gives pages and pages of errors.

Flinger also doesn't compile on my system.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

tavasti
Established Member
Posts: 2047
Joined: Tue Feb 16, 2016 6:56 am
Location: Kangasala, Finland
Has thanked: 369 times
Been thanked: 208 times
Contact:

Re: Open source singing synth.

Post by tavasti »

onefang wrote: Sun Feb 12, 2023 3:45 pm

Sinsy's source code web site says "Currently, it supports only Japanese." but I want English.

For some reason it seems to be that many vocal synths seem to be japanese or chinese.

Linux veteran & Novice musician

Latest track: https://www.youtube.com/watch?v=ycVrgGtrBmM

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

I managed to get OddVoices to compile. It sounds as bad as Festival's singing mode, but at least it can be tweaked more, AND I can edit it in MusE since it can grok MIDI files with Lyric events. So I should be able to tweak it to sound a bit better.

I might even be able to write a MusE script to automate the process.

I wonder if I can get Festival to generate the wav file that OddVoices uses to teach itself? Seems feasible, then maybe I can use the higher quality Festival voices that it's singing mode can't use, but with OddVoices.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

One of the programs in my package repos is jcadencii, a port of Cadencii to Linux, and the Debian package includes a mini WINE, which I guess is enough to run the Windows VOCALOID, VOCALOID2, UTAU, WORLD, and AquesTone voice generating backends. Can't find any docs about how to actually set up these backends under jcadencii+miniWINE+Linux. Where would I find open versions of these backends?

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

User avatar
onefang
Established Member
Posts: 148
Joined: Fri Feb 03, 2023 1:17 am
Location: Australia
Has thanked: 67 times
Been thanked: 11 times
Contact:

Re: Open source singing synth.

Post by onefang »

artix_linux_user wrote: Tue Mar 21, 2023 9:26 pm

this?
https://github.com/UtaUtaUtau/straycat

OK so that's a resampler, but I try to stay away from things that want to use things other than apt to install / update dependencies and such. Especially npm and PyPi, which get far too many malware in them.

Think I'm just gonna stick with what I got, and try to unrustify my own voice. After all, in the original "Set the controls for the heart of the sun", most of the singing is mumbled. That was back when Pink Floyd thought none of them could sing.

I prefer to be known as a figment of the 'nets imagination, living in the future, waiting for the rest of you to catch up.
Notes from Untalenz, an untalented old muso https://Untalenz.rocks/

Post Reply