FAQs:
If your question isn’t listed here, take a look in the quick start guide and main doc to see if it’s already answered there. Use the tabs on the left for easy navigation.
Quick: docs.google.com/document/d/1PDkSrKKiHzzpUTKzBldZeKngvjeBUjyTtGCOv2GWwa0/edit
Main: docs.google.com/document/d/1y1pfS0LCrwbbvxdn3ZksH25BKaf0LaO13uYppxIQnac/edit

>Where can I find the AI text-to-speech tools and how do I use them?
A list of TTS tools: docs.google.com/document/d/1y1pfS0LCrwbbvxdn3ZksH25BKaf0LaO13uYppxIQnac/edit#heading=h.yuhl8zjiwmwq
How to get the best out of them: docs.google.com/document/d/1y1pfS0LCrwbbvxdn3ZksH25BKaf0LaO13uYppxIQnac/edit#heading=h.mnnpknmj1hcy

>Where can I find content made with the voice AI?
In the PoneAI drive: drive.google.com/drive/folders/1E21zJQWC5XVQWy2mt42bUiJ_XbqTJXCp
And the PPP Mega Compilation: docs.google.com/spreadsheets/d/1T2TE3OBs681Vphfas7Jgi5rvugdH6wnXVtUVYiZyJF8/edit

>I want to know more about the PPP, but I can’t be arsed to read the doc.
See the live PPP panel shows presented on /mlp/con for a more condensed overview.
2020 pony.tube/w/5fUkuT3245pL8ZoWXUnXJ4
2021 pony.tube/w/a5yfTV4Ynq7tRveZH7AA8f
2022 pony.tube/w/mV3xgbdtrXqjoPAwEXZCw5
2023 pony.tube/w/fVZShksjBbu6uT51DtvWWz

>How can I help with the PPP?
Build datasets, train AIs, and use the AI to make more pony content. Take a look at the quick start guide for current active tasks, or start your own in the thread if you have an idea. There’s always more data to collect and more AIs to train.

>Did you know that such and such voiced this other thing that could be used for voice data?
It is best to keep to official audio only unless there is very little of it available. If you know of a good source of audio for characters with few (or just fewer) lines, please post it in the thread. 5.1 is generally required unless you have a source already clean of background noise. Preferably post a sample or link. The easier you make it, the more likely it will be done.

>What about fan-imitations of official voices?
No.

>Will you guys be doing a [insert language here] version of the AI?
Probably not, but you're welcome to. You can however get most of the way there by using phonetic transcriptions of other languages as input for the AI.

>What about [insert OC here]'s voice?
It is often quite difficult to find good quality audio data for OCs. If you happen to know any, post them in the thread and we’ll take a look.

>I have an idea!
Great. Post it in the thread and we'll discuss it.

>Do you have a Code of Conduct?
Of course: 15.ai/code

>Is this project open source? Who is in charge of this?
pony.tube/w/mqJyvdgrpbWgZduz2cs1Cm

PPP Redubs:
pony.tube/w/p/aR2dpAFn5KhnqPYiRxFQ97

Stream Premieres:
pony.tube/w/6cKnjJEZSCi3gsvrbATXnC
pony.tube/w/oNeBFMPiQKh93ePqTz1ns8

Any updates on MOSS?

>9

File: a1183363622_2.jpg (25 KB, 350x350)

25 KB JPG

>>43516950 >>43558451

>>43515526
https://www.youtube.com/watch?v=FziZYANzCls
https://u.pone.rs/rfxsptss.zip
I made an album recently that uses Delta's new RVC NG for the between-song dialogue. It's actually pretty nice, especially since it's actually possible to get more varied energy out of it for yelling and whispering and such, whereas the old RVC struggled with that. Old RVC is still on the singing though.

>>43516297
Nice!

>10

Can AI operate with flash/toonboom puppets yet? Because now it's clear that generating sloppy shit from scratch will never git gud.

>>43517328

Last bump.

>>43517853
ToonBoom has a product called Ember which integrates with Harmony and does some very limited AI stuff, like extending background images and generating scratch tracks (roughouts of character dialogue that you use for timing your animation until the professional voicework is done). As for 3rd-party AI integration with Toon Boom Harmony, I know nothing.

>>43518906
is it good

File: alignment_progress_fast.gif (631 KB, 1200x400)

631 KB GIF

>>43519891 >>43520316 >>43520672 >>43522322 >>43523460 >>43556109 >>43556453 >>43557351

>>43515531
Nothing on MOSS for now, I've been noticing a lot of people could use something more lightweight for gamedev or other purposes, so last night I began developing a small non-autoregressive model (well, kind of semi-autoregressive because it uses GRUs -- you need some form of autoregression to model pony speech well). This one is 32M parameters.
GIF is on LJSpeech, very first test.

>>43519884
Really good to have news and Godspeed, Anon.

>>43519884
>you need some form of autoregression to model pony speech well
To expand on this point (history time!), I spent the better part of ~late 2023 trying to make a pony VITS, which always failed despite all the upgrades I stacked on it because it was entirely non-autoregressive and thus had no way of modeling how the speech changed over time. Oct 2023 I got a decent Tacotron 2 working with the predecessor of the alignment framework I'm using now: https://zdisket.github.io/conv-att-c/

>>43517853
>Can AI operate with flash/toonboom puppets yet?
You can spend the time training an AI to animate flash puppets (AFAIK it hasn't been done, yet.) Or, you could spend that time making animations yourself.

10

>>43519884
Very, VERY excited to use this for H:E. I think it'll be the default model shipped in the package if it's hyper-optimized for weaker graphics cards.

File: pip 1719060717748766.png (1.74 MB, 2000x2000)

1.74 MB PNG

>>43557884

>didnt even noticed the thread was back 2 days ago in the catalog
fuck me, I guess?
>>43517853
You know what I would love to see? some way for the specialized ai to operate characters inside Blender, since this one already has some python code integrated into it.

>https://u.pone.rs/cltgsbgu.mp4
On kind-but-not-exactly related note, the ai video stuff has really progressed since last two years, now instead of looking whenever somebody has an extra arm or morphs into part of the furniture in the background after few seconds, instead the telltale sign is just audio being weird and not matching what is happening in the video and contextually people just behaving weirdly when interacting with anything for longer than two seconds.
It's nice seeing the more tech literate normies using it to create cool shit, like the guy who is making a audiobook/drama continuation of the ST Voyager.

File: other 1360359.png (1020 KB, 3000x4815)

1020 KB PNG

>>43522025 >>43528650

>https://www.youtube.com/watch?v=730zGRwbQuE
>imagine

>>43517853
How exactly has the last 4-5 years of AI innovation convinced you that it will never improve past what it can do today?

>>43521207
Unf

>>43519884
>>43520316

Can you tell us more about the architecture of the TTS model itself? Is it based on anything, or is it something custom made?

> Also, what upgrades does the new attention framework have?

Has anyone fine tuned an LLM on character personality yet? I'm interested in setting up a roleplay model that uses MOSS TTS for dialogue output

making love with ai mares

>>43519884
Is there a repo for your version of MOSS with all the voice models?

>>43523262
hot

Mares

>10

>>43525311
>11

I really wish the whatever open sourced song models were small enough to run on a 10gb gpus and not requiring 48gb for like 45 seconds of audio like they do right now

>>43524703
snowpity

>>43525749
What models are you referring to Anon?

>>43526330
I think last open source music model was YaE (or some othe rshit with just three letters) from china. It has been a year so maybe there was so e improvements on makir it more useful but I do remember seeing early stara with "use 32GB to create 30s of music in just under 15m" .
Doesn't help that suno and other ai music services really suck balls now when trying to create a proper good sounding music with them. They always are pushing for pop like sounds for some reason.

>https://github.com/Speedstu/CUDA-for-AMD-Windows
Somehow related news, for people with newer AMD cards can use and and run the actual cuda scripts without messing with the Linux processes.

>https://www.youtube.com/watch?v=U7YU0w9Mo_I
>vr game project with ai thinking and ai talking mares
oh shit son, its happening!

File: boop 1780899346428650.png (1.01 MB, 2400x2000)

1.01 MB PNG

>>43527730 >>43529629

>>43527122
mares are for booping

>>43527605
>https://u.pone.rs/irpozdou.mp3
Oh hey, the thread is back. Let me share some simple rvc cover from some time ago (song names is MartinLechowicz - ogrod eden).

>>43527730
comfy

File: lots of money 1745959480789468.png (671 KB, 764x764)

671 KB PNG

>>43529285

>https://u.pone.rs/cwxoechz.mp3

File: 20260208_215353922.jpg (965 KB, 4000x3000)

965 KB JPG

>>43528848 >>43529705 >>43561283

>>43521207
I won't have to imagine, someday

>>43528650
3D printed mares?

>>43528647
kino

>>43527605
boopa the snoofa

>>43528650
we will be looking forward to your project Anon. I find it weird that there isnt really anybody trying to make LLM that can both talk and interact with the outside world using robot arms/bodies.

>Breeze-TTS-2
>minimum gpu required is 12GB
>can create audio at 3.1 real-time speed, with fast enough LLM is may allowed for streaming audio in such speed you can talk back and forth just like in real space
>can clone audio
man, all the tech changed between now and the past six years feel like a magic. we will have ai mares for rest of the time!

>>43530442
:excite:

>>43527122
whatever happened to blob anyway?

>>43526535
>They always are pushing for pop like sounds for some reason.
Probably overfitting.

amres

>>43532366
yeah, I guess whomever is doing the training is grabbing whatever dataset is cheapest to make/buy, and with how much pop trash is overflowing all the radios and playlist, this would reflect the poisoning of the training process.

>https://docs.comfy.org/tutorials/audio/minimax/minimax-music-3
>https://huggingface.co/Comfy-Org/MiniMax-Music-3/tree/main
>ai song generating model that can supposedly work on 8gb vram using comfy ui
welp, I guess I know what I will obsessively try to mend over this weekend, sadly it doesn't look like it can generate the vocals and music as two separate files, otherwise hooking it up to rvc would have made an almost instant pony sang music.

>>43532894
i love them

>>43533644
could be promising

snoofa

>>43527122
promising stuff anon!

>https://u.pone.rs/gwsvgfvy.mp3
damn, look what I just found out, all the way from 2019

>>43536295
vintage

>>43536295
was this uhhh tacotron?

>>43536801
I'm 100% possitive it was the tts they found before tacotron. The one that needed at least 5 hours of audio to even begin the training process .

>>43536974
We've come really far.

>>43537545
in mares

>>43537954
amres

>>43538340

ilovethem

File: RaraEyes2.png (479 KB, 1800x1800)

479 KB PNG

>>43540021 >>43540570 >>43540909 >>43541310

https://u.pone.rs/gzapkdtb.wav
Playing with new Suno. I put Pony Zone through it.

>>43539562
thats pretty nice, but both the instrumental and vocals feel like they are missing 10% of extra "umpf" to make it really good.

>>43539562
not bad

>>43539562
Can't wait to test out the "suno at home" model to see how it really compares to the online models.

>>43539562
unf rara unf

snowpity

Post from the sister thread /chag/, that Anon really cooked something really fucking good here
>>43541285
>I asked Opus 5.5 to create an MLP RPG video with code
>https://u.pone.rs/rlvvvpsw.mp4
>>43541680
>It's just:
>>Using only code, create a very cool video of an MLP video game RPG, SNES style, with HP bars and stuff.
>It's minimalist by design, since I wanted to test some of the claims that were made about its ability to do that. I just let it run in the background with Claude Code until it finished.
>>AI video generation
>Keep in mind there is no AI image generation or video generation. Anthropic doesn't have those.
>It wrote a SNES-style pixel renderer in code and constructed everything with that. Same for the music.
>>43541456
>Asked it to isolate everything. So here are the sprites, backgrounds, musics and sfx.
>https://u.pone.rs/oqtrcmto.zip

>>43542043
oh wow

What's the best way to get a moan or groan from SoVitS 4.0 settings?

>>43542493
Holy moley.

>>43542493
>sex hacker
What is that?

Anyone want to help me with a half lewd SFW sex hacker game for possibly this upcoming gamejam? SFW meaning no genitals showing...
https://pastes.io/KJVSMmia

>>43542043
that sequence at the end where all the M6 came together was friggin kino. AI is slowly getting less sloppy with each new release. we will unironically start genning our own MLP episodes in 2027.

>https://www.youtube.com/watch?v=aB8prowklyg
poni ai stuff

>>43544142
noice

>>43533644
>The comfy version that has all the cuda working is not able to run the workflow due to outdated notes
>The new comfy version with updated nodes is not able to run it because of incompatibility with old cuda drivers
>BUT the cpu version can open the workflow just fine
>after 15 minutes the model generation didn't even moved to 1%
Fuck, the python module compatibility are one again kicking my ass. I will need to sit and think about this because having offline music generator sounds rad as fuck.

>>43545000
Are you using the python version or the standalone one?

>>43545000
>https://u.pone.rs/iqoitdyt.mp3
Gentlemen, we got them, the suno at home

>>43545928
>>43533644
This was the initial test, using the lowest quality models from minimax music3, the first clips I made was just 5 seconds and it took 2m50s to generate some instrumental (despite adding some text for it to sing), then I generated some 10s clip and that took about 12s to makes so clearly the early time was just from model taking its time to load up. For the 30s clip it took 39s to generate however I did noticed that the node set up will crop a second or two from the end of the generated clip, so now everything has additional 2 seconds added .
To load the int8 diffusion, text and vae models it took just about 20GB ram (how much vram? no fucking idea, my installation of linux decided to be a piece of shit and break whatever code that was able to monitor the vram use on my end).
Im now testing the mid tier models fp16 and I can see its already too 27.6 ram, its been 20 minutes and it looks like its only just about half way done.
Also one note, for whatever reason the comfyui MM3 nodes will not save the audio automatically, and when connecting to specialised mp3 nodes it will throw a pissy error about arrays not matching, so sadly it looks like I wouldn’t be able to just load up batch of 20 songs and let it run overnight (however, this could be just me problem, because I had yet to see anybody else complain about it)
>>43545343
on the windows I first tried doing some specific version (cant tell you which ones, it was ages ago) , but every time there was some update, modules just got over riden and things just randomly stop working. Above I was trying to use the premade zip environments that come from official website but as you seen that was unsuccessful.
As for my linux set up, I just downloaded the official appimage file and let it install whatever it needed to install to make it work. Other than audio not saving automatically it looks like it all works just fine.

>https://u.pone.rs/eauqqatx.mp3
...and it crashed, I guess using mid and high tier models for music generations will be limited to people with battlestation loaded with 16~32 Vram and 64Gb ram.
Im not planing on dumping all the music slop I may end up making in the thread, however now that I don't have the "you can only make X gened clips per day" hard limitation hanging over my head, I can finally look into some old musical projects.
Also I discovered that the audio files indeed are being saved, however insead of using the "output" file inside of its folder, like a normal program would have it set it, it created a "comfyui-shared/output" in the home directory, to dump all the files as flac. So at least that mystery was solved.

>>43546118
comfy maresic anon

>>43546118
Have you worked with a node based workflow before anon?

So, ElevenLabs V4 came out and I think the instant cloning might be the new SOTA compared to MOSS-TTS-PNY. The voice is insanely accurate (about 95% accuracy compared to MOSS' 100%), with the remaining inaccuracies being slight enough for RVC to be more than capable of resolving. The emotional delivery and control is a substantial step change, too. The only issue rn is that Elevenlabs, even on the >$20 creator plan, still jews you out of lossless wav output format and limits you to 192kbps mp3.

Here's how it handles Pinkie, one of the hardest voices for TTS software to accurately depict: https://files.catbox.moe/fn48ru.mp3

>>43548829
and here's twilight: https://files.catbox.moe/bmtibk.wav
and a very brief audiobook i slopped up with both of them: https://files.catbox.moe/v9wckn.wav
i was able to get wav outputs too, for some reason

>>43548829
okay, listening to it again, i think SOTA is overdoing it. MOSS still mogs for now, but I think a combination of MOSS for more prosaic lines and 11labs for the more adventurous and complex lines is the ideal.

>>43548742
No, this is my first time messing around with confyui (with exception of trying to run some image stuff like a year ago). The only changes to the original that I made was editing the MM3 main note to output the seed, and download some GitHub that converts the INT to text so I could use the seed numtas part of the file name .

>>43548829
>>43549146
one last post. I decided to crank up the similarity slider all the way to 100 (it was at 75% before), and i think it sounds even better than before. also cloned dashie and rarity's voice, and they sound pretty swell, too.

https://files.catbox.moe/85peyw.mp3
https://files.catbox.moe/icynpq.mp3
https://files.catbox.moe/9lajv1.mp3
https://files.catbox.moe/8ddwul.mp3

>>43549657
waow accurate

>>43549657
not gonna lie, this sounds almost perfect if not for some odd focusing on some parts of the words, pauses (or lack of them) and the flow of speech, but still its like 95% sounds like it could be some kind of unused clips from show archives.

mares

>>43551422
This

>>43549657
I don't often check this thread (only when I see it on the front page), but if this is the level what can be achieved then damn. Pretty good. If you ask me to differentiate between this and the actual VAs I would be in trouble.

>>43552205
yeah, now all we need is that anon that was working on a program that converts normal stories to script-like-format to create a version of this app that could work without all the python jank and we are almost near the steps of having an automated pipeline of fics being converted to professionally sounding audiobooks.

>>43548829
>>43549657
These are amazing, way beyond anything I ever imagined would be possible way back when PPP started. Even if it's in the hands of the Jews for now it's super encouraging to hear this level of quality, especially if it doesn't require a reference voice recording as input.

How much effort did it take to put them together? All generated from one take or did you need to edit together several individual gens?

>>43549657
>7 years later the only way AI voices sound good is via a closed paywalled platform
Fuck this shit takes too long, I thought we'd fully own mare voices by now

>>43552909
Just one single take, crazily enough. I did have gemini place inline emotion tags intelligently in the generated story, though, which is partly responsible for the expressiveness.

i'll drop the dataset i used for instant cloning tomorrow once i finish the rest of the M6, if anyone wants to jew out the bux for 11labs

snoofa

>>43515527
>>Do you have a Code of Conduct?
>Of course: 15.ai/code
lol xd lmao

>>43553823
We should REALLY update the thread OP

>>43552949
>I thought we'd fully own mare voices by now
we did

more conversation tests. Twilight and Pinkie streaming Minecraft
https://files.catbox.moe/g9y34c.mp3
https://files.catbox.moe/ekzsb8.mp3

>>43552949
Delta stuff is like 94% there

>>43554149
neat!

>>43554360
yup

>>43552949
*Closed paywall platforms that use our incredible amount of fan labor as a basis

>>43519884
Kickass man! Thanks!

>>43519884
+1 for interest in a smaller tts model

>>43519884
BLESSED

>>43520720
>specialized ai to operate characters inside Blender
Like create animations or use as an avatar?

>>43516297
kino

>>43548829
>1:30
>2:10
holy fuck
Pinkie's laughter is unironically one of the most precious sounds to me and it's been so hard to clone historically
if you're telling me an AI can finally just let me listen to her being all giggly and sweet I'm gonna fucking cry

File: jail time for filly 2016471.png (762 KB, 2000x1550)

762 KB PNG

>>43558715 >>43559281 >>43560857 >>43563537 >>43614001 >>43619502

>https://u.pone.rs/booklrom.mp3
BEHOLD, first /mlp/ song done with minimax 3 (and rvc/sovit voice conversion). Lyrics written by >>43544247 Anon

>>43558702
shit, I fucked up, that was mppp OP, lyrics are here its the >>43552239 poster

>>43558702
>>43558715
Overall it is good!
A few words got pronounced pretty badly (bureaucratic, requirement), and I expected the last sentence to close the song completely (instrumentals already closing at "Raise your glass to Pissfilly").
Maybe some anon could rewrite the lyrics a bit so it flows better.

>>43559281
Yeah, there are some problems with the two generated test pieces were it swapped few sentences around. I feel like its good chance its caused by the use of the low tier int8 model, sadly I don't have a 24gb vram to test out the large minimax 3 music models to compare the quality (some Anons on /g/ stated that it has clearly reach the same quality as suno outputs from last year).

>>43554149
These were super cute. I listened last night in bed with the other ones. Thank you so much for making them, Anon! All of the audio files got put into today's rewatch Cytube by the way, people were overall very impressed with the high quality. Super exciting times.

>>43542043
thanks for the zip anon!

>>43558702
Great stuff Anon!

>>43528650
If I don't get to fuck a real 3d printed llm powered and ai voiced pony by this time next year I will be incredibly blueballed.

>>43551422
mares!

>>43562206
I love them!

>>43558702
noice! Love seeing board collabs.

>>43563537
+1, I wish there was more collab projects between Anons

>>43563771
Dunno, would people here be interested in making a musical AI album ? I think I remember ages ago Simone joking about making "Trixie the musical" but that was ages ago when Talknet was still the hot shit on the board.

>>43564613
Sounds like a good idea.

File: 1520246.png (1.44 MB, 5000x9347)

1.44 MB PNG

>>43580158

Bumping!

>>43564613
I actually made an AI album as a personal joke to shitpost about a friend once. I didn't do any fancy AI vocal changing shit, was just raw on Udio, but re-genning over and over again to get the sound I wanted took absolute ages. Granted, it all depends on what kind of AI usage you're talking about. If it's more like what BGM and Vul do it's basically just normal music composition with AI vocals.

>>43566409
>>43566056
I was thinking more along of picking a fic (or even better, a green text), chop it up into story element pieces and let ones Anons write the lyrics for these parts of the story + provide references of what the vibes they are going with and people with good GPU (or willing to have struggle session with online services) could generate the music with AI models, and from there it's going to be standard vocal/instrumental separation and conversion with Rvc/sovit/Delta models to pony voice.
>BGM and Vul
If they lurk in the thread and choose to join in, it would be super cool to have a high skilled musician help with a track or two.

>>43549657
>>43554149
call it morbid curiosity, but now i want to hear an audio where twilight sparkle turns evil and betrays her friends

>>43567473
What do you mean by this Ree stop banning local mobile ips you janny fucks!

mares

>>43568558
and mare accessories.

>>43567982
exactly what i said. she turns to the dark side, perhaps she believes she's been nothing more than celestia's pawn so she turns against her

File: dream of living in equest(...).png (939 KB, 1216x5176)

939 KB PNG

>>43578880

>>43566693
I always liked reading this thread with Anon recalling schizo dream of living a full life in Equestria, but the way is told is very unorganized with lots of stuff personal sol happening here that just wound't make for an exciting flow of story.

using the new voice tools to create some OC. hopefully i finish this by tomorrow but have a WIP for now

https://u.pone.rs/hqzpqgog.mp4

>>43570246
kek
good WIP anon

>>43570246
hey beter

>>43570246
nice, looking forward to see the finish bit

>>43570246
lmfao

mares

>>43549657
Rarity is the least accurate here by a mile. Doesn't capture the modulation or intonation of her voice at all. Her voice dips and rises, and her median is much lower than this, giving it that velvety texture. She's stuck at a ~80-85% of her high here.

The rest of these are great.

>>43570104
neat green

>>43566084
mares go ooo

>>43578880
Yeah, it's little bit unorganized, but I like how Anon was was presenting the life of an farm bumpkin (well, a peaches in his case) and have develop an unusual musical taste.

>>43548829
>Season 2 with Season 1 bubbliness.
>She sounds like FLuttershy when she whispers

One more thing you faggots and 15.AI asian /fit/ faggot never understood is that S2-S9 are corrupted data and only S1 is quality data.

>>43549657
Man these are really amazing.

I love them!

snoof

>>43584059
It could be possible with the audio clip clone option select the specific season/episode version if the voice of a pony, I'm pretty sure someone did that with Sweetie Bell doing her squeaky voice in S1-S2.

I haven't checked in with you guys in years. I just wanna say I appreciate all your hard work.

which models are the fastest? I want to make a Semi-real-time text reader I'm okay with it sounding a little bit shit compared to the best ones

>>43595298
There was someone in /chag/ posting a model that was pretty fast, Delta model is petty fast but due to my pc problems Im not able to test how easy/hard is to make it work locally.
For a theoretical use, this model >>43530442 has option for voice cloning, so it could be possible to use longer clips of mane6 to copy their voices and have them speak at 3* real time speed.
Alternatively there was that REALLY old "DeltaVox RS plus 136 speaker" thats just simple text to speech BUT that one is bit annoying in use since the dictionary on how words need to be spoken in locked in and naturally ponies tend to pronounce things in a very retarded way for some reason.

>>43595338
>https://huggingface.co/HoppouAI/Breeze-TTS-2.cpp
had a quick look at huggingface and apparently there is a quantized model that is able to run on just 1GB of vram, once again, no idea how or if it works.

>>43595338
I looked through /chag/ And I couldn't find the model you were talking about can you link it

>>43599097
>>43577121
>Pony TTS app supporting SillyTavern: https://drive.google.com/drive/folders/16Ss26VBmgzcSuTGzhaHqRuyVRceTf-YB
ohh, yeah it looks like it's just slightly modded styletts2 and gpt-sovits from here.

>>43599751
Thanks anon!

File: 1674476894226144.png (2.18 MB, 1920x1884)

2.18 MB PNG

>>43604721

>>43601713
not a problem, I kind of fear that with all the pushing for advancement for whatever is newest and shinnies tech we may potentially loose some diamonds in the rough. Like I would love to be able to have mane6 run on the same tech as Microsoft Sam, however from the looks of it trying to wrangle SAPI voice set up into anything useful is next to impossible (or at least M$ is super stingy with sharing any info about it), which is shame because I feel like a lot of old tech like this could be perfect to somehow integrate into a single program on phone and have an instant mare-in-a-pocket.

>>43601740
They're still that protective over that old tech?

>>43604721
More like they used to be protective for it, but now its kind of abandoned and since none of their code monkies had made archives of the production process, it's now partol of forgotten technologies, just like Roman concrete.
Maybe some of them still have the how-to-do instructions on some old laptop that's sitting at the bottoms of a huge pile of e-waste but who knows, at this point it would probably be easier to recreate the tech, or make something that works on similar principles.

>>43605520
grim, maybe it can be reverse engineered with AI?

>>43599751
yowza!

>>43609728
>>43604721
>https://reactos.org/wiki/SAPI
>https://mare.by/HA00XiBx.txt
Looks like I was bit wrong (maybe?), I dont really understand the whole SAPI stuff so I asked the copilot to explain it to me, the above is bit of a mess since copy paste to text didnt work so well but at least it kind of pointing into the right direction, such as that there are API docs from microsoft websites (im looking at one for sapi 5.1 and that huge bitch is a 3k page pdf).
The first wiki link here suggest there are existing tts engines that can be used to get the custom sapi 5 voices working, the most interesting one looks to be the RHVoice, since its open source and they state they have versions that can work on windows, linux and android.
So not a lot of how-to-do-it, but at the same time its not a complete information black hole either.

>>43558702
this is really good, I'm glad I checked this thread

>>43614001
Yeah, having all the music ai stuff set up locally feels great, knowing I can ask it for whatever lyrics, vocals or style I want without worrying it will end up rapeing my wallet after few minutes of genning.

>>43616393
sunbeam

>>43558702
Woah mare music.

mares

File: GM__PP_MareGiggle_FULL.gif (1.88 MB, 416x224)

1.88 MB GIF

>>43627019 >>43627164 >>43629653 >>43640070 >>43643341

Turns out LTX 2.5 is pretty mare capable despite not being fine-tuned or LoRA'd on show data and other mare related content (yet).

In my experimenting, I've been referring to these as "Gibbermares" as they often speak gibberish when not specifically told what to say. So far it seems pretty useful, especially for emotional vocal delivery. Although in its raw state, the accuracy is really only consistent with the Mane 6 and Starlight (kinda), it struggles with other mares and even Spike.

All audio in the following clips are unmodified; no passes through RVC or the like.

[Pinkie Pie]
Mare mare mare // Artificial // Gibber
>https://mare.by/afcNDNeX.webm
>https://mare.by/3M3jMhdn.webm
>https://mare.by/nTlyyerX.webm

[Applejack]
Look what we got here // Love Rainbow Dash
>https://mare.by/pDUt3X1h.webm
>https://mare.by/nSFjdpod.webm

[Fluttershy]
Temple mare // Real Equestria // Gibber-sing
>https://mare.by/KsYcsYBo.webm
>https://mare.by/VtXLH8qw.webm
>https://mare.by/rdPvbYzK.webm

[Rainbow Dash]
Anon shook it // Gibber
>https://mare.by/PzWuPMeu.webm
>https://mare.by/4MRwasUE.webm

>>43626948
fake

File: GM__SG_Pretend.gif (3.05 MB, 416x224)

3.05 MB GIF

>>43643341

>>43626948
Forgot to mention that mares of this accuracy were mostly done via i2v (Frame to Video) which is preferred for optimal style and character adherence; more than t2v anyway.

[Starlight Glimmer]
Changed // Mare mare mare
>https://mare.by/7spMCHyf.webm
>https://mare.by/ZcLFYkeK.webm

[Twilight Sparkle]
Repent Anon // Gibber
>https://mare.by/Tp8U34f7.webm
>https://mare.by/uIwnGwop.webm

[Rarity]
Gibber // Mare mare mare
>https://mare.by/pzyvMPf1.webm
>https://mare.by/PWPOc1jQ.webm

Mares

>>43626948
>https://mare.by/4MRwasUE.webm
Poor Dashie suffering from a stroke.
Looking forward to see when this tech will be able to do next year.

>10

>>43545928
Suno started digging their grave as soon as they imposed the download limits. Now there's no reason to use them given the rise of open alternatives. Along with being able to pair any language model (including uncensored) to feed the lyrics.

There a full version of this chill jazzy track?

WIP, does anyone know how to get a cleaner vocal removal from the song? Also advice for getting the best out of a model. thx
https://u.pone.rs/bxmurleb.mp3

>>43635774
Ultimate Vocal Remover 5. Ask AI how to set it up, the best settings, etc.

File: Special Mares.png (175 KB, 448x420)

175 KB PNG

>>43635774
>>43636530
UVR5 was my go-to as well, but kept breaking too many times for me and was awkward to process multiple files. So now I just use audio-separator and use the following .sh script to separate files. Keep in mind this bash script was made for my own system, Linux Mint, so might need to be modified accordingly.

Ask the AI of your choice on how to setup audio-separator, install the models with audio-separator, etc.

Batch Script (Change .txt to .sh) = https://mare.by/d9ZGDypr.txt
Models List = https://mare.by/YU6PYObE.txt

^ The above is also a useful resource for seeing what models are available and what they're good at.

>>43635329
>There a full version of this chill jazzy track?
Sadly, no, it was just me messaging about with te minimax prompts , which annoying I did not saved. I may try to recreate it to get something that kind of sound similar to it but it's gonna be up to the rng gods of ai generating to see how close it will sound to that version.

>>43626948
>LTX 2.5
I dont really follow all the animation models so far, do you happen to know how much of the new stuff that come out depends on providing it with a reference image(s) and how much can just generate things from just internal training?

File: ltx_2.5_Earlyt2v_Suddenly(...).png (560 KB, 1158x627)

560 KB PNG

>>43643341 >>43653542

>>43640070
>how much of the new stuff that come out depends on providing it with a reference image(s)
I've only really tested LTX 2.5 so far due to the rising evidence there's plenty of 2D animation in its dataset. Whereas the rest of the are too "buh the realism" to be that useful for mares unless trying to get a Pony IRL type stuff. As with any AI, the more information you give it the more it'll understand and try to better predict the desired outcome, but can also constrain the creativity.

>how much can just generate things from just internal training
It certainly is capable of understanding and generating G4 mares with a well structured prompt even with t2v. Unfortunately with a lot of 3D bias present with the mode the amount of G5 garbage nudged me to focus on i2v instead, which makes it at least 95% less likely to generate 3D mares, and instead adhere to the show's style. Additionally because the style and identity is interpreted from an image rather than text, the character names and style is less likely to leak into the dialogue. The amount of times I heard mares say "Friendship is Magic 2" or reading the prompt word for word in character

Here's some of the first generations I tried with t2v type generation:
>https://mare.by/OxFa9Bvu.webm
>https://mare.by/0LxwC2G2.webm
>https://mare.by/9gVdXOkl.webm

Also randomly got a full on Peppa Pig generation when the prompt contained only pony; there's apparently a lot of data of that too that will need to be biased away from.
>https://mare.by/3hbVDlVP.webm

>https://mare.by/PhShhRiS.wav
Oh hey, audio shitposting is back

emergency thread save, sorry for dry bumping but this is literally in the last slot on the cata

>>43626948
>>43627164
>>43640558
Absolute diarrhea. Is there no way to make it use flash rigs?

mare

>>43644211
fake

File: ComfyUI - Gibbermares v1.png (315 KB, 1536x639)

315 KB PNG

>>43644933 >>43644937 >>43645423 >>43650493

ComfyUI Workflow
"LTX 2.5 i2v - Gibbermares v1"
>https://mare.by/7oMCGjnh.json

[Example]
Start frame -> Output
>https://mare.by/IgbbgQpN.png
>https://mare.by/EooMNxuA.mp4

>>43644482
Berry interesting set up Anon

>>43644482
thank you for this

>>43644482
lmfao

>>43644211
Indeed

>https://www.youtube.com/watch?v=svrdRAoIlxM
>I Made the Best Green Screen Tool 100x Better!
Sorry for posting a not pony related video, but this is still kind of neat ai tool, the guy from CorridorCrew made a new version of a greenscreen processing model that is able to compete with the expensive on-the-market programs, and its completely free (one of the impressive examples was guy wearing green clothes on a green background and the mask layer was able to create the cut out footage of him perfectly).

>>43643341
3D AI animations already do that but with 3D rigs. It should definitely be possible with 2D rigs

File: aj and mum guitar.png (433 KB, 1800x1200)

433 KB PNG

>>43647818 >>43656083

>https://u.pone.rs/argfaxuq.mp3
Simple rvc cover, AJ - Everybody Knows, (source Cover by Cleo )

>>43646078
very cool anon thanks for sharing.

>so much slide threads
I guess some chuckleheads have nothing better to do than than shitting up the front page.

>>43646990
grim

>>43646378
nice work Anon.

guess what
mares

bump

>>43644482
cool stuff

Lurker here but just wanted to say I really appreciate the efforts of the thread.

poned

>>43640558
Holy shit these are amazing, kek. The constant "Friendship is Magic 2" like it was the only word they knew how to say is hilarious and I love how it just shat out Peppa Pig for no reason. Do you have any other amusing ones? I don't care if they're slop, I love seeing weird AI gens, especially when it's pony, so post as many as you want if you do.

And what hardware are you using, by the way? I really wanna get a better GPU at some point but I'm kind of waiting on AMD's RNDA 5/UDNA stuff to drop first.

>>43653542
>AMD's RNDA 5/UDNA stuff to drop first.
Any AI accelerator stuff in that?

File: MareVHS.jpg (268 KB, 546x308)

268 KB JPG

>>43655573 >>43655612 >>43656820

>>43653542
Recently major upgrade. Primarily to do these types of generations. Also to get back into training RVC mares locally and some secondary non-mares (Protectron from FO4, etc).
Upgraded to an RTX 5060 TI (16GB), and downgraded my MOBO to DDR4 so I can make use the cheap 64GBs of T-Force RAM (3200MHz CL16)

>Any other amusing ones
Just finished the 7m41s compilation. Featuring all M6 + Glimmy + Trixie (Although she in particular is unspoken)
https://mare.by/yCRGXUAr.mp4

>>43655043
kek

>https://u.pone.rs/xcmpxxip.mp4
I was reminded of it recently so, lets enjoy it again
>>43655043
nonsense mares talk is cute

>>43646378
Manehattan accent Applejack.

>>43655043
The fucking editing like it was it's own slop anthology was amazing.

Ponk's BLUBLUBLUBLUBLUB at 2:03 into the transition of her, like, getting split in half fucking sent me, as well as the dumb Twilight stare with the buzzing at 7:05. Very very fun watch, I really liked the gentle humorous analog horror thing you went for like you were watching fucked up half-baked windows into Equestria or something deranged. Thanks for taking the time to make it. Did you make the transitions yourself? They're very fun, gives the whole thing fantastic presentation beyond it just being weird slop outputs.

>10

File: StaticTwig.png (269 KB, 429x332)

269 KB PNG

>>43660231 >>43660958 >>43663221 >>43664979

>>43656820
>gentle humorous analog horror thing you went for
The idea went from needing fillers between clips of the compilation -> finding generic white noise boring -> feeling nostalgic and wanting to replicate the bygone era. In the end found it fun to blend the technologies of the past and future; Synthetic mares captured on magnetic tape. Growing up in the analog times definitely helped, there's plenty of now relic tech I miss from then.

>Did you make the transitions yourself?
Kind of. These VHS effect transitions were all generated via Google's Flow (Omni 1.1 specifically). In part because the effects I tried to generate in WanAlpha were complete ass. Omni has a lot of style adherence and variety to get good effects, as well as enough mare knowledge to have them present with decent accuracy. Also moderately accurate with smaller details like Cutie Marks and matching FIM's visual style.

It however isn't as good at full mare clips however because of a number of factors: Either it doesn't know their voices or it forcibly replaces the audio because censorship. Generations offered through online services will never have the privacy and file management of local gens. Omni uses limited Flow credits and is proprietary/closed, whereas LTX is open-source, can generate mares endlessly and flexibly, and can be fine-tuned for further refinement. To get the most out of it, you'd have to pay; but even without a subscription everyone gets 50 credits daily, which is enough for 7 x 360p clips of 10s each. So the math works out for visual effects and transitions but not for anything usable for long form content. I get about 40 good VHS transitions per 70 credits. Which is all I currently need it for.

[Omni 1.1]
Twilight VHS Effects - 4 of 41 (Batch 1)
https://mare.by/9mUexluH.mp4
Various VHS Effect - 41 of 41 (Batch 1)
https://mare.by/FjbnbWBU.mp4
Pinkie and Applejack - Visually coherent but wrong voice
https://mare.by/OPLWFRM2.mp4

>>43658769
neat

>>43658769
>Pinkie and Applejack - Visually coherent but wrong voice
>https://mare.by/OPLWFRM2.mp4
ooo, that looks pretty decent, like if somebody got their hands on the flash assets and was messing around

>>43660958
that last second expression change has me dying

>>43661397
oh my fuck I didn't even realize that
the fact there's a fucking microwave ding when it happens is destroying me holy shit

https://www.instagram.com/p/Dd-Xmh9KSbA/
https://u.pone.rs/vyhsprbd.mp4 (same vid just pone.rs if it's easier)

Man, someone alerted me to this video and apparently this is AI? It gets the art style near perfectly, and not only that, the personalities in the animation is on point, too. I legit thought this was made by a person because Pinkie was so perfectly Pinkie in the way she was moving and expressing herself.

>>43662447
author said it was made using Higgsfield Genjutsu, you need a subscription and it's proprietary so you can't run this locally anyway.

>>43662461
Oh shit kek my bad I should have stated, 'cuz I know. Seedance 2 did some pretty impressive ponies as well so maybe it's not that big of a surprise, but, yeah - for me moreso it's cool seeing the proprietary stuff getting ahead because the local stuff is usually trailing behind by only a year or two.

I can't wait to have homemade AI mares that good, you have no idea.

mares

>>43658769
Looks nothing like actual VHS. Shitty zoomerslop.

>>43658769
Late response as I forgot to reply, but shit, thanks for sharing, this is really interesting. I had a buddy sub to the high tier subscription when Omni first dropped and was blowing everyone's mind, but it's cool to hear more about it.
Also if you don't mind me asking, what was the prompting for the VHS transitions? And did you ask for it to make multiple VHS transitions within a longer video or did you just make clips individually, or what? If Omni has free credits daily I might play around with it a bit as I love video gen.

also wew, went to go test out Omni 1.1 and the LLM hallucinated that it could use audio references for some reason, so I went and generated some memey pony audio in hopes it could get better voices

but alas, I got a few sentences all put together in Audacity and exported only for it to say it couldn't actually use them, jej

File: CosmicLimare_ReverseLoopSmol.gif (1.9 MB, 320x180)

1.9 MB GIF

>9
I love when random mares leak through. Their snowpities must be potent to be able to push through the bias of canonical mares unprompted. Here's a couple liminal mares plus some odd Pinkie and Applejack outputs the AI invented in the past 80 output or so:
https://mare.by/L95tVbX8.mp4

>>43662447
>>43662461
>https://u.pone.rs/vyhsprbd.mp4
That clip was really good! I only spotted like... 5-6 minor errors in the Ponk frames. I look forward to the time when proprietary models like Sora, Omni, Genjutsu, and the like finally get small enough to not need third party services for that level of quality without the drip feeding and censorship. Even LTX while moderately mare capable, it still needs a pretty beefed up system to run (~32GB RAM divided between GPU and CPU).

I could imagine the following workflow. A Sora equivalent inventing an overall scene using its creativity and flexibility, Genjutsy equivalent afterwards to enhance visual fidelity for accurate mares, and finally an LTX equivalent for the audio pass so the mares have more accurate voice.

Speaking of, Sora had some fun outputs before it was killed off:
https://mare.by/Phyh7wPQ.mp4

>>43664979
Google Flow uses a language model as the interpreter, so the more written instruction you provide the more strictly it'll try to adhere to it. This is also how you request the resolution, video count, duration, etc. One additional benefit to this is that if the output is shit you can tell it what it did wrong or what it needs more of, and it'll do more with your requested changes taken into account.

Most of my 'VHS' prompts were variations of the following, it's way more credit efficient to ask for multiples version in the one clip:
https://mare.by/C08iHVdO.txt

>>43662917
indeed

>>43670485
isneed

File: inseed.png (102 KB, 311x224)

102 KB PNG

>>43673447

>>43672193
inseed

>>43672616
in mares

>10