[ home / bans / all ] [ qa / jp ] [ maho ] [ f / ec ] [ b / poll ] [ tv / bann ] [ toggle-new / tab ]

/maho/ - Magical Circuitboards

Advanced technology is indistinguishable from magic

New Reply

Options
Comment
File
Whitelist Token
Spoiler
Password (For file deletion.)
Markup tags exist for bold, itallics, header, spoiler etc. as listed in " [options] > View Formatting "


[Return] [Bottom] [Catalog]

File:MSIAfterburner_goh6KzKnsS.png (3.02 MB,3369x1068)

 No.324

Last year I did a bunch of experiments with Stable Diffusion image generation stuff and of course one of the first things I did was create Kuon and Aquaplus LORAs for my own personal use. Well, now for SDXL (specifically Pony which is a finetune of SDXL so that it's actually usable for this kind of thing) is now something I wish to try, I have begun the process of getting Kuon in higher quality. By that I mean, higher quality AI generations! Kuon could not be any higher quality herself!

The first step of the SDXL Kuon LORA process has begun after a week of careful image cropping, editing and tagging! Yes, you don't need to be this specific about it, but it's worth doing. I've started the style training thing before going to bed, but I still need to create a curated set of Kuon-specific images to train the concept of her appearance for the second part! It will take me another week or so to gather all those and carefully curate them, but since I'll be looking at images of Kuon the entire time it won't feel like work.
Well, assuming this first style thing works. Who knows what I'll wake up to? It could be a huge mess since I'm not quite accustomed to this SDXL stuff.
KUUUUUUUUUUUUUUUUOOOOOOOOOOOOOOOOOOON!

 No.325

File:Utawarerumono.S02E01.False….jpg (166.3 KB,1920x1080)

Oh. and did you know? This is the first Kuon thread of /maho/. It can be considered a real board now. Pretty cool, huh?

 No.326

File:python_rV0MtSPjeJ.png (51.25 KB,702x1201)

This stuff goes way over my head. Unfortunately it seems like most of it is undocumented and just relies on experimentation. You can search around for the words but uhh.. most people just say stuff like "you'll have to test it out yourself and see if it works". I did download a preset I saw on 4chan's /h/ so I guess I'll see how it goes. I don't remember it being this complicated last time, although I guess people were more in the dark and just threw stuff out there.

 No.328

File:cmd_7M2XzLP1t3.png (45.85 KB,801x577)

Cool. I have no idea what the error is since it's listing it 10 times. I think it's the "save and resume" option that I ticked on? I guess I'll turn that off and see if that fixes it...

 No.354

File:e9fc60db9110a441763df9402b….png (509.83 KB,600x800)

>>325
I was thinking I'd wait until I have something to show for it, but now I gotta say it... I've been working on a programming language for the past couple days and I'm calling it Kuon!!
Kuon Programming Language... has a nice ring to it, I think.

Anyway, yeah, sort of off topic for this thread, just thought I'd mention it. Kissu has a lot of tech people apparently, I thought it was just vermin and 1 or 2 other anons until this board opened

 No.355

File:explorer_71zBucdVEE.png (1.3 MB,1781x1100)

Hooray! It seems like it finished some training rounds while I was away! The triton error is some optimizer that only works on linux, but I don't know what the other stuff means. Well, if it works then it works!
Looks like it will be a couple hours until it's done with the last epoch thing? I think I'm "overbaking" this, but I'll find out once it's done and I can actually boot up SD to test it out. Although I'll be able to test out the 'style', I won't be able to specifically prompt Kuon. I could get the hair and eye color and stuff, but not her specific outfit and and face. She does look similar to other characters of the same style, of course, perhaps closest to Tama-nee, but still a bit different.

>>354
!! WHOA! THE KUON LANGUAGE?! Now you're speaking my language! It's going to be beautiful and elegant, right?
I'm not a tech guy, though, I just follow instructions and FAQs for this stuff to accomplish limited goals.

 No.356

File:sample_90214cc2c059c098b5a….jpg (34.5 KB,850x607)

>>355
>It's going to be beautiful and elegant, right?
I'm more so going for something very practical but easy to write. So instead of going in a direction of pure elegance like lisp or haskell, I'm more so doing something like mainstream languages, merging a lot of different ideas together and trying to keep it simple and very light on syntax.
Now that I think about it, that sort of feels fitting for Kuon... her whole appeal isn't just beauty, after all, she's a very capable and independent person with lots of different qualities

Anyway, I'm still trying out a bunch of different ideas, but I've got a rough idea of what the language looks like in my head with some things written down

 No.357

File:kuonfan.png (1.12 MB,1173x659)

>>356
Cool! I have absolutely no idea how any of that works, but I love the name!

 No.359

File:Grabber_yQRK0siQZF.png (70.76 KB,745x788)

My hard drive is becoming slightly more Kuony.
I'm not sure why, but gelbooru has over 1,000 Kuon images whereas danbooru is at like 300. Gelbooru does have lower standards and has stuff like terrible nude edits and so on, but that's not going to be very many here. Very strange.
Funnily enough I was using Grabber before all this AI stuff happened and it turns out that it's also a fantastic tool for AI purposes since it bulk downloads and labels stuff with tags.

 No.360

File:firefox_CGnBbBYBQM.png (1.41 MB,1164x605)

!!!!!!!!!!!!!!!!!!

 No.361

File:''lemonade''.png (221.13 KB,478x526)

>>324
>UUUUUUUUUUUUUUUUOOOOOOOOOOOOOOOOOOO
>>359
>Kuony

 No.362

>>360
cursed

 No.363

File:xyz_grid-0008-score_9,_sco….png (8.79 MB,4032x3072)

Hmmmm... I did a bunch of testing and while it's somewhat good, I'm not happy with it. The style really isn't there. The general concepts are there such as animal ears being on the side and how the :D face should look, but general style needs work.
The total training of the 5 epochs took about 7 or so hours, but it turns out the last 3 epochs were actually too noisy, so future tests will be quite a bit shorter... I think.
Oh yeah, did I mention that PonyXL is apparently really bad at faces without using the adetailer extension? Because apparently that's a known thing.

 No.364

File:xyz_grid-0011-score_9,_sco….png (9.14 MB,4032x3072)

And here is a set with Kuon-like characteristics.
Of these the first set is definitely the closest to the style so I'll probably look at these settings for adjusting them. But, on the previous image set the third one looked quite good.
Man, this stuff is annoying to figure out.

 No.365

File:grid-0098-score_9,_score_8….png (2.74 MB,2304x1024)

Yeah, adetailer does a fantastic job of getting the eyes right. This will be the baseline of my future testing!

 No.366

But man, the hands...
This is something I ran into on my 1.5 LORAs, too, the hands just get messed up. I wonder if I can fix them with tags or something...

 No.370

File:grid-0003-score_9,_score_8….png (4 MB,3072x1024)

Another round of training complete with different settings. Seems to allow greater variety in outfits, which was a problem in what you see here >>364
But, I think style can be improved more.
I'm going to try a slower learning rate with more epochs. The unfortunate thing with these AI LLM things is so much of it is random. I can never actually reproduce the exact training because it branches out and it's uncontrollable. I guess 'exponential' might be a good word to use because if it veers into a direction it may continue following it.

 No.372

File:python_gMhYjlwukV.png (44.11 KB,775x953)

I read about the 'Lion' optimizer and that will be the setting I use as it trains overnight with a greatly reduced learning rate running for more epochs.
There's this Network Dimension stuff which is uhh... I can't remember but the larger it is the larger the filesize of the LORA. It's an efficiency and diminishing returns thing, but I don't really care about efficiency since it's just one LORA.
You may notice how there's a LyCORIS preset thing there, and yes some guy did name it after the show which was very popular at the time. It's a subset of LORA and I can't remember how it differed.

 No.385

File:xyz_grid-0000-score_9,_sco….png (20.54 MB,4608x3073)

Man, I really don't understand this. I guess the second from bottom is the best one currently, so I'll build off that? Bottom has some really good parts to it, but it also seems to be damaging the output. I bet if I had some saved steps between the last two the ideal would be in there somewhere. That's the one that takes 5 hours to get to.
I need to find a way to get the style without damaging the colors and lines.
Interestingly the third one has the same errors as my SD1.5 LORA in that it adds noses and lips. I wonder why.

 No.386

File:Utawarerumono.S03E20.1080p….png (2.87 MB,1920x1080)

After 12 hours of training with different options... it's awful. Well, there goes that day. Maybe this 'lion' thing isn't actually good for this purpose? Huh....

 No.390

File:explorer_F7vnDQLyUk.png (58.34 KB,624x514)

Another set done overnight. I noticed a queue system thing for different settings so I have a bunch to test out. I'll just test the 'final' version of each one at first and I sure hope I see something good from this...
The ones I saved as LionLycoris806 took a LOT longer.

But these filesizes are quite a bit lower than my first tests. If it works, great, but if it doesn't I don't know if it's a filesize/DIM issue...

 No.483

File:blehhh.png (10.55 MB,4548x1528)

Okay, these are super "fried", although the top one the least. I may need to remove some of the older training images since the colors are again washed out, but I saw them as valuable because they had different angles or clothing.

 No.484

oh wait I just realized I had an older lora active in each of these so it's doubled up...
gotta test again

 No.489

File:KUON.png (15.23 MB,5376x2297)

The training from the past 2 days hasn't been very satisfactory, but I guess it points me back to the 'standard' training setup. But, this looks so much more like Kuon than SD 1.5!
I checked and someone else made a style lora for this, but it's not very good. It completely lacks charm and beauty. They gave no care to identifying the differences between brown and yellow eyes (kind of hard with Amaduyu) and you can tell they didn't label the animal ears correctly and probably didn't fix any tags. It was obviously a bulk thing with no care put into it. I bet they didn't even crop and edit artbook and gacha stuff! (The Utawarerumono gacha is an insult, but the art is very good for AI training)
The top row is the version I saw online and the bottom row is mine which I'm still trying to improve.

This is how it looks without me even training it on Kuon specifically! I did have a weird issue with SD 1.5 when I combined the Aquaplus style with Kuon, so maybe I should make a second Lora that is uhh... hmm... just her clothing sets? Her hair? Ehhh....

OH MY GOD KUON IS SO CUTE! My GPU and VRAM has been occupied 99% of the time the past few days which is warming up my room in summer and I can't watch video without stuttering... BUT KUON! WOW!

Oh yeah apparently Pony is known for being bad at backgrounds which is exacerbated by the ones I had to use for this training, so that kind of sucks, but having better hands and detail and stuff is worth it. After I finish training this I can try to isolate the specific LORA channel things so I can get the ideal influence while limiting the damage to image integrity.

KUON!

 No.490

>>489
I completed 2 training rounds overnight and a third one will be done in a couple hours at which point I'll make another comparison chart!
Also something cool I noticed with my tagging is that I can properly prompt "white cat tail" to mean Kuon's tail, whereas it prompts a white cat in the other guy's LORA since it was never trained with that in mind. One does pop up rarely, but for the most part it doesn't.
AND LOOK AT HER HAIR TIE! My 1.5 merge wasn't able to do the "low-tail long hair" thing, but there it is in the images without even training on Kuon specifically!

 No.1196

File:cmd_Y4vhM9dDDC.png (52.75 KB,960x500)

kitaaaaaaa

 No.1197

nope, this one isn't better. there goes another 8 hours of GPU usage

 No.1209

on topic sager

 No.1214

File:explorer_KnSU8VLBs8.png (50.08 KB,633x431)

Making all these epochs took all night and then all day, and my python window thing does this annoying things sometimes where I need to open the window and hit enter for it to resume. It happens with SD and it happens with Silly Tavern and now it even happens with lora training. I just don't get it, but it's VERY annoying.

 No.1215

File:tmpgtu17hxt.png (1.35 MB,896x1152)

After more testing the thing I made yesterday does seem to have more prompt freedom than my previously-winning thing that I made a few days ago.
For my next training set I guess I'll make some minor changes to the learning rate... or something. No wait, I'll have it run longer. If it comes out better on later epochs then I'll uhh... hmm... reduce learning rate and have it go even longer?
Hands, though... I really wonder if there's something I can do because Pony seems far better at them when my trained lora thing isn't active...

 No.1221

File:asdf.jpg (16.85 MB,7728x4029)

blehhhhhhhhhhh

 No.1222

File:tmpg_u1a_g9.png (1.36 MB,896x1152)

ashdnas9udhnasiuodnjasiudnas
GOD WHY IS IT SO HARD TO FIND SOME SORT OF PATTERN

 No.1223

The curve is hard to fit

 No.1224

>>1222
trippy kuon the destroyer

 No.1225

and uhhh because it's as blackboxy as they come iunno

 No.1226

File:python_s5MI2HtTpv.png (14.45 KB,1134x273)

>>1225
Yeah, blockbox for sure. At least it seems these days you can set a specific seed so MAYBE stuff can be reproduced? Probably not, though. The way I heard people talk about this stuff last year reproducing the same training session is completely impossible, so this is probably just attempting to steer it back in the same location.

 No.1227

File:waterfox_NJvmc05q0W.png (118.13 KB,1742x356)

Information I only now know because someone decided to ask a question in a thread and another guy was helpful enough to remember a post from 2 months ago...
Most of my source images have transparent backgrounds which I then changed by adding gradients or backgrounds from other Aquaplus games so maybe this is something I should do...
But Pony's backgrounds are already known for being bad so I wonder if I should bother.
These backgrounds here aren't great now that I specifically look at them, but they're not the focus of the image of course >>1221

 No.1228

File:02429-score_9,_score_8_up,….png (912.99 KB,1024x1024)

I needed some motivation so I downloaded some other LORAs.
I think I'm on the right track and tonight's training should make a better LORA than any other... maybe.

 No.1229

File:ShareX_aTO42U83BG.png (28.55 KB,957x310)

I have a feeling I'm wasting all this time training it for TWENTY hours, but I want to be sure that this Locon thing is a dead end for this specific purpose. Not sure why the training time thing seems to grow over time (the IT/s thing).
Locons seems to train 4x slower, but supposedly they have more data available so in theory more style could be carried over, but my previous locon in testing wasn't very conclusive.

 No.1230

>>1229
>(the IT/s thing
err apparently it's s/IT
Seconds per iteration or something? dunno

 No.1233

File:02441-score_9,_score_8_up,….png (1.24 MB,1152x896)

Those 20 hours bore no fruit, so I guess I have my answer.
Also check out this Simpsons "do it for her" LORA hehehe.
Yes, yes I am!
DOOT HER

 No.1237

>>1233
Are you looking to achieve something in particular? A task as open ended as approximating a general style across all sorts of situations while dealing with the unreliable results of a ramshackle console nobody seems to truly understand would make me lose hair from stress, and it seems to me pics like >>1215 and >>489 are already pretty decent. What do you think it's missing?

 No.1239

File:asdadasda.png (20.99 MB,7056x2418)

>>1237
Well, apart from just trying to make it look as good as possible I want to minimize the damage to hands, colors and backgrounds and stuff. With some of these it's close to being there, but then there's something that sticks out as worse than other versions. I should test to see how it interacts with other LORAs more, too, but that's a low priority.
Some of it just hard to explain, but in this set of images I prefer the warmer, softer colors of the middle row, but it also has the most errors and some sort of prompt bleed thing where the 'white cat tail' prompt for Kuon's tail also summons a white cat.
In the bottom row, the floral-pattern kimono I prompted for Kuon looks very similar to Karulau's Uta 2 and 3 kimono in the training data, which I guess isn't a huge problem but it's less than ideal.
In all of the images you can see how the stained glass background in the middle is quite bad, but I don't know if there's anything I can do about that. I read about some masked thing and posted about it here >>1227 but I don't see any options in that UI thing and am really not going to research command prompt stuff. This AI stuff is so horrendously documented that it's a wonder that any information spreads at all.

 No.1240

File:__karulau_utawarerumono_an….png (1.23 MB,2048x2048)

>>1239
Aforementioned kimono. It's definitely leaning into it in that LORA but not any of the others, which is quite strange.

 No.1241

File:Cha16c_8BS.png (914.2 KB,752x1385)

>>1239
and now that I look at it more the middle outfit is leaning into Irena's Sage outfit.
Hmm... these ARE cool outfits, but I think this may be a problem when it comes to prompting other outfits.... maybe?
arrgghhh

 No.1242

File:hmmm.png (22.31 MB,7056x2410)

>>1239
and here's the same training process as that bottom row there, but with fewer steps. Each "step" is a processed image... I think. I have like 150 different images, but I have it set up so that higher quality ones are processed a greater number of times.

 No.1328

File:02534-score_9,_score_8_up,….png (1.23 MB,896x1152)

I think I'm happy with it, at least for now. Who knows when there will be a different model out, and if/when I get more VRAM I can make new versions much faster. I think I've minimized the damage to hands. They're still AI hands, but she doesn't have 12 fingers.
But, I still want to make a Kuon specific one. As it is I can't prompt her outfit and her hair accessory thingie is not accurate at all. I guess I'll get to work doing it sometime soon, but for now I'm taking a short break because all this tagging and sorting and stuff makes my eyes and brain hurt, even if I'm looking at Kuon.
I'm very happy that I can generate her tail now, though, as that was something I couldn't get to work in my older 1.5 SD Kuon lora. I probably could have done it, but I simply forgot how to make loras and kept procrastinating.

 No.1332

File:02682-score_9,_score_8_up,….png (1.3 MB,896x1152)

Did another round of training, this time training on 'autismmix' instead of base pony, but I don't have the results yet. I did try to prompt Nekone with my existing merges and it seems to work decently for having so little data.
I never defined her ears apart from generic 'animal ears' so maybe that's something I should have done, but her ears are so similar to Eruruu's and such that I figured more training data on 'animal ears' was better than splitting them up.

 No.1333

File:firefox_X7qD6XkFCW.jpg (656.19 KB,2767x1067)

It's quite interesting to see what happens when you copy the tags for an image that was in the training data verbatam.
Source image on the left, copied tags on the right. It's very accurate because it's just directly copying it without introducing anything new, at least on purpose.

 No.1334

The training on Autismmix was a failure. I mean, it's there but it's easily worse. It was my assumption that this would be the case, but it's nice to know for sure.
ALso... working on getting SDXL and my LORA working in irc and /chat/!

 No.1338

File:02701-score_9,_score_8_up,….png (1.46 MB,1024x1024)

Pony, or more specifically the SDXL base's higher resolution actually makes the regional prompt extension useful to me! Add in adetailer to fix the faces (although it's a crapshoot at which face is selected first with the correct prompt) and things come out quite well.
I'm not someone that will spend time inpainting and photoshop editing and stuff, so the image I generate is the image I keep. (Well, unless I'm making a thread or something but it's rare I use an AI image for that)
This isn't an ideal image since the style took a hit somehow, but wow it's pretty amazing to have Nekone and Kuon there, roughly.

 No.1531

File:00728.png (1.16 MB,896x1152)

On a lark I decided to search 'Kuon' on civitai and there was in fact a Kuon LORA for Pony.
But... it's not very good. The guy has 342 models on there, so it's obvious that he does the automated mass production things which creates models that are decent enough for most people for most purposes (masturbation), but definitely not ideal. I'm not sure why anyone would make that many models, it's certainly not fun and you're creating the material that other people use to try and make money without getting any of it yourself.

 No.1559

File:mpc-hc64_HzaeuH1ipA.png (2.85 MB,2227x1052)

I saw another Kuon lora (civitAI search seems quite strange and didn't show this one directly) but it was disappointing to me again.
Alright, I'm refreshed enough to give Kuon the attention she deserves!
Now that I'm training a concept instead of a style the process is a little bit different. First, I'm going to separate Kuon by outfit so I can try to trigger different outfits of hers on command.
But, I'm noticing some angles are missing so I'm going to watch Kuon's charming and beautiful and amazing anime form again and carefully go frame-by-frame to collect as much visual information as I can. But, I actually do find this frame-by-farme stuff mentally exhausting so I guess this will take me a little while since there's 53 episodes to go through. They really should have made it at least 80 episodes, but I guess it was a miracle that season 3 happened at all.

 No.1560

File:mpc-hc64_Qhn5tsVUgY.png (1.12 MB,1146x1078)

Like this, this seems like a good frame to show what it looks like from behind. If you don't provide this information then the AI will make an assumption.




[Return] [Top] [Catalog] [Post a Reply]
Delete Post [ ]

[ home / bans / all ] [ qa / jp ] [ maho ] [ f / ec ] [ b / poll ] [ tv / bann ] [ toggle-new / tab ]