Overtime: How to Build ComfyUI Custom Nodes With Claude

0:00Full conversation

Play from 0:00 8:88 0:00 I can show you a couple of things in here. I mean like I I totally get why people are intimidated by because it it it looks like an absolute nightmare or it can do especially if you're if you're disorganized like me. But I mean this is so this is essentially this is where I make all my kind of graphics. So like this is uh you know dots tracked onto from or tracked from this person's face. So that's like my latest the latest post and and I've got a node here where I just type in what I want to track.

Play from 0:29 8:88 0:29 Okay. And then and then that gets put into I've got another node that can control the colors of them. So like you can either got presets or I can just put in like the hex codes for every color that I want to use.

Play from 0:38 8:88 0:38 Um and then and these are custom. Yeah, I am I am releasing it. But like it's so difficult to use that I don't want to release until I figure out how to how to give it to people in in a simpler way. But essentially they it it creates this thing called called regions which essentially is just the like the dots in space. They're basically B boxes but like the it's the it's the B boxes which are which are essentially the box around the thing that you're tracking.

Play from 1:07 8:88 1:07 Um so here we've got like you know dots where the eyes and the nose and the mouth is and the ears. But if you if I if let's say if I use this node here which is which is the box one and so I can create corner squares which are kind of like the sort of bounding box squares like in Photoshop or whatever or like it used to or sort of like the stereotypical bounding box rounded ones. You got a regular box. You got corners which are like kind of almost like crosshairs. Um, so if I was to make a box and, you know, make the opacity one, then then that would allow me to not just put the dots there, but I'd put a box around the thing that is tracking.

Play from 1:47 8:88 1:47 So then the mouth would have an entire box around it and the the nose would have an entire box around it. Um, I'll show you just so here a few

Play from 1:56 8:88 1:56 and then these are like all these little elements like you've created these over time, right? Like so like all these and then basically you're you're kind of using them as the raw materials for new things that you're building, right?

Play from 2:09 8:88 2:09 Yeah. So like so this show this shows like those layers that come out of that one, right? So like this is all tracked from it.

Play from 2:17 8:88 2:17 Turn that music off. So this was the base video and then all of the stuff on top basically is tracked.

Play from 2:24 8:88 2:24 Yeah. Yeah. Added on top. So sick. Yeah. I love this. And then and this is your motion design background coming in here, right? You're dreaming it up from that from that skill set.

Play from 2:35 8:88 2:35 Yeah. So then like you know I just I just use as many tools as I possibly can get my hands on that can create images from another thing and so like you know things like pose pose rigs and like various other things. So how can I create things from this that can then apply it to it? Um, and then I mean like the the so the videos themselves like so this is an example of like these are the start and end images and and they're just little sections like this just loads of little little videos like that where they go from one to the other

Play from 3:05 8:88 3:05 and then that and that's another one. So I just I just make all the images and then do the little they're like you know maybe like two seconds long and then they're all stitched together into one long one and then and then I work on top like work on top of it. So on the comfy side that's the key frame animations that you're using and then a lot of this stuff is is all custom nodes that you have built for yourself. Now

Play from 3:30 8:88 3:30 let's just say Rory over here wanted to go build a custom node. Is it is this something you're doing with uh you know with Claude Astra things like that? Is that like all the

Play from 3:40 8:88 3:40 It's not probably not as easy as like as doing it in um an app that maybe like has a um has a built-in, right? So you got to it's code and like you know you've got to you got to add it from somewhere, right? You got to add the folder and like it's not quite kind of like drag and drop. I mean it kind of is, but it is still pretty easy, right? If you want to build a node for cuffy eye, you really just ask Lord just like, "Hey, I want to build a custom node that can do this." You just got got to know like what you want it to do. So, I made one like yesterday. I'm not not even not really even played with it much, but that gives things a um like a glass refraction. So, to see if it see like just cuz like I saw some images on

Play from 4:21 8:88 4:21 uh kind of I was I was looking at images on on on um Pinterest and like they had like some cool like refractions on on graphic stuff. I think that might be an image. That's why it's not a video. There you go. Oh man. Um, yeah, but like so that node I made in like 10 minutes.

Play from 4:41 8:88 4:41 Um, just by by saying, "Hey, like I want to make a I want to make a uh a a node that that does glass refractions." And it gave me like there's like 15 options on there.

Play from 4:51 8:88 4:51 Uh, video. Um, yeah. So, they're they're super easy to make. Um, you just got to you got to really like you got to understand how Comfy works and and be able to uh be able to wield that and obviously like you know manage a folder full of full of Python scripts. But it's a lot scarier than what it actually is once you get into it.

Play from 5:14 8:88 5:14 This is making me want to go in there now and play with I I never I never really went down the custom node route and now that I'm thinking about it like this is now with you know Claude and Astra can do this stuff in he's had like five minutes. So when you have to like really that looks sick.

Play from 5:30 8:88 5:30 I love that. Yeah. And then but what about but this is the this is the thing about

Play from 5:36 8:88 5:36 you know change change the strength less less bars or whatever and you can and you can create any parameters, right? So normally with with sort of normal tools you're using you really only have the options that they give you. But with this is like you can literally just decide what the options are. Right? Like or you can or you could like with this one you could like combine two, right? So you could just copy copy this and run it back through another one and you change the angle. So like make it 90° instead of instead of zero and then you're going to have two on top of each other. It's just going to create some sort of absolute mess,

Play from 6:15 8:88 6:15 right? But like or you can you could connect 15 of them all at different angles, right? So like it's just really easy to make stuff but like once you get your head around it and and the fact that like this is a note that I made yesterday, you know, with with an LLM and then this is the first time I tried this actually looks kind of cool, right? Like it's but it's like

Play from 6:35 8:88 6:35 I love it. It's the freedom to be able to do anything you want because it's open source because it's like just sitting on a computer like no one no one's controlling the back end of of Comfy for you like that that's that's yours alone. Um, so that if they update, you don't have to do the update, you know, like you can you can freeze it. Like there's no kind of uh there's no big comfy behind the scenes like controlling what's on your computer because it's it's all it's all all separate and you just downloaded it. That's