Gordon Ramsay in The Menu Scene 1 Updated

[GdaTyler]

This uses that updated head workflow I've been using lately: https://mrdeepfakes.com/forums/threads/guide-improved-src-shape-method-for-saehd-head-fakes.22358/
@frosty3907 This is one of a few using this method that I've been working on, the Daredevil one in recent times as well uses this.

For this one however, I tried again to use AMP HEAD for most shots since the hair is much sharper on AMP than SAEHD. Had to make a painful number of xseg masks to make the hair look passable. Settled on this because I was going crazy finding one that worked. Masking the hair was particularly tricky since I had to remove some of the rough edges and white glow from the original src. Removing the original actor from the background, I did everything manually, I've completely abandoned using content aware fill since it almost always looks like utter shit. Too much effort one would argue since this video won't really do well, but for me it's satisfying to do properly.

I have another scene from the movie that I have to re-render. Hopefully in a couple days I can move on to the other 9 or so fakes I have to finish.

If anyone is curious this was my first attempt at this scene:

 

[[deleted]]

It's pretty good and I feel you for the time it must take to do this manually. I remember I did like 250 frames one by one in Photoshop years ago on a NSFW fake because xseg wasn't good or maybe didn't even exist at the time, don't remember. Anyways, it's still a bit flickery on the sides of the face sometimes, and there's some tiny white glows here and there, but it's good. I think you should try Nuke. Never used it myself but apparently it's the shit and it's THE pro compositing tool. Looks scary as hell and not sure how easy it is to get your hands on it, but I think it might be the next step to achieve more realism.

 

[GdaTyler]

Please, Log in or Register to view quote content!

Will definitely look into it. Hopefully there's a way to try it out for free.

 

[frosty3907]

I don't think nuke is going to be a productive path for you, davinci resolve maybe.
nonetheless, content aware fill in the most recent available "free" AE versions isn't bad, otherwise I often just generate a background by hand and track and mask it in.
another thing you could try is using runwayml or similar to generate greenscreen of your DST (or SRC, been too long since I used DFL) dataset, then you should be able to just use keylight or similar chromakeying in your post workflow

 

[GdaTyler]

Please, Log in or Register to view quote content!

Yeah the manual background and tracking is what I've switched to since it's the most accurate method imo. Especially for moving scenes. I know people can do wonders with the content aware tool if you use it properly, but on my limited setup I find myself saving more time and having so much more control just removing the subject manually.

I used runwayml for another fake that saved me a lot of time, but for some reason the output looks so much worse than the output in the preview window. I ended up screencapping the preview lol.

As for Nuke, I think it's way too expensive and probably too complicated for me, but it'd be fun to try it out if it were accessible. Haven't looked into that as yet. For most of my current HEAD fakes, I've been forced to reextract the result.mp4 and make a more accurate xseg mask. The learned predicted mask usually cuts out a lot of what I need, similar to the xseg mask mode on the first merge. The average person probably won't bother and the average viewer won't notice, but I think it really makes a difference.

 

[frosty3907]

Yeah I'd definitely be interested in giving it a go if I get the time, I haven't used dfl for yonks now though, inswapper was just too convenient.
Maybe I'll try and dedicate a few hours to it soon, if I can get the model trained I think I could work out a decent workflow.
I am thinking:
Custom SRC dataset on greenscreen with stationary hair (long dynamic hair won't ever work)
Train head with an inverted whole face priority mask
Train face
Overlay face on head
Composite with chromakey
If necessary expand border in post as content aware fill or static background

I've never worked with AMP either.. will have to go over your posts again when I'm awake and have a minute