MrDeepFakes Forums

Some content may not be available to Guests. Consider registering an account to enjoy unrestricted access to guides, support and tools

  • We are looking for community members who are intested in helping out. See our HELP WANTED post.

TecoGAN super resolution neural network

SPT

Moderator
Staff member
Moderator
Verified Video Creator


https://github.com/thunil/TecoGAN

Hello, since it is quite uncommon to have faces with 256 resolution (or more), why not use this algorythm on 128 res faces, and then convert and merge into a video as usual ?

It is far from my knowledge to use it and integrate it into DFL, but I'm currently using JavPlayer, a program to decensor mosaic in japanese porn, which uses TecoGAN successfully. From what I understand it can boost resolution of anything up to 4x, and it would be way faster than training a real 256 or 512 model. From my experience with decensoring japanese porn, using this for deepfakes would take the normal amount of computing time + more or less 20%.

To be clear, contrary to the Topaz AI gigapixel method, we would use this only on faces (like JavPlayer uses it only on the mosaic censored part of a video) and not the entire video. That's why it doesn't take much time. Only after the TecoGAN upscaling is done, the final video would be created.

So if someone can inform the maker of DFL about it, I think it could be awesome. Or maybe there's already something like this in the latest version, I haven't tried DFL since 6 months.
 

dpfks

DF Enthusiast
Staff member
Administrator
Verified Video Creator
This is very impressive indeed. Hope @"iperov" see's this, curious to see what he thinks.
 

LCC

DF Pleb
DFL already does this mate. Can't remember the exact name, but pretty sure the option is 'Super Resolution' while converting.

Although the model it uses isn't great (DCSCN).
 

TMBDF

Moderator | Deepfake Creator | Guide maintainer
Staff member
Moderator
Verified Video Creator
DFL now uses RankSRGAN instead of DCSCN which is sort of like ESRGAN and similar to TecoGAN as they all are based on generative adversarial networks.
Comparison between SRGAN, ESRGAN and currently implemented RankSRGAN: https://pythonawesome.com/content/images/2019/08/RankSRGAN.jpg
As you can see RankSRGAN gives best results.
Difference as I understand is that Teco has some temporal coherency capability which means it's better for moving footage, not sure however if it has much of importance for just upscaling a face.
RankSRGAN can give good results provided your model produces sharp enough results, you can always enable box/gaussian sharpening and use that to make super resolution effect more pronounced (I often go as high as 5 or even 8 with box or gaussian if I want a bit "softer" sharpening).
If your predicted faces are blurry super resolution won't make much of difference.
 
Top