MrDeepFakes Forums
  • New and improved dark forum theme!
  • Guests can now comment on videos on the tube.
   
ginoginiUsing After Effects to track SRC and DST faces
#1
Hello, everyone.

I was wondering if there's a way to integrate face tracking of After Effects with DFL. 
I use after effects and face tracking is really precise and better than DFL one.

Do you know if there's a way to do this or you have a link to a guide?

Thanks, everyone.
#2
What do you mean by face tracking? What do you want to use it for?
TMB-DF on the main website - You are not allowed to view links. Register or Login to view.
Want to request a paid deepfake or have any questions reagarding the forums or deepfake creation using DeepFaceLab? Write me a message.
Donations (BTC): 1H2vT4saNyULYtm42v2Wm83VuuWHTV4PHW
#3
(08-18-2019, 09:26 PM)tutsmybarreh Wrote: You are not allowed to view links. Register or Login to view.What do you mean by face tracking? What do you want to use it for?

After Effects can track faces the same (and better) than how DFL does.
DFL gives a lot of false positives and wrong face recognition. If that part of the job could be done by a software like AE it would be fantastic.
#4
There is more to the face extraction/aligning process than just tracking, DFL creates landmarks it needs to use for merging process (data_dst - aligned_debug folder) as well as encodes additional data about the position/shapes of eyes, nose, mouth and face shape to face images in aligned folder for both src and dst. It's not possible to use external software to do that because you have no way to incorporate that additional data into those frames without actually coding the feature yourself.
TMB-DF on the main website - You are not allowed to view links. Register or Login to view.
Want to request a paid deepfake or have any questions reagarding the forums or deepfake creation using DeepFaceLab? Write me a message.
Donations (BTC): 1H2vT4saNyULYtm42v2Wm83VuuWHTV4PHW
#5
(08-18-2019, 09:44 PM)tutsmybarreh Wrote: You are not allowed to view links. Register or Login to view.There is more to the face extraction/aligning process than just tracking, DFL creates landmarks it needs to use for merging process (data_dst - aligned_debug folder) as well as encodes additional data about the position/shapes of eyes, nose, mouth and face shape to face images in aligned folder for both src and dst. It's not possible to use external software to do that because you have no way to incorporate that additional data into those frames without actually coding the feature yourself.

It is exactly what AE does when tracks faces. However, you are right. If there's not something who can translate AE output data and insert them in DFL, this is impossible. That's why I was asking if somebody did it. There are a lot of plug-ins in AE and nothing is impossible to do in this kind of stuff.
#6
(08-18-2019, 10:07 PM)ginogini Wrote: You are not allowed to view links. Register or Login to view.
(08-18-2019, 09:44 PM)tutsmybarreh Wrote: You are not allowed to view links. Register or Login to view.There is more to the face extraction/aligning process than just tracking, DFL creates landmarks it needs to use for merging process (data_dst - aligned_debug folder) as well as encodes additional data about the position/shapes of eyes, nose, mouth and face shape to face images in aligned folder for both src and dst. It's not possible to use external software to do that because you have no way to incorporate that additional data into those frames without actually coding the feature yourself.

It is exactly what AE does when tracks faces. However, you are right. If there's not something who can translate AE output data and insert them in DFL, this is impossible. That's why I was asking if somebody did it. There are a lot of plug-ins in AE and nothing is impossible to do in this kind of stuff.

I know it captures all that data (eyes closed, eyebrows up, etc) but the problem is like you say how to convert that data. Another thing is that soon you may see an AI based approach to tracking, facial recognition and all of that stuff, photoshop already has some AI driven features so it would be kinda a step back (assuming AI is a step forward).
TMB-DF on the main website - You are not allowed to view links. Register or Login to view.
Want to request a paid deepfake or have any questions reagarding the forums or deepfake creation using DeepFaceLab? Write me a message.
Donations (BTC): 1H2vT4saNyULYtm42v2Wm83VuuWHTV4PHW

Forum Jump:

Users browsing this thread: 1 Guest(s)