MrDeepFakes Forums

Some content may not be available to Guests. Consider registering an account to enjoy unrestricted access to guides, support and tools

  • We are looking for community members who are intested in helping out. See our HELP WANTED post.

Best method for vr? do their morphed faces cause problems?

havok

DF Vagrant
In vr the faces are often morphed and stretched in strange ways because it has to be warped by the headsets lenses. Is there a mode that works well with strange face shapes or would h128 be the safest bet?
 

jreg72

DF Vagrant
splitvr 2.0 had a unwarp/rewarp feature that i actually never got to work (think some scipt or exe was missing). i think it used ffmpeg filters to unmorph frames and later revert the morphing with the same settings. the plan was to make the faces look "normal" prior to extraction and training.

personally i stick to scenes with the target face in the center of the frames, usually the face being near the frame boarders and close-ups causes distortions.

edit: i was also looking for methods to convert vr to normal vids (other than screen capturing a vr player), this could be a workaround if you're interested in the scenes (soooo much good pov stuff) and not particularly care for vr
 

havok

DF Vagrant
jreg72 said:
splitvr 2.0 had a unwarp/rewarp feature that i actually never got to work (think some scipt or exe was missing). i think it used ffmpeg filters to unmorph frames and later revert the morphing with the same settings. the plan was to make the faces look "normal" prior to extraction and training.

personally i stick to scenes with the target face in the center of the frames, usually the face being near the frame boarders and close-ups causes distortions.

edit: i was also looking for methods to convert vr to normal vids (other than screen capturing a vr player), this could be a workaround if you're interested in the scenes (soooo much good pov stuff) and not particularly care for vr

Even with videos where the face is right in the center and doesnt have noticeable warping Im still losing a significant amount of frames when finding faces with both dlib and MT :/
 
havok said:
jreg72 said:
splitvr 2.0 had a unwarp/rewarp feature that i actually never got to work (think some scipt or exe was missing). i think it used ffmpeg filters to unmorph frames and later revert the morphing with the same settings. the plan was to make the faces look "normal" prior to extraction and training.

personally i stick to scenes with the target face in the center of the frames, usually the face being near the frame boarders and close-ups causes distortions.

edit: i was also looking for methods to convert vr to normal vids (other than screen capturing a vr player), this could be a workaround if you're interested in the scenes (soooo much good pov stuff) and not particularly care for vr

Even with videos where the face is right in the center and doesnt have noticeable warping Im still losing a significant amount of frames when finding faces with both dlib and MT :/

Have you tried out the check results debug and manually attempting those frames where it bugs out? I don't know, even if that's successful, if it will actually help or hinder the training phase but maybe it will re warp the faces if you have manually aligned the images for the conversion
 
Top