So here's my workflow - it helps remove noticeable stuttering from missed faces and also increases final FPS.
Posted as a small thanks to iperov dpfks and others for their hard work.
Drag your ORIGINAL footage (data_dst.mp4 if using DFL) into the project window of AE, and then drag it from there into the project timeline, this will setup a composition with the correct duration and FPS as well as provide the audio track.
Right-click the Project window and Import > Multiple Files - select the first PNG of of your Converted sequence from the Merged folder, make sure Sequence Option: PNG Sequence is checked. Click Import - a second window will appear, don't click Import again, click Done.
Since AE doesn't know the framerate of the image sequence you'll need to tell it:
Click either the composition in the Project window or the original footage clip and it will tell you the FPS in the info window immediately above, then right-click your PNG sequence > Interpret Footage > Main and change "Assume this frame rate:" to match your source framerate.
Now drag your image sequence onto the timeline just above your original footage.
Now scrub through the timeline (by moving the blue cursor or using PgUp or PgDn for frame-by-frame) until you find a section/frame where the face is missed or just any section you want to remove- this can be a large segment or a single frame - we're going to cut it out.
Once the playback head is on the last good frame before the frames you want to remove make sure neither the image sequence nor the source footage are selected in the timeline window and press Ctrl+Shift+D - this will cut the footage at that point (if you have either one selected it will only cut that track - if nothing is selected it cuts all tracks).
Now move the playback head to the last frame you want removed and press Ctrl+Shift+D again, you can now select the segment you've cut out on both the image sequence and original footage and press Delete.
After your done editing you'll end up with something like Attachment 1 (turns out attachments don't work - Your allocated attachment usage quota is N/A)... (it was a bunch of layers with gaps in-between them from the removed segments)
Now to remove the gaps:
Select the bottom clip in the timeline window and hold Shift, then select the top most clip from the source footage (which will be halfway up, since the image sequence clips are above them) - now from the top menu: Animation > Keyframe Assistant > Sequence Layers - Overlap shouldn't be checked, click OK and it will arrange the layers into sequential order.
Repeat the process for the image sequence above the source clip.
Now if you'd like to increase the FPS (smoother motion):
See Attachment 2:
(if anyone knows a better image host lemme know)
Click the first indicated icon shown to enable frame blending for the project.
With all the image sequence layers selected, select the second indicated icon (which will be blank initially) by clicking twice until you see the Pixel Motion icon indicated in the attachment.
Now to change the framerate and remove the dead space at the end of the project:
Move the playback head to the very last frame of usable footage, note the timecode in the project window (hours:minutes:seconds:frames) now go to Composition > Composition Settings and change the Duration to this timecode and the Frame Rate to double your initial framerate (so if it was 30fps before, set it to 60fps), click OK.
Now export the video; File > Export > Add to Adobe Media Encoder Queue
Video encoding options are beyond the scope of this guide but the basic mp4 settings should be fine.
You can also use this with PNG masks to Match Grain of the original footage to remove the 'too smooth' look of the faces and various other useful things like auto-levels with temporal smoothing to reduce flicker - I'll post guides on these things if interest is expressed.
Posted as a small thanks to iperov dpfks and others for their hard work.
Drag your ORIGINAL footage (data_dst.mp4 if using DFL) into the project window of AE, and then drag it from there into the project timeline, this will setup a composition with the correct duration and FPS as well as provide the audio track.
Right-click the Project window and Import > Multiple Files - select the first PNG of of your Converted sequence from the Merged folder, make sure Sequence Option: PNG Sequence is checked. Click Import - a second window will appear, don't click Import again, click Done.
Since AE doesn't know the framerate of the image sequence you'll need to tell it:
Click either the composition in the Project window or the original footage clip and it will tell you the FPS in the info window immediately above, then right-click your PNG sequence > Interpret Footage > Main and change "Assume this frame rate:" to match your source framerate.
Now drag your image sequence onto the timeline just above your original footage.
Now scrub through the timeline (by moving the blue cursor or using PgUp or PgDn for frame-by-frame) until you find a section/frame where the face is missed or just any section you want to remove- this can be a large segment or a single frame - we're going to cut it out.
Once the playback head is on the last good frame before the frames you want to remove make sure neither the image sequence nor the source footage are selected in the timeline window and press Ctrl+Shift+D - this will cut the footage at that point (if you have either one selected it will only cut that track - if nothing is selected it cuts all tracks).
Now move the playback head to the last frame you want removed and press Ctrl+Shift+D again, you can now select the segment you've cut out on both the image sequence and original footage and press Delete.
After your done editing you'll end up with something like Attachment 1 (turns out attachments don't work - Your allocated attachment usage quota is N/A)... (it was a bunch of layers with gaps in-between them from the removed segments)
Now to remove the gaps:
Select the bottom clip in the timeline window and hold Shift, then select the top most clip from the source footage (which will be halfway up, since the image sequence clips are above them) - now from the top menu: Animation > Keyframe Assistant > Sequence Layers - Overlap shouldn't be checked, click OK and it will arrange the layers into sequential order.
Repeat the process for the image sequence above the source clip.
Now if you'd like to increase the FPS (smoother motion):
See Attachment 2:
(if anyone knows a better image host lemme know)
Click the first indicated icon shown to enable frame blending for the project.
With all the image sequence layers selected, select the second indicated icon (which will be blank initially) by clicking twice until you see the Pixel Motion icon indicated in the attachment.
Now to change the framerate and remove the dead space at the end of the project:
Move the playback head to the very last frame of usable footage, note the timecode in the project window (hours:minutes:seconds:frames) now go to Composition > Composition Settings and change the Duration to this timecode and the Frame Rate to double your initial framerate (so if it was 30fps before, set it to 60fps), click OK.
Now export the video; File > Export > Add to Adobe Media Encoder Queue
Video encoding options are beyond the scope of this guide but the basic mp4 settings should be fine.
You can also use this with PNG masks to Match Grain of the original footage to remove the 'too smooth' look of the faces and various other useful things like auto-levels with temporal smoothing to reduce flicker - I'll post guides on these things if interest is expressed.