Still can't believe that it was Robert Downey Jr. who played that black dude
Anyway cool video but to me it looks like you used to much sharpening to try and get the small detail to show up but it made it just stick out because it's a bit sharper than actual clip and overall there is no grain and because you didn't post process you did not have the ability to do so.
I always upscale in post too because I can always tweak it more than even now with the fancy new converter.
You should post process if you want really realistic results, you'll hopefully see it in my upcoming video that I'l be posting to my new deepfake channel, maybe to even rival ctrl shift face, there are a lot of cool things you can do if you edit it in post.