MrDeepFakes Forums
  • New and improved dark forum theme!
  • Guests can now comment on videos on the tube.
   
cheesetoastIs This a Model Collapse? No spike activity do to sleep mode but stable after
#1
Hello I was wondering is this a model collapse? I left my computer to train at night and once I checked in the morning, my computer was in sleep mode and noticed no spikes activity at all in the preview. The image previews does look fine and I continued the training. The spikes look stable once I continued the training. Is this something I should be worried about and should redo the whole training from scratch? Sadly I did not back up a good model folder.

[Image: 6s8wXCdh.jpg]

My setting 

===== Model summary =====
== Model name: SAE
==
== Current iteration: 92383
==
== Model options:
== |== batch_size : 1
== |== sort_by_yaw : False
== |== random_flip : True
== |== resolution : 128
== |== face_type : f
== |== learn_mask : True
== |== optimizer_mode : 2
== |== archi : df
== |== ae_dims : 512
== |== e_ch_dims : 42
== |== d_ch_dims : 21
== |== multiscale_decoder : Fals
== |== ca_weights : False
== |== pixel_loss : False
== |== face_style_power : 0.0
== |== bg_style_power : 0.0
== |== apply_random_ct : False
== |== clipgrad : False
== Running on:
== |== [0 : GeForce GTX 970]
=========================
#2
nah, model collapse is when one whole column of your preview pics is solid black or another color
#3
(07-13-2019, 11:15 PM)super_bleu Wrote: You are not allowed to view links. Register or Login to view.nah, model collapse is when one whole column of your preview pics is solid black or another color

phew.  I thought I wasted three days of training.  Thanks

Forum Jump:

Users browsing this thread: 1 Guest(s)