I use different batch size from 1-32 depending on what i'm doing and what i want. Optimizer seems to cause problems for me unless iteration time is supposed to jump from 1000-3000ms to 30 seconds or more or just freeze and not do anything. Dimms I usually keep at default. Style power I change many times during training. Resolution, pixel loss, color transfer, gradient clipping all depend on the situation.