since we know a higher batch can be trained on mode 2 which uses ram in conjunction with vram. has anyone experimented with 8gb vs 16gb vs 32gb ram on mode 2? vram remaining constant, how high did you batch go using different amount of ram used?
example: i can train a SAE 128 model on my 1070 Ti 8gb vram and 16gb ddr4 ram on mode 1 with batch of 13
i can bump up the batch to 21 on mode 2 which uses the ddr4 ram.
sooooo..... how much do you figure someone can bump up the batch size to, using 16gb, 32gb or 64gb ddr4 ram while still on mode 2?
don't tell me to try mode 3. there are pros and cons of using mode 2 vs 3 and i'm not using 3 if i don't have to.
example: i can train a SAE 128 model on my 1070 Ti 8gb vram and 16gb ddr4 ram on mode 1 with batch of 13
i can bump up the batch to 21 on mode 2 which uses the ddr4 ram.
sooooo..... how much do you figure someone can bump up the batch size to, using 16gb, 32gb or 64gb ddr4 ram while still on mode 2?
don't tell me to try mode 3. there are pros and cons of using mode 2 vs 3 and i'm not using 3 if i don't have to.