super_bleu
DF Vagrant
Is this possible? If so is there anybody here who can modify the existing notebook so that it will run on the TPU?
This sounds like it will allow us to train models at a much much faster rate. Seems to be the obvious next step for the Google Colab fork of DFL
here's some info on Googles TPU
"TPU has the ability to process 65,536 multiply-and-adds for 8-bit integers every cycle.
As a comparision, consider this:
CPU can handle tens of operation per cycle
GPU can handle tens of thousands of operation per cycle
TPU can handle upto 128000 operations per cycle
TPU is several folds faster than GPU for neural network computations"
This sounds like it will allow us to train models at a much much faster rate. Seems to be the obvious next step for the Google Colab fork of DFL
here's some info on Googles TPU
"TPU has the ability to process 65,536 multiply-and-adds for 8-bit integers every cycle.
As a comparision, consider this:
CPU can handle tens of operation per cycle
GPU can handle tens of thousands of operation per cycle
TPU can handle upto 128000 operations per cycle
TPU is several folds faster than GPU for neural network computations"