Is it possible to initialise student network with other weights than random?
If my understanding is correct, the flag --ckpt affects both teacher and student. I'd like to load student from a checkpoint but have teacher as specified in the config file.