kazu.distillationΒΆ
Modules
Modified for distillation using Pytorch Lightning by KAZU team. |
|
Influenced by Huawei Noah's Ark Lab TinyBERT, but heavily modified structurally to fit in our PyTorch Lightning training setup. |
|
Modules
Modified for distillation using Pytorch Lightning by KAZU team. |
|
Influenced by Huawei Noah's Ark Lab TinyBERT, but heavily modified structurally to fit in our PyTorch Lightning training setup. |
|