Skip to content
Back to pull request #380

feat(isp): add early_reduce_scatter_release support #1262

Sign in to view logs

feat(isp): add early_reduce_scatter_release support

feat(isp): add early_reduce_scatter_release support #1262

Run time

Learn about OS pricing on GitHub Actions
Job Run time
training_16GPU_4DP2TP2PP_FSP (t_cluster)
1m 41s
training_16GPU_4DP2TP2PP_MSP (t_cluster)
2m 16s
training_16GPU_4DP2TP2PP_MTP (t_cluster)
1m 52s
training_4GPU
2m 39s
training_8GPU_4DP2PP (t_cluster)
2m 1s
training_8GPU_4DP2PP_ZB
1m 59s
training_8GPU_4DP2TP (t_cluster)
1m 48s
training_8GPU_ISP
1m 43s
training_8GPU_ISP_CKPT
3m 56s
training_8GPU_4DP2TPSP (t_cluster)
1m 51s
training_llama2 (t_cluster)
1m 53s
23m 39s