You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, there are a great overlapping between these three sections, especially when there are tools, such as DeepSpeed, PaddlePaddle, PyTorch Lightning, awkwardly falling under "Computation Load Distribution".... rather than "Training Orchestration"
Thus, I propose to merge them into two separate sections: 1. Computation Optimisation, 2. Model Training, to make the conceptual boundary clearer.
The text was updated successfully, but these errors were encountered:
zhimin-z
changed the title
Proposal to merge "Training Orchestration", "Computation Load Distribution", and "Optimized Computation" into two separate sections
Proposal to merge "Training Orchestration", "Computation Load Distribution", and "Computation Optimisation" into two separate sections
Mar 3, 2025
Currently, there are a great overlapping between these three sections, especially when there are tools, such as DeepSpeed, PaddlePaddle, PyTorch Lightning, awkwardly falling under "Computation Load Distribution".... rather than "Training Orchestration"
Thus, I propose to merge them into two separate sections: 1. Computation Optimisation, 2. Model Training, to make the conceptual boundary clearer.
The text was updated successfully, but these errors were encountered: