torchtitan
torchtitan (Orchestra-Research/AI-Research-SKILLs): Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
Stars
13k
Votes
—
Score
41.2863
Source: Orchestra-Research/AI-Research-SKILLs · 01-model-architecture/torchtitan/SKILL.md
npx skills add Orchestra-Research/AI-Research-SKILLs --skill torchtitan
Related skills
| 01 | axolotlOrchestra-Research/AI-Research-SKILLs | Science | 13k | 4128.6 |
↗ | Orchestra-Research/AI-Research-SKILLs · Science · 4128.6 |
| 02 | neuroskill-bciNousResearch/hermes-agent | Science | 255k | 5406.3 |
↗ | NousResearch/hermes-agent · Science · 5406.3 |
| 03 | aeonK-Dense-AI/scientific-agent-skills | Science | 52k | 4720.1 |
↗ | K-Dense-AI/scientific-agent-skills · Science · 4720.1 |
| 04 | anndataK-Dense-AI/scientific-agent-skills | Science | 52k | 4720.1 |
↗ | K-Dense-AI/scientific-agent-skills · Science · 4720.1 |
| 05 | powerbi-modelinggithub/awesome-copilot | Science | 40k | 4603.6 |
↗ | github/awesome-copilot · Science · 4603.6 |