🧀 BigCheese.ai

Social

DualPipe: An innovative bidirectional pipeline parallelism algorithm

🧀

DualPipe is an advanced algorithm for bidirectional pipeline parallelism, reducing pipeline bubbles and increasing efficiency. Developed by DeepSeek-AI, it's accompanied by a technical report available on arXiv. The repo contains code, issues, and pull requests related to DualPipe implementation.

  • 577 stars on GitHub
  • 28 forks on GitHub
  • MIT licensed
  • Python language used
  • Designed for PyTorch 2.0+