Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[checkpointio] support asyncio for 3d #6144

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

[checkpointio] support asyncio for 3d #6144

wants to merge 19 commits into from

Commits on Nov 20, 2024

  1. [checkpointio] support async model save (hpcaitech#6131) 

    * [checkpointio] support async model save

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @ver217 @pre-commit-ci @flybird11111
    2 people authored and flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    b2a3236 View commit details
    Browse the repository at this point in the history

  2. [ckpt] Add async ckpt api (hpcaitech#6136) 

    * fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix
    @wangbluo @flybird11111
    wangbluo authored and flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e2c51c0 View commit details
    Browse the repository at this point in the history

  3. [async io]supoort async io (hpcaitech#6137) 

    * support async optimizer save/load

* fix

* fix

* support pin mem

* Update low_level_zero_plugin.py

* fix

* fix

* fix

* fix

* fix
    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    dc105b7 View commit details
    Browse the repository at this point in the history

  4. 3d-asyncio

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    b0881f9 View commit details
    Browse the repository at this point in the history

  5. rebase main

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    adf6a23 View commit details
    Browse the repository at this point in the history

  6. [checkpointio] support async model save (hpcaitech#6131) 

    * [checkpointio] support async model save

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @ver217 @pre-commit-ci @flybird11111
    2 people authored and flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    014081b View commit details
    Browse the repository at this point in the history

  7. [async io]supoort async io (hpcaitech#6137) 

    * support async optimizer save/load

* fix

* fix

* support pin mem

* Update low_level_zero_plugin.py

* fix

* fix

* fix

* fix

* fix
    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    cdd820a View commit details
    Browse the repository at this point in the history

  8. 3d-asyncio

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    ff04170 View commit details
    Browse the repository at this point in the history

  9. Update low_level_optim.py

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e324c8a View commit details
    Browse the repository at this point in the history

  10. fix

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    5c49004 View commit details
    Browse the repository at this point in the history

  11. fix

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    5dc598d View commit details
    Browse the repository at this point in the history

  12. fix

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    98d0feb View commit details
    Browse the repository at this point in the history

  13. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    119e240 View commit details
    Browse the repository at this point in the history

  14. fix

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    3ead974 View commit details
    Browse the repository at this point in the history

  15. Merge branch '3d-asyncio' of github.com:flybird11111/ColossalAI into … 

    …3d-asyncio
    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e6cd85e View commit details
    Browse the repository at this point in the history

  16. fix

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    a7082a4 View commit details
    Browse the repository at this point in the history

  17. fix

    @flybird11111
    flybird11111 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    2755e92 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. support optimizer checkpoint asyncio for general

    @flybird11111
    flybird11111 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    8444055 View commit details
    Browse the repository at this point in the history

  2. support save

    @flybird11111
    flybird11111 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    a944cde View commit details
    Browse the repository at this point in the history