Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Custom dataloader registry support #2932

Open
wants to merge 62 commits into
base: main
Choose a base branch
from
Open

Custom dataloader registry support #2932

wants to merge 62 commits into from

Commits on Jul 28, 2024

  1. copying CZI custom dataloader into our repo

    @ori-kron-wis
    ori-kron-wis committed Jul 28, 2024
    Configuration menu
    Copy the full SHA
    7088e4b View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. added some fixes to the custom dataloader stuff

    @ori-kron-wis
    ori-kron-wis committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    cc72b05 View commit details
    Browse the repository at this point in the history

  2. Some suggestions

    @canergen
    canergen committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    46048e3 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Changes to datamodule pipeline

    @canergen
    canergen committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    14f343d View commit details
    Browse the repository at this point in the history

  2. Fixed attr_dict

    @canergen
    canergen committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    17282cd View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. added some fixes based on custom data loader test

    @ori-kron-wis
    ori-kron-wis committed Aug 1, 2024
    2 Configuration menu
    Copy the full SHA
    a4143f5 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Changes to dataloader

    @canergen
    canergen committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    69abc47 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. copying CZI custom dataloader into our repo

    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    dc21a3d View commit details
    Browse the repository at this point in the history

  2. added some fixes to the custom dataloader stuff

    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    a1098b3 View commit details
    Browse the repository at this point in the history

  3. Some suggestions

    @canergen @ori-kron-wis
    canergen authored and ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    b07216b View commit details
    Browse the repository at this point in the history

  4. Changes to datamodule pipeline

    @canergen @ori-kron-wis
    canergen authored and ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    a578af1 View commit details
    Browse the repository at this point in the history

  5. Fixed attr_dict

    @canergen @ori-kron-wis
    canergen authored and ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    42434ec View commit details
    Browse the repository at this point in the history

  6. added some fixes based on custom data loader test

    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    3d0c890 View commit details
    Browse the repository at this point in the history

  7. Changes to dataloader

    @canergen @ori-kron-wis
    canergen authored and ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    eff5b1e View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'origin/ori-2907-custom-dataloader-regis… 

    …try' into ori-2907-custom-dataloader-registry
    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    cbdc26e View commit details
    Browse the repository at this point in the history

  9. add changes to tests and some merging with main following custom data… 

    …module / registry big change
    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    18d65a6 View commit details
    Browse the repository at this point in the history

  10. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    4fe3ee1 View commit details
    Browse the repository at this point in the history

  11. just put the cutom dataloder2 test under remarks so hook tests will r… 

    …un, we will later adjust this file
    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    1110966 View commit details
    Browse the repository at this point in the history

  12. fixes

    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    7972bdc View commit details
    Browse the repository at this point in the history

  13. additional external models fixes once there is a registry

    @ori-kron-wis
    ori-kron-wis committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    2d86c43 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2024

  1. fixed a few failed tests

    @ori-kron-wis
    ori-kron-wis committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    3c44d86 View commit details
    Browse the repository at this point in the history

  2. fix archesmixin init and added new custom dataloader test and github … 

    …action
    @ori-kron-wis
    ori-kron-wis committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    c0889d8 View commit details
    Browse the repository at this point in the history

  3. fix again for from __future__ import annotations 

    and fix the test for custom dataloaders
    @ori-kron-wis
    ori-kron-wis committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    8fe043c View commit details
    Browse the repository at this point in the history

  4. fix for run custom dataloader in github action

    @ori-kron-wis
    ori-kron-wis committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    d8cf0f6 View commit details
    Browse the repository at this point in the history

  5. rollback

    @ori-kron-wis
    ori-kron-wis committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    c41e8b2 View commit details
    Browse the repository at this point in the history

  6. added label to the new githubaction for custom dataloader

    @ori-kron-wis
    ori-kron-wis committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    6ec5d4d View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. fix for github action for custom dataloaders

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    6bce317 View commit details
    Browse the repository at this point in the history

  2. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    1f4ae9d View commit details
    Browse the repository at this point in the history

  3. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    de1f30b View commit details
    Browse the repository at this point in the history

  4. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    49fa01e View commit details
    Browse the repository at this point in the history

  5. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    e33a935 View commit details
    Browse the repository at this point in the history

  6. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    48627d9 View commit details
    Browse the repository at this point in the history

  7. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    609094d View commit details
    Browse the repository at this point in the history

  8. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    8cf3517 View commit details
    Browse the repository at this point in the history

  9. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    ba5a028 View commit details
    Browse the repository at this point in the history

  10. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    a7dc3fe View commit details
    Browse the repository at this point in the history

  11. another fix to custom dataloder test and github action

    @ori-kron-wis
    ori-kron-wis committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    f3ff0f8 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Sep 9, 2024
    Configuration menu
    Copy the full SHA
    083c76e View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Sep 15, 2024
    Configuration menu
    Copy the full SHA
    70bba69 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8c75662 View commit details
    Browse the repository at this point in the history

  2. Returned REGISTRY_KEYS for import, after was drop in recent merges

    @ori-kron-wis
    ori-kron-wis committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b6eb2f1 View commit details
    Browse the repository at this point in the history

  3. It is ok to drop it after scarches categorial covariates fix

    @ori-kron-wis
    ori-kron-wis committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2979ea2 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    67e9b34 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    11fe33a View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    4a648ff View commit details
    Browse the repository at this point in the history

  4. moved to type checking blocks beucase of ruff updates

    @ori-kron-wis
    ori-kron-wis committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e3831cb View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    e1837bd View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge remote-tracking branch 'origin/main' into ori-2907-custom-datal… 

    …oader-registry
    @ori-kron-wis
    ori-kron-wis committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    bf4d3bf View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. updated for CZI custom dataloader test and backend

    @ori-kron-wis
    ori-kron-wis committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    2cc8ff9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ori-2907-custom-dataloader-registry

    @ori-kron-wis
    ori-kron-wis authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    e62dc3a View commit details
    Browse the repository at this point in the history

  3. added cellxgene-census folder as well for debug (will not be merged)

    @ori-kron-wis
    ori-kron-wis committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    41fd877 View commit details
    Browse the repository at this point in the history

  4. added cellxgene-census packge to run test

    @ori-kron-wis
    ori-kron-wis committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    10ada9c View commit details
    Browse the repository at this point in the history

  5. added torchdata packge to run test

    @ori-kron-wis
    ori-kron-wis committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    dd3649c View commit details
    Browse the repository at this point in the history

  6. fixed the test workwflow

    @ori-kron-wis
    ori-kron-wis committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    c6acb5a View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. adding the lamindb as well

    @ori-kron-wis
    ori-kron-wis committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    b35c6eb View commit details
    Browse the repository at this point in the history

  2. fix the c.dataloders test

    @ori-kron-wis
    ori-kron-wis committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    1801604 View commit details
    Browse the repository at this point in the history

  3. fix the c.dataloders test

    @ori-kron-wis
    ori-kron-wis committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    ed77a65 View commit details
    Browse the repository at this point in the history

  4. fix the c.dataloders test

    @ori-kron-wis
    ori-kron-wis committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    fc831d5 View commit details
    Browse the repository at this point in the history

  5. fix the c.dataloders test

    @ori-kron-wis
    ori-kron-wis committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7400621 View commit details
    Browse the repository at this point in the history

  6. fix the c.dataloders test

    @ori-kron-wis
    ori-kron-wis committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    47376ca View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2024

  1. removed redundat functions in code base

    @ori-kron-wis
    ori-kron-wis committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    f94f7fa View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. Added scanvi support, including CZI datamodule fix for it

    @ori-kron-wis
    ori-kron-wis committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    962f043 View commit details
    Browse the repository at this point in the history