Skip to content

High-performance Python librarys for connecting AI/ML frameworks with OSS storage.

License

Notifications You must be signed in to change notification settings

aliyun/oss-connector-for-ai-ml

Repository files navigation

OSS Connector for AI/ML

ossconnector.github.io

Overview

OSS Connector for AI/ML contains some high-performance Python libraries specifically designed for AI and ML scenariosis, tailored to work with Alibaba Cloud OSS (Object Storage Service).

Currently, the OSS connector is composed of two libraries: OSS Model Connector and OSS Torch Connector.

  • OSS Torch Connector is dedicated to AI training scenarios, including loading datasets from OSS and loading/saving checkpoints from/to OSS.

  • OSS Model Connector focuses on AI inference scenarios, loading large model files from OSS into local AI inference frameworks.

The core part of is OSS Connector for AI/ML is implemented in C++ using PhotonLibOS. This repository only contains the code of Python.

For details, please refer to ossconnector.github.io or aliyun.github.io/oss-connector-for-ai-ml.

Related

OSS Connector for AI/ML 中文文档

License

This project is licensed under the terms of the MIT License.