Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Paths to local models #14

Open
AlexChristensen opened this issue Feb 5, 2024 · 1 comment
Open

Paths to local models #14

AlexChristensen opened this issue Feb 5, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@AlexChristensen
Copy link
Collaborator

Some folks might download models onto their computer via different paths than what {transformers} or other LLM modules set

To avoid downloading a model multiple times, some users might prefer to provide a path to their model instead

@AlexChristensen AlexChristensen added the enhancement New feature or request label Feb 5, 2024
@AlexChristensen AlexChristensen added this to the 0.1.5 milestone Feb 5, 2024
@atomashevic atomashevic modified the milestones: 0.1.5, 0.1.6 Oct 1, 2024
@atomashevic atomashevic self-assigned this Oct 1, 2024
@atomashevic
Copy link
Owner

I was thinking of implementing something like ollama pull. For example, model_pull() would take either a model name or a local (absolute or relative) path as input.

It would also be a good idea to add another function that lists all locally available models and the functions they can be used for. When listing local/offline models, we can repeat the message about local inference (#23).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants