Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

idea: Add support for additional model file formats (Safetensors, PyTorch, etc.) #4100

Closed
Tracked by #4254
imtuyethan opened this issue Nov 22, 2024 · 1 comment
Closed
Tracked by #4254
Labels
category: model support Support new model, or fix broken model type: feature request A new feature

Comments

@imtuyethan
Copy link
Contributor

Problem Statement

Currently, Jan only supports GGUF format models, requiring users to find or convert models to GGUF before using them with Jan. This creates friction for users who want to use models in their original formats, especially when working with newer models released in formats like safetensors.

Feature Idea

Enable Jan to support additional model file formats:

  • Safetensors Support (both fp16 and fp32 variants)
  • Implement auto-conversion to GGUF if needed for compatibility?
  • PyTorch (.pt, .pth) format support
  • ...
@imtuyethan imtuyethan added the type: feature request A new feature label Nov 22, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Jan & Cortex Nov 22, 2024
@imtuyethan imtuyethan added the category: model support Support new model, or fix broken model label Nov 22, 2024
@imtuyethan
Copy link
Contributor Author

Closed as dup: #4254

@imtuyethan imtuyethan moved this from Investigating to Completed in Jan & Cortex Dec 10, 2024
@github-project-automation github-project-automation bot moved this from Completed to QA in Jan & Cortex Dec 10, 2024
@imtuyethan imtuyethan moved this from QA to Completed in Jan & Cortex Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: model support Support new model, or fix broken model type: feature request A new feature
Projects
Archived in project
Development

No branches or pull requests

1 participant