-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add fine-tuning documentation #76
Comments
@samuelstevens Suggested some example code from biobench:
|
My understanding of the three example above: These use only the visual part of the BioCLIP model and train SVM/ridge classifier/simpleshot based on the image embeddings. No text embeddings are used. |
Yep, that's correct. biobench is a method to evaluate vision-only models like the vision encoder from BioCLIP, or DINOv2, etc. |
Adds a notebook that trains a SVM that predicts species based on image embeddings created by BioCLIP. The SVM logic is based on https://github.com/samuelstevens/biobench by @samuelstevens. Part of issue #76.
Adds a notebook that trains a SVM that predicts species based on image embeddings created by BioCLIP. The SVM logic in init_svc() is copied from https://github.com/samuelstevens/biobench by @samuelstevens. Part of issue #76. Co-authored-by: Samuel Stevens <[email protected]> Co-authored-by: Copilot <[email protected]>
Adds a notebook that trains a SVM that predicts species based on image embeddings created by BioCLIP. The SVM logic in init_svc() is copied from https://github.com/samuelstevens/biobench by @samuelstevens. Part of issue #76. Co-authored-by: Samuel Stevens <[email protected]> Co-authored-by: Copilot <[email protected]> Co-authored-by: Hilmar Lapp <[email protected]>
Adds a notebook that trains a RidgeClassifier that predicts species based on image embeddings created by BioCLIP. The RidgeClassifier logic is simplified from init_svc() in https://github.com/samuelstevens/biobench by @samuelstevens. Part of issue #76. Co-authored-by: Samuel Stevens <[email protected]>
Provide documentation on how users could fine-tune BioCLIP.
The text was updated successfully, but these errors were encountered: