add CLIP-ViT-L-scope #1022
add CLIP-ViT-L-scope #1022
Conversation
Lewington-pitsos
requested review from
SBrandeis,
gary149,
Wauplin,
julien-c,
pcuenca and
ngxson
as code owners
| "clip-scope": { | ||
| prettyLabel: "CLIP-ViT-L-scope", | ||
| repoName: "CLIP-ViT-L-scope", | ||
| repoUrl: "https://github.com/Lewington-pitsos/vitsae", |
There was a problem hiding this comment.
Hi @Lewington-pitsos, thanks for opening a PR :) Just to understand, what is the library here? For what I can see:
clip-scopeseems like a generic name that is not mentioned in both the model card and the github repoclipscopeseems to be a Python library ("from clipscope import ConfiguredViT, TopKSAE" in the model card) but can't see how to install it. At least it doesn't seem to be on PyPI.CLIP-ViT-L-scopeis a very specific name (the name of the repo on the Hub)vitsaeis the name of the repo on the Hub. Is it planned to be a published library at some point?
I'm asking this because depending on what you plan to do here, the integration with the Hub could change. Typically, do you think other repos might use the same library in the future or will it be a "one-shot"? We usually recommend to have a consistent naming between the library and repo tags to avoid confusion. Also, the name of the library is usually different from the name of the repo on the Hub, especially when multiple models are linked to the same library.
|
Thanks for the super quick feedback, I have tried to make the names more consistent as suggested, I have also changed the repo to point to the github repo for using the files (clipscope) rather than the one I used to train the models (vitsae). The clipscope repo is much more likely to be used by others in future than vitsae. I seem to be able to access the clipscope pypi package (https://pypi.org/project/clipscope/) and In terms of tracking, these models are all derived from the same training process and a common use case for them should be to compare how they perform against one another. In a sense collectively they comprise a single tool. https://huggingface.co/google/gemma-scope-2b-pt-res from which we took inspiration takes a similar approach and places large numbers of related models together as a single "model". Personally I am most interested in the extent to which people are using the tool in any respect than I am in which parts of it are being used most. |
There was a problem hiding this comment.
Thanks for the clarification @Lewington-pitsos! Then I think it makes sense to integrate the library as mentioned below.
Also, to make it connected to your model repo on the Hub, you'll have to edit the model card metadata to add library_name: clipscope here. Once that's done and the comments below are addressed, we should be able to merge :)
Co-authored-by: Lucain <[email protected]>
|
apologies for the delay, accepted the suggested commit and changes made to the readme https://huggingface.co/lewington/CLIP-ViT-L-scope/blob/main/README.md I think we should be ok to merge now |
|
Sorry, had a few lint issues ^^ |
|
aah, I should have picked that up, much obliged |
No description provided.