Skip to content

Add basic SAELens code snippet #835

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 5, 2024
Merged

Add basic SAELens code snippet #835

merged 3 commits into from
Aug 5, 2024

Conversation

xenova
Copy link
Contributor

@xenova xenova commented Aug 5, 2024

Follow-up to #826, and (currently) an intermediate PR before .from_pretrained support is added for any model on the HF Hub. See jbloomAus/SAELens#234 (comment) for additional discussion.

Copy link
Contributor

@osanseviero osanseviero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool 🔥

@@ -401,6 +401,16 @@ export const timm = (model: ModelData): string[] => [
model = timm.create_model("hf_hub:${model.id}", pretrained=True)`,
];

export const saelens = (/* model: ModelData */): string[] => [
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@xenova
Copy link
Contributor Author

xenova commented Aug 5, 2024

Btw: failing tests seem unrelated to this PR 🫡

@pcuenca
Copy link
Member

pcuenca commented Aug 5, 2024

Very cool, and interesting linked discussion! 🙌

Btw: failing tests seem unrelated to this PR

Yes, I think you are right, I saw something similar in other PRs.

@xenova xenova merged commit 3f9c0a9 into main Aug 5, 2024
3 of 5 checks passed
@xenova xenova deleted the saelens branch August 5, 2024 22:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants