Skip to content

add gptj modeling in TGI #2366

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

add gptj modeling in TGI #2366

wants to merge 1 commit into from

Conversation

sywangyi
Copy link
Contributor

@sywangyi sywangyi commented Aug 7, 2024

Signed-off-by: Wang, Yi A <[email protected]>
@sywangyi
Copy link
Contributor Author

sywangyi commented Aug 7, 2024

@danieldk @yao-matrix please help review

@sywangyi
Copy link
Contributor Author

sywangyi commented Aug 7, 2024

image
GPTJ is used in mlperf. so enable in it tgi

drbh added a commit that referenced this pull request Aug 8, 2024
* add gptj modeling

Signed-off-by: Wang, Yi A <[email protected]>

* fix: update docs for model addition

* fix: adjust syntax typo

* fix: adjust syntax typo again

---------

Signed-off-by: Wang, Yi A <[email protected]>
Co-authored-by: Wang, Yi A <[email protected]>
@drbh
Copy link
Collaborator

drbh commented Aug 8, 2024

closing because these commits were included in this PR: #2372 (to run CI). Thank you for the contribution! 🙏

@drbh drbh closed this Aug 8, 2024
@sywangyi sywangyi deleted the gptj branch November 4, 2024 00:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants