Skip to content

Navigation Menu

Appearance settings

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

lucidrains / DALLE-pytorch Public

Notifications You must be signed in to change notification settings
Fork 639
Star 5.6k

Code
Issues 121
Pull requests 5
Discussions
Actions
Projects
Uncyclo
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Uncyclo
Security
Insights

Vast.ai Sparse Attention

Jump to bottom Edit New page

afiaka87 edited this page Mar 31, 2021 · 1 revision

Vast.ai Configuration

lord krishna with arjun

Toggle table of contents Pages 21

Home
Attention Layers
Citations
CLIP Rerank
Deepspeed
DeepSpeed Apex Automatic Mixed Precision
Deepspeed Installation
Deepspeed Usage
DeepSpeed Checkpoints
DeepSpeed Multi node
Deepspeed ZeRO Infinity
Generate From Pretrained Model
Horovod
Horovod Usage
Horovod Installation
Hugging Faces Tokenizer
Image Mask e.g. "the exact same cat on the top as sketch on the bottom"
Multi GPU and Multi Node
Quick Start
Train with your Own Dataset
Vast.ai Sparse Attention

Add a custom sidebar

Clone this wiki locally

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.