Skip to content

Commit 3ff5c8f

Browse files
committed
fix v3
1 parent 4f35ce0 commit 3ff5c8f

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

_posts/2024-09-25-pytorch-native-architecture-optimization.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,6 @@ title: "PyTorch Native Architecture Optimization: torchao"
44
author: Team PyTorch
55
---
66

7-
87
We’re happy to officially launch torchao, a PyTorch native library that makes models faster and smaller by leveraging low bit dtypes, quantization and sparsity. [torchao](https://github.com/pytorch/ao) is an accessible toolkit of techniques written (mostly) in easy to read PyTorch code spanning both inference and training. This blog will help you pick which techniques matter for your workloads.
98

109
We benchmarked our techniques on popular GenAI models like LLama 3 and Diffusion models and saw minimal drops in accuracy. Unless otherwise noted the baselines are bf16 run on A100 80GB GPU.

0 commit comments

Comments
 (0)