Merge branch 'main' into fix-non-mm-chat

Jack-Khuu · web-flow · commit bd6b512fe1ae · 2024-10-01T11:38:41.000-07:00
diff --git a/torchchat/cli/cli.py b/torchchat/cli/cli.py
@@ -494,7 +494,7 @@ def arg_init(args):
         )
 
     if "mps" in args.device:
-        if hasattr(args, "compile") and hasattr(args, "compile_prefill"):
+        if getattr(args, "compile", False) or getattr(args, "compile_prefill", False):
             print(
                 "Warning: compilation is not available with device MPS, ignoring option to engage compilation"
             )

Original file line number	Diff line number	Diff line change
`@@ -494,7 +494,7 @@ def arg_init(args):`
`494`	`494`	`)`
`495`	`495`
`496`	`496`	`if "mps" in args.device:`
`497`		`- if hasattr(args, "compile") and hasattr(args, "compile_prefill"):`
	`497`	`+ if getattr(args, "compile", False) or getattr(args, "compile_prefill", False):`
`498`	`498`	`print(`
`499`	`499`	`"Warning: compilation is not available with device MPS, ignoring option to engage compilation"`
`500`	`500`	`)`