Skip to content

to make TIE quantized conv operator to fall back to hifi quantized conv op instead of cpu op for shapes not supported by the TIE kernel. #10770

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 9, 2025
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions backends/cadence/hifi/operators/operators.h
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@
_(uint8_t, Byte) \
_(int8_t, Char)

using ::executorch::aten::IntArrayRef;
using ::executorch::aten::optional;
using ::executorch::aten::ScalarType;
using ::executorch::aten::Tensor;
Expand Down Expand Up @@ -67,6 +68,44 @@ void quantized_linear_per_tensor_out(
__ET_UNUSED const optional<Tensor>& offset,
Tensor& out);

void quantized_conv_out(
__ET_UNUSED KernelRuntimeContext& ctx,
const Tensor& input,
const Tensor& weight,
const Tensor& bias,
IntArrayRef stride,
IntArrayRef padding,
IntArrayRef dilation,
int64_t groups,
int64_t in_zero_point,
const Tensor& weight_zero_point,
const Tensor& bias_scale,
double output_scale,
int64_t output_zero_point,
__ET_UNUSED const Tensor& out_multiplier,
__ET_UNUSED const Tensor& out_shift,
bool channel_last,
Tensor& out);

void quantized_conv_per_tensor_out(
__ET_UNUSED KernelRuntimeContext& ctx,
const Tensor& input,
const Tensor& weight,
const Tensor& bias,
IntArrayRef stride,
IntArrayRef padding,
IntArrayRef dilation,
int64_t groups,
int64_t in_zero_point,
int64_t weight_zero_point,
double bias_scale,
double output_scale,
int64_t output_zero_point,
__ET_UNUSED int64_t out_multiplier,
__ET_UNUSED int64_t out_shift,
bool channel_last,
Tensor& out);

} // namespace native
} // namespace HiFi
} // namespace impl
Expand Down
Loading