Skip to content

Commit 4551e04

Browse files
authored
Fix decoupled batch statistics to account for implicit batch size (#361)
1 parent 01ba273 commit 4551e04

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/python_be.cc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1236,7 +1236,7 @@ ModelInstanceState::ProcessRequests(
12361236
uint64_t compute_end_ns = 0;
12371237
SET_TIMESTAMP(compute_end_ns);
12381238
reporter.SetComputeEndNs(compute_end_ns);
1239-
reporter.SetBatchStatistics(request_count);
1239+
reporter.SetBatchStatistics(total_batch_size);
12401240

12411241
if (response_batch.data_->has_error) {
12421242
if (response_batch.data_->is_error_set) {

0 commit comments

Comments
 (0)