PERF: fix #32976 slow group by for categorical columns#33739

rtlee9 wants to merge 1 commit intopandas-dev:masterpandas-dev/pandas:masterfrom

rtlee9:cat_groupby_fixrtlee9/pandas:cat_groupby_fixCopy head branch name to clipboard