[CPU] Add software prefetch to overlap bandwidth for scaled_embedding_bag#4171

yanbing-j wants to merge 3 commits intopytorch:mainpytorch/ao:mainfrom

yanbing-j:yanbing/optimize_scaled_embedding_bag_fp8yanbing-j/ao:yanbing/optimize_scaled_embedding_bag_fp8Copy head branch name to clipboard