Add BF16 support for int8_vectorwise_quant / LLM.int8 activation quant#1985

kru2710shna wants to merge 3 commits into

bitsandbytes-foundation:mainbitsandbytes-foundation/bitsandbytes:mainfrom

kru2710shna:feature/int8-bf16-vectorwise-quantkru2710shna/bitsandbytes:feature/int8-bf16-vectorwise-quantCopy head branch name to clipboard