Skip to content

fix(bpe): disambiguate legacy v1 merges with spaces in vocab tokens - #2078

Closed
SMC17 wants to merge 1 commit into
huggingface:mainfrom
SMC17:bpe-legacy-v1-merges-with-spaces
Closed

fix(bpe): disambiguate legacy v1 merges with spaces in vocab tokens#2078
SMC17 wants to merge 1 commit into
huggingface:mainfrom
SMC17:bpe-legacy-v1-merges-with-spaces

Commits

Commits on May 29, 2026