Special tokens meaning

[tensorjackal]

What does <|audio_prompt_start|> and <|audio_prompt_end|> mean? And where are they used?

      "<|audio_start|>": 101,
      "<|audio_end|>": 102,
      "<|audio_prompt_start|>": 103,
      "<|audio_prompt_end|>": 104,
      "<|background|>": 105,
      "<|/background|>": 106,
      "<|characters|>": 107,  
      "<|/characters|>": 108,
      "<|speaker_id|>": 109,
      "<|/speaker_id|>": 110,
      "<|span|>": 111,
      "<|/span|>": 112,

[3350511721a-ship-it]

What does <|audio_prompt_start|> and <|audio_prompt_end|> mean? And where are they used?

      "<|audio_start|>": 101,
      "<|audio_end|>": 102,
      "<|audio_prompt_start|>": 103,
      "<|audio_prompt_end|>": 104,
      "<|background|>": 105,
      "<|/background|>": 106,
      "<|characters|>": 107,  
      "<|/characters|>": 108,
      "<|speaker_id|>": 109,
      "<|/speaker_id|>": 110,
      "<|span|>": 111,
      "<|/span|>": 112,

[liuxin99]

@3350511721a-ship-it @tensorjackal
These tokens are reserved for future controllable features and are not utilized in the current version.

[tensorjackal]

Does this allow instruction following?

[liuxin99]

We are currently working on this feature, and you can expect support for it in a future version of VoxCPM.