I'm wondering about the concept of 'max new token'. Could someone explain what it is and possibly provide some context or examples for better understanding?
7 answers
KpopStarlight
Tue Nov 05 2024
For those seeking concise answers, a lower number of max new tokens is recommended.
CryptoPioneer
Tue Nov 05 2024
This setting ensures that the AI keeps its responses brief and to the point.
NebulaChaser
Tue Nov 05 2024
Max new tokens allow for the customization of AI responses.
EchoSeeker
Tue Nov 05 2024
It prevents the AI from generating overly verbose or lengthy answers.
SakuraTide
Tue Nov 05 2024
By adjusting this setting, users can determine the length of the AI's output.