OpenAI.Request.Top_P

OpenAI.Request.Top_P

Property declaration

 Dim Top_P As Single

Remarks

An alternative to sampling with Temperature, called nucleus sampling, where the model considers the results of the tokens with Top_P probability mass.

For example, a Top_P of 0.1 means only the tokens comprising the top 10% probability mass are considered.

OpenAI generally recommends altering this or Temperature, but not both.