LLMSamplingParams Model
LLMSamplingParams Model documentation for JavaScript SDK
Properties
| Name | Type | Description | Notes |
|---|---|---|---|
| maxTokens | Number | Maximum tokens to generate (>0 if set; provider-dependent limits apply) | [optional] |
| temperature | Number | Sampling temperature 0.0-2.0 (0.0=deterministic, 2.0=highly random) | [optional] |
| topP | Number | Nucleus sampling threshold 0.0-1.0 (smaller values focus on higher probability tokens) | [optional] |
| topK | Number | Top-k sampling limit (>0 if set; primarily for local/open-source models) | [optional] |
| frequencyPenalty | Number | Frequency penalty -2.0 to 2.0 (positive values reduce repetition based on frequency) | [optional] |
| presencePenalty | Number | Presence penalty -2.0 to 2.0 (positive values encourage topic diversity) | [optional] |
| stopSequences | [String] | Generation stop sequences (≤10 sequences; each ≤100 chars; generation halts on exact match) | [optional] |