Interface for the input parameters specific to the Writer model.

interface WriterInput {
    apiKey?: string;
    bestOf?: number;
    frequencyPenalty?: number;
    logprobs?: number;
    maxTokens?: number;
    minTokens?: number;
    model?: string;
    n?: number;
    orgId?: string | number;
    presencePenalty?: number;
    temperature?: number;
    topP?: number;
}

Hierarchy

  • BaseLLMParams
    • WriterInput

Implemented by

Properties

apiKey?: string

Writer API key

bestOf?: number

Generates this many completions server-side and returns the "best"."

frequencyPenalty?: number

Penalizes repeated tokens according to frequency.

logprobs?: number

Whether to return log probabilities.

maxTokens?: number

Maximum number of tokens to generate in the completion.

minTokens?: number

Minimum number of tokens to generate.

model?: string

Model to use

n?: number

Number of completions to generate.

orgId?: string | number

Writer organization ID

presencePenalty?: number

Penalizes repeated tokens regardless of frequency.

temperature?: number

Sampling temperature to use

topP?: number

Total probability mass of tokens to consider at each step.

Generated using TypeDoc