Skip to content

Ai_Cf_Meta_Llama_3_3_70B_Instruct_Fp8_Fast_Output

Ai_Cf_Meta_Llama_3_3_70B_Instruct_Fp8_Fast_Output = { response: string; tool_calls?: object[]; usage?: { completion_tokens?: number; prompt_tokens?: number; total_tokens?: number; }; } | string | AsyncResponse

Defined in: node_modules/.pnpm/@cloudflare+workers-types@4.20251118.0/node_modules/@cloudflare/workers-types/index.ts:5019

{ response: string; tool_calls?: object[]; usage?: { completion_tokens?: number; prompt_tokens?: number; total_tokens?: number; }; }

response: string

The generated text response from the model

optional tool_calls: object[]

An array of tool calls requests made during the response generation

optional usage: object

Usage statistics for the inference request

optional completion_tokens: number

Total number of tokens in output

optional prompt_tokens: number

Total number of tokens in input

optional total_tokens: number

Total number of input and output tokens

string

AsyncResponse