Use a Model with the Vercel AI SDK
A Model is an OpenAI-compatible chat model, so the AI SDK’s OpenAI-compatible provider calls it. Set FACET_BASE_URL and FACET_API_KEY as in Call a Model.
npm install ai @ai-sdk/openai-compatible
import { createOpenAICompatible } from "@ai-sdk/openai-compatible";
import { generateText } from "ai";
const facet = createOpenAICompatible({
name: "facet",
baseURL: process.env.FACET_BASE_URL!,
apiKey: process.env.FACET_API_KEY,
});
const { text } = await generateText({
model: facet("support-triage"),
prompt: "My card was charged twice",
});
Send only the input. Facet adds the Model’s Instructions to every call, so leave out your own system prompt.
Stream the answer
import { streamText } from "ai";
const result = streamText({ model: facet("support-triage"), prompt: ticket });
for await (const part of result.textStream) process.stdout.write(part);
In a Next.js route handler, return result.toTextStreamResponse().
Pin a version
facet("support-triage@v4") keeps answering from v4 after newer versions go live.
Next steps
- Call a Model: every parameter and header a call takes
- Return structured output: get answers as fields or JSON