Sample encountered an error: undefined, when using GitHub Models Playground (JavaScript SDK)

[ourahma]

Body

Hey,

I am testing the new GitHub Models / Azure AI Inference with the JavaScript SDK (@azure-rest/ai-inference).
I tried to adapt the official sample code from the Playground, but I keep getting the following error:

The sample encountered an error: undefined

---

Example code

Here is the relevant part of my code (almost identical to the sample):

export class LLMClient {
    private apiKey: string;
    private model: string;
    private apiUrl: string;

    constructor(apiKey: string, model: string = "deepseek/DeepSeek-V3-0324") {
        this.apiKey = apiKey;
        this.model = model;
        this.apiUrl = "https://models.github.ai/inference";
    }

    async generateReadmeContent(projectInfo: ProjectInfo): Promise<string> {
        const prompt ="My prompt";
        
        const client = ModelClient(this.apiUrl, new AzureKeyCredential(this.apiKey)); 
        
        try {
            const response = await client.path("/chat/completions").post({
                body: {
                    messages: [
                        { role: "user", content: prompt },
                        { role: "system", content: "The content ...." }
                    ],
                    temperature: 1.0,
                    top_p: 1.0,
                    max_tokens: 1000,
                    model: this.model,
                },
                contentType: "application/json",
        
            });

            if (isUnexpected(response)) {
                
                throw response.body.error; 
            }

            return response.body.choices[0].message.content;

        } catch (error) {
            console.error("The sample encountered an error:", error);
           
        }
    }
}

---

Context

• SDK: @azure-rest/ai-inference
• Runtime: Node.js (ESM, "type": "module")
• Token: created with model:read permission as indicated in the GitHub Models Playground docs

---

Question

• Is this a known issue with the JS SDK?
• Or am I missing something when following the Playground sample?

I would really appreciate any clarification or guidance on this issue. Thanks a lot for your time and support 🙏

Guidelines

• I have read and understood this category's guidelines before making this post.

[varunpats]

Hey @ourahma,

Below are the few steps to debug the exact issue.

1 - Enhance error logging: log response.status, headers, and body to diagnose.
2 - Confirm you're using @azure-rest/ai-inference and not the Azure OpenAI SDK (they are different).
3 - Verify endpoint structure and optionally pass apiVersion explicitly.
4 - Make sure the model (e.g. deepseek/DeepSeek-V3-0324) is supported in your deployment context (chat vs agent).
5 - If the issue persists, seek Azure support or file a GitHub issue with full logs and context.

Above steps will provide more details about the issue and certainly you'll be able to find a fix.

Let me know it if works!

[andriiafanasiev]

It looks like the error might be due to how the response is being handled or how the request is structured. A few things to check:

Make sure the AzureKeyCredential is correctly imported from @azure/core-auth and your API key has the required model:read scope.

Verify that the endpoint https://models.github.ai/inference is reachable from your Node.js environment.

Try logging the full response object before calling isUnexpected() to see if there’s an error message returned. Sometimes the SDK wraps errors in a way that response.body.error is undefined.

Ensure your messages array is properly structured and non-empty; sometimes an empty or malformed system/user message can cause undefined errors.

This is not a widely reported bug, so it’s likely a small mismatch between Playground usage and SDK call.

If this helps, please mark this comment as the Accepted Answer.