Together AI

A global fintech's coding agent traffic was spiky and concentrated in engineering hours. It grew every time another team adopted an agent, a hundred teams moving independently, all at once. No fixed capacity plan could track that. Dedicated Model Inference gave engineers control instead. They provision endpoints, ship model updates, and test changes themselves. No tickets, no waiting on us. See what changed: https://lnkd.in/e7dzUXdF

We are proud to be launch partners for NVIDIA Open Agent Safety Platform. We believe safe and responsible AI development is critical as the use of agents scale and they get more prevalent. Together AI is committed to safe AI and we have built platform capabilities for secure development and deployment of agents. We will continue investing in this space, including our work with NVIDIA on OpenShell.

A simpler way for businesses to use AI. At #ApsaraConference2026, Ted Cui, VP of Engineering and Inference Platform at Together AI, shared his perspective on how AI is becoming more accessible with businesses able to tap into AI capabilities without having to navigate the complexity behind them. Explore more: https://lnkd.in/emEvJkue #AgenticEra #AgentNative #AIAgentsAtApsara #BringYourAgent #AlibabaCloud

We fine-tuned a 4B Jev-like classifier for $17 and are releasing a full tutorial on how we did it. It's called tev1-4B-experimental, and it's built on Qwen3.5 4B. It's available today on our serverless platform for $0.042/1M input tokens & $0/1M output tokens. The tutorial teaches you exactly how to finetune your own decision classifier from scratch for less than $20! In addition to the tutorial, we're also open sourcing the model weights, the code & the data recipe we used to train it. Check it out below!

Coding agents are moving fast from prototype to production. The infrastructure question is what's left. Join Parth Sareen from Ollama and Zain Hasan from Together AI at The AI Conference for a breakout on what it actually takes to build coding agents on open models, and run them at scale.

This week in London, we got into the real economics of running AI in production: cost, model selection, routing, reliability, and what it actually takes to make open models work at scale. Thanks to Abhijit Mehta (Deel), Alan Shen (MiniMax), and Max Ryabinin and Sarung Tripathi from Together AI for the perspectives, and to everyone who joined us to discuss what it takes to hit production-grade reliability without giving up performance. Until next time.

Moving from closed to open source models is becoming a much more practical path for production AI. We put together the five-stage playbook we’ve seen work across customer migrations: Discover → Evaluate → Adapt → Decide → Production The key is to start with your workload. Narrow down models using relevant benchmarks, replay real production traffic to evaluate quality and performance, adapt the prompt or model where needed, quantify the ROI, then roll out gradually in production. In some cases, we’ve seen customers reduce costs by up to 70% after moving to open models. Read the full playbook: https://lnkd.in/eNaKbNF5

I'll be giving a joint talk with Prashanth Thinakaran of Clockwork Systems this Thursday at AI Infra Summit on "Preserving Progress and Goodput: Workload-Aware Fault Tolerance for Distributed Training", in the Data & Models track -- if you're wanting see how you can reduce your goodput loss by 3-5x for large-scale distributed training jobs in the face of GPU hardware failures with checkpoint-free live migration, check out this talk! https://lnkd.in/gMuDc-Y9 #AIInfraSummit

Choosing the right open model for production is harder than it looks. Benchmarks tell you one story. Your actual workload tells you another. At The AI Conference, our Head of Field Engineering Rochelle Mattern is walking through how teams should actually shortlist and evaluate open models: what to weigh, what to ignore, and how to test against the requirements that matter for real applications, not leaderboard scores. If your team is building with open models, this is worth your time.

DeepSeek V4.1 Flash is now available on Together AI. DeepSeek’s latest Flash model is built for coding, agentic workflows, and long-context tasks, with 552B total parameters, a 1M context window, and native multimodal support. Start building now https://lnkd.in/egrR9J-m