Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

Today’s Episode90% of teams have adopted AI, yet 56% of CEOs say they saw no major financial benefit. Both metrics are accurate, and I’m pretty sure you fall somewhere between them.With new AI tools flooding the market every week, it is safe to say that every team has its own AI setup by now. But are any of those setups in sync with each other?I’ve been building this argument in stages. First, Carl Vellotti showed you how to build a personal OS, and Hannah layered it with building a team OS. Jiaona and Mikhail vouch for a full-blown company OS as well.So, today you get a screen share.My guests are the product team at Together AI that raised $800M at an $8.3B valuation and sells inference and fine-tuning to developers. Charles Zedlewski is their CPO who brought Necoline, Pavneet, and Hassan on the call to talk about how to build a shared context repo.Their customers are already agents and their engineers are already agent-first. Their product team had no choice but to catch up.Brought to you byArize - Ship AI agents and features faster with fewer regressions.Get a full year of Arize, Bolt.new, Airtable, Speechify, Descript, Magic Patterns, Linear, Dovetail and Mobbin at bundle.aakashg.com.10 Key takeaways1. Individual productivity can move a company backwards - The team's starting question was not how to make each person faster. It was whether everyone generating unlimited code and content actually added up to progress. Charles called the failure mode flooding your coworkers' context windows, where everyone launches slop at each other.2. The shared repo holds context and skills, not code - Markdown and YAML files covering customer intelligence, sandboxes, and the output of strategy meetings broken down by mission and milestone. Anything tied to a specific codebase stays out of it. The point is that a PM can read another team's context and draft a real proposal before taking up that PM's time.3. Skills live closest to the work they touch - If a skill references code inside one team's repo, it stays colocated there. Everything else goes to a personal or shared repo. Test it on a branch, use it a few times, and only push to main once it proves repeatable. Niche ones never get pushed.4. Shared context is a hierarchy, not a flat pool - The team abandoned the idea that everyone should carry everyone's context. Most people have no motivation to learn the depth of someone else's area. They want the one answer they came for. Some people live at the bottom of the hierarchy, most just traverse the top.5. The PRD stopped being a gate - Historically it was the document everyone aligned on before building started. Together treats it as a trigger for ideation and problem solving instead. One to two pages, defining the customer problem, a few solution options, and a sample user journey. That is enough to argue about whether the thing is worth building.6. A prototype replaces the bulk of the long document - A separate skill takes the one pager and produces a prompt for a design tool, and that visual is where the sharpest feedback shows up, from engineering and marketing alike.7. Discovery collapsed from half a day to five minutes - The research agent pulls from the support platform, the project tracker, and internal docs at once. It surfaced 19 tickets filed in two months, flagged that the feature had been partially built and abandoned, and gave verbatim quotes with sources. The value is not the summary. It is not duplicating work someone already started.8. Automate execution, keep decisions human - Defining the feature, the API surface area, and the abst