Videos vSx5IULvBns
Always-on agents run production without the on-call tax — Justin Smith, Resolve AI
Scene timeline
73 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 307
- whisperx 307
- chunks
- 44
- from 307 cues
- keyframes
- 43
- kept of 73 captured
- frames with text
- 43
- 1,724 lines read
- chapters
- 0
- from the source metadata
- keyframe bytes
- 11.0 MB
- word timings on 307 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-10 03:37 | 1m 42s |
stt |
done | — | 2026-08-10 03:39 | 28s |
chunk |
done | — | 2026-08-10 03:40 | 0s |
text_embed |
done | — | 2026-08-10 19:46 | 1s |
keyframe |
done | — | 2026-08-10 03:40 | 2m 43s |
ocr |
done | — | 2026-08-10 03:42 | 30s |
frame_embed |
done | — | 2026-08-10 19:46 | 7s |
Frames, and what the machine read
-
- AlEngineer0.95
- World's Fair0.97
-
- AlEngineer0.96
- World's Fair0.99
-
- LAB & PLATINUM SPONSORS0.99
- Amazon AGI Lab0.98
- ANTHROP\C1.00
- Google DeepMind1.00
- MINIMAX0.96
- OpenAI0.92
- Akamai1.00
- arize1.00
- aws1.00
- Braintrust bright data0.99
- B1.00
- Browserbase1.00
- docker1.00
- :neo4j0.91
- ORACLE1.00
- PayPal1.00
- qodo1.00
- reducto1.00
- Sonar1.00
- Makers of0.99
- togetherai1.00
- Unblocked1.00
- WorkOS1.00
- SonarQube1.00
-
- Resolve.ai1.00
- AlEngineer0.97
- World's Fair1.00
-
- AlEngineer0.97
- World'sFair1.00
- Justin Smith1.00
- Founding Product Engineer, Resolve Al1.00
- PRESENTED BY1.00
- Microsoft1.00
- 15+ years building developer tools and observability platforms0.99
- at companies like Splunk and VMware. Focused on product0.99
- design, frontend architecture, and turning complex1.00
- infrastructure data into usable experiences.0.99
- Resolve.ai1.00
- WorldsFalk0.88
- TRACK 8· JULY 2, 20260.93
- Agentic Engineering1.00
-
- AlEngineer0.98
- World'sFair1.00
- The first wave of AI changed0.99
- Bigger PRs0.99
- how we1.00
- build software1.00
- PRESENTED BY1.00
- More frequently1.00
- Microsoft1.00
- From developers (and non-developers?)0.99
- that might not know the code1.00
- BUT Developer productivity!1.00
- Resolve.ai1.00
- World's Fair0.85
- TRACK 8• JULY 2, 20260.95
- Agentic Engineering1.00
-
- AIE WF26 — Always-on age..0.83
- 2:25 PM - 2:45 PM0.94
- 60.70
- Take notes1.00
- AlEngineer0.96
- World'sFair1.00
- 70% of engineering time1.00
- Maintain platforms0.99
- Scale infra0.97
- is spent on1.00
- Debug1.00
- incidents1.00
- running software1.00
- aws1.00
- Ship hotfixes0.95
- Production1.00
- Alert1.00
- Coding1.00
- D0.84
- II0.66
- updates1.00
- Runbook1.00
- 00.52
- Patch vulnerabilities0.96
- Restore service0.98
- Escalations0.92
- Software Engineering1.00
- Resolve.ai1.00
- Spend Their Time? - doc #US53204750.98
- World's Falr0.84
- TRACK 8• JULY 2, 20260.96
- Agentic Engineering1.00
-
- Running software is getting1.00
- AIE WF26 — Always-on age..0.86
- 2:25 PM - 2:45 PM0.97
- Take notes0.99
- AlEngineer0.98
- World's Fair0.96
- exponentially harder1.00
- With Al generating majority of the code1.00
- AI IS CREATING LOT MORE ISSUES IN PRODUCTION0.98
- ERA OF "UNLIMITED TOKENS" IS COMING TO AN END0.98
- NEED FOR FULL STACK AI, NOT JUST MODELS1.00
- 1 in 5 organizations suffered a serious0.99
- incident linked to Al-generated code1.00
- Companies are scrambling1.00
- to curtail soaring AI costs0.99
- Prioritise Al Ecosystems, Not Just Al0.98
- Models: Microsoft CEO Satya Nadella0.99
- Yes amnor sue0.85
- 40%0.80
- tha0.52
- losing is appeal0.97
- building broader Al ecosystems, while emphasising that human capital will become even0.98
- The Microsoft CEO argued that the priority should shift from building frontier Al models to0.98
- more valuable in the Al era.0.99
- Jkn 85, 2026 15:21 pm 15T ①0.77
- Microsoft reports are exposing Al's1.00
- Why Domain-Specific AI Is Reshaping0.99
- more expensive than paying1.00
- real cost problem: Using the tech is1.00
- Enterprise Strategy1.00
- human employees0.97
- □ <0.56
- AI Coding Assistants Are Getting Worse0.99
- Newer models are more prone to silent but0.99
- Anthropic to disable its most advanced0.99
- deadly failure modes1.00
- Tokenminimizing: Meta1.00
- AI models after US order limiting foreign1.00
- Al-generated code contains more bugs and1.00
- Moves to Curb Employee AI0.99
- access1.00
- errors than human output0.99
- Usage as AI Costs Reach0.97
- By Craig Hale published December 18, 20250.93
- Al-generated code produces 1.7x more issues than human code0.99
- Billions1.00
- By yot Mann0.88
- Company said US government believes safeguards can be0.99
- bypassed and product used to identify software0.99
- vulnerabilities1.00
- Resolve.ai1.00
- World's Falr0.90
- TRACK 8• JULY 2, 20260.96
- Agentic Engineering0.98
-
- AIE WF26 — Ahways-on age...0.91
- 2:25 PM - 245 PM0.93
- 60.59
- Take notes1.00
- AlEngineer0.98
- World's Fair0.99
- Scale infra1.00
- Escalations1.00
- Why?1.00
- Alert response0.97
- Patck0.97
- vulnerabilities0.99
- Operating software in1.00
- production requires1.00
- Runbook updates1.00
- multiple teams1.00
- and systems0.99
- Ship1.00
- hotfixes1.00
- Restore service1.00
- Maintain platforms0.99
- Debug incidents0.97
- Resolve.ai1.00
- World's Fair0.89
- TRACK 8• JULY 2, 20260.96
- Agentic Engineering1.00
-
- AlEngineer0.99
- World'sFair1.00
- How do you fix this imbalance?1.00
- Al for Prod1.00
- Resolve.ai1.00
- Worid's Fair0.95
- TRACK 8• JULY 2, 20260.95
- Agentic Engineering1.00
-
- AlEngineer0.97
- World class engineering teams1.00
- World'sFair1.00
- using AI for prod1.00
- zscaler1.00
- DOORDASH1.00
- coinbase1.00
- fewer engineers in war rooms1.00
- Increased productivity - 30%1.00
- Increased reliability - 87%1.00
- faster investigations0.98
- debugging sessions weekly0.99
- Increased operational1.00
- hardening - 1oos of production0.97
- salesforce1.00
- MongoDB.1.00
- snowflake1.00
- expedia group1.00
- CISCO0.99
- toast0.97
- Fireworks Al0.95
- BLUEGROUND1.00
- MSCI0.96
- GGUIDEWIRE1.00
- i; veza°0.90
- ūpwind1.00
- GAMETIME1.00
- Pinecone1.00
- iFIT0.98
- Resolve.ai1.00
- World's Fair0.93
- TRACK 8• JULY 2, 20260.96
- Agentic Engineering1.00
-
- AI for prod1.00
- AlEngineer0.99
- World's Fair0.96
- AI AGENTS1.00
- + Al agents that handle on-call, incidents,0.99
- and daily operational tasks0.98
- On-call agents0.99
- Incidents agents1.00
- Background agents1.00
- Your agents1.00
- AGENT ARCHITECTURE1.00
- + Trusted to get to root cause in the most0.98
- demanding production environments1.00
- Models1.00
- Context · Reasoning0.96
- Actions1.00
- Learning1.00
- Evals1.00
- ENTERPRISE GRADE PLATFORM0.97
- + Fits into your agent ecosystem, or build1.00
- your agents on Resolve Al0.99
- Integrations · Cost efficiency · Agent Security · Usage & audit · Deployment0.96
- Resolve.ai1.00
- World's Fair0.93
- TRACK 8· JULY 2, 20260.93
- Agentic Engineering1.00
-
- Agents to run and fix your software0.98
- AlEngineer0.98
- World's Fair0.97
- AI AGENTS1.00
- On-call agent1.00
- Incidents agent0.98
- Background agents1.00
- Your agents0.96
- Autonomous triage1.00
- Shared investigation thread0.99
- Schedule on event or trigger1.00
- MCP/API/Skill0.99
- Root cause backed by evidence1.00
- Multiplayer investigation1.00
- Multi-turn chat1.00
- Drives incident channel1.00
- AI AGENT ARCHITECTURE1.00
- Evals1.00
- Models1.00
- Context1.00
- Reasoning1.00
- Actions1.00
- Learning1.00
- Absorb new model and1.00
- harness releases1.00
- Post-trained models1.00
- Frontier model1.00
- Knowledge graph1.00
- Tool fluency0.99
- Causal reasoning1.00
- Multi-agent1.00
- Guardrails0.99
- Scoped autonomy0.98
- Implicit signals1.00
- Explicit feedback0.98
- Domain specialized eval0.99
- framework1.00
- orchestration1.00
- Context engineering1.00
- coordination1.00
- Calibrated to mirror1.00
- engineer's investigation0.99
- ENTERPRISE GRADE PLATFORM1.00
- Integrations1.00
- Cost efficiency1.00
- Agent Security1.00
- Usage & audit0.97
- Deployments1.00
- 60+ connectors0.99
- Optimized token usage1.00
- Tenant isolation1.00
- Usage reports0.98
- Cloud0.92
- Custom tool integrations0.99
- Credit based pricing0.96
- Data protection1.00
- Trace agent reasoning1.00
- Resolve AI Managed VPC0.99
- w/BYOK*0.97
- Resolve.ai1.00
- Worid's Falr0.87
- TRACK 8· JULY 2, 20260.95
- Agentic Engineering1.00
-
- Agents to run and fix your software0.99
- AlEngineer0.96
- World's Fair0.99
- AIAGENTS0.99
- On-call agent0.98
- Incidents agent1.00
- Background agents0.99
- Your agents1.00
- Autonomous triage1.00
- Shared investigation thread0.99
- O Schedule on event or trigger0.97
- MCP/API/Skill0.99
- Root cause backed by evidence1.00
- Multiplayer investigation0.98
- Multi-turn chat0.97
- Drives incident channel0.98
- AI AGENT ARCHITECTURE0.97
- Evals1.00
- Models1.00
- Context1.00
- Reasoning1.00
- Actions1.00
- Learning1.00
- harness releases1.00
- Absorb new model and0.99
- Frontier model1.00
- Tool fluency1.00
- Multi-agent0.96
- Scoped autonomy1.00
- Guardrails0.99
- Explicit feedback1.00
- Implicit signals1.00
- Domain specialized eval0.98
- framework1.00
- orchestration1.00
- Context engineering0.97
- coordination0.98
- engineer's investigation1.00
- Calibrated to mirror0.99
- ENTERPRISE GRADE PLATFORM0.98
- Integrations1.00
- Cost efficiency1.00
- Agent Security1.00
- Usage & audit1.00
- Deployments1.00
- 60+ connectors0.99
- Optimized token usage0.99
- Tenant isolation1.00
- Usage reports1.00
- Cloud1.00
- Custom tool integrations0.99
- Credit based pricing1.00
- Data protection0.98
- Trace agent reasoning1.00
- Resolve AI Managed VPC0.97
- w/BYOK *0.90
- Resolve.ai1.00
- World's Fair0.90
- TRACK 8• JULY 2, 20260.95
- Agentic Engineering1.00
-
- AlEngineer0.98
- World's Fair0.96
- LIVE POLL · SHOW OF HANDS0.96
- Are you using0.98
- agents in your1.00
- daily work today?1.00
- Resolve.ai1.00
- TRACK 8• JULY 2, 20260.96
- Agentic Engineering1.00
-
- AlEngineer0.99
- Most production work is always there and0.98
- World'sFair1.00
- not always α critical event0.98
- Watch the deploy that just went out0.99
- On-call has a page. Incidents have a bridge.1.00
- Write the morning deploy and incident digest1.00
- INVISIBLE TOIL0.98
- Re-investigate the p99 drift that came back1.00
- This work has no critical1.00
- trigger that makes anyone1.00
- Produce the weekly capacity report1.00
- account for it, so it stays1.00
- invisible and adds up.1.00
- Run the recurring health check nobody owns1.00
- Resolve.ai1.00
- Worid's Fair0.95
- TRACK 8· JULY 2, 20260.95
- Agentic Engineering1.00
-
- Every operational task requires1.00
- AlEngineer0.99
- World'sFair1.00
- two things0.96
- Task = Execution × Production Context0.98
- PRESENTED BY1.00
- Microsoft1.00
- Execution1.00
- Production Context1.00
- The task in isolation, the actual analysis or change.1.00
- What you know about the specific environment the1.00
- Small and roughly fixed.0.99
- work is being done in to know how to execute and1.00
- evaluate the work being done. Knowledge and tools.1.00
- Large and growing.0.99
- Production Context » Execution.0.99
- Navigating your environment is a major contributor to toil.0.99
- Resolve.ai1.00
- Worid's Fair0.89
- TRACK 8• JULY 2, 20260.95
- Agentic Engineering1.00
Transcript
307 cues· 4,711 words· 24,653 chars
- 0:12 Hello, hello.
- 0:15 Hey everybody, welcome to this talk, always on agents run production without the on-call text.
- 0:23 My name is Justin Smith, one of the founding product engineers at Resolve AI.
- 0:28 Been in the space for about 15 plus years in the sort of monitoring, observability, how do you kind of operate production systems space.
- 0:37 Was at Splunk for a while, was one of the architects on the observability suite there.
- 0:42 I spent a good tenure at VMware.
- 0:45 Really, really enjoy product design and front end architecture.
- 0:48 How do people experience a product or a use case or something like that?
- 0:54 That's the stuff I like to dabble in.
- 1:00 But I want to talk a little bit about the first wave of AI.
- 1:04 And it's been a fun one.
- 1:06 I think the first big wave, and I'm sure we've all experienced this, is just how we build software.
- 1:13 But there's some sort of net effects of that.
- 1:15 It's a lot of bigger PRs that are coming through.
- 1:18 We definitely see a lot of this a lot more frequently.
- 1:21 So people are shipping code at a much faster rate from developers and we're beginning to see maybe from even non-developers that maybe don't actually know the code or what it's doing or the sort of like operating principles behind it.
- 1:35 But we're getting developer productivity
- 1:39 And that's good, right?
- 1:40 That's a good thing that we're all able to produce more and faster.
- 1:45 kind of, sort of, what we actually found out, and this was a survey study done, is that 70% of the time from an engineer is actually not just like, is not focused just on writing code.
- 1:56 It's actually spent on actually running the code that is actually shipped into production.
- 2:00 Maintaining all the platforms, scaling the infrastructure, debugging all the incidents and being on call, shipping hot fixes, right, dealing with alerts,
- 2:10 updating all the sort of run books and operating procedures, restoring services, dealing with escalations, dealing with sort of like questions from other teams and things like that.
- 2:20 So really coding was never the big bottleneck, right?
- 2:25 A lot of it was really around, thank you, Granola.
- 2:28 A lot of it was really around like how do we actually run these things sort of in production?
- 2:34 And that's getting harder and harder and harder.
- 2:37 AI is creating a lot more issues in production as AI code sort of goes through.
- 2:43 It's not clear we have the right sort of structures in place to deal with the amount of kind of changes that are coming through.
- 2:49 Unlimited tokens is sort of coming to an end.
- 2:51 The token max, right, they're starting to clamp down.
- 2:54 Prices are going up.
- 2:55 Companies are getting a lot more stringent on what's being used for AI.
- 3:00 We need full stack AI.
- 3:01 It's not just about the models anymore.
- 3:03 It's about the context around the models and what the models can do inside of a specific domain.
- 3:08 These become the problem areas that we need to sort of focus and tackle on.
- 3:13 And this is true today, right?
- 3:15 So it's creating more sort of complexity inside of our environment.
- 3:19 I mean, the reality is that systems have always been complex.
- 3:22 That's why we have these big tools that can try to give us insights into these systems.
- 3:28 There are multiple teams, there's multiple systems that are all having to work together and they all have their own goals that they're trying to deliver towards, but you have organizational goals.
- 3:37 And how do you keep all of this sort of in
- 3:42 Let me get rid of this.
- 3:43 How do you keep all of this in balance, right?
- 3:46 How do you pull all of this stuff together in a way that actually helps you and facilitates your organization?
- 3:55 And the answer is, well, you gotta use AI inside of production to deal with sort of the amount of increase of complexity that AI is kind of putting into your product or into your system.
- 4:08 And so that's where Resolve, you know, this was kind of our sort of hypothesis from the beginning was, you know, we're going to see an influx in, you know, issues coming out of coding, just the increase in coding velocity.
- 4:22 There's going to be more need for kind of AI to actually operate and run these systems.
- 4:26 We're, you know, lucky to work with, you know, some world-class engineering teams that are solving like really difficult problems at
loading