Videos LZuWZRze3MU
The New Primitives: Building AI Native Software — Kwindla Kramer, Daily
Scene timeline
103 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 205
- whisperx 205
- chunks
- 36
- from 205 cues
- keyframes
- 69
- kept of 103 captured
- frames with text
- 69
- 810 lines read
- chapters
- 16
- from the source metadata
- keyframe bytes
- 12.8 MB
- word timings on 205 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-09 21:08 | 0s |
stt |
done | — | 2026-08-08 23:33 | 23s |
chunk |
done | — | 2026-08-08 23:33 | 0s |
text_embed |
done | — | 2026-08-10 19:34 | 1s |
keyframe |
done | — | 2026-08-08 23:33 | 3m 28s |
ocr |
done | — | 2026-08-08 23:36 | 20s |
frame_embed |
done | — | 2026-08-10 19:34 | 11s |
Frames, and what the machine read
-
- AlEngineer0.95
- World's Fair0.97
-
- AIEngineer0.95
- World's Fair0.99
-
- LAB & PLATINUM SPONSORS0.99
- Amazon AGI Lab0.98
- ANTHROP\C1.00
- Google DeepMind1.00
- MINIMAX0.94
- OpenAI0.92
- Akamai1.00
- arize0.93
- aws1.00
- Braintrust bright data0.98
- B1.00
- Browserbase1.00
- docker1.00
- :neo4j0.92
- ORACLE1.00
- PayPal1.00
- qodo1.00
- reducto1.00
- Sonar1.00
- Makers of0.99
- togetherai1.00
- Unblocked1.00
- WorkOS1.00
- SonarQube1.00
-
- AlEngineer0.99
- World's Fair0.98
-
- AlEngineer0.99
- World'sFair0.96
- PRESENTED BY1.00
- The New0.97
- Microsoft1.00
- Primitives1.00
- Building Al-Native Software1.00
- Kwindla Hultman Kramer1.00
- @kwindla1.00
- Daily.co |Pipecat0.99
- TRACK 6· JUNE 30, 20260.96
- World'sFair1.00
- Voice & Realtime Al0.99
-
- AlEngineer0.99
- 19451.00
- 021.00
- World'sFair1.00
- PRESENTED BY1.00
- Vannevar Bush1.00
- Microsoft1.00
- As We May Think0.97
- GQ0.71
- TRACK 6· JUNE 30, 20260.96
- World'sFair1.00
- Voice & Realtime Al0.98
-
- AlEngineer0.98
- AS WE MAY THINK0.99
- 031.00
- World's Fair0.96
- Document display on a screen0.98
- Data transmission over networks, including by0.99
- radio1.00
- Document scanning and optical character0.99
- recognition1.00
- The personal computer0.99
- • Speech to text0.97
- GoPro camera0.99
- Text to speech1.00
- The Amazon Kindle store0.99
- • Programming languages0.98
- • Voice interfaces0.96
- • Hypertext0.94
- Brain-computer interfaces0.98
- • Search engines0.97
- GノQ0.58
- TRACK 6· JUNE 30, 20260.97
- World's Fair0.98
- Voice & Realtime Al0.99
-
- AlEngineer0.99
- 061.00
- World'sFair1.00
- Loops1.00
- PRIORS0.88
- Tool calls1.00
- Context engineering1.00
- LLMs1.00
- GPUs1.00
- NO-PRIORS.COM1.00
- GノQ0.59
- TRACK 6· JUNE 30, 20260.96
- World'sFair1.00
- Voice & Realtime Al0.98
-
- AlEngineer0.99
- World'sFair1.00
- Loops1.00
- PRIORS0.86
- Tool calls1.00
- Context engineering0.99
- LLMs1.00
- GPUs1.00
- NO-PRIORS.COM1.00
- TRACK 6· JUNE 30, 20260.96
- World'sFair0.97
- Voice & Realtime Al0.99
-
- AlEngineer0.99
- World'sFair1.00
- Loops1.00
- PRIORS0.89
- Tool calls1.00
- Context engineering1.00
- LLMs1.00
- GPUs1.00
- NO-PRIORS.COM1.00
- TRACK 6· JUNE 30, 20260.96
- World'sFair1.00
- Voice & Realtime Al0.99
-
- AlEngineer0.97
- Agents ++1.00
- World'sFair1.00
- Multi-model1.00
- harnesses1.00
- Software copilots1.00
- Org-level harnesses1.00
- TRACK 6· JUNE 30, 20260.96
- World'sFair1.00
- Voice & Realtime Al0.99
-
- AlEngineer0.99
- 081.00
- World's Fair0.99
- Elle0.93
- WOO0.50
- Ele0.86
- Edit0.98
- Options0.98
- Navigate0.96
- Annotate Starting Points1.00
- NCSA Mosaic for MS Windows0.97
- Personal1.00
- Help0.98
- <body>0.97
- <base href=htspi//ww.yahoo.com/>0.83
- <html>0.87
- <head>0.99
- <title>Yahool</title>0.96
- </bead>0.95
- <form action=*http://search.yahoo.com/bin/search>0.95
- YAHOO!1.00
- <a href-htsp1//o.yahoo.com/homet/SnaceID-0:U/AdID-4833.0.85
- <a href/bin/tonl><IMc alt-[Yahoo1]" ismap vidth-460 he0.68
- <a hret-*/homet/7httpi//local.vaboo.com/local/">Get Local-0.85
- <1-- Parans 0, 4833 ->0.87
- <center>1.00
- <a href-"/homet/7httpi//w.yahoo.com/picka/*>Weekly Picki0.91
- 1.00.97
- Re SpX T A0.55
- Yeloe Pos Posie Reish - Ctr Man – Puk Outai et Scos0.51
- • Aats nd Humaites - Achectes hmturscly Lémoes0.51
- • Pusiness and Froomy(ta) Cmcs Ioamt Qand0.56
- • Compoters and Iatersela'l - Itrt Www Schret Meda0.56
- ● Edacatien sercts Ka12 Cade Eatrace0.52
- • Entertarsewt Xra Casl Lika Mones Maic Heor0.53
- ● Gevermeat 9 Eections Poloc (Xtra' Amoes Law Mcarr0.65
- • Heat ral Mehone Erss Decares Emes0.54
- • Refereace - Labrins Dictomarsa Phone Humbers0.61
- • News and Media[Xhaf - rent Evestt Magstoes TV Niewisiets0.62
- ut510.000.68
- WedidyPia0.56
- <a href=/search,html> Options</a>0.82
- <a href-hoen/lhai//munie.yaho.com>Stock Quotea</a>0.58
- <font size=-1>0.94
- <a href-"/homen/7httpu//yR.yaboo.com/yt.hm?FAM:yahookSEC=0.78
- <a href-*/homen/7httpi//ww.yahoo.com/search/people/>Peoj0.82
- <a hretomen/http//.vaboo.com/yaboo/>city ap0.58
- <a href-*/homen/7httpi//sports.yahoo.com>Sports Seores</0.88
- <a href-"Ata/Architecture/>Architecture</a>,0.79
- <a hret-"/Arta/Photosraphy/">Photography</a>,0.77
- <input size-30 name-p> <input type-submit value-Search>0.94
- <ul>0.96
- <11>0.98
- <a href-/Arta/><b>arts and Bumanities</b></a> -0.86
- </font>0.99
- </center>1.00
- <a href-"/Arta/Humanities/Literature/">Literature</a>...0.95
- ● Science - CS Paags Auong agseerng0.59
- • Serial Sdece Aatcosiss asake Eutis0.50
- • Society and Coltere Prole Eavcomeng Rrion0.65
- <a href"/Business_and Economy/Markets_and Inveatnenta>0.76
- <a hret=/headlines/buainesa/> <b>[xtrat |</b></a>-0.72
- <a href-"/Business_and_Economy/Conpanies/>Companies</a>,0.92
- <1>0.67
- <a href-"/Business_and_Economy/Classifieda/>Classifieds<0.93
- TRACK 6· JUNE 30, 20260.97
- World's Fair0.99
- Voice & Realtime Al0.99
-
- AlEngineer0.99
- 1995-20251.00
- 091.00
- World's Fair0.99
- Choose a ride0.99
- El0 050.69
- Elle Edi Oplions Mavigate Annotate Starting Points Personal0.93
- [0]0.62
- Holp0.86
- UberX 40.95
- 11:07 - 2 min away0.95
- Affordable rides,all to yourself0.90
- $10.851.00
- 11:07 -3 min away0.92
- Uber Green 41.00
- Eco-friendly1.00
- $10.851.00
- Comfort 40.99
- 11:07-3 min away0.93
- $14.241.00
- Newer cars with extra legroom0.99
- • Eetertatmeettad - Cad Lnia Mos Hanc Het0.52
- UberXL 60.98
- 11:08-4 min away0.97
- Affordablerides for groups up to 60.90
- $14.511.00
- • Reere d Spert( t es Tn As Qo0.56
- • Refereare - Lácons Dicsnes Pose Huchers0.61
- Comfort Electric 440.97
- 11:07-4 min away0.96
- $15.141.00
- Premium zero-emission cars1.00
- 1108-4 min away0.99
- Uber Pet 40.96
- $13.951.00
- Affordable rides for you and your pet1.00
- TRACK 6· JUNE 30, 20260.96
- Voice & Realtime Al0.98
- World's Fair1.00
-
- AlEngineer0.96
- World'sFair1.00
- 101.00
- Abacus1.00
- Keyboard accounting1.00
- machine1.00
- Arithmetical machine1.00
- Memex1.00
- o0.72
- 19451.00
- PRESENTED BY1.00
- well attempt to grasp the game of poker entirely by1.00
- the use of the mathematics of probability. The abacus,0.98
- Microsoft1.00
- with its beads strung on parallel wires, led the Arabs0.99
- to positional numeration and the concept of zero many0.99
- centuries before the rest of the world; and it was a0.99
- useful tool —so useful that it still exists.0.98
- It is a far cry from the abacus to the modern key-1.00
- board accounting machine. It will be an equal step1.00
- to the arithmetical machine of the future. But even1.00
- this new machine will not take the scientist where he0.99
- needs to go. Relief must be secured from laborious1.00
- detailed manipulation of higher mathematics as well,0.99
- TRACK 6· JUNE 30, 20260.97
- World'sFair1.00
- Voice & Realtime Al0.98
-
- AlEngineer0.99
- World'sFair1.00
- 19671.00
- 151.00
- Star Trek1.00
- GノQ0.64
- TRACK 6· JUNE 30, 20260.97
- World's Fair0.97
- Voice & Realtime Al0.97
-
- AlEngineer0.99
- World'sFair1.00
- 19671.00
- 151.00
- Star Trek1.00
- GQ0.63
- TRACK 6· JUNE 30, 20260.96
- World's Fair0.96
- Voice & Realtime Al0.98
-
- AlEngineer0.99
- World'sFair1.00
- 19671.00
- Star Trek1.00
- TRACK 6· JUNE 30, 20260.96
- World's Fair0.96
- Voice & Realtime Al1.00
-
- AlEngineer0.99
- 19671.00
- World'sFair0.97
- Star Trek1.00
- TRACK 6· JUNE 30, 20260.97
- World'sFair1.00
- Voice & Realtime Al0.98
-
- AlEngineer0.99
- 19671.00
- World'sFair1.00
- Star Trek1.00
- TRACK 6· JUNE 30, 20260.96
- World's Fair0.97
- Voice & Realtime Al0.98
Transcript
205 cues· 3,132 words· 17,706 chars
- 0:12 Good morning.
- 0:14 I know a lot of you in this room.
- 0:16 It's great to see you.
- 0:17 Welcome to the Voice Track at AI Engineer World's Fair.
- 0:20 For those of you who don't know me, my name is Quinla Holtmann-Kramer.
- 0:24 I work at a company called Daily.
- 0:26 We make developer infrastructure for real-time audio, video, and AI.
- 0:31 And we're the team behind Pipecat, which is the most widely used framework for building voice agents today.
- 0:37 Pipecat is open source and vendor neutral.
- 0:39 It's used by companies like AWS and Nvidia and Anthropic and thousands of startups and scale-ups and enterprises.
- 0:48 And today I'm gonna talk about what kind of agents we're building today, including voice agents, but not just voice agents, and what I'm interested in building next.
- 0:58 And I'm gonna try to put all this in the context of the roughly 80-year history of digital computing so far.
- 1:06 So we've got a lot to cover, we're gonna go fast.
- 1:09 But we're gonna start in 1945 with an essay called As We May Think written by an engineer, an academic, a civil servant named Vannevar Bush.
- 1:19 Bush deeply understood technologies ranging from analog computers to photography to radio to radar.
- 1:27 And as we may think is an extraordinary piece of writing, the essay predicts the development of, among other things, document display on a screen, and document scanning in OCR, and speech-to-text, and text-to-speech, and programming languages, and hypertext, and search engines, and data networks, something like the GoPro camera, something weirdly like the Amazon Kindle store, and voice interfaces, and brain computer interfaces.
- 1:53 And I've been thinking a lot about, as we may think lately, because Bush wrote this essay right at the very beginning of the computing age, and I think it feels to most of us like we're working right at the beginning of a new age, the intelligence age.
- 2:09 So what will we build?
- 2:13 Well, at the moment, we're building agents, and we're having a lot of fun doing it.
- 2:19 And a lot of the AI engineering work we're all talking about this week is focused on building a full, coherent software stack for AI agents.
- 2:28 Here is Satya Nadella talking a couple of weeks ago on a crossover episode of the no priors and latent space pod about the challenges of building agents in 2026.
- 2:37 That's right.
- 2:39 So in some sense, you kind of want the harness to define the models, the data, and the tools.
- 2:49 And so that you have a loop across those three.
- 2:51 And so what we are trying to, first of all, make sure is each of our products that we build, whether it's GitHub Copilot or the security stuff we showed with M-Dash or even the discovery for science, it doesn't matter.
- 3:04 All of them are multi-model harnesses with tools access so that you can do this progressive disclosure of tools even so that they're token efficient.
- 3:15 And then you're feeding it with very rich context.
- 3:20 So if you were here last year at AI Engineer World's Fair, you could draw a through line from the things we were talking about last year to loops and tool calls and context engineering and the stuff we're focused on this year to some emerging ideas.
- 3:34 You can hear that in Nadella's clip just there.
- 3:38 I think of this as kind of agents plus plus, like multi-agents.
- 3:41 model harnesses and software co-pilots embedded in every single piece of software, organization level harnesses.
- 3:47 So how do we go from Agents to Agents++ to the next thing beyond Agents?
- 3:54 Well, the last time we had this kind of massive change in how we write software and what we write software for and to do was the early days of the World Wide Web.
- 4:03 And I was around for the early days of the World Wide Web.
- 4:06 I was a baby programmer in 1995.
- 4:08 And the thing we talked about all the time in 1995, the way we talk about agents today, is web pages.
- 4:15 I spent a lot of time writing HTML by hand and building web server software in C and indexing and search software in C and authoring tooling and management infrastructure for web pages in Perl.
- 4:27 I was as excited about HTML in 1995 as I am about agents today.
- 4:34 And the web page is still with us and it's still important and useful, but today we talk a lot more about web applications and native mobile applications than we talk about web pages.
- 4:44 So just like we went from web pages to full blown web and native mobile, clearly we're gonna chart a path to a new fully AI native software that comes after Agents and Agents++.
- 4:57 So let's keep going back in time in order to think about this future.
- 5:02 Here's a timeline Vannevar Bush lays out in As We May Think.
- 5:05 He talks about the abacus, which was both an immensely useful device for doing practical, everyday mathematical calculations, and also an incredibly important theoretical tool that led to ideas like numeric place value and the concept of zero.
- 5:22 And Bush talks about the massive jump from the abacus to the state-of-the-art electromechanical keyboard calculating machines that he had in 1945.
- 5:33 And then he posits that we're about, or he is about to
- 5:40 witness and help create an equally large leap to what he calls the arithmetical machine.
- 5:48 And then he goes a step even further than that and he invents or designs in that essay a device he calls the mimics.
- 5:56 And we have a little bit of an advantage over Bush in 1945.
- 5:59 We've seen 80 years of computing play out.
- 6:02 So we can modify his timeline a little bit.
loading
Chapters
- 0:00 Daily, Pipecat, and what comes after agents
- 1:31 What Vannevar Bush predicted in 1945
- 2:13 Nadella on multimodel harnesses
- 4:12 Agents are the web pages of 1995
- 5:25 From the abacus to the stored program computer
- 6:46 The 1950s: getting human intent into the machine
- 7:30 The 1960s: interactivity, Sketchpad, and Star Trek
- 8:51 The 1970s: abstractions that scale
- 9:32 VisiCalc and why it did not replace accountants
- 10:49 Knowledge Navigator, Apple's 1987 prediction
- 12:46 The web was multimodal from the start
- 13:24 Minority Report, Iron Man, and building it for real
- 17:10 Cloud, then agents, then what
- 18:24 Knowledge Navigator rebuilt on real technology
- 19:38 Gradient Bang and the primitives it exercises
- 20:52 Closing