Videos JRTAtZ5iBkU
HTML is All You Need (for Agents to Make Graphics) - Amol Kapoor, Nori
Scene timeline
17 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 99
- whisperx 99
- chunks
- 12
- from 99 cues
- keyframes
- 17
- kept of 17 captured
- frames with text
- 17
- 130 lines read
- chapters
- 0
- from the source metadata
- keyframe bytes
- 1.1 MB
- word timings on 99 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-10 18:53 | 2m 00s |
stt |
done | — | 2026-08-10 18:55 | 10s |
chunk |
done | — | 2026-08-10 18:55 | 0s |
text_embed |
done | — | 2026-08-10 19:56 | 0s |
keyframe |
done | — | 2026-08-10 18:55 | 20s |
ocr |
done | — | 2026-08-10 18:56 | 7s |
frame_embed |
done | — | 2026-08-10 19:56 | 3s |
Frames, and what the machine read
-
- AMOL· CEO, NORI AGENTIC0.97
- docs1.00
- code1.00
- data1.00
- slack1.00
- Hi -I'm Amol.0.90
- We spend a lot of time thinking about how coding agents really work.0.99
-
- agents can ONLY write code0.99
- slides1.00
- docs1.00
- charts1.00
- • email0.84
- CODING AGENT0.99
- video1.00
- sheets1.00
- websites0.95
- diagrams1.00
- dashboards1.00
- You have to be able to think like an agent to get it to do what you want it to do.0.99
-
- THE REAL COST0.98
- 34,0001.00
- hüman-years0.96
- ...spenton slides. every single day.0.98
- the world pours something like 34,000 human years into making slide decks.0.99
-
- TITLE1.00
- K0.94
- snap1.00
- All motions and patterns that make sense for our geospatial view of the world.1.00
-
- THE SKEPTIC'S CASE1.00
- “Sure — but agents can't actually reason0.98
- about space.”0.97
- ARC-AGI1.00
- INPUT1.00
- OUTPUT0.98
- and there are whole benchmarks like ARC-AGl that are built exactly around that0.99
- premise.1.00
-
- > Draw a pelican riding a bicycle. I0.97
- gpt-40-mini0.97
- gemini-1.5-flash1.00
- claude-3-opus1.00
- Here's some examples of what the models actually give you on this test.0.99
-
- BUT WHY, THOUGH?0.97
- L 190.0 48.0 q 18 14 30 2 Z0.98
- C -3.2 12.6 8.1 19.4 22.0 170.95
- M 56 128 a 30 30 0 1 0 60 00.98
- L 105 80 150 1280.97
- 102600.99
- 1681.00
- C 0.882 0.41 0.130.94
- 0.770.99
- 0.550.96
- .211.00
- M 134 35 1 0.001 0.0010.95
- q 88.7 312.4 71.2 290.1 144 560.98
- M 100 84 104 122 z0.97
- If I asked you, someone who is presumably human, to hand-write an SVG of a0.99
- pelican,1.00
-
- Imagine a language that...0.98
- describes visual layout0.99
- has mountains of training data0.99
- Imagine a language that's incredible at describing layout, that models have seen1.00
- and trained on billions of examples of,1.00
-
- Imagine a language that...0.99
- describes visual layout1.00
- has mountains of training data0.99
- models understand it intuitively1.00
- renders straight to pixels0.99
- runs basically everywhere0.98
- that they understand intuitively, that renders to pixels and can run everywhere.0.99
-
- model writes meaning1.00
- Q3 Results0.99
- <h1>Q3 Results</h1>0.99
- <div class="grid"> .… </div0.96
- browser1.00
- <canvas id="chart"></canvas>0.99
- →0.59
- charts1.00
- the model never places a coordinate.0.99
- And you can get all sorts of visual effects, charts and layouts,0.99
-
- SAME PROMPT· DIFFERENT MEDIUM0.98
- in HTML0.98
- gemini-1.5-flash, as SVG1.00
- as HTML - structure you can read0.99
- And you can read and theme and edit every single line of it.1.00
-
- THE REFRAME0.98
- PRESENTING MODE0.99
- Q3 Results0.99
- EDITING MODE0.98
- HTML1.00
- same result0.99
- So you can just pick the editing format that the agents are already good at,0.99
- HTML,1.00
-
- VIDEOS → HTML0.96
- norisessions.com/talk/index.html1.00
- Elements1.00
- <div class="stage">0.99
- <div class="scene">1.00
- <div class="nori-logo">...</div>0.98
- <div class="caption-bar">.…</div>0.98
- <√div>0.98
- <√div>0.94
- a talk, rendered in a browser0.99
- (yes - you're watching one right now)0.98
- It's literally just divs all the way down.1.00
-
- but it's usually the wrong one if you're actually trying to create something of0.99
- use.1.00
-
- Board Deck0.99
- ??1.00
- 20.98
- HTMLノ0.86
- context?0.99
- I do want to take a quick beat here and point out that a beautiful deck on its own1.00
- is generally not worth anything.0.99
-
- NORI SESSIONS0.99
- on the commute1.00
- transcripts1.00
- Board Deck0.99
- emails1.00
- Workspace1.00
- session1.00
- Slack0.99
- format1.00
- layout1.00
- charts1.00
- you → vision & story0.98
- I've built entire board decks from my phone on the subway during my commute.0.99
-
- HTML is All You Need0.97
- (for Agents to Make Graphics)1.00
- norisessions.com1.00
- Given the right language and for graphics, all you need is HTML.0.99
Transcript
99 cues· 1,116 words· 5,904 chars
- 0:10 Hi, I'm Amol, CEO of Nori Agentic.
- 0:14 We deploy an AI employee that understands your company, your code, docs, Slack, and other kinds of data.
- 0:23 We spend a lot of time thinking about how coding agents really work.
- 0:28 Most people think coding agents only write code.
- 0:31 But if you ask me, that's just bad marketing.
- 0:33 Forget the name for a second.
- 0:35 Coding agents can do almost anything.
- 0:38 There's just one trick.
- 0:39 You have to be able to think like an agent to get it to do what you want it to do.
- 0:44 Today, we're going to talk about how we use coding agents to do something most people think agents are terrible at.
- 0:50 Make visual artifacts, like slides, docs, and yeah, even video.
- 0:59 Every day, the world pours something like 34,000 human years into making slide decks.
- 1:05 Most of that time isn't the thinking, it's the fiddling.
- 1:09 A deck that takes 10 hours should really take about 25 minutes once you remove all the formatting and the branding and the moving things around.
- 1:18 Say you need to make a slide.
- 1:20 What do you do?
- 1:22 You open a tool, PowerPoint, slides, Figma, Canva, and then you start manipulating a canvas.
- 1:29 Every one of these tools is built for human hands and human eyes.
- 1:32 Click, drag, drop, resize, snap to grid, all motions and patterns that make sense for our geospatial view of the world.
- 1:41 There is a data structure underneath, but it's in a format that only the application can read.
- 1:47 What happens when you hand these tools to an agent?
- 1:49 Well, the output comes out all wrong.
- 1:52 Things overlap in weird ways.
- 1:54 You can't see the text.
- 1:55 There's no alignment.
- 1:56 It's just garbage.
- 1:58 AI skeptics say that it's not just the tools.
- 2:01 Agents fundamentally can't reason about space.
- 2:04 And there are whole benchmarks like Arc AGI that are built exactly around that premise.
- 2:10 There's a famous little test for this from developer Simon Willison.
- 2:14 He asks every new model the same thing.
- 2:17 Can you draw a pelican riding a bicycle?
- 2:20 But there's a trick.
- 2:21 The agent is only allowed to use SVG.
- 2:25 It's a quick gut check for whether a model can reason about space at all.
- 2:29 Here's some examples of what the models actually give you on this test.
- 2:32 And yeah, these are pretty bad.
- 2:35 Like genuinely, deeply, really bad.
- 2:39 So does that mean it's hopeless?
- 2:41 Agents are just doomed to be bad at graphics?
- 2:43 No, I don't think so.
- 2:46 If you ask me, it's not the model, it's the medium.
- 2:49 If I asked you, someone who is presumably human, to handwrite an SVG of a pelican, you wouldn't be able to do that either.
- 2:58 SVGs are just a wall of numbers.
- 3:00 You can't go from a wall of numbers to a pelican.
- 3:03 You just can't see that way.
- 3:05 That's just not how people think.
- 3:07 We think graphically, so we build tools that let us draw on a canvas.
- 3:12 Figma MCPs, PowerPoint CLIs, screenshot and replace loops, what do all of these agent tools have in common?
- 3:19 They all approach the problem like a human.
loading