Videos khVX_BUnEwU
Active Graph Agent Runtime (BabyAGI 4) — Yohei Nakajima, Untapped Capital
Scene timeline
52 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 217
- whisperx 217
- chunks
- 31
- from 217 cues
- keyframes
- 48
- kept of 52 captured
- frames with text
- 48
- 1,016 lines read
- chapters
- 11
- from the source metadata
- keyframe bytes
- 5.3 MB
- word timings on 217 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-10 23:48 | 1m 11s |
stt |
done | — | 2026-08-10 23:49 | 27s |
chunk |
done | — | 2026-08-10 23:49 | 0s |
text_embed |
done | — | 2026-08-10 23:49 | 0s |
keyframe |
done | — | 2026-08-10 23:49 | 1m 57s |
ocr |
done | — | 2026-08-10 23:51 | 22s |
frame_embed |
done | — | 2026-08-10 23:52 | 8s |
Frames, and what the machine read
-
- AlEngineer0.96
- World's Fair1.00
-
- AIEngineer0.95
- World's Fair0.99
-
- LAB & PLATINUM SPONSORS0.99
- Amazon AGI Lab0.98
- ANTHROP\C1.00
- Google DeepMind1.00
- MINIMAX0.97
- OpenAI0.92
- Akamai1.00
- arize0.92
- aws1.00
- Braintrust bright data0.98
- B1.00
- Browserbase1.00
- docker1.00
- :neo4j0.93
- ORACLE1.00
- PayPal1.00
- qodo1.00
- reducto1.00
- Sonar1.00
- Makers of0.99
- togetherai1.00
- Unblocked1.00
- WorkOS1.00
- SonarQube1.00
-
- World's Fair0.99
-
- AlEngineer0.99
- World's Fair0.97
- PRESENTED BY1.00
- Microsoft1.00
- let's build the simplest thing1.00
- that can build itself1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.95
- Engineering the future of Al0.99
-
- AlEngineer0.99
- World's Fair0.98
- United States - Past 5 years0.96
- Interest over time0.99
- ai agents1.00
- Search term1.00
- Let it be free!0.97
- Open-sourcing "Baby AGr, a paired down version of the "Task-Driven0.94
- Autonomous Agent* at 105 lines of code.0.95
- PRESENTED BY1.00
- 1001.00
- Google Trends1.00
- Three task agents (execution, creation, prioritization) work in harmony..0.90
- forever.0.97
- Microsoft1.00
- 801.00
- 国0.74
- Cit-tub - yoheinakajmalbabyagi0.79
- 601.00
- 6:28 AM - Apr 3. 2023 1.9M Vlews0.86
- Feb 28 - Mar 31, 20230.97
- 401.00
- ai agents 00.98
- Mar 31 - Apr 30, 20231.00
- 201.00
- ai agents 10.98
- 20221.00
- 20231.00
- 20241.00
- 20251.00
- 20261.00
- Google Trends1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.99
- Engineering the future of Al0.98
-
- AlEngineer0.98
- World's Fair0.99
- Amjad Masad @amasad · Mar 290.91
- Yohei prototyped a mini AGI on Replit0.97
- eDOrDEK·Mar 260.73
- ≡ Forbes0.98
- FORTUNE1.00
- EDITORS' PICK0.97
- Auto-GPT May Be1.00
- BabyAGI is taking Silicon Valley1.00
- The Strong AI Tool1.00
- by storm. Should we be scared?0.99
- That Surpasses0.97
- ChatGPT1.00
- PRESENTED BY1.00
- Bernard Marr Contributor0.96
- Microsoft1.00
- Auto-GPT and BabyAGI: How0.99
- Hype grows over "autonomous" Al agents0.99
- that loop GPT-4 outputs1.00
- generative Al to the masses1.00
- 'autonomous agents' are bringing0.98
- Auto-GPT, BabyAGI, and AgentGPT: How to use Al age0.98
- OpenAI1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.99
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.98
- World's Fair0.97
- BabyAGI0.99
- dee0.71
- cat0.93
- Deer0.85
- t1f0.61
- Fax0.91
- 20.96
- 200.94
- v30.91
- Date0.99
- Apr 230.84
- Apr 230.91
- May 230.89
- Jun 230.93
- Jul 230.90
- Sep 230.97
- Sep 240.98
- 0ct 240.86
- Feb 260.82
- Lines0.96
- 1051.00
- 3001.00
- 3201.00
- 3541.00
- 8870.99
- 2,2990.93
- 5,9620.88
- 1740.99
- 33.5060.99
- Files0.70
- 110.92
- 25-0.93
- 40+0.88
- 70-0.89
- PRESENTED BY1.00
- Model0.82
- Planning1.00
- per-loop0.94
- davinci-0030.98
- GPT-40.99
- dynamic replan0.94
- upfront0.99
- GPT-4 + 3.50.99
- GPT-3.50.97
- upfront0.98
- GPT-3.50.99
- upfront + reflect0.97
- GPT-3.5-16k0.96
- upfront +0.95
- reflect0.93
- any1.00
- any (litellm)0.99
- Smplicit (LLM)0.94
- any (litellm)0.97
- inplicit (LLM)0.93
- Microsoft1.00
- Execution0.99
- sequential0.99
- sequential1.00
- sequential0.99
- parallel0.97
- parallel0.98
- parallel0.98
- sequential0.97
- sequential0.98
- async + pool0.96
- Task deps1.00
- sone0.92
- single0.99
- multi0.92
- multi0.86
- multi0.95
- mlti0.91
- fn graph0.86
- none0.99
- objective tree0.96
- Teswination0.93
- sever0.60
- all complete0.99
- a110.79
- complete0.99
- all complete1.00
- all complete1.00
- all complete0.99
- manual0.98
- tool signal0.97
- end_tuan0.97
- Hemory0.91
- Pinecone1.00
- session str1.00
- dep chain1.00
- dep chain0.99
- enbedings0.97
- ndjson + summazy0.94
- exoc logs0.93
- messages[]0.96
- SQLite + KG0.95
- Tools0.93
- 15°0.79
- fn packs0.96
- self-creating0.99
- self-creating • persist0.97
- Extensibility0.94
- edit souzce0.90
- edit souace0.90
- edit souace0.90
- edit source0.87
- skill plugins0.99
- skill plugins0.99
- tn registry0.90
- zuntime exec()0.84
- zegistez + 080.93
- I/00.83
- CLI print0.99
- CLI print0.99
- CLI print1.00
- CLI + file0.95
- CLI - file0.90
- Flask web UI0.97
- Flask dashboard0.97
- CLI0.99
- multi-channel1.00
- Concurrency0.92
- threads0.97
- threads0.98
- threads0.95
- asyne + semaphore0.94
- Erzor handl ing0.94
- tzy/except0.97
- try/except0.95
- try/except1.00
- txy/except0.93
- try/except0.99
- logged1.00
- try/except1.00
- retxy + backoff +0.92
- repair0.81
- Key insight1.00
- LLMs can chain1.00
- tasks1.00
- tasks need1.00
- structure0.98
- plan0.99
- upfront0.94
- pazallelize0.98
- DAG1.00
- axchitecture0.96
- plugin1.00
- chat0.91
- reflection0.97
- functions as1.00
- atoms0.95
- LLM is the0.98
- plannex0.91
- sutonomous assistant0.98
- babyagi.wiki1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.95
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.98
- World'sFair1.00
- instagraph1.00
- mindgraph1.00
- code graph1.00
- log graph1.00
- 25 files across 9 nested folders with functions that depend on each0.96
- other, cleanly organized0.99
- upgade0.94
- created by Al based on auto-generated file descriptions which curently0.97
- PRESENTED BY1.00
- "this include param description for each function which 1 don't need for0.98
- Microsoft1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World'sFair1.00
- TRACK 5• JULY 2,20260.96
- Graphs1.00
-
- AlEngineer0.97
- World'sFair1.00
- graphrag1.00
- Search term0.99
- graph rag1.00
- United States1.00
- Past 5 years0.97
- Web Search0.96
- Interest over time0.99
- Urited States · Past 5 years0.94
- Codegraph1.00
- Log graph1.00
- Mindgraph1.00
- 3/21/20241.00
- 4/11/20241.00
- 3/16/20241.00
- Instagraph1.00
- 9/13/20231.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.99
- TRACK 5· JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.99
- World'sFair1.00
- E2B0.99
- Firecrawl1.00
- Composio1.00
- mem01.00
- FalkorDB1.00
- AgentMail0.95
- Browser Use0.96
- The General Intelligence0.97
- Company of New York0.99
- Hamster1.00
- Intelligent Internet1.00
- FlymyAl0.94
- DENIED1.00
- ANTIMLABs0.87
- Zinley1.00
- AGNOST AI1.00
- ∏∑0.75
- COVENANT LABS1.00
- SAZABI1.00
- VideoDB1.00
- Monid1.00
- RunAnywhere1.00
- untapped.vc1.00
- agentfund.com1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.98
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.98
- World'sFair0.97
- ActiveGraph1.00
- an event-sourced graph runtime for1.00
- building auditable agents1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.98
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer1.00
- World's Fair0.98
- The Log is the Agent'0.98
- Event-Sourced Reactive Graphs for Auditable, Forkable Agentie Systems0.94
- Yobei Nakajima0.87
- Untappod Capital0.95
- activegraph..i0.95
- 2199 11[1] 102660.64
- May 22, 20260.99
- Abetraet0.80
- an1.00
- hility, with state persiso0.86
- for0.94
- s, LLMI-barkond routinns, or logic0.87
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.97
- TRACK 5· JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.98
- World'sFair1.00
- today, most people build agents around the llm0.99
- Logs1.00
- Response APl0.97
- Memory1.00
- LLM1.00
- Tools1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World'sFair1.00
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.99
- World's Fair0.96
- this projects a graph (state of agent)0.99
- agent state1.00
- as a graph0.99
- Logs1.00
- goal.created1.00
- prompt.created1.00
- Ilm.called0.97
- tool.called1.00
- tool.response1.00
- Ilm.response0.96
- prompt.updated1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.96
- TRACK 5• JULY 2, 20260.97
- Graphs1.00
-
- AlEngineer0.99
- World's Fair0.98
- attach behaviors that react to graph changes0.98
- behaviors can then emit events1.00
- agent state1.00
- as a graph0.99
- behavior1.00
- Logs1.00
- goal.created1.00
- prompt.created1.00
- Ilm.called0.97
- tool.called1.00
- tool.response1.00
- Ilm.response0.95
- prompt.updated1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.96
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.98
- World'sFair1.00
- policies determine how the graph can be modified0.98
- agent state0.98
- as a graph0.99
- behavior1.00
- behavior1.00
- behavior1.00
- behavior1.00
- behavior1.00
- behavior1.00
- policies1.00
- Logs1.00
- goal.created1.00
- prompt.created1.00
- Ilm.called0.97
- tool.called1.00
- tool.response1.00
- Ilm.response0.96
- prompt.updated1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.97
- TRACK 5• JULY 2, 20260.94
- Graphs1.00
-
- AlEngineer0.99
- World'sFair1.00
- this is your agent on activegraph0.99
- behavior1.00
- behavior1.00
- behavior1.00
- behavior1.00
- behavior1.00
- behavior1.00
- policies1.00
- Logs1.00
- goal.created1.00
- prompt.created1.00
- Ilm.called0.95
- tool.called0.98
- tool.response1.00
- Ilm.response0.96
- prompt.updated1.00
- tool.called1.00
- tool.response1.00
- Ilm.response0.98
- prompt.updated1.00
- you get replays, rollbacks, and forks0.99
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.96
- TRACK 5• JULY 2, 20260.96
- Graphs0.93
-
- AlEngineer0.97
- World'sFair1.00
- Logs1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World'sFair1.00
- TRACK 5· JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.99
- World's Fair0.97
- replace messages[ ] with logs0.96
- run - "Evaluate Acme"0.93
- Reset1.00
- PLay0.92
- Step -0.89
- NAIVE · MESSAGES[)0.88
- EVENT LOG - SOURCE OF TRUTH0.96
- USER Evaluate Acme as an investment.0.98
- goal.created0.96
- goal:"Évaluate Acne"0.92
- ASSISTANT Plan: (1) research market (2) draft memo0.97
- behavior.started0.99
- ASSISTANT Market LoOks -$4B TAM.0.92
- planser0.95
- To0. fetched q3_report.pdf (12kb)0.92
- object.created0.96
- task research0.99
- AsSIsTant _(earlier turns dropped to fit windaw)_0.90
- abject.created0.99
- ASSISTANT Final memo drafted.0.99
- task • mno -depends_on0.85
- SYSTER run complete0.94
- lle.responded0.91
- claim: TAM -8480.84
- tool.responded0.98
- g3_report.pdf0.93
- object.created0.98
- clain • incumbest risk0.91
- patch.applied1.00
- meno - status=done0.83
- runtime.idle0.95
- no pending events0.97
- @yoheinakajima1.00
- activegraph.ai1.00
- World's Fair0.97
- TRACK 5• JULY 2, 20260.95
- Graphs1.00
-
- AlEngineer0.97
- World'sFair1.00
- you can't edit the graph, just emit events0.99
- # you never set fields directly - you emit events, the graph folds them0.98
- research = graph.add_object("task", {"title": "Research", "status": "open"})0.99
- meno0.99
- = graph.add_object("task", {"title": "Draft memo", "status": "blocked"})0.99
- graph.add_relation(research.id, memo.id, "depends_on")1.00
- # reads are queries over the projected world1.00
- open_tasks = graph.objects(type="task", where={"status": "open"})0.99
- blockers = graph.relations(type="depends_on", target=memo.id)0.99
- but you query over the graph1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World'sFair1.00
- TRACK 5· JULY 2,20260.95
- Graphs1.00
-
- AlEngineer0.97
- World'sFair1.00
- behaviors listen to graph changes and emit events0.99
- @behavior(name="planner", on=["goal.created"])0.98
- def planner(event, graph, ctx):1.00
- research = graph.add_object("task", ("title": "Research", "status": "open"})0.97
- PRESENTED BY1.00
- meno0.94
- = graph.add_object("task", {("title": "Draft nemo", "status": "blocked"})0.95
- Microsoft1.00
- graph.add_relation(research.id, memo.id, "depends_on")0.99
- ends_on", on=["task.completed"])0.98
- def unblock(relation, event, graph, ctx):0.99
- if event.payload["task_id"] = relation.source:0.99
- graph.patch_object(relation.target, ("status": "open"})0.98
- behaviors can live on edges as a relation_behavior0.99
- @yoheinakajima1.00
- activegraph.ai1.00
- World'sFair1.00
- TRACK 5• JULY 2,20260.96
- Graphs1.00
-
- AlEngineer0.98
- World'sFair1.00
- behavior subscriptions can be complex1.00
- from activegraph import behavior0.99
- @behavior(1.00
- PRESENTED BY1.00
- name="contradiction_detector",1.00
- on=["object.created"],1.00
- Microsoft1.00
- where={"object.type": "claim"},1.00
- pattern="(c:claim)-[:contradicts]->(other:claim)",1.00
- @yoheinakajima1.00
- activegraph.ai1.00
- World'sFair1.00
- TRACK 5• JULY 2,20260.95
- Graphs1.00
Transcript
217 cues· 3,410 words· 18,380 chars
- 0:12 Hi, everybody, thanks for coming.
- 0:14 I'm excited to be here.
- 0:16 AI Engineer World Fair has been so fun meeting everybody.
- 0:20 But I'm here to talk about Active Graph, which is my new open source experimental approach to building agents, which looks a little bit different than maybe you've been building agents.
- 0:29 It's definitely experimental.
- 0:31 The idea is more to inspire you with some potentially new ideas.
- 0:36 Agents are awesome, but long-running agents break.
- 0:39 And if they're so awesome, why am I still building them?
- 0:42 They should build themselves.
- 0:44 Let's build the simplest thing that can build itself has basically been kind of my research theme for the last three years since I did Baby AGI back in March of 2023.
- 0:53 So that's over three years ago.
- 0:55 If you were there at the time, it was crazy.
- 0:57 It went wild.
- 0:58 It was covered by media.
- 1:00 People thought it was going to work.
- 1:01 It didn't work at all.
- 1:04 Over the course of three years, I've done nine iterations of Baby AGI, less fanfare, but every time just experimenting on how do we get autonomous agents to actually work, usually with the theme of self-improvement.
- 1:14 If you go to Baby AGI Wiki, you can see earlier experiments.
- 1:18 In this process, I kept coming back to graphs, and I've had a couple of projects.
- 1:23 Earlier, I did one called Instagraph and MineGraph that was pre-GraphRagRag.
- 1:27 I did some code graphs, function graphs, log graphs, and since then it seems like a lot of people have started using graphs to build agents.
- 1:36 And in addition to that, I've actually gotten to invest in a good number of agentic companies, some of which I'm sure you recognize through my fund's untapped capital, and I also have an agent fund.
- 1:47 But yeah, that's me.
- 1:48 Yohei, VC by day, Builder by night.
- 1:51 You might recognize this face more than this face.
- 1:55 Active Graph is an event-sourced graph runtime for building auditable data.
- 2:00 I have a paper that was my first archive paper called the log is the agent, but I'm here to explain it.
- 2:06 So today most people build agents around the LLM.
- 2:08 You start with the LLM, you add a response API, you give it tools, you add memory, and then you make sure you log everything correctly, which can give you all the benefits the Active Graph will give you.
- 2:19 But Active Graph asks what if you built around the log?
- 2:22 Now, what does that mean?
- 2:24 It means not everything the agent does, but more importantly, every change to the agent, right?
- 2:31 Nobody here is using the same agent they were using a year ago.
- 2:34 And the agent you're gonna use a year from now is gonna be different.
- 2:37 And a lot of people, what the agent does and how the agent changes are tracked in two different places.
- 2:41 But I'm saying let's flatten that down into a single immutable event log.
- 2:46 And this is the ground truth of the agent.
- 2:49 And this projects a sort of graph.
- 2:50 This is the state of the agent.
- 2:52 And what I mean by that is, for example, a prompt can be edited multiple times, but you might have a master prompt that gets used when you query the graph.
- 3:00 And then on top of this, you attach something that I'm calling behaviors.
- 3:04 Behaviors react to graph changes.
- 3:09 And then they emit events, which then in turn updates the state of the agent, which might trigger new behaviors.
- 3:18 LLMs don't talk to each other in Active Graph.
- 3:20 They all communicate through this shared state, and that's what makes it a little bit different.
- 3:24 Behaviors can be deterministic, or they can include LLMs, which is how you build this agent.
- 3:30 And you get this beautiful typed
- 3:33 Event log, that's the source of truth about everything the agent did and everything, every change that's happened, which means, actually, oh shoot, I jumped ahead.
- 3:41 So in addition to that, there's a concept called policies which determine how the graph can be modified.
- 3:45 I'll come back to it, but for example, things like a source article that you found in research, you might be fine with adding, but if you're changing a prompt, maybe you want human in the loop,
loading
Chapters
- 0:00 ActiveGraph and three years of BabyAGI
- 1:55 Build around the log, not the LLM
- 3:24 Behaviors, policies, and views
- 6:43 Packs and the blackboard architecture lineage
- 8:12 The log as memory, and the API key that resumed itself
- 9:53 Reference agents built natively on the log
- 11:11 Self improvement: regimes and controlled self modification
- 12:25 ActiveGraph Lab writes its own experiments
- 13:02 A Pokemon card competition as a testbed
- 14:33 Surprises: why AI architects this better
- 15:49 Why an agent needs an experiential world model