Videos eW_vxrjvERk
Connecting the Dots with Context Graphs — Stephen Chin, Neo4j
Scene timeline
46 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 152
- whisperx 152
- chunks
- 30
- from 152 cues
- keyframes
- 41
- kept of 46 captured
- frames with text
- 41
- 1,037 lines read
- chapters
- 0
- from the source metadata
- keyframe bytes
- 5.7 MB
- word timings on 152 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-10 17:27 | 1m 26s |
stt |
done | — | 2026-08-10 17:29 | 19s |
chunk |
done | — | 2026-08-10 17:29 | 0s |
text_embed |
done | — | 2026-08-10 19:53 | 1s |
keyframe |
done | — | 2026-08-10 17:29 | 1m 27s |
ocr |
done | — | 2026-08-10 17:30 | 19s |
frame_embed |
done | — | 2026-08-10 19:53 | 6s |
Frames, and what the machine read
-
- AlEngineer0.98
- EUROPE1.00
-
- PRESENTINGSPONSOR1.00
- Google DeepMind1.00
-
- PLATINUM SPONSORS0.98
- # Braintrust0.96
- WorkOS OpenAI0.95
-
- AlEngineer1.00
- Connecting the d1.00
- EUROPE1.00
- with context grap0.98
- Stephen Chin (@steveonjava)1.00
- EU/ACO0.88
- VP of Developer Relations @ Neo4j0.99
- AlEngineer0.99
- a(e'el0.51
- EUROPE1.00
-
- yEQ0.55
- R0.56
- m0.73
- *0.71
- 8m2110.59
- 80.51
- nrVon0.58
- **0.87
- AIE1.00
- ★1.00
- en0.96
- 60.90
- *OTR0.63
- ★1.00
- ★1.00
- ★1.00
- =m O0.65
- Dre0.63
- mes0.59
- Engineer1.00
- AlEngineer0.97
- D260.60
- EUROPE1.00
-
- AIE1.00
- ★1.00
- ★0.98
- ALLI AM OFFERING IS THE TRUTH0.99
- Engineer1.00
- AlEngineer0.96
- 2860.66
- EUROPE1.00
-
- Today1.00
- Scattered, lost reasoning1.00
- Why?1.00
- Considered?1.00
- Alternatives1.00
- CRM1.00
- AIE1.00
- ★1.00
- Precedent?1.00
- ★1.00
- ★1.00
- ★1.00
- #0.99
- Slack1.00
- Slack1.00
- Zendesk Support0.97
- Ticket1.00
- Jira Project0.99
- Board1.00
- pd1.00
- PagerDuty1.00
- Zoom1.00
- Context Lose in People's Heads & Silos0.99
- Tribal Knowledge, Cross-System Synthesis,1.00
- Approval Chains Outside Systems.1.00
- Engineering the future of Al0.97
- Engineer1.00
- J260.53
-
- Context Graph1.00
- Connected, captured decision traces1.00
- *★★0.57
- Decision1.00
- Agent1.00
- Policy1.00
- AIE1.00
- ★1.00
- Discount Approval1.00
- Standard Discount Rule1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- System of1.00
- Healthcare Sector1.00
- Exception1.00
- Reasoning1.00
- Similar Deal Q30.99
- Precedent1.00
- Evidence1.00
- Evidence1.00
- Churn Risk Data0.97
- Similar Deal Q30.99
- Outcome1.00
- Deal Closed, Positive1.00
- Inputs, Policies, Exceptions, Precedents,1.00
- Approvers, Approvers, Outcomes.0.99
- Decision Trace as First-1.00
- Engineering the future of Al0.98
- Engineer1.00
- J260.66
-
- Conne0.97
- AlEngineer0.99
- EUROPE1.00
- Discount Appr0.97
- Decision1.00
- △0.61
- Exception1.00
- Healthcare Sector1.00
- EU/ACC0.97
- Inputs, Policies1.00
- Approvers. App0.97
- AlEngineer0.99
- EUROPE1.00
- 1260.90
-
- Hype cycle for Agentic Al1.00
- Multiagent Systems1.00
- Al Coding Agents1.00
- Enterprise Al Assistants-0.97
- Agentic Al Security1.00
- Agentic Analytics-0.98
- Model Context Protocol1.00
- gentic Al0.99
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- EXPTONS0.77
- Human-Agent Collaboration Workspace1.00
- Al Agent Development Platform0.99
- Domain-S0.98
- Context Graphs1.00
- No-Code Agent Builders1.00
- Machine Qustomers0.96
- ★1.00
- ★1.00
- ★1.00
- Embodied Al1.00
- Agent Management Platform0.99
- Al Agent Communication Protocols1.00
- Agent Marketplace1.00
- Al Agents in Software Enginering1.00
- Continual Learning1.00
- FinOps for Agentic Al-0.98
- Agentic Commerce1.00
- Agentic Browser1.00
- Agent Experience (AX)0.99
- Guardian Agent1.00
- Agent Development Life Cycle1.00
- Agent Orchestration1.00
- Plateau will be reached:1.00
- <2yrs.1.00
- 2.-5 yrs.0.96
- 5-10 yrs.1.00
- >10 yrs.1.00
- Obsolete before plateau0.97
- Computer Use for Agents1.00
- As of April 20261.00
- Innovation1.00
- Peak of Inflated0.99
- Trough of0.99
- Slope of1.00
- Plateau of1.00
- Trigger1.00
- Expectations1.00
- Disillusionment1.00
- Enlightenment1.00
- Productivity1.00
- TIME0.98
- Engineering the future of Al1.00
- Engineer1.00
- 2260.70
-
- Knowledge graph components1.00
- Name: “Dan"0.91
- Name: “Ann"0.92
- Born: May 29, 19700.98
- Born: Dec 5, 19750.99
- Nodes1.00
- Twitter: “@dan"0.91
- *★★0.67
- KNOWS1.00
- AIE1.00
- ★1.00
- represent entities in the graph1.00
- KNOWS1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- Relationships1.00
- Person1.00
- LIVES WITH1.00
- Person1.00
- DRIVES1.00
- represent associations or0.99
- interactions between nodes1.00
- Since:1.00
- OWNS1.00
- Jan 10, 20110.99
- Properties1.00
- Car1.00
- represent attributes of nodes or1.00
- Brand: “Volvo"0.94
- relationships including vectors, can be indexed1.00
- Model: “V70"0.95
- Description: “An executive car manufactured and..."0.99
- DescEmbedding: [0.1, -0.3, 0.4, ..., -0.7]0.98
- DescSource: "https://en.wikipedia.org/wiki/Volvo_V70"0.99
- Engineer1.00
- AlEngineer0.96
- J260.53
- EUROPE1.00
-
- Knowledge graph components1.00
- Name:“Dan"0.95
- Name: “Ann"0.93
- Born: May 29, 19700.99
- Born: Dec 5, 19750.97
- Nodes1.00
- Twitter:“@dan"0.97
- *★★0.67
- KNOWS1.00
- AIE1.00
- ★1.00
- represent entities in the graph1.00
- KNOWS1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- Relationships1.00
- Person1.00
- LIVES WITH0.99
- Person1.00
- DRIVES1.00
- represent associations or1.00
- interactions between nodes1.00
- Since:1.00
- OWNS1.00
- Jan 10, 20110.98
- Properties1.00
- Car1.00
- represent attributes of nodes or0.98
- Brand: “Volvo"0.95
- relationships including vectors, can be indexed1.00
- Model:“V70"0.99
- Description: “An executive car manufactured and..."0.99
- DescEmbedding: [0.1, -0.3, 0.4, ..., -0.7]0.99
- DescSource: "https://en.wikipedia.org/wiki/Volvo_V70"0.99
- Engineering the future of Al1.00
- Engineer1.00
- J260.52
-
- from graphs eno0.99
- How1.00
- ousure a high-quality production0.97
- AlEngineer0.99
- EUROPE1.00
- 8880.85
- EU/ACC1.00
- AlEngineer0.99
- EUROPE1.00
-
- Context from graphs enables explainable Al0.98
- How do you ensure a high-quality production environment with Agents?0.99
- ***0.64
- AIE1.00
- Storing1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- learnings from user/agent interactions in the graph0.99
- database as context1.00
- 80.65
- Visualizing1.00
- conversations, flows, reasoning within context0.99
- Analysing1.00
- Context data for agent system performance,0.99
- semi-automatically identify & apply opportunities for0.99
- improvement1.00
- Engineering the future of Al1.00
- Engineer1.00
- 2260.57
-
- Enhance relevance with domain context1.00
- What was in the Care Plans associated with Andrea Jenkins's emphysema?1.00
- Baseline RAG0.98
- *★★0.56
- ★1.00
- AIE1.00
- ★1.00
- Llamalndex-RAG backed by GPT 4.01.00
- and Chroma vector database1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- The Care Plan associated with Andrea Jenkins' emphysema included0.99
- activities respiratory therapy, specifically deep breathing and0.99
- coughingexercises.0.97
- LLMDirect1.00
- OpenAl over Neo4j function call0.98
- Grounded but1.00
- The care plan associated with Andrea71.00
- incomplete1.00
- Jenkins714 emphysema likely included the0.99
- followingcomponents:1.00
- Not1.00
- connected0.99
- to real0.99
- data0.99
- Engineer1.00
- AlEngineer0.95
- J860.57
- EUROPE1.00
-
- Enhance relevance with domain context1.00
- What was in the Care Plans associated with Andrea Jenkins's emphysema?1.00
- Baseline RAG0.98
- *★★0.58
- ★1.00
- AIE1.00
- ★0.99
- Llamalndex-RAG backed by GPT 4.00.98
- ★1.00
- and Chroma vector database1.00
- ★1.00
- ★1.00
- ★1.00
- LLMDirect1.00
- GraphRAG1.00
- OpenAl over Neo4j function call0.98
- Grounded but1.00
- Neo4j, LangChain,1.00
- The care plan associated with Andrea71.00
- incomplete1.00
- and OpenAI0.99
- Jenkins714 emphysema likely included the0.99
- The Care Plan for Andrea7 Jenkins714's0.99
- Not1.00
- Complete,1.00
- emphysema included medication1.00
- connected1.00
- to real0.98
- data1.00
- accurate1.00
- answer1.00
- exercises.1.00
- management, smoking cessation1.00
- counseling,andpulmonary rehabilitation0.99
- Engineering the future of Al1.00
- Engineer1.00
- J260.58
-
- Short term memory0.99
- · Current Context0.95
- • Compression, Relevancy0.96
- *★*0.57
- • Integrate Tool Results0.99
- AIE1.00
- Long term memory1.00
- ★1.00
- ★1.00
- ★1.00
- · Episodic0.95
- · Semantic / Structural0.95
- • Procedural / Instructional0.97
- Reasoning memory1.00
- · Tool Call Traces0.98
- • Reasoning Traces0.96
- • Previous Decisions0.99
- Engineering the future of Al1.00
- Engineer1.00
- 2260.63
-
- rm memory0.91
- Conv0.98
- istory and session state with au0.97
- AlEngineer1.00
- EUROPE1.00
- Conversation storage1.00
- Sessions and messages persisted as graph nodes with1.00
- metadata1.00
- Multi-stage entity extraction0.99
- Pipeline combining spaCy, GLiNER, and LLM extractors with0.99
- configurable merge strategies1.00
- EU/ACC0.99
- Entity resolution1.00
- Multi-strategy dedup: exact, fuzzy, and semantic matching with1.00
- type-aware resolution1.00
- session = await memory.add_session("user_123")0.99
- await memory.add_message(session.id, role="user",0.95
- content-"Review Jessica's account")0.98
- elo'w0.72
- AlEngineer1.00
- EUROPE1.00
-
- Short-term memory0.97
- Conversation history and session state with automatic entity extraction1.00
- Neo4j agent memory entity0.98
- ★1.00
- Conversation storage1.00
- extraction pipeline1.00
- AIE1.00
- ★1.00
- Sessions and messages persisted as graph nodes with1.00
- Stage 10.96
- Stage 20.98
- Stage 30.94
- ★1.00
- metadata1.00
- Raw Text1.00
- spaCy1.00
- GLiNER20.99
- LLM Fallback0.99
- ★1.00
- ★1.00
- ★1.00
- Multi-stage entity extraction1.00
- Pipeline combining spaCy, GLiNER, and LLM extractors with0.99
- Merge Strategy1.00
- configurable merge strategies0.99
- Union | confidence | cascade0.96
- Deduplication1.00
- Entity resolution1.00
- Fuzzy + semantic matching0.99
- Multi-strategy dedup: exact, fuzzy, and semantic matching with1.00
- Enrichment1.00
- type-aware resolution1.00
- Extracted Entities1.00
- session = await memory.add_session("user_123")0.99
- await memory.add_message(session.id, role="user",1.00
- content="Review Jessica's account")1.00
- Google DeepMind0.99
- Engineer1.00
- 2260.53
-
- Reasoning memory1.00
- Decision traces, tool usage audits, and provenance — the layer that makes Al explainable0.99
- *★*0.63
- ★1.00
- Tool call traces0.97
- Decision provenance0.97
- AIE1.00
- ★0.98
- 10.99
- 21.00
- Every tool invocation,1.00
- Why did the agent choose this path?1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- parameters, results —0.98
- complete audit trail1.00
- Causal chain fully recorded1.00
- Learning from1.00
- Compliance &1.00
- experience1.00
- 31.00
- debugging1.00
- Agent checks if it solved1.00
- When something goes1.00
- something similar before,0.98
- wrong, you can trace exactly1.00
- reuses successful patterns1.00
- what happened and why1.00
- AlEngineer0.97
- Engineer1.00
- J260.85
- EUROPE1.00
-
- ng memory1.00
- Decis.1.00
- us, tool usage audits, and proven0.97
- AlEngineer1.00
- EUROPE1.00
- Tool call traces1.00
- 11.00
- Every tool invocation,0.99
- parameters, results -0.94
- complete audit trail1.00
- EU/ACC0.99
- Learning from1.00
- experience1.00
- 31.00
- Agent checks if it solved0.99
- something similar before,0.99
- reuses successful patterns1.00
- AlEngineer0.99
- EUROPE1.00
-
- Why graphs for agent memory?1.00
- Relationships Are First-Class1.00
- Multi-Hop Traversal1.00
- 品0.97
- **★0.60
- ★1.00
- Connections between entities, decisions, and1.00
- Follow chains: Customer → Account →0.99
- AIE1.00
- ★0.99
- events are the data — not an afterthought0.99
- Transaction → Decision → Policy → Employee0.97
- ★1.00
- ★1.00
- ★★0.74
- Structural Similarity1.00
- Explainable Decisions1.00
- Graph embeddings (FastRP) find similar1.00
- Full provenance chain: trace exactly1.00
- situations by network topology, not just text1.00
- how and why every decision was made1.00
- Cross-Session Knowledge1.00
- Production Ready0.99
- Information learned in one conversation0.99
- Neo4j: ACID compliance, enterprise scale,0.99
- is available in all future interactions1.00
- proven technology1.00
- Engineering the future of Al1.00
- Engineer1.00
- 2860.61
Transcript
152 cues· 2,753 words· 15,597 chars
- 0:14 Hello and welcome everybody to connecting the dots with context graphs.
- 0:20 My name is Steven Chen.
- 0:22 I run the developer relations team at Neo4j and you are in store for the power hour of context and graphs and all this technology.
- 0:31 So I'm the first speaker.
- 0:33 We have some other amazing talks after me.
- 0:35 So I hope you enjoy all the great content which you're going to see over the next
- 0:40 hour or so.
- 0:40 So what I'm gonna talk about is a bit about how we've all been feeling with the AI revolution where we are
- 0:49 trapped as engineers.
- 0:51 We are using AI coding tools, or maybe they're using us, where our work is being reviewed.
- 0:57 Who here has their work reviewed by an agent when they check in their PRs?
- 1:02 Yes, all of you.
- 1:03 So we're stuck in this limbo where we have amazing tools, we have amazing capabilities, but rather than us controlling them, they are controlling us.
- 1:14 And we would like to get to a state
- 1:18 where we're in control of this.
- 1:20 So we have to decide, is it going to be the,
- 1:24 The blue pill where we're stuck inside of this mire of disparate knowledge, stuck in Slack discussions and little customer threads and different enterprise systems which are all segregated and siloed and when we ask the agents to make critical business decisions or our applications to make critical business decisions with all this spread, it can't possibly give good answers because it doesn't have the context or do we wanna,
- 1:54 dive in and embrace the red pill, escape from the matrix, and have a system of reasoning where we actually have all these systems connected, all of our different enterprise data sources, previous decision traces, the reasoning calls of the tools to give us a more consolidated view of our enterprise stack, and escape from the matrix.
- 2:22 So who's in the escape club?
- 2:24 Who wants to break out?
- 2:25 Okay, hopefully if you're in the room, you're with me.
- 2:29 And guess who else is with us?
- 2:33 Gartner has now officially made context graphs as part of the AI hype cycle.
- 2:39 So we have been officially recognized by the analysts of the world.
- 2:46 they also realize that we're all stuck in this mire.
- 2:49 Foundation Capital actually started this thread with their $3 trillion startup opportunity post about how context graphs are gonna move forward the industry and dramatically change how we build applications.
- 3:01 And what I'll do is I'll show some demos and I'll talk about how we can move from being stuck
- 3:06 in this matrix stuck in this world and then become the superheroes of our organization and actually build the capability of the systems using technologies like knowledge graphs.
- 3:18 So knowledge graphs are a very powerful tool for us to aggregate all this information, create the connections, create the relationships.
- 3:25 And at a fundamental level, they hold nodes, which are people or things or companies or relationships.
- 3:35 you have relationships between nodes where in this case, Dan, those are properties.
- 3:42 lives with Anne, he drives her car apparently, so we know who wears the pants in this relationship.
- 3:48 And we have some embeddings on top of the car, so we're embedding vector information in it.
- 3:53 So we can also do similarity searches and kind of combine the best of both worlds with building information, but then also combining it with LLMs.
- 4:03 So when we take what LLMs are really good at,
- 4:06 this language, this reasoning, this creativity.
- 4:09 When we combine that with what knowledge graphs are really effective at, so knowledge, context, and enrichment, then we can start doing things with our data, like storing all these relationships together, visualizing them so we can get to the data which matters, finding hidden patterns, and then analyzing this and getting more insights, which will help power the context graph demonstrations, which I'm going to show you all.
- 4:37 So here's a simple example of how graphs power retrieval because I think it's good to understand what the difference is between a baseline LLM.
- 4:47 So this is a healthcare case.
- 4:49 What was the care plan associated with Andrea Jenkins emphysema?
- 4:53 And when you ask the LM, it has broad knowledge.
- 4:55 It understands a lot of information.
- 4:57 It knows what emphysema is.
- 4:58 It knows what standard practice is.
- 5:00 So it gives a very generic answer, preventing damage to the lungs, yada, yada, yada.
- 5:05 Now, when we give it a RAG system, so we go to vector database, now it has more context.
- 5:11 It knows a bit about the patient and their information.
- 5:14 And it tells you, maybe recommend some activities like respiratory theory, deep breathing, coughing exercises.
- 5:20 So this is pretty generic medical advice.
- 5:24 Now where we want to get to,
loading