Videos B9h9ovW5H9U
Why your agents need decision traces, not just documents — Zach Blumenfeld, Neo4j
Scene timeline
58 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 159
- whisperx 159
- chunks
- 33
- from 159 cues
- keyframes
- 43
- kept of 58 captured
- frames with text
- 43
- 1,687 lines read
- chapters
- 0
- from the source metadata
- keyframe bytes
- 7.5 MB
- word timings on 159 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-10 23:01 | 1m 27s |
stt |
done | — | 2026-08-10 23:03 | 26s |
chunk |
done | — | 2026-08-10 23:03 | 0s |
text_embed |
done | — | 2026-08-10 23:03 | 9s |
keyframe |
done | — | 2026-08-10 23:03 | 1m 48s |
ocr |
done | — | 2026-08-10 23:05 | 32s |
frame_embed |
done | — | 2026-08-10 23:06 | 8s |
Frames, and what the machine read
-
- AlEngineer0.98
- EUROPE1.00
-
- PRESENTINGSPONSOR1.00
- Google DeepMind1.00
-
- PLATINUM SPONSORS0.98
- # Braintrust0.96
- WorkOS OpenAI0.95
-
- neo4j0.99
- Context Graphs 1010.99
- AIE1.00
- ★1.00
- What They Are and How to Get Started in0.98
- 5 Minutes1.00
- Context Graphs 1010.99
- Engineering the future of Al0.98
-
- Context Graphs1.00
- Content Geaph0.87
- foundation1.00
- capital1.00
- Al's trillion-dollar opportunity:1.00
- Context graphs1.00
- **0.85
- ★1.00
- AIE1.00
- https://foundationcapital.com/context-graphs-ais-trillion-dollar-opportunity/1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- CONTEXT GRAPHS: CAPTURING THE 'WHY'0.99
- ENTERNRIM0.86
- Context1.00
- Graphs1.00
- https://arxiv.org/abs/2406.111600.98
- €dharmesh0.93
- 18:521.00
- Hands On With Context Graphs And0.99
- In The Age of Al0.99
- Context Graphs: Capturing The "Why"0.98
- Oharmesh Shah0.97
- Sudhir Hasbe (Ep 43)1.00
- Graphs, Graphs Everywhere-with1.00
- Neo4j1.00
- Building Al systems that don't just make decisions, but remember and1.00
- use the "why".1.00
- Willa Lyon 9 min nead Jan 14, 20260.87
- 21.00
- AlEngineer0.97
- EUROPE1.00
-
- What Do Agents Need to be Accurate?1.00
- Knowledge Base1.00
- Context Graph1.00
- Information required to answer0.99
- Information required to make1.00
- *★★0.60
- questions1.00
- decisions1.00
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- AlEngineer0.96
- EUROPE1.00
-
- What Do Agents Need to be Accurate?1.00
- Knowledge Base1.00
- Context Graph1.00
- Information required to answer0.99
- Information required to make0.99
- ***0.60
- ★0.99
- questions1.00
- decisions1.00
- AIE1.00
- ★0.98
- ★1.00
- ★1.00
- ★1.00
- Ex: Financial Analyst Agent1.00
- “Approve credit limit increase for Jessica Norris? Requesting £ 25K”0.98
- Retrieve:1.00
- Customer info, transactions, and policies1.00
- Response:1.00
- "Moderate-to-high risk score, elevated-risk1.00
- jurisdiction. Per High-Value Transaction policy,1.00
- warrants scrutiny. Key factors to investigate :0.99
- account activity patterns, transaction velocity, and1.00
- KYC status. Recommend a manual review before0.99
- proceeding."1.00
- Engineering the future of Al1.00
-
- What Do Agents Need to be Accurate?1.00
- Knowledge Base1.00
- Context Graph1.00
- Information required to answer0.98
- Information required to make1.00
- ***0.60
- questions1.00
- decisions1.00
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- Facts, entities, policies, current0.99
- Decision traces, precedents,1.00
- state1.00
- expert-validated outcomes0.98
- Enables accurate retrieval. It tells0.98
- Enables agent to act with0.99
- the agent what is true.0.99
- institutional knowledge. It tells the1.00
- agent what to do & why.0.99
- Engineering the future of Al1.00
-
- Context Graph Data Model1.00
- ENTITIES (What exists)0.99
- Financial Services Context Graph0.99
- Person, Account, Transaction, Organization0.99
- HAS_TXN0.98
- Account1.00
- *★★0.54
- ★1.00
- ENTITIES (What exists)0.98
- OMNS0.87
- AIE1.00
- ★1.00
- ★1.00
- EVENTS (What happened)1.00
- Person1.00
- ★1.00
- ★1.00
- ★1.00
- DECIDED1.00
- Decisions, Transactions, Approvals, Rejections0.99
- EXPLOYED_BY0.96
- Decision1.00
- APPLIED1.00
- Policy0.99
- DECISIONS (The "why*)0.99
- CONTEXT (The why)1.00
- Policies applied, Risk factors, Employee reasoning1.00
- Blog:1.00
- AlEngineer0.97
- EUROPE1.00
-
- Context Graph Demo1.00
- Financial Services Agent1.00
- context-graph-demo.vercel.app1.00
- DATA SOURCES1.00
- BACKEND SERVICES0.98
- FRONTEND & USER INTERFACE1.00
- ★1.00
- ★1.00
- AIE1.00
- ★1.00
- ★1.00
- Support Ticket1.00
- System0.97
- Ingestion/ETL1.00
- Data1.00
- 10 MCP Tools1.00
- + Claude Agent SDK0.99
- FastAPI Application0.99
- Claude Agent1.00
- Data Transfer1.00
- API Calls &1.00
- Application1.00
- Next.Js UI0.94
- User Actions1.00
- & Queries0.96
- Salesforce)1.00
- CRM (e.g.,0.95
- (Embeddings)1.00
- OpenAI API0.98
- Chakra Ul v30.97
- Neo4j Context Graph & GDS0.99
- Internal1.00
- X0.98
- NVL Graphs1.00
- Business Data1.00
- AuraDS0.97
- Neo4j1.00
- Search1.00
- Vector1.00
- Graph Data Science Algorithms0.99
- (GDS) -FastRP, KNN, Node0.97
- (Visualization)1.00
- Similarity, Louvain, PageRank1.00
- Prerequisites: Python 3.11+, Node.js 18+, Neo4j AuraDS, Anthropic API Key, OpenAI API Key0.98
- AlEngineer0.97
- EUROPE1.00
-
- docs.google.com/presentation/d/1SUohQetFkVVs8OTvi02w8Uglb-WVZgNNtWCLuTQ871l/ed0.99
- To exit full screen, press and hold0.99
- f_0_1340.89
- ☆0.77
- Work0.90
- File Edit View Insert Format Slide Arrange0.98
- Context Graph - 5 min☆0.94
- Tools0.99
- Extensions1.00
- Help1.00
- ③0.65
- Slideshow1.00
- Share0.98
- Q. Menus0.90
- Tr0.99
- Background1.00
- Layout1.00
- Theme1.00
- Transition1.00
- A0.91
- ★1.00
- ★1.00
- Context Graph Demo0.98
- ★1.00
- AIE1.00
- Financial Services Agent1.00
- ★1.00
- ★1.00
- context-graph-demo.vercel.app0.99
- 回0.76
- ★1.00
- ★1.00
- ★1.00
- DATA SOURCES1.00
- BACKEND SERVICES1.00
- FRONTEND & USER INTERFACE0.98
- Support Ticket0.93
- System0.94
- B0.75
- FastAPI Application0.96
- « Claude Agent SOK0.89
- 口0.98
- 690.69
- Chakra UI v30.88
- ΩNoo4j Contat Graph & GDS0.85
- D0.93
- Interral0.84
- Q0.55
- 回0.56
- Engineering the future of Al0.99
-
- C0.56
- à context-graph-demo.vercel.app0.97
- @☆0.73
- Work1.00
- Context Graph Demo1.00
- Al-powered decision tracing with Neo4j1.00
- Blog Post1.00
- Issues1.00
- GitHub1.00
- About & Schema0.97
- Al Assistant0.99
- Context Graph1.00
- Decision Trace1.00
- Ask questions about customers, decisions, and1.00
- Visualize entities, decisions, and causal relationships0.99
- Inspect reasoning, precedents, and causal chains0.99
- policies1.00
- patterns.1.00
- Decisions in Graph1.00
- Now let me search for similar credit limit1.00
- increase decisions to understand1.00
- precedents for this type of request.1.00
- Decisions visible in the Context Graph. Click to view1.00
- details, or double-click nodes in the graph to expand.1.00
- ★1.00
- ★1.00
- DECISION: REJECT X0.99
- 4 decisions in graph0.99
- ★1.00
- ★1.00
- ★1.00
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- Requested Amount: $25,000 increase0.99
- Final Recommendation: REJECTION1.00
- Credit Limit Increase Request -0.98
- Jessica Norris1.00
- Decision made for compliance case. Type:1.00
- review. Standard review completed with...0.99
- 10/20/20251.00
- review1.00
- compliance1.00
- 68% conf1.00
- Analysis Summary1.00
- Based on my comprehensive analysis of0.99
- rejection fraud1.00
- 79% conf1.00
- precedents in the Context Graph, I0.99
- Jessica Norris's profile and historical1.00
- Transaction blocked. Pattern matches known1.00
- fraud typology FT-8291. Velocity check failed: 1...0.99
- recommend rejecting this credit limit0.99
- 6/27/20251.00
- 4 risk factors0.97
- increase request due to multiple high-1.00
- risk factors.1.00
- rejection compliance1.00
- 71% conf1.00
- Key Risk Factors Identified:1.00
- Decision made for compliance case. Type:0.99
- Previous Fraud & Compliance1.00
- rejection. Standard review completed with...0.98
- Rejections1.00
- Fraud rejection (June 2025):0.98
- 5/21/20251.00
- 2 risk factors1.00
- Transaction blocked matching1.00
- rejection credit0.99
- 71% conf1.00
- Ask about customers, decisions, or1.00
- policies...1.00
- expand1.00
- Click to inspect0.97
- Credit application rejected. Credit score of 7091.00
- below minimum threshold of 620. Recent...0.98
- 9/13/20241.00
- 1 risk factors1.00
- Engineering the future of Al1.00
-
- context-graph-demo.vercel.app1.00
- ☆0.96
- Work0.97
- Context Graph - 5 min ☆0.93
- File Edit View Insert Format Slide0.99
- Arrange1.00
- Tools1.00
- Extensions1.00
- Help1.00
- ③0.55
- Slideshow1.00
- Share0.98
- Q Menus0.86
- 宁0.67
- @ 92%0.90
- Tr0.96
- Background1.00
- Layout1.00
- Theme1.00
- Transition1.00
- ★1.00
- ★1.00
- Context Graph Demo1.00
- ★0.96
- AIE1.00
- Financial Services Agent1.00
- ★1.00
- ★1.00
- context-graph-demo.vercel.app1.00
- 回0.58
- ★1.00
- ★1.00
- ★1.00
- DATA SOURCES1.00
- BACKEND SERVICES1.00
- FRONTEND & USER INTERFACE0.99
- Suppert Ticket0.97
- System0.96
- FastAPI Application0.97
- + Claude Agent SDK0.98
- 口0.99
- 690.64
- Chakna UI v30.86
- Neosj Cantxt Oraph & GOS0.84
- D0.83
- Q0.74
- AlEngineer0.96
- EUROPE1.00
-
- 2ΩNe040.72
- Conte0.99
- Scheo0.87
- t context-graph-demo.vercel.app0.96
- 我☆0.67
- Work0.99
- Context Graph Demo0.99
- Al-powered decision tracing with Neo4j0.99
- Blog Post1.00
- Issues0.99
- GitHub1.00
- About & Schema1.00
- Al Assistant0.99
- Context Graph1.00
- Decision Trace1.00
- Ask questions about customers, decisions, and0.99
- Visualize entities, decisions, and causal relationships1.00
- Inspect reasoning. precedents, and causal chains1.00
- policies1.00
- Now let me get more details on the0.99
- Decisions in Graph1.00
- ★1.00
- ★1.00
- AIE1.00
- ★1.00
- previous rejection decision and1.00
- analyze fraud patterns for her1.00
- accounts.1.00
- FINAL DECISION: REJECT1.00
- Recommendation1.00
- Decisions visible in the Context Graph. Click to0.98
- expand.1.00
- view details, or double-click nodes in the graph to1.00
- 5 decisions in graph0.97
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- I recommend REJECTING the1.00
- $25,000 credit limit increase1.00
- request for Jessica Norris.1.00
- Decision made for compliance case. Type:0.99
- review. Standard review completed with...0.99
- review1.00
- compliance0.96
- 68% conf1.00
- Key Risk Factors1.00
- 10/20/20251.00
- Prior Fraud Rejection (June 2025)0.99
- - Critical Issue0.98
- Transaction blocked matching0.98
- known fraud typology FT-82910.99
- Velocity check failed; 140.98
- fraud typology FT-8291. Velocity check failed..0.97
- Transaction blocked. Pattern matches known1.00
- rejection fraud0.99
- 79% conf0.99
- transactions in 29 minutes1.00
- 6/27/20251.00
- 4 risk factors1.00
- Geographic anomaly: IP location1.00
- inconsistent with account1.00
- rejection credit0.99
- 88% conf0.97
- address1.00
- Credit limit increase of $25,000 rejected for1.00
- after-hours activity1.00
- Multiple red flags: new device,1.00
- high amount, round amount,1.00
- Jessica Norris. Customer has significant...1.00
- 4/9/20261.00
- Multiple Compliance Violations0.99
- Two separate compliance1.00
- Decision made for compliance case. Type:1.00
- rejection compliance0.99
- 71% conf0.99
- rejection. Standard review completed with...1.00
- Ask about customers, decisions, or1.00
- policies..0.98
- 5/21/20251.00
- 2 risk factors1.00
- Al Engineer0.91
- EUROPE1.00
-
- Noo40.75
- Schec0.94
- workspace.neo4j.io/workspace/query1.00
- 8☆0.80
- Work0.95
- jeo4j0.68
- Explore1.00
- Query1.00
- Import1.00
- 613240c5.databases.neo4j.io /neo4j0.98
- Send feedback0.99
- e0.93
- Database information1.00
- Nodes (3.536)0.96
- Account1.00
- Alert1.00
- Started stresming 25 reconds after 13 ms and completed after 14 m0.96
- Employee1.00
- Message0.99
- MATCH p=(:Decision)-[:CAUSED|INFLUENCED[PRECEDENT_FOR]->(:Dec1s1on) RETURN p LIMIT 10e0.97
- ()0.70
- ReasoningStep1.00
- SupportTicket1.00
- Organization0.98
- Tool1.00
- ReasoningTrace0.98
- ToolCall1.00
- Preference1.00
- Graph1.00
- Table0.98
- traud0.95
- RAW1.00
- CAUBED0.96
- community_id0.97
- confidence_scor 0.9540.99
- 28691.00
- 00.69
- 00.60
- ★1.00
- ★1.00
- Show all nodes (I more)0.98
- fraud1.00
- created_at1.00
- 2026-04-08T14:14:55.244001.00
- ★1.00
- AIE1.00
- ★1.00
- Relationships (13,463)0.99
- decision_:timesta 2026-2-1121:52:0284213900.85
- 0000Z0.99
- ★1.00
- ★1.00
- ABOUT APPLIED_POLICY0.99
- mp1.00
- 000Z0.99
- ★1.00
- ★1.00
- ★1.00
- ASSIGNED_TO1.00
- BELONGS_TO_ACCOUNT_COMMUNITY1.00
- support0.89
- fast_rp_embeddi [.0.010616122744977474,.0.000.92
- decision_type1.00
- "approval"0.97
- 00.94
- CAUSED COUNTERPARTY1.00
- FROM_ACCOUNT HAS_SIMILAR_FACTORS0.99
- BELONGS_TO_DECISION_COMMUNITY1.00
- ng1.00
- 668194413185, 0.1539906260.97
- 25265680626034737,-0.2180.98
- 3954119682312.-0.00432630.99
- 33514404, 0.12980301678180.97
- INFLUENCED MADE_BY OWNS0.98
- 0695, -0.19989818334579...0.94
- OWNS_ACCOUNT PRECEDENT_FOR0.99
- REGARDING RELATED_TO RESOLVED_BY0.97
- SHARES_HIGH_PERCENTAGE_OF_TRANSACTI...0.99
- SUBMITTED_BY1.00
- support0.96
- tradinn0.94
- 4· Q x0.50
- id1.00
- reasoning1.00
- b5647123-2574-4ab7-bf3e-0.95
- d7b63ae6cc880.94
- "Decision made for support c0.99
- Show all1.00
- Show all relationships (3 more)0.98
- Property keys1.00
- :welcome0.99
- 口0.88
- GUIDE1.00
- DATASET1.00
- Last update: 10:47:20 AM0.85
- Engineering the future of Al1.00
-
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- Engineering the future of Al1.00
-
- How the Agent Traces Decision History1.00
- Tool Calls (7)1.00
- View tool parameters0.99
- and results1.00
- Tool Call search_customer1.00
- REJECT or ESCALATE — grounded in institutional knowledge, not just a credit score1.00
- Arguments:1.00
- "query": "Jessica0.99
- 11.00
- Query Context Graph1.00
- Norris",0.95
- "limit": 50.98
- Agent retrieves Jessica's full profile: accounts, transactions, employer, risk tier1.00
- Tool Call find_precedents1.00
- Arguments:1.00
- ***0.66
- AIE1.00
- 21.00
- Trace Decision History1.00
- increase $25000",0.97
- "category": "credit",1.00
- "linit": 100.94
- "scenario": "credit limit0.99
- ★1.00
- ★1.00
- ★1.00
- Past fraud flag (April 2025), compliance rejections, velocity check failures1.00
- Tool Call detect_fraud_patterns1.00
- Arguments:1.00
- 31.00
- Hybrid Search1.00
- "account_id": "6a5a92ab-0.97
- 7ela-4990-9ca0-0.99
- Semantic similarity (text embeddings) + structural similarity (FastRP graph embeddings)1.00
- fe08574b2ddc",0.99
- "neighbor_count": "1@"0.95
- Recommendation1.00
- ESCALATE FOR MANUAL REVIEW -0.97
- 41.00
- Recommendation1.00
- Do not approve automatically1.00
- Reasoning: While Jessica Norris has1.00
- strong financial indicators (substantial1.00
- account balance, low personal risk1.00
- score, clean transaction history), there1.00
- 31 nodes · 30 relationships · Jessica's complete context in a single graph traversal0.99
- are significant geopolitical and1.00
The page's on-screen-text budget of 600
lines is spent, so the last cards in this grid list fewer lines than they
hold. Narrow the page with ?frames= to read them.
Transcript
159 cues· 2,638 words· 14,124 chars
- 0:14 So my name is Zach.
- 0:16 I work for Neo4j.
- 0:18 We're a graph intelligence company.
- 0:20 You can think of us like a knowledge layer graph database at the core.
- 0:24 We help connect and resolve information so AI systems can be a little bit more accurate and explainable.
- 0:31 I used to work in technical market.
- 0:32 I very recently am going back to my AI and machine learning roots.
- 0:37 transferred over to a research engineering role.
- 0:40 So I'm going to talk to you today about context graphs.
- 0:44 How many people in this room have heard about context graphs before?
- 0:49 Okay, so we've got about half.
- 0:50 And how many people have actually coded anything with a context graph or with a graph like Neo4j in general?
- 0:58 Okay, okay, about half, so that's good to know.
- 1:00 So I'm gonna talk a little bit about how we think about context graphs at Neo4j, define what they are, and then I want to go over some tools that are built by William Loyne, who's one of our product managers, so that you can get started with them very quickly with your own code and your agent framework.
- 1:17 So context graphs, foundation capital, I think back in December
- 1:26 And essentially, we saw a lot of noise around this idea of creating decision traces and reasoning to help agents make better decisions.
- 1:35 And so to kind of think actually about what a content graph is, you need to ask yourself, what do agents need to really be accurate, right?
- 1:43 And so for one thing, doing a lot of retrieval, you're going to need a knowledge base, obviously.
- 1:50 So a knowledge base for something like RAG or graph retrieval
- 1:53 basically helps an agent or a chatbot answer questions correctly.
- 2:00 What a context graph does, and the evolution of this, is really the information required to not only answer questions correctly, but make better decisions.
- 2:10 So if we took a concrete example, and I'll show you a demo of this, a financial analyst agent, and say that this agent has a question around improved interest rate increase and a request for a certain amount of money.
- 2:26 to allow that agent to receive information about the system.
- 2:30 So customer info, transactions, and policies.
- 2:34 The response from that is likely to look something like this, where it could maybe assign some sort of risk score and recommend some sort of review and talk about some key risk factors.
- 2:44 What is helpful, what a context graph enables an agent to do is actually give an answer.
- 2:52 Should you reject, accept, and why?
- 2:56 And it does this because in addition to getting that customer information in those transactions, it's also going to get you past decision traces and presidents, dynamic information about why decisions are made.
- 3:13 Systems of record, really about facts, entities, current state.
- 3:21 about presidents, causal chains, outcomes, and enabling the agent to act with subject matter expertise, and telling the agent really for a context graph, the entities about things that exist, there'll be a so decisions, transactions, approvals, things like that, and then content sees that
- 3:50 and different reasoning by AI that memory but by employees and past humans that have made some of it because you know with internet connection I never know you know how things are gonna go all the code for this is available I'll show links at the end basically and
- 4:18 Data that we generate, replicates, taking data in from a CRM and a support system in some other places.
- 4:25 It's using Claude in sort of the agent runtime, has some open AI embeddings.
- 4:31 There's Neo4j database assisting the data with some vectors.
- 4:36 And then we have our Next.js front end as well.
- 4:42 So let me show you this recording.
- 4:47 running here so you can kind of see what this looks like because again you ask it a question and it will call basically a series of tools and you can see it bringing the graph data back and then you see it getting these different decision traces and eventually it will get this reject decision right and if
- 5:27 Then it does this thing called find precedence, which is going to be in a second, but it's going to look at information to pull a bunch of
- 6:26 Internet would work.
- 6:30 Connect to each other in these.
- 6:31 Build off of each other.
- 6:53 is so like I was saying before, um, we query just context around Jessica's profile.
- 7:00 We pulled back decision traces and we did a special hybrid search, especially around those presidents, both on semantic similarity and structural similarity inside of the graph that actually looked at how the decision traces were made from previous decisions.
- 7:15 And it tried to match that.
- 7:17 And I'll talk a little bit about how that works with graph embeddings in the next slide to ultimately come up with the recommendation.
- 7:23 And so we add a, we have a vector index, so we're able to search like fraud rejection, for example, sort of on the semantics.
- 7:34 But then we have this called graph embedding.
- 7:36 So a lot of you in here are probably familiar with text embeddings on words.
- 7:42 A graph embedding is the same concept except those green nodes that I was showing you before everything was connected, we actually embedded those into a vector.
- 7:50 And so what that means is similar decision traces are now gonna be able to be looked up by vector similarity.
loading