The agent-ready web: Simplify user actions with WebMCP — Tara Agyemang, Google

What was stored

cues

206

whisperx 206

chunks

37

from 206 cues

keyframes

33

kept of 62 captured

frames with text

33

1,005 lines read

chapters

0

from the source metadata

keyframe bytes

6.0 MB

word timings on 206 cues

Provenance

Frames, and what the machine read

• 

  0:03 #0 done2 line(s)

  shot 0·sharpness 658.4

  1. AlEngineer0.98
  2. EUROPE1.00
• 

  0:08 #1 done2 line(s)

  shot 1·sharpness 829.1

  1. PRESENTINGSPONSOR1.00
  2. Google DeepMind1.00
• 

  0:13 #2 done3 line(s)

  shot 2·sharpness 907.6

  1. PLATINUM SPONSORS0.98
  2. # Braintrust0.96
  3. WorkOS OpenAI0.95
• 

  0:17 #3 done6 line(s)

  shot 3·sharpness 386.9

  1. Google1.00
  2. The agent-ready web1.00
  3. Simplify user actions with WebMCP1.00
  4. Tara Agyemang / April 20260.97
  5. AlEng0.96
  6. EUROP1.00
• 

  0:54 #4 done9 line(s)

  shot 4·sharpness 1924.7

  1. Google1.00
  2. AIE1.00
  3. The agent-ready web0.98
  4. ★0.99
  5. Simplify user actions with WebMCP1.00
  6. Tara Agyemang / April 20260.99
  7. Engineering the future of Al1.00
  8. AlEngir0.97
  9. EUROPE1.00
• 

  1:11 #5 done14 line(s)

  shot 5·sharpness 1304.7

  1. docs.google.com - to exit full screen, press0.97
  2. AIE1.00
  3. Google!1.00
  4. Google1.00
  5. ★0.99
  6. Google1.00
  7. ★1.00
  8. ★1.00
  9. ★1.00
  10. Google1.00
  11. Braintrust1.00
  12. WorkOS OpenAI0.95
  13. AlEng0.92
  14. EURO0.93
• 

  1:46 #6 skipped

  shot 6·duplicate of #5

• 

  1:50 #7 done29 line(s)

  shot 7·sharpness 1437.2

  1. + Aak Oem0.83
  2. AUsens/taraojo/Projecta/concert-tickets/index.homi0.82
  3. BEATDROP1.00
  4. Featured Events About0.97
  5. Search events, arfists0.96
  6. ★1.00
  7. Feel the Live Music0.99
  8. AIE1.00
  9. ★1.00
  10. ★1.00
  11. Experience1.00
  12. ★1.00
  13. ★1.00
  14. ★1.00
  15. Find your next unforgettable night with BeatDrop.1.00
  16. Browse Events1.00
  17. Hello, Tara0.97
  18. How can I help you today?0.99
  19. Discuss a topic with me0.92
  20. How can I use Gemini Live?0.95
  21. Do I have any meeting conflicts next week?0.98
  22. Featured Events1.00
  23. Sharig "BeatDrop ( COocer Tikkents"0.76
  24. Type to ask about a tab0.96
  25. Google1.00
  26. AlEngineer0.97
  27. EUROPE1.00
  28. AlEngir0.91
  29. EUROR0.90
• 

  2:11 #8 done9 line(s)

  shot 8·sharpness 2337.8

  1. purchase 2 tickets to the afrobeat festival0.99
  2. on 28th december, my budget is 200 per0.98
  3. AIE1.00
  4. person. pick the best seats, as close the1.00
  5. the front as possible0.99
  6. AlEngineer0.96
  7. EUROPE1.00
  8. AlEngil0.96
  9. EUROPE1.00
• 

  2:24 #9 skipped

  shot 9·duplicate of #8

• 

  2:58 #10 done56 line(s)

  shot 10·sharpness 1968.3

  1. StaticT0.98
  2. StaticT1.00
  3. StaticT1.00
  4. image "0.94
  5. <c0.88
  6. https:/0.99
  7. Featured Events1.00
  8. 4b6ad7a0.97
  9. StaticT1.00
  10. src="https1.00
  11. heading1.00
  12. it=crop&an1.00
  13. StaticT1.00
  14. StaticT1.00
  15. afrobeat0.96
  16. StaticT0.98
  17. ★1.00
  18. image1.00
  19. AIE1.00
  20. https:/1.00
  21. ★1.00
  22. StaticT1.00
  23. b30b53o0.92
  24. ★1.00
  25. ★1.00
  26. ★1.00
  27. heading1.00
  28. StaticT0.99
  29. StaticT1.00
  30. Afrobeat Festival1.00
  31. Summer Vibes Festival0.98
  32. StaticT1.00
  33. heading1.00
  34. December 28, 20260.96
  35. 人y12.20260.95
  36. button1.00
  37. Elko Atiantk. Lagos0.84
  38. Central Park, NY0.96
  39. <C0.78
  40. button1.00
  41. button1.00
  42. £1501.00
  43. £890.99
  44. button1.00
  45. src="https1.00
  46. image1.00
  47. it=crop&an1.00
  48. https:/1.00
  49. bd47b1o0.99
  50. StaticT1.00
  51. heading1.00
  52. StaticT1.00
  53. StaticT0.89
  54. Engineering the future of Al0.99
  55. AlEngir0.96
  56. EUROP1.00
• 

  3:44 #11 skipped

  shot 11·duplicate of #8

• 

  4:02 #12 done11 line(s)

  shot 12·sharpness 1166.1

  1. ***0.58
  2. AIE1.00
  3. WebMCP1.00
  4. ★1.00
  5. ★1.00
  6. Web Model Context Protocol1.00
  7. Google1.00
  8. AlEngineer0.96
  9. EUROPE1.00
  10. AlEngir0.95
  11. EURO1.00
• 

  4:28 #13 skipped

  shot 13·duplicate of #12

• 

  4:50 #14 done35 line(s)

  shot 14·sharpness 1660.2

  1. WebMCP - Model Context Tool Inspector0.98
  2. WebMCP Tools0.95
  3. description1.00
  4. inputSchema1.00
  5. name1.00
  6. Start a new maze game. Generates a fresh1.00
  7. right exit.1.00
  8. maze and places the player at the top-left1.00
  9. corner. The goal is to reach the bottom-0.99
  10. start_game1.00
  11. ★1.00
  12. AIE1.00
  13. Copy as ScriptToolConfigCopy as JSON1.00
  14. ★1.00
  15. ★1.00
  16. ★1.00
  17. ★1.00
  18. MAZE ESCAPE0.99
  19. Interact with the Page0.98
  20. User Prompt0.98
  21. You are trapped in a maze. Ask the AI agent to1.00
  22. help you escape!1.00
  23. Start a new maze game.1.00
  24. The agent can use the start game tool to begin.0.96
  25. Send1.00
  26. Reset1.00
  27. Update Gemini API key0.99
  28. Copy trace1.00
  29. Tool1.00
  30. "start_game"1.00
  31. Input Arguments1.00
  32. 0}0.69
  33. Engineering the future of Al0.99
  34. AlEngir0.92
  35. EUR1.00
• 

  5:23 #15 done32 line(s)

  shot 15·sharpness 1623.9

  1. WebMCP - Model Context Tool Inspector0.97
  2. WebMCP Tools0.97
  3. description1.00
  4. inputSchema1.00
  5. name1.00
  6. Start a new maze game. Generates a fresh maze0.99
  7. and places the player at the top-left corner. The goal0.99
  8. start_game1.00
  9. is to reach the bottom-right exit.1.00
  10. Copy as ScriptToolConfigCopy as JSON0.99
  11. AIE1.00
  12. Interact with the Page1.00
  13. ★1.00
  14. ★1.00
  15. ★1.00
  16. MAZE ESCAPE0.97
  17. User Prompt1.00
  18. You are trapped in a maze. Ask the AI agent to0.98
  19. Start a new maze game.1.00
  20. help you escape!1.00
  21. The agest can use the start_game tool to begin.0.95
  22. Send1.00
  23. Reset1.00
  24. Update Gemini API key0.99
  25. Copy trace1.00
  26. Tool1.00
  27. "start_game"1.00
  28. Input Arguments1.00
  29. 0}0.82
  30. Engineering the future of Al0.99
  31. AlEngir0.93
  32. EURO1.00
• 

  5:56 #16 done37 line(s)

  shot 16·sharpness 1579.6

  1. omelabs.github.io/webmcp-tools/demos/webmcp-maze/0.99
  2. WebMCP - Model Context Tool Inspector0.98
  3. description1.00
  4. inputSchema name1.00
  5. Start a new maze game. Generates a fresh maze0.99
  6. is to reach the bottom-right exit.0.98
  7. and places the player at the top-left corner. The goal0.99
  8. start_game1.00
  9. Copy as ScriptToolConfig Copy as JSON0.99
  10. *★★0.67
  11. ★1.00
  12. Interact with the Page0.99
  13. AIE1.00
  14. ★1.00
  15. User Prompt1.00
  16. ★1.00
  17. Start a new maze game.0.98
  18. ★1.00
  19. ★1.00
  20. ★1.00
  21. MAZE ESCAPE0.98
  22. You are trapped in a maze. Ask the AI agent to0.98
  23. help you escape!1.00
  24. Send1.00
  25. Reset1.00
  26. Update Gemini API key1.00
  27. Copy trace0.98
  28. The agent can use the start game tool to begin.0.98
  29. Tool1.00
  30. "start_game"1.00
  31. Input Arguments1.00
  32. {0}0.67
  33. Execute Tool0.96
  34. AlEngineer0.97
  35. EUROPE1.00
  36. AlEngi0.95
  37. EUR0.82
• 

  6:07 #17 done40 line(s)

  shot 17·sharpness 2125.4

  1. ☆0.94
  2. MOVES1.00
  3. 2/1001.00
  4. HOLDING1.00
  5. WebMCP - Model Context Tool Inspector0.98
  6. requareu : L uarecczon0.67
  7. Pick up a collectible item1.00
  8. (key or dynamite) from0.99
  9. only carry one item at a1.00
  10. your current cell. You can1.00
  11. pickup1.00
  12. time. Drop your current0.99
  13. item first if needed.1.00
  14. ★1.00
  15. Interact with the Page0.99
  16. AIE1.00
  17. ★1.00
  18. User Prompt1.00
  19. ★1.00
  20. Start a new maze game, then show me what's around, an0.99
  21. ★1.00
  22. ★1.00
  23. ★1.00
  24. Send1.00
  25. Reset1.00
  26. Update Gemini API key0.98
  27. Copy trace1.00
  28. User prompt: "Start a new maze game."1.00
  29. AI calling tool "start_game" with ()0.96
  30. Tool "start_game" result: {"message":"A new maze has been generated! Use0.99
  31. 'look' to see your surroundings, then 'move' to navigate.","mazeSize":0.99
  32. {"rows":10,"cqls":10},"startPosition":{"row":0,"col":0},"exitPosition":0.99
  33. {"row":9,"col":9}}0.98
  34. AI result: A new maze has been generated! Use 'look' to see your0.99
  35. surroundings, then 'move' to navigate. The maze is 10x1e, starting at0.99
  36. (0,0) and the exit is at (9,9).0.98
  37. AlEngineer0.97
  38. EUROPE1.00
  39. AlEng0.91
  40. EUR1.00
• 

  6:32 #18 done37 line(s)

  shot 18·sharpness 2055.8

  1. MOVES1.00
  2. 2/1001.00
  3. HOLDING1.00
  4. WebMCP - Model Context Tool Inspector0.98
  5. time. Drop your current0.98
  6. item first if needed.1.00
  7. Interact with the Page0.98
  8. User Prompt1.00
  9. Start a new maze game, then show me what's around, and then move1.00
  10. north.1.00
  11. ★1.00
  12. AIE1.00
  13. ★1.00
  14. ★1.00
  15. Send1.00
  16. Reset1.00
  17. Update Gemini API key0.97
  18. Copy trace1.00
  19. ★1.00
  20. ★1.00
  21. ★1.00
  22. User prompt: "Start a new maze game."1.00
  23. AI calling tool "start_game" with {}0.99
  24. Tool "start_game" result: {"message":"A new maze has been generated! Use0.99
  25. 'look' to see your surroundings, then 'move' to navigate.","mazeSize":0.99
  26. {"rows":10,"cols":10},"startPosition":{"row":0,"col":0},"exitPosition":0.99
  27. {"row":9,"col":9}}1.00
  28. AI result: A new maze has been generated! Use 'look' to see your0.99
  29. surroundings, then 'move' to navigate. The maze is 10x1e, starting at0.99
  30. (0,0) and the exit is at (9,9).0.99
  31. Tool1.00
  32. "drop"1.00
  33. Input Arguments1.00
  34. AlEngineer0.97
  35. EUROPE1.00
  36. AlEngi0.98
  37. EURC0.89
• 

  7:05 #19 done51 line(s)

  shot 19·sharpness 2044.2

  1. ☆0.97
  2. MOVES1.00
  3. 2/1001.00
  4. HOLDING0.99
  5. WebMCP - Model Context Tool Inspector0.97
  6. { "type": "object",0.97
  7. Move the player one cell1.00
  8. "properties": { "direction": {0.99
  9. Returns success or failure0.98
  10. in a cardinal direction1.00
  11. (north, south, east, west).1.00
  12. "west" ], "description":0.98
  13. "type": "string", "enum": [0.98
  14. "north", "south", "east",0.99
  15. "The1.00
  16. move1.00
  17. with a reason.1.00
  18. direction to move." }},0.98
  19. "required": [ "direction" ] }0.98
  20. Pick up a collectible item0.98
  21. (key or dynamite) from0.99
  22. *★★0.64
  23. AIE1.00
  24. ★1.00
  25. ★1.00
  26. your current cell. You can0.97
  27. only carry one item at a0.97
  28. time. Drop your current1.00
  29. pickup1.00
  30. item first if needed.1.00
  31. ★1.00
  32. ★1.00
  33. ★1.00
  34. ★1.00
  35. Interact with the Page0.99
  36. User Prompt1.00
  37. Start a new maze game, then show me what's around, and then move1.00
  38. north.1.00
  39. Send1.00
  40. Reset1.00
  41. Update Gemini API key1.00
  42. Copy trace1.00
  43. User prompt: "Start a new maze game."1.00
  44. AI calling tool "start_game" with {}0.98
  45. Tool "start_game" result: {"message":"A new maze has been generated! Use0.98
  46. 'look' to see your surroundings, then 'move' to navigate.","mazeSize":0.99
  47. {"rows":10,"cols":10},"startPosition":{"row":0,"col":0},"exitPosition":1.00
  48. {"row":9,"col":9}}0.99
  49. Engineering the future of Al1.00
  50. AlEngi0.96
  51. EURO1.00
• 

  7:42 #20 done43 line(s)

  shot 20·sharpness 2157.0

  1. MOVES1.00
  2. EXPLORED 4/1000.98
  3. HOLDING0.99
  4. WebMCP - Model Context Tool Inspector0.98
  5. { "type": "object",0.97
  6. Move the player one cell1.00
  7. "properties": { "direction": {0.99
  8. Returns success or failure1.00
  9. in a cardinal direction1.00
  10. (north, south, east, west).0.98
  11. with a reason.0.99
  12. "west" i, "description":'"The0.96
  13. "type": "string", "enum": [0.99
  14. "north", "south", "east",0.98
  15. direction to move." }},0.98
  16. "required": ["direction" ] }0.96
  17. move0.98
  18. ★1.00
  19. Pick up a collectible item0.98
  20. (kev or dvnamite) fmm0.96
  21. AIE1.00
  22. ★1.00
  23. Interact with the Page1.00
  24. ★1.00
  25. ★1.00
  26. ★1.00
  27. ★1.00
  28. User Prompt1.00
  29. Send1.00
  30. Reset1.00
  31. Update Gemini API key1.00
  32. Copy trace1.00
  33. User prompt: "move down, then right"0.99
  34. AI calling tool "move" with {"direction":"south"}1.00
  35. Tool "move" result: {"success":true,"position":0.99
  36. {"row":1,"col":0},"atExit":false,"moveCount":1}1.00
  37. AI calling tool "move" with {"direction":"east"}0.99
  38. Tool "move" result: {"success":true,"position":0.99
  39. {"row":1,"col":1},"atExit":false,"moveCount":2}1.00
  40. AI result: I moved you down, then right. You are now at row 1, column 1.1.00
  41. Google DeepMind1.00
  42. AlEngii0.93
  43. EUROP1.00
• 

  8:04 #21 done42 line(s)

  shot 21·sharpness 2093.1

  1. MOVES1.00
  2. 8/1000.99
  3. HOLDING0.98
  4. WebMCP - Model Context Tool Inspector0.99
  5. current inventory, ana1.00
  6. whether the exit is here.0.98
  7. { "type": "object",0.98
  8. Move the player one cell0.98
  9. "properties": { "direction": {0.99
  10. (north, south, east, west).1.00
  11. in a cardinal direction0.99
  12. "type": "string", "enum": [0.99
  13. "north", "south", "east",0.99
  14. move1.00
  15. with a reason.1.00
  16. Returns success or failure1.00
  17. "west" ], "description": "The0.96
  18. direction to move." }},0.97
  19. "required": [ "direction" ] }0.96
  20. ★1.00
  21. AIE1.00
  22. (kev nr dvnamite) from0.93
  23. Pick up a collectible item1.00
  24. ★1.00
  25. Interact with the Page0.99
  26. ★1.00
  27. ★1.00
  28. User Prompt1.00
  29. Send1.00
  30. Reset1.00
  31. Update Gemini API key0.99
  32. Copy trace1.00
  33. {"row":1,"col":2},"atExit":false,"moveCount":3}1.00
  34. AI calling tool "move" with {"direction":"north"}0.98
  35. Tool "move" result: {"success":true,"position":0.99
  36. {"row":0,"col":2},"atExit":false,"moveCount":4}1.00
  37. AI calling tool "move" with {"direction":"east"}0.99
  38. Tool "move" result: {"success":true,"position":0.99
  39. {"row":0,"col":3},"atExit":false,"moveCount":5}0.99
  40. Engineering the future of Al0.98
  41. AlEngi0.98
  42. EUROP1.00
• 

  8:15 #22 skipped

  shot 22·duplicate of #21

• 

  8:45 #23 done45 line(s)

  shot 23·sharpness 2106.1

  1. EXPLORED0.99
  2. 1/1000.97
  3. HOLOING GREENKEY0.99
  4. WebMCP - Model Context Tool Inspector0.99
  5. current inventory, ana0.99
  6. whether the exit is here.0.99
  7. Move the player one cell0.99
  8. { "type": "object",0.98
  9. "properties": { "direction": {0.99
  10. in a cardinal direction1.00
  11. (north, south, east, west).1.00
  12. "type": "string", "enum": [0.99
  13. "north", "south", "east",0.99
  14. move1.00
  15. with a reason.1.00
  16. Returns success or failure1.00
  17. "west" ], "description": "The0.96
  18. direction to move."}},0.99
  19. "required": [ "direction" ] }0.95
  20. ★1.00
  21. AIE1.00
  22. ★1.00
  23. (kev or rdvnamite) from0.91
  24. Pick up a collectible item1.00
  25. ★1.00
  26. Interact with the Page0.98
  27. ★1.00
  28. ★1.00
  29. ★1.00
  30. User Prompt1.00
  31. Send1.00
  32. Reset1.00
  33. Update Gemini API key0.98
  34. Copy trace0.99
  35. Tool "move" result: {"success":true,"position":1.00
  36. {"row":0,"col":6},"atExit":false,"moveCount":12}1.00
  37. AI calling tool "look" with {}0.97
  38. Tool "look" result: {"position":("row":0,"col":6},"openDirections":0.99
  39. ["east","west"],"collectibleHere":null,"inventory":"key_green","atExit":f1.00
  40. - not yet visible through fog of war", "mazeSize":0.98
  41. {"rows":10,"cols":10},"moveCount":12}0.99
  42. AlEngineer0.97
  43. EUROPE1.00
  44. AlEngi0.96
  45. EUROP1.00

Transcript

206 cues· 3,183 words· 16,615 chars