vidtheque.

read-only demo

Videos o-zkvb0iFDQ

MCP UI: Extending the frontier — Liad Yosef and Ido Salomon, MCP Apps

index_state ready data_status ok

AI Engineer· published 2026-05-06· 0:22:20· en-US· indexed 2026-08-10 19:51

Open on YouTube

Scene timeline

  1. Shot 0, 0:00 to 0:05, 1 of 1 keyframes kept
  2. Shot 1, 0:05 to 0:09, 1 of 1 keyframes kept
  3. Shot 2, 0:09 to 0:14, 1 of 1 keyframes kept
  4. Shot 3, 0:14 to 0:25, 1 of 1 keyframes kept
  5. Shot 4, 0:25 to 0:45, 1 of 1 keyframes kept
  6. Shot 5, 0:45 to 0:53, 1 of 1 keyframes kept
  7. Shot 6, 0:53 to 0:57, 1 of 1 keyframes kept
  8. Shot 7, 0:57 to 1:01, 1 of 1 keyframes kept
  9. Shot 8, 1:01 to 1:14, 1 of 1 keyframes kept
  10. Shot 9, 1:14 to 1:26, 1 of 1 keyframes kept
  11. Shot 10, 1:26 to 1:35, 1 of 1 keyframes kept
  12. Shot 11, 1:35 to 1:41, 1 of 1 keyframes kept
  13. Shot 12, 1:41 to 2:03, 1 of 1 keyframes kept
  14. Shot 13, 2:03 to 2:10, 1 of 1 keyframes kept
  15. Shot 14, 2:10 to 2:14, 1 of 1 keyframes kept
  16. Shot 15, 2:14 to 2:35, 1 of 1 keyframes kept
  17. Shot 16, 2:35 to 2:40, 1 of 1 keyframes kept
  18. Shot 17, 2:40 to 2:56, 1 of 1 keyframes kept
  19. Shot 18, 2:56 to 3:04, 1 of 1 keyframes kept
  20. Shot 19, 3:04 to 3:25, 1 of 1 keyframes kept
  21. Shot 20, 3:25 to 3:52, 1 of 1 keyframes kept
  22. Shot 21, 3:52 to 4:24, 1 of 1 keyframes kept
  23. Shot 22, 4:24 to 4:29, 1 of 1 keyframes kept
  24. Shot 23, 4:29 to 4:31, 1 of 1 keyframes kept
  25. Shot 24, 4:31 to 4:38, 1 of 1 keyframes kept
  26. Shot 25, 4:38 to 4:47, 1 of 1 keyframes kept
  27. Shot 26, 4:47 to 4:57, 1 of 1 keyframes kept
  28. Shot 27, 4:57 to 5:09, 1 of 1 keyframes kept
  29. Shot 28, 5:09 to 5:16, 1 of 1 keyframes kept
  30. Shot 29, 5:16 to 5:47, 1 of 1 keyframes kept
  31. Shot 30, 5:47 to 6:17, 1 of 1 keyframes kept
  32. Shot 31, 6:17 to 6:47, 1 of 1 keyframes kept
  33. Shot 32, 6:47 to 6:52, 1 of 1 keyframes kept
  34. Shot 33, 6:52 to 7:22, 1 of 1 keyframes kept
  35. Shot 34, 7:22 to 8:02, 1 of 1 keyframes kept
  36. Shot 35, 8:02 to 8:05, 1 of 1 keyframes kept
  37. Shot 36, 8:05 to 8:32, 1 of 1 keyframes kept
  38. Shot 37, 8:32 to 8:33, 0 of 1 keyframes kept
  39. Shot 38, 8:33 to 8:54, 0 of 1 keyframes kept
  40. Shot 39, 8:54 to 8:57, 1 of 1 keyframes kept
  41. Shot 40, 8:57 to 9:27, 1 of 1 keyframes kept
  42. Shot 41, 9:27 to 9:56, 1 of 1 keyframes kept
  43. Shot 42, 9:56 to 10:26, 0 of 1 keyframes kept
  44. Shot 43, 10:26 to 10:37, 1 of 1 keyframes kept
  45. Shot 44, 10:37 to 10:41, 1 of 1 keyframes kept
  46. Shot 45, 10:41 to 10:45, 1 of 1 keyframes kept
  47. Shot 46, 10:45 to 10:48, 1 of 1 keyframes kept
  48. Shot 47, 10:48 to 10:50, 1 of 1 keyframes kept
  49. Shot 48, 10:50 to 11:03, 1 of 1 keyframes kept
  50. Shot 49, 11:03 to 11:12, 1 of 1 keyframes kept
  51. Shot 50, 11:12 to 11:38, 1 of 1 keyframes kept
  52. Shot 51, 11:38 to 12:04, 1 of 1 keyframes kept
  53. Shot 52, 12:04 to 12:30, 1 of 1 keyframes kept
  54. Shot 53, 12:30 to 12:49, 1 of 1 keyframes kept
  55. Shot 54, 12:49 to 12:57, 1 of 1 keyframes kept
  56. Shot 55, 12:57 to 13:08, 1 of 1 keyframes kept
  57. Shot 56, 13:08 to 13:42, 1 of 1 keyframes kept
  58. Shot 57, 13:42 to 14:00, 1 of 1 keyframes kept
  59. Shot 58, 14:00 to 14:09, 1 of 1 keyframes kept
  60. Shot 59, 14:09 to 14:15, 1 of 1 keyframes kept
  61. Shot 60, 14:15 to 14:24, 1 of 1 keyframes kept
  62. Shot 61, 14:24 to 14:28, 1 of 1 keyframes kept
  63. Shot 62, 14:28 to 14:38, 1 of 1 keyframes kept
  64. Shot 63, 14:38 to 14:49, 1 of 1 keyframes kept
  65. Shot 64, 14:49 to 14:52, 1 of 1 keyframes kept
  66. Shot 65, 14:52 to 15:01, 1 of 1 keyframes kept
  67. Shot 66, 15:01 to 15:16, 1 of 1 keyframes kept
  68. Shot 67, 15:16 to 15:31, 0 of 1 keyframes kept
  69. Shot 68, 15:31 to 15:39, 1 of 1 keyframes kept
  70. Shot 69, 15:39 to 16:10, 1 of 1 keyframes kept
  71. Shot 70, 16:10 to 16:15, 1 of 1 keyframes kept
  72. Shot 71, 16:15 to 16:30, 1 of 1 keyframes kept
  73. Shot 72, 16:30 to 16:41, 1 of 1 keyframes kept
  74. Shot 73, 16:41 to 17:14, 0 of 1 keyframes kept
  75. Shot 74, 17:14 to 17:26, 1 of 1 keyframes kept
  76. Shot 75, 17:26 to 17:36, 1 of 1 keyframes kept
  77. Shot 76, 17:36 to 17:58, 1 of 1 keyframes kept
  78. Shot 77, 17:58 to 18:03, 1 of 1 keyframes kept
  79. Shot 78, 18:03 to 18:13, 1 of 1 keyframes kept
  80. Shot 79, 18:13 to 18:17, 1 of 1 keyframes kept
  81. Shot 80, 18:17 to 18:32, 1 of 1 keyframes kept
  82. Shot 81, 18:32 to 18:42, 1 of 1 keyframes kept
  83. Shot 82, 18:42 to 19:14, 1 of 1 keyframes kept
  84. Shot 83, 19:14 to 19:20, 1 of 1 keyframes kept
  85. Shot 84, 19:20 to 19:30, 1 of 1 keyframes kept
  86. Shot 85, 19:30 to 19:32, 1 of 1 keyframes kept
  87. Shot 86, 19:32 to 19:33, 1 of 1 keyframes kept
  88. Shot 87, 19:33 to 19:39, 0 of 1 keyframes kept
  89. Shot 88, 19:39 to 19:54, 1 of 1 keyframes kept
  90. Shot 89, 19:54 to 19:55, 1 of 1 keyframes kept
  91. Shot 90, 19:55 to 20:17, 0 of 1 keyframes kept
  92. Shot 91, 20:17 to 20:26, 1 of 1 keyframes kept
  93. Shot 92, 20:26 to 20:37, 1 of 1 keyframes kept
  94. Shot 93, 20:37 to 20:45, 1 of 1 keyframes kept
  95. Shot 94, 20:45 to 20:59, 1 of 1 keyframes kept
  96. Shot 95, 20:59 to 21:32, 1 of 1 keyframes kept
  97. Shot 96, 21:32 to 21:44, 1 of 1 keyframes kept
  98. Shot 97, 21:44 to 21:47, 1 of 1 keyframes kept
  99. Shot 98, 21:47 to 22:05, 1 of 1 keyframes kept
  100. Shot 99, 22:05 to 22:20, 1 of 1 keyframes kept

100 shot(s).

keyframes kept every frame deduplicated

What was stored

cues
278
whisperx 278
chunks
39
from 278 cues
keyframes
93
kept of 100 captured
frames with text
93
2,365 lines read
chapters
11
from the source metadata
keyframe bytes
10.9 MB
word timings on 278 cues

Provenance

Each pipeline stage, its state and the model that produced it
stage state model started took
fetch done — 2026-08-10 14:44 2m 17s
stt done — 2026-08-10 14:47 24s
chunk done — 2026-08-10 14:47 0s
text_embed done — 2026-08-10 19:51 0s
keyframe done — 2026-08-10 14:47 2m 16s
ocr done — 2026-08-10 14:49 38s
frame_embed done — 2026-08-10 19:51 16s

Frames, and what the machine read

  • 0:03 #0 done2 line(s)

    shot 0·sharpness 658.4

    1. AlEngineer0.98
    2. EUROPE1.00

  • 0:08 #1 done2 line(s)

    shot 1·sharpness 829.1

    1. PRESENTINGSPONSOR1.00
    2. Google DeepMind1.00

  • 0:13 #2 done3 line(s)

    shot 2·sharpness 907.7

    1. PLATINUM SPONSORS0.98
    2. # Braintrust0.96
    3. WorkOS OpenAI0.95

  • 0:24 #3 done11 line(s)

    shot 3·sharpness 657.0

    1. AlEngineer0.98
    2. EUROPE1.00
    3. Ido Salo0.91
    4. Creator @ Ag0.99
    5. icc0.90
    6. Creator @M0.95
    7. Co-creator & Maintair0.98
    8. X @idosall0.92
    9. Oidosal0.92
    10. AlEngineer1.00
    11. EUROPE1.00

  • 0:39 #4 done14 line(s)

    shot 4·sharpness 2592.2

    1. AIE1.00
    2. Liad Yosef1.00
    3. ★1.00
    4. ★1.00
    5. Collaborator @ MCP-UI0.98
    6. Co-creator & Maintainer @ MCP Apps0.98
    7. Co-founder @ era labs0.99
    8. X@liadyosef0.94
    9. Oliady0.90
    10. in liadyosef0.99
    11. BWACC0.78
    12. Engineer1.00
    13. Engineering the future of Al1.00
    14. 0260.85

  • 0:52 #5 done19 line(s)

    shot 5·sharpness 3309.5

    1. 10%1.00
    2. Feb 281.00
    3. Mar 20.90
    4. Mar 40.97
    5. Mar 60.94
    6. Mar 80.95
    7. Mar 100.92
    8. New onboarding cohort1.00
    9. Baseline1.00
    10. AIE1.00
    11. Daily, Last 10 days | Amplitude 2.00.96
    12. ★1.00
    13. ★1.00
    14. Found it. A new onboarding flow was deployed on1.00
    15. Monday that has already improved activations by0.99
    16. 40%. Early results look strong!1.00
    17. Engineer1.00
    18. Engineering the future of Al1.00
    19. 0260.86

  • 0:57 #6 done31 line(s)

    shot 6·sharpness 2232.5

    1. A1.00
    2. Amplitude1.00
    3. Activation rate1.00
    4. 40%1.00
    5. Mar 100.98
    6. 31.4%1.00
    7. ★1.00
    8. 30%1.00
    9. AIE1.00
    10. 19.2%1.00
    11. ★1.00
    12. 20%1.00
    13. ★1.00
    14. ★1.00
    15. ★1.00
    16. 10%1.00
    17. 01.00
    18. Feb 280.92
    19. Mar 20.99
    20. Mar 40.99
    21. Mar 60.94
    22. Mar 80.99
    23. Mar 100.98
    24. New onboarding cohort1.00
    25. Baseline1.00
    26. Daily, Last 10 days | Amplitude 2.00.99
    27. EWACC0.86
    28. Engineer1.00
    29. Braintrust1.00
    30. WorkOs OpenAI0.94
    31. 0260.65

  • 0:58 #7 done16 line(s)

    shot 7·sharpness 3774.6

    1. Daily, Last 10 days |Amplitude 2.00.97
    2. Found it. A new onboarding flow was deployed on0.98
    3. Monday that has already improved activations by0.99
    4. 40%. Early results look strong!1.00
    5. AIE1.00
    6. ★1.00
    7. ★1.00
    8. ★1.00
    9. Makes sense! Can you show me where the0.99
    10. old flow was losing people?1.00
    11. 70.81
    12. BWACC0.65
    13. Engineer1.00
    14. Braintrust1.00
    15. WorkOS OpenAI0.94
    16. 0260.81

  • 1:09 #8 done8 line(s)

    shot 8·sharpness 1178.2

    1. We're used to text, but -0.97
    2. AIE1.00
    3. ★1.00
    4. ★1.00
    5. Engineer0.99
    6. # Braintrust0.95
    7. WorkOS OpenAI0.94
    8. 0260.88

  • 1:16 #9 done13 line(s)

    shot 9·sharpness 1903.7

    1. We're used to text, but -0.95
    2. *★*0.59
    3. AIE1.00
    4. ★1.00
    5. ★1.00
    6. ★1.00
    7. ★1.00
    8. Text isthe worst0.97
    9. BWACC0.90
    10. Engineer0.98
    11. AlEngineer0.97
    12. 0260.87
    13. EUROPE1.00

  • 1:33 #10 done37 line(s)

    shot 10·sharpness 3400.7

    1. The UX Gap1.00
    2. Openness: T-score 70 (curious, creative, and open-minded)1.00
    3. Conscientiousness: T-score 65 (organized, reliable, and responsible)0.99
    4. Extraversion: T-score 50 (introverted but comfortable in social situations)1.00
    5. Agreeableness: T-score 60 (cooperative and easy to work with)0.99
    6. Neuroticism: T-score 45 (calm and composed under pressure)0.98
    7. *★*0.60
    8. ★1.00
    9. Performance metrics from last year: No previous data available as this is the individual's first0.99
    10. AIE1.00
    11. ★1.00
    12. year with the company.0.99
    13. ★1.00
    14. Collaboration and communication style: Prefers to work independently but can collaborate1.00
    15. ★1.00
    16. ★1.00
    17. ★1.00
    18. effectively in team settings. Communicates clearly and concisely.0.98
    19. Team Member 2-Senior Java Developer0.99
    20. Role within the team: Leads the development of complex Java-based applications, mentors1.00
    21. junior team members, and works with project managers to deliver projects on time and1.00
    22. within budget.1.00
    23. Specific job duties and responsibilities: Design, develop, test, and maintain Java-based0.99
    24. applications, provide technical guidance and mentoring to junior team members,0.99
    25. collaborate with other team members and stakeholders on project requirements, and ensure1.00
    26. adherence to best practices and coding standards.1.00
    27. Skills and qualifications required for the job: Extensive knowledge of Java, experience with0.99
    28. designing and developing enterprise-grade applications, familiarity with agile0.99
    29. methodologies, experience with software testing and debugging, and experience with1.00
    30. cloud-based platforms.0.99
    31. < Share0.93
    32. Regenerate response0.98
    33. BWACC0.88
    34. Engineer1.00
    35. AlEngineer0.96
    36. 0260.89
    37. EUROPE1.00

  • 1:36 #11 done10 line(s)

    shot 11·sharpness 1490.4

    1. What if every app in the world1.00
    2. AIE1.00
    3. ★1.00
    4. ★1.00
    5. could send its own Ul to the chat?0.98
    6. BW/ACC0.64
    7. Engineer1.00
    8. AlEngineer0.97
    9. 0260.86
    10. EUROPE1.00

  • 1:43 #12 done10 line(s)

    shot 12·sharpness 1913.0

    1. Please show me my entries0.98
    2. Of course! Here is the entry for today:1.00
    3. AIE1.00
    4. Reply to Claude...1.00
    5. @Research0.95
    6. Sonnet 4.51.00
    7. Engineer1.00
    8. AlEngineer0.98
    9. 0260.74
    10. EUROPE1.00

  • 2:09 #13 done8 line(s)

    shot 13·sharpness 920.4

    1. Using MCP-UI1.00
    2. AIE1.00
    3. ★1.00
    4. ★1.00
    5. Engineer0.94
    6. AlEngineer0.97
    7. 0260.77
    8. EUROPE1.00

  • 2:12 #14 done52 line(s)

    shot 14·sharpness 3469.2

    1. Ido Salomon@idosal1 ·May 160.92
    2. Promote1.00
    3. Introducing MCP UI, the SDK that wires UI components directly into the0.99
    4. MCP protocol0.99
    5. Watch the video to see the new phase in Al interaction!0.98
    6. Why browse when you can have universal apps that deliver the right Ul to0.98
    7. consume any data and perform any action?1.00
    8. Replace cumbersome walls of text with slick interactive components,0.99
    9. Wild Goose Case1.00
    10. bringing rich web experiences to MCP-enabled agents such as Claude and0.98
    11. THE FUTURE OF AGENTIC1.00
    12. Cursor.1.00
    13. *★★0.60
    14. INTERFACES1.00
    15. Let's build Jarvis so @kentcdodds doesn't have to!>>0.99
    16. AIE1.00
    17. ★1.00
    18. AG , 20250.53
    19. LOCATION1.00
    20. lockopensource0.95
    21. ★1.00
    22. ★1.00
    23. ★1.00
    24. Bob1.00
    25. Performance Overview0.98
    26. Average 1251.00
    27. Reach 91%0.99
    28. ANOREH HARVARD0.92
    29. LIAD YOSEF0.99
    30. IDO SALOMON0.93
    31. Design Teohvolegint0.80
    32. Bleek, Ine.0.78
    33. menday.com0.84
    34. AL.0.83
    35. Feb1.00
    36. Mar1.00
    37. Apr1.00
    38. May0.98
    39. Jun1.00
    40. 12431.00
    41. 2891.00
    42. 671.00
    43. Panding0.98
    44. Blocked0.97
    45. Nudge1.00
    46. 0:041.00
    47. end a message0.96
    48. BW/ACC0.74
    49. Engineer1.00
    50. AlEngineer0.97
    51. O260.69
    52. EUROPE1.00

  • 2:31 #15 done12 line(s)

    shot 15·sharpness 1867.9

    1. An open protocol to1.00
    2. send UI over MCP and0.97
    3. standardize Ul-to-Host0.96
    4. AIE1.00
    5. communication1.00
    6. ★0.99
    7. Community SDKs for1.00
    8. easy adoption1.00
    9. BW/ACC0.83
    10. Engineer1.00
    11. Engineering the future of Al1.00
    12. 0260.87

  • 2:40 #16 done14 line(s)

    shot 16·sharpness 3104.8

    1. An open protocol to1.00
    2. send UI over MCP and0.96
    3. standardize Ul-to-Host0.99
    4. AIE1.00
    5. communication1.00
    6. ★1.00
    7. APPS1.00
    8. Community SDKs for0.99
    9. easy adoption0.97
    10. MCP-1.00
    11. EW/ACC0.85
    12. Engineer1.00
    13. Engineering the future of Al1.00
    14. 0260.92

  • 2:45 #17 done11 line(s)

    shot 17·sharpness 698.2

    1. pen protocol to0.99
    2. send UI over MCP an0.96
    3. AlEngineer0.99
    4. EUROPE1.00
    5. standardize Ul-to-Ho0.97
    6. communication1.00
    7. EU/ACC1.00
    8. Community SDKs fo1.00
    9. easy adoption0.99
    10. AlEngineer1.00
    11. EUROPE1.00

  • 3:03 #18 done7 line(s)

    shot 18·sharpness 1288.4

    1. AI0.99
    2. AIE1.00
    3. ★1.00
    4. ★1.00
    5. Engineer0.95
    6. Engineering the future of Al0.98
    7. 0260.93

  • 3:13 #19 done27 line(s)

    shot 19·sharpness 2651.5

    1. Home » Posts0.93
    2. MCP Apps - Bringing UI Capabilities To0.98
    3. MCP Clients0.99
    4. MCP Apps is now live as the first official MCP extension — tools can return interactive UI0.98
    5. components that render directly in the conversation.0.99
    6. January 26, 2026 - 9 min - MCP Core Maintainers0.98
    7. Table of Contents1.00
    8. ★1.00
    9. Today, we're announcing that MCP Apps are now live as an official MCP extension.0.99
    10. AIE1.00
    11. ★1.00
    12. Tools can now return interactive Ul components that render directly in the conversation:1.00
    13. ★1.00
    14. dashboards, forms, visualizations, multi-step workflows, and more. This is the first official1.00
    15. ★1.00
    16. ★1.00
    17. ★1.00
    18. MCP extension, and it's ready for production.0.99
    19. What's new, Jared?0.94
    20. I'm meeting with Conor today about the dashboard0.99
    21. redesign. Can you help me map out the roll out plan?0.99
    22. +0.85
    23. Opus 4.50.89
    24. BWACC0.87
    25. Engineer0.98
    26. Engineering the future of Al0.98
    27. 0260.84

  • 3:36 #20 done14 line(s)

    shot 20·sharpness 2679.9

    1. TheFork1.00
    2. .monday.com0.99
    3. AIE1.00
    4. IIElevenLabs0.99
    5. POSTMAN1.00
    6. ★1.00
    7. shopify1.00
    8. S0.98
    9. obot1.00
    10. BWACC0.83
    11. Engineer1.00
    12. AlEngineer0.96
    13. 0260.97
    14. EUROPE1.00

  • 4:05 #21 done37 line(s)

    shot 21·sharpness 4133.9

    1. + Connect0.94
    2. Sam Morrow · 2nd0.94
    3. atCitluh0.70
    4. Two ne1.00
    5. MCP Apps compatibility in ChatGPT0.98
    6. - we sh0.98
    7. Build portable MCP Apps Uls that run in ChatGPT0.98
    8. - we sh0.97
    9. ★1.00
    10. Overview1.00
    11. ★1.00
    12. Try it 00.95
    13. AIE1.00
    14. ★1.00
    15. ChatGPT supports the MCP Apps open standard for embedded app Uls.0.99
    16. ★1.00
    17. Should1.00
    18. MCP Apps UIs run inside an iframe and communicate with the host over a standard bridge (ui/* JSON-RPC over0.99
    19. ★1.00
    20. ★*0.76
    21. Ran Get my0.99
    22. postMessage ). ChatGPT implements this same iframe-and-bridge model, so you can build your UI once and run it in0.99
    23. ChatGPT and other MCP Apps-compatible hosts.0.99
    24. Existing Apps SDK APIs remain supported, and new, experimental capabilities ship first in the Apps SDK. OpenAl helped0.99
    25. shape the MCP Apps standard from ChatGPT Apps, and new capabilities move into the MCP spec after shape and0.98
    26. e0.66
    27. functionality validation.1.00
    28. Build with the MCP Apps standard keys and bridge by default. Use window.openai when you need ChatGPT-specific0.99
    29. capabilities.1.00
    30. 13 comments · 6 reposts0.96
    31. 451.00
    32. 6.3K0.95
    33. CCAaron Koivunen and 59 others0.98
    34. Engineer1.00
    35. AlEngineer0.96
    36. 0260.78
    37. EUROPE1.00

  • 4:28 #22 done33 line(s)

    shot 22·sharpness 2202.8

    1. + Follow1.00
    2. CHAT0.77
    3. Matvey Kukuy in 2nd0.92
    4. Example/Hieader - Logged In0.93
    5. CEO at Archestra, ex. Engineering Director at Grafana. OSS.0.97
    6. 6d ·0.79
    7. Acme1.00
    8. MCP Apps support has been merged into Archestra v1.1.40!1.00
    9. Example/Header - Logged Out0.99
    10. Weicome, Jane Doe!0.92
    11. Sign out0.99
    12. Acme1.00
    13. Example/Page - Logged In0.99
    14. Sign in0.89
    15. ★1.00
    16. Thank You1.00
    17. Acme1.00
    18. AIE1.00
    19. ★1.00
    20. KubeCon Amsterdam0.98
    21. 20261.00
    22. ★1.00
    23. Pages in Storybook1.00
    24. Sign in0.93
    25. ★1.00
    26. ★1.00
    27. ★1.00
    28. 1 comment · 1 repost0.97
    29. CCO250.92
    30. BNACC0.79
    31. Engineer1.00
    32. Engineering the future of Al1.00
    33. 0260.89

  • 4:29 #23 done45 line(s)

    shot 23·sharpness 2593.8

    1. Nathan Tarbert 1st0.90
    2. DevRel - CopilotKit0.95
    3. 2w · Edited -0.92
    4. Matvey Kukuy i· 2nd0.90
    5. MCP Apps + Copilotkit is actually next-level Generative UI!0.97
    6. xample/Header - Logged In0.95
    7. CEO at Archestra, ex. Engineering Director at Grafana. OSS0.99
    8. 6d ·0.81
    9. Mind blown, but here's why.1.00
    10. I'm building a presentation and have an idea I need to send to the designers.0.99
    11. Acme1.00
    12. MCP Apps support has been merged into Archestra v1.1.40!0.99
    13. Normally, I'd open Figma, write some text, take a screenshot, and send it over.0.99
    14. Instead, for the first time, I opened our Excalidraw studio app - built0.98
    15. ple/Header - Logged Out0.98
    16. Weicome, Jane Dee!0.95
    17. Sign out0.99
    18. with CopilotKit - described what I wanted, and watched it draw the diagram 10.99
    19. described in real time using MCP Apps. Grabbed the Excalidraw link. Sent it -0.98
    20. Acme1.00
    21. done!1.00
    22. ★1.00
    23. Thank You1.00
    24. Shoutout to Anmol for building such a cool app, and to the MCP Apps0.99
    25. creators Ido Salomon & Liad Yosef!0.99
    26. (Page - Logged In0.93
    27. Sign in0.87
    28. AIE1.00
    29. ★1.00
    30. KubeCon Amsterdam0.98
    31. 20261.00
    32. That's the power of open source!1.00
    33. Eme0.80
    34. ★1.00
    35. How it works + Repo1.00
    36. Sign in0.93
    37. ★1.00
    38. ★1.00
    39. in Storybook0.99
    40. CCO250.94
    41. Cleude Opus 4.50.94
    42. BW/ACC0.85
    43. Engineer0.99
    44. Engineering the future of Al1.00
    45. 0260.89

Transcript

278 cues· 3,845 words· 20,064 chars

  1. 0:15 OK. Hi, everyone.
  2. 0:17 We built this talk, well, not really yesterday.
  3. 0:18 We built this talk this morning, and it might already be out of date.
  4. 0:23 I'm Amir Salaman.
  5. 0:24 I'm the creator of MCPUI, co-creator of MCPApps and maintainer, and also the creator of AngelCraft, if you were on the previous session.
  6. 0:34 I'm Liad.
  7. 0:35 I work with Didot on MCP UI.
  8. 0:37 I co-created the MCP app spec with Didot.
  9. 0:40 And I'm also co-founder of Error Labs, which is like human agentic interfaces company.
  10. 0:46 So MCP apps are all around us.
  11. 0:48 You might not even realize it, but the interactive applications you see today in ChatGPT, Cloud, and others are actually based on MCP and the MCP app spec.
  12. 1:02 But why do we need MCP apps?
  13. 1:03 And what's MCP apps?
  14. 1:04 I mean, you heard David this morning talk about it a little bit.
  15. 1:08 We're used to text.
  16. 1:08 We're used to MCP tools sending text to our chat agents.
  17. 1:13 But that's not ideal, right?
  18. 1:14 Because text is really bad.
  19. 1:17 And actually, this was one of the main blockers of companies or tools not to send their data to ChatGPT because they didn't want to be reduced to, like,
  20. 1:27 this thing, this wall of text, where you don't have identity.
  21. 1:29 You don't know if this information came from Shopify, Booking, Expedia, or any other company.
  22. 1:35 But what if every tool or every company could just send its own UI to the chat?
  23. 1:41 So instead of us looking at this thing,
  24. 1:44 we can just imagine that for the parts that are relevant, we can have the relevant UI.
  25. 1:48 The relevant UI from Shopify, from Hugging Face, from Monday.
  26. 1:52 And this can be not only presentation, this can be interactive.
  27. 1:56 So we want to be able to respond to a user click on this Hugging Face widget.
  28. 2:04 So we don't have to imagine it anymore.
  29. 2:06 So back in May last year, I released MCPUI.
  30. 2:10 The concept was pretty simple.
  31. 2:12 There are a bunch of stuff around it.
  32. 2:13 But the concept was pretty simple of how do we take UI and find some way to pass it over MCP.
  33. 2:21 We need some general way to do that so we can both have UI over MCP and have the communication between the UI and the host.
  34. 2:32 Obviously it also had community SDKs and the general motivation was we don't need to throw away everything we know about UI and UX just to get into this new world of agents.
  35. 2:44 We can simply adapt and use that and preserve our branding and identity and still be practical.
  36. 2:51 And just a few months back, MCPUI, we partnered with
  37. 2:56 Anthropic and OpenAI to really put this into the MCP standard as the first official extension called MCP apps.
  38. 3:06 And as you can see here, it made kind of a big splash.
  39. 3:08 We had support from a bunch of hosts.
  40. 3:10 Now VS Code and Cursor and Cloud and ChatGPT and Microsoft Copilot and a bunch of others already adopted it.
  41. 3:18 And you have these really cool interfaces built in right to your assistance.
  42. 3:25 And going back a little bit, there were early adopters for MCPUI.
  43. 3:29 So these are some of the companies, shout out for Hugging Face, Sean, if you're here, that adopted MCPUI.
  44. 3:35 So even a year ago, Shopify was already sending MCPUI chunks of all of millions stores of Shopify, online stores send MCPUI chunks.
  45. 3:44 Hugging Face, all of Hugging Face spaces were MCPUI widgets.
  46. 3:49 And now, once it's standardized, we have much bigger adoption.
  47. 3:53 So we have VS Code, we have Cursor, we have Copilot, GitHub.
  48. 3:59 ChatGPT are supporting MCP apps.
  49. 4:02 Not only that, ChatGPT are recommending MCP apps as the way to build ChatGPT apps.
  50. 4:06 So it's really standardized.

Chapters

  1. 0:00 Introduction to MCP Apps
  2. 1:02 Why we need MCP Apps: Moving beyond text-based chat
  3. 2:06 Evolution of the MCP UI standard and partnerships
  4. 3:25 Industry and community adoption
  5. 5:14 Core concepts: Passing UI over MCP
  6. 6:49 Practical demonstration (PostHog and Claude)
  7. 8:54 Technical architecture: How it works
  8. 10:23 A new era of web interaction and user experience
  9. 12:32 Interaction mindset and message spectrums
  10. 14:56 Future outlook: Reusable views and model-UI interaction
  11. 16:18 Spectrum of UI generation: Predefined vs. Generative

Open at this second