read-only demo

Videos zDGHt0LB-dA

GPU Cloud Deployment Without Leaving Your IDE — Audry Hsu, RunPod

index_state ready data_status ok

AI Engineer· published 2026-06-09· 0:20:18· en-US· indexed 2026-08-11 10:56

Open on YouTube

Scene timeline

  1. Shot 0, 0:00 to 0:05, 1 of 1 keyframes kept
  2. Shot 1, 0:05 to 0:09, 1 of 1 keyframes kept
  3. Shot 2, 0:09 to 0:14, 1 of 1 keyframes kept
  4. Shot 3, 0:14 to 0:38, 1 of 1 keyframes kept
  5. Shot 4, 0:38 to 1:02, 1 of 1 keyframes kept
  6. Shot 5, 1:02 to 1:35, 1 of 1 keyframes kept
  7. Shot 6, 1:35 to 2:16, 1 of 1 keyframes kept
  8. Shot 7, 2:16 to 3:05, 1 of 1 keyframes kept
  9. Shot 8, 3:05 to 3:52, 1 of 1 keyframes kept
  10. Shot 9, 3:52 to 4:20, 1 of 1 keyframes kept
  11. Shot 10, 4:20 to 4:49, 0 of 1 keyframes kept
  12. Shot 11, 4:49 to 5:17, 0 of 1 keyframes kept
  13. Shot 12, 5:17 to 5:24, 1 of 1 keyframes kept
  14. Shot 13, 5:24 to 5:33, 1 of 1 keyframes kept
  15. Shot 14, 5:33 to 5:34, 1 of 1 keyframes kept
  16. Shot 15, 5:34 to 5:36, 1 of 1 keyframes kept
  17. Shot 16, 5:36 to 5:37, 1 of 1 keyframes kept
  18. Shot 17, 5:37 to 5:40, 1 of 1 keyframes kept
  19. Shot 18, 5:40 to 5:42, 1 of 1 keyframes kept
  20. Shot 19, 5:42 to 6:11, 1 of 1 keyframes kept
  21. Shot 20, 6:11 to 6:41, 1 of 1 keyframes kept
  22. Shot 21, 6:41 to 7:10, 0 of 1 keyframes kept
  23. Shot 22, 7:10 to 7:40, 1 of 1 keyframes kept
  24. Shot 23, 7:40 to 7:42, 1 of 1 keyframes kept
  25. Shot 24, 7:42 to 8:18, 0 of 1 keyframes kept
  26. Shot 25, 8:18 to 8:55, 1 of 1 keyframes kept
  27. Shot 26, 8:55 to 9:21, 1 of 1 keyframes kept
  28. Shot 27, 9:21 to 9:28, 0 of 1 keyframes kept
  29. Shot 28, 9:28 to 9:57, 0 of 1 keyframes kept
  30. Shot 29, 9:57 to 10:27, 0 of 1 keyframes kept
  31. Shot 30, 10:27 to 10:57, 0 of 1 keyframes kept
  32. Shot 31, 10:57 to 11:27, 0 of 1 keyframes kept
  33. Shot 32, 11:27 to 11:59, 0 of 1 keyframes kept
  34. Shot 33, 11:59 to 12:36, 1 of 1 keyframes kept
  35. Shot 34, 12:36 to 12:40, 1 of 1 keyframes kept
  36. Shot 35, 12:40 to 13:00, 1 of 1 keyframes kept
  37. Shot 36, 13:00 to 13:29, 0 of 1 keyframes kept
  38. Shot 37, 13:29 to 13:58, 0 of 1 keyframes kept
  39. Shot 38, 13:58 to 14:05, 1 of 1 keyframes kept
  40. Shot 39, 14:05 to 14:27, 0 of 1 keyframes kept
  41. Shot 40, 14:27 to 14:41, 1 of 1 keyframes kept
  42. Shot 41, 14:41 to 15:15, 1 of 1 keyframes kept
  43. Shot 42, 15:15 to 15:48, 1 of 1 keyframes kept
  44. Shot 43, 15:48 to 15:50, 1 of 1 keyframes kept
  45. Shot 44, 15:50 to 15:56, 0 of 1 keyframes kept
  46. Shot 45, 15:56 to 16:22, 0 of 1 keyframes kept
  47. Shot 46, 16:22 to 16:49, 0 of 1 keyframes kept
  48. Shot 47, 16:49 to 16:52, 0 of 1 keyframes kept
  49. Shot 48, 16:52 to 17:04, 0 of 1 keyframes kept
  50. Shot 49, 17:04 to 17:09, 1 of 1 keyframes kept
  51. Shot 50, 17:09 to 17:13, 0 of 1 keyframes kept
  52. Shot 51, 17:13 to 17:15, 1 of 1 keyframes kept
  53. Shot 52, 17:15 to 17:16, 0 of 1 keyframes kept
  54. Shot 53, 17:16 to 17:18, 1 of 1 keyframes kept
  55. Shot 54, 17:18 to 17:19, 1 of 1 keyframes kept
  56. Shot 55, 17:19 to 17:47, 1 of 1 keyframes kept
  57. Shot 56, 17:47 to 17:56, 1 of 1 keyframes kept
  58. Shot 57, 17:56 to 18:35, 1 of 1 keyframes kept
  59. Shot 58, 18:35 to 19:12, 1 of 1 keyframes kept
  60. Shot 59, 19:12 to 19:50, 1 of 1 keyframes kept
  61. Shot 60, 19:50 to 20:03, 1 of 1 keyframes kept
  62. Shot 61, 20:03 to 20:18, 1 of 1 keyframes kept

62 shot(s).

keyframes kept every frame deduplicated

What was stored

cues
225
whisperx 225
chunks
35
from 225 cues
keyframes
42
kept of 62 captured
frames with text
42
2,208 lines read
chapters
0
from the source metadata
keyframe bytes
7.1 MB
word timings on 225 cues

Provenance

Each pipeline stage, its state and the model that produced it
stage state model started took
fetch done 2026-08-11 10:52 1m 17s
stt done 2026-08-11 10:53 18s
chunk done 2026-08-11 10:54 0s
text_embed done 2026-08-11 10:54 0s
keyframe done 2026-08-11 10:54 1m 47s
ocr done 2026-08-11 10:56 32s
frame_embed done 2026-08-11 10:56 7s

Frames, and what the machine read

  • 0:02 #0 done2 line(s)

    shot 0·sharpness 667.3

    1. Al Engineer0.94
    2. EUROPE1.00
  • 0:06 #1 done2 line(s)

    shot 1·sharpness 825.0

    1. PRESENTINGSPONSOR1.00
    2. Google DeepMind1.00
  • 0:11 #2 done3 line(s)

    shot 2·sharpness 938.7

    1. PLATINUM SPONSORS0.98
    2. # Braintrust0.95
    3. WorkOS OpenAI0.95
  • 0:17 #3 done5 line(s)

    shot 3·sharpness 362.9

    1. runpod0.99
    2. Introducing1.00
    3. Runpod1.00
    4. AlEngineer0.99
    5. EUROPE1.00
  • 0:54 #4 done5 line(s)

    shot 4·sharpness 372.7

    1. runpod1.00
    2. Introducing1.00
    3. Runpod1.00
    4. AlEngineer0.99
    5. EUROPE1.00
  • 1:28 #5 done14 line(s)

    shot 5·sharpness 1462.5

    1. Chat1.00
    2. runpod1.00
    3. ***0.64
    4. Introducing1.00
    5. AIE1.00
    6. 1.00
    7. 1.00
    8. 1.00
    9. Runpod1.00
    10. The foundational platform for building,0.99
    11. running, and scaling custom Al systems.1.00
    12. Engineering the future of Al0.99
    13. AlEngineer0.99
    14. EUROPE1.00
  • 1:40 #6 done18 line(s)

    shot 6·sharpness 2164.4

    1. Chat0.98
    2. Why Runpod Exists1.00
    3. ***0.63
    4. AIE1.00
    5. 1.00
    6. 1.00
    7. 1.00
    8. Infrastructure eats1.00
    9. GPU access is0.97
    10. Builder primary focus1.00
    11. developer time1.00
    12. slow and opaque1.00
    13. should be building1.00
    14. ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.96
    15. Braintrust1.00
    16. WorkOS OpenAI0.95
    17. AlEngineer0.98
    18. EUROPE1.00
  • 2:41 #7 done19 line(s)

    shot 7·sharpness 1962.5

    1. 0Chat0.92
    2. Favorites0.98
    3. Built by builders1.00
    4. ***0.76
    5. AIE1.00
    6. 1.00
    7. Two engineers, started in0.98
    8. 1.00
    9. 1.00
    10. 1.00
    11. basement in 20221.00
    12. • Built in public with the community0.99
    13. • $120M ARR · 500K developers0.95
    14. in 20261.00
    15. ©2026 Runpod inc. All rights reserved. Confidential and proprietary.0.95
    16. AlEngineer0.97
    17. EUROPE1.00
    18. AlEngineer0.98
    19. EUROPE1.00
  • 3:46 #8 done20 line(s)

    shot 8·sharpness 1861.4

    1. 0Chat0.91
    2. Running on Runpod1.00
    3. *★*0.60
    4. AIE1.00
    5. ANTHROP\C1.00
    6. databricks1.00
    7. Microsoft1.00
    8. 1.00
    9. 1.00
    10. 1.00
    11. perplexity1.00
    12. WIX1.00
    13. replit1.00
    14. TOYOTA1.00
    15. CIVITAI0.98
    16. 2Zillow0.94
    17. ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.97
    18. Engineering the future of Al0.99
    19. AlEngineer0.98
    20. EUROPE1.00
  • 3:58 #9 done31 line(s)

    shot 9·sharpness 1834.2

    1. Chat0.98
    2. How teams build on Runpod0.99
    3. Q0.56
    4. 890.94
    5. AIE1.00
    6. 1.00
    7. 1.00
    8. 1.00
    9. 1.00
    10. 1.00
    11. Pods1.00
    12. Serverless1.00
    13. Clusters1.00
    14. Hub1.00
    15. Blink and it's ready1.00
    16. Bring your container0.95
    17. Instant or1.00
    18. Deploy in seconds1.00
    19. Dozens of GPU options1.00
    20. Network storage1.00
    21. reserved options1.00
    22. One-click deployment1.00
    23. Pay by the second0.99
    24. Scale globally1.00
    25. High-speed networking1.00
    26. Autoscaling endpoints0.99
    27. Slurm and PyTorch1.00
    28. ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.95
    29. Engineering the future of Al1.00
    30. AlEngineer0.98
    31. EUROPE1.00
  • 4:24 #10 skipped

    shot 10·duplicate of #9

  • 5:14 #11 skipped

    shot 11·duplicate of #9

  • 5:19 #12 done20 line(s)

    shot 12·sharpness 2091.5

    1. Chat0.99
    2. Serverless1.00
    3. Autoscaling inference without1.00
    4. infrastructure overhead1.00
    5. AIE1.00
    6. Best for1.00
    7. 1.00
    8. 1.00
    9. 1.00
    10. Real-time inference1.00
    11. • Variable or spiky traffic0.97
    12. • User-facing Al products0.97
    13. Why teams use it0.99
    14. No pre-provisioning0.98
    15. • Scales automatically0.98
    16. Pay only for usage0.98
    17. ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.97
    18. Engineering the future of Al0.97
    19. AlEngineer0.96
    20. EUROPE1.00
  • 5:28 #13 done10 line(s)

    shot 13·sharpness 1104.6

    1. Chat0.99
    2. *★*0.57
    3. AIE1.00
    4. 1.00
    5. 1.00
    6. 0.99
    7. runpod1.00
    8. Engineering the future of Al0.99
    9. AlEngineer0.99
    10. EUROPE1.00
  • 5:33 #14 done72 line(s)

    shot 14·sharpness 1836.9

    1. System Settings1.00
    2. Edit0.98
    3. Window1.00
    4. Help1.00
    5. 508Al Engineer Booth open - 3h left0.90
    6. 80.79
    7. Apr 9 16:100.99
    8. Displays1.00
    9. about:blank1.00
    10. 00:09:171.00
    11. Reset0.99
    12. Audry Hsu1.00
    13. Slide 16s0.76
    14. Built-in Display0.95
    15. ExtronScalerD0.98
    16. Bluetooth1.00
    17. VPN1.00
    18. Battery1.00
    19. Network1.00
    20. Use as1.00
    21. 1920 × 1080 (Default)0.96
    22. 1600×9001.00
    23. Mirror for Bullt-in Display0.96
    24. d're building.*0.92
    25. AIE1.00
    26. 1.00
    27. 1.00
    28. runp1.00
    29. Accessibility0.98
    30. General1.00
    31. Appearance1.00
    32. Apple Intelligence &...0.97
    33. Show all resolutions1.00
    34. Color profile0.99
    35. 1280×7201.00
    36. 960×5400.97
    37. ExtronScalerD0.99
    38. 1.00
    39. 1.00
    40. Displays1.00
    41. Refresh rate0.99
    42. 60 Hertz1.00
    43. C0.75
    44. 1.00
    45. 1.00
    46. 1.00
    47. Menu Bar1.00
    48. Rotation0.99
    49. Standard0.98
    50. Spotlight1.00
    51. Underscan0.99
    52. Wallpaper0.96
    53. Notifications0.95
    54. Advanced...0.96
    55. Night Shift..0.92
    56. Serverless0.97
    57. Focus1.00
    58. Sound1.00
    59. Screen Time0.99
    60. Lock Screen0.96
    61. Privacy & Security0.97
    62. Touch ID & Password0.96
    63. Users & Groups0.99
    64. Internet Accounts1.00
    65. Game Center0.99
    66. iCloud0.93
    67. Wallet & Apple Pay0.94
    68. Arrange1.00
    69. Engineering the future of Al0.99
    70. OR0.52
    71. AlEngineer0.99
    72. EUROPE1.00
  • 5:36 #15 done23 line(s)

    shot 15·sharpness 1451.1

    1. Bookmarks0.93
    2. History0.99
    3. Extensions Window Help0.99
    4. 508Al Engineer Booth open - 3h left0.92
    5. Apr 9 16:100.99
    6. out:blank1.00
    7. 00:09:191.00
    8. Reset0.99
    9. AUDIENCE TOOLS0.99
    10. SPEAKER NOTES0.97
    11. Side 160.97
    12. Slide 16 of 161.00
    13. That's a quick overview of Runpod and how teams are using it in production today. Happy to dive deeper into any part of0.97
    14. this, or talk through how this might fit with what you're building."0.97
    15. AIE1.00
    16. runpod1.00
    17. 1.00
    18. 1.00
    19. 1.00
    20. Serverless0.97
    21. Engineering the future of Al1.00
    22. AlEngineer0.99
    23. EUROPE1.00
  • 5:36 #16 done93 line(s)

    shot 16·sharpness 1566.0

    1. System Settings1.00
    2. Edit View Window0.99
    3. Help1.00
    4. m0.57
    5. Q500.97
    6. B Al Engineer Booth open - 3h left0.95
    7. 80.84
    8. Apr 9 16:100.98
    9. 63°1.00
    10. London1.00
    11. H:71°L:47°0.95
    12. Cloudy1.00
    13. THURSDAY0.98
    14. 91.00
    15. Displays1.00
    16. Audry Hsu1.00
    17. 2026-0..16.47.080.93
    18. Screen Recording1.00
    19. 2026-0...02.300.95
    20. Screen Recording1.00
    21. 63*0.75
    22. 63*0.81
    23. Wi-Fi0.94
    24. Built-in Display0.97
    25. ExtronScalerD0.98
    26. Frl0.95
    27. 43°0.90
    28. 54*0.89
    29. Bluetooth1.00
    30. Sat1.00
    31. Sun1.00
    32. 45"0.82
    33. 42*0.97
    34. 54*0.76
    35. 56*0.88
    36. 55*0.82
    37. VPN1.00
    38. Battery1.00
    39. Network1.00
    40. Use as1.00
    41. Optimize for0.97
    42. Mirror for Bullt-in Display0.96
    43. MacBook Pro (3)1.00
    44. 2026-0..3.570.91
    45. Screen Recording1.00
    46. Tue1.00
    47. 401.00
    48. 60°0.79
    49. General1.00
    50. Color profile0.97
    51. ExtronScalerD0.98
    52. 1.00
    53. 1.00
    54. Appearance1.00
    55. Accessibility0.99
    56. Refresh rate1.00
    57. 60 Hertz0.99
    58. 0.93
    59. AIE1.00
    60. 1.00
    61. Apple Intelligence &.0.97
    62. Underscan1.00
    63. 2026-0..t 18.44.120.93
    64. 1.00
    65. 1.00
    66. Displays0.99
    67. Advanced..0.92
    68. Night Shift....0.83
    69. 1.00
    70. 1.00
    71. 1.00
    72. Menu Bar1.00
    73. Spotlight1.00
    74. 2026-0... 17.04.4.520.90
    75. Screen Recording0.94
    76. after cpu bug0.97
    77. Wallpaper1.00
    78. Notifications0.97
    79. Sound1.00
    80. Focus1.00
    81. 2026-0..t14.13.520.99
    82. 鱼. Lock Screen0.91
    83. Privacy & Security0.99
    84. Touch ID & Password0.99
    85. Users & Groups1.00
    86. Internet Accounts1.00
    87. ICloud0.92
    88. Wallet & Apple Pay0.99
    89. Arrange0.94
    90. Engineering the future of Al1.00
    91. OR0.66
    92. AlEngineer0.99
    93. EUROPE1.00
  • 5:38 #17 done56 line(s)

    shot 17·sharpness 1353.5

    1. iTerm20.90
    2. Shell1.00
    3. Session1.00
    4. Scripts1.00
    5. Profiles0.98
    6. Window1.00
    7. Help1.00
    8. 80.96
    9. Apr 9 16:100.99
    10. 63°1.00
    11. London1.00
    12. Stay at The Rayal Horse..0.87
    13. BATURDAY0.97
    14. H:71°L:47°0.96
    15. 19:470.97
    16. 2026-0.16.47.080.96
    17. Screen Recording1.00
    18. 2026-0...0.300.92
    19. Screen Recording1.00
    20. 55*0.90
    21. 63*0.88
    22. Frl0.98
    23. 43°0.95
    24. 54*0.87
    25. Sat1.00
    26. 64*0.75
    27. Sun1.00
    28. 56*0.84
    29. 55*0.92
    30. 2026-0...333570.91
    31. Screen Recording1.00
    32. Tue1.00
    33. 60"0.78
    34. 1.00
    35. 1.00
    36. 0.87
    37. AIE1.00
    38. 2026-0..t 18.44.1220.88
    39. 1.00
    40. 1.00
    41. $10.85
    42. 151.00
    43. 1.00
    44. 1.00
    45. 1.00
    46. Dia0.99
    47. 2026-0...t17.04.4.520.89
    48. Screen Recording0.99
    49. after cpu bug0.99
    50. 2026-0..t14.113.520.83
    51. 2026-0..114.22.180.92
    52. 2026-0..t14.45.170.94
    53. Engineering the future of Al1.00
    54. OR0.65
    55. AlEngineer0.98
    56. EUROPE1.00
  • 5:42 #18 done93 line(s)

    shot 18·sharpness 1312.2

    1. docs.runpod.lo0.95
    2. Chat1.00
    3. wark0.98
    4. runpod1.00
    5. Docs0.97
    6. Examples1.00
    7. Community1.00
    8. CLI API Modeis Release notes0.97
    9. Runpod Biing0.91
    10. Pul Requests0.95
    11. Q Search0.94
    12. MK0.68
    13. Flash1.00
    14. prod0.95
    15. Get started1.00
    16. Overview1.00
    17. Copy page0.93
    18. Intro to runpod - Run:0.96
    19. Overview - Runpod D:0.97
    20. Welcome1.00
    21. Qulckstart0.97
    22. Concepts1.00
    23. Build autoscaling Al/ML. apps using local code with Runpod Flash.0.99
    24. Runpod Hub0.96
    25. Manage API keys0.96
    26. Flash is currenty in beta. Jein our Discord to provide feedtack and get support.0.97
    27. 0.90
    28. 1.00
    29. 1.00
    30. 1.00
    31. AIE1.00
    32. 1.00
    33. 1.00
    34. 1.00
    35. 1.00
    36. 1.00
    37. My Endpoint0.94
    38. New Tab0.99
    39. Flash0.97
    40. MCP servers NEW0.94
    41. Overview BETA0.86
    42. Quilckstart0.92
    43. Pricing1.00
    44. Agenit skills sW0.83
    45. Creato endpoints0.99
    46. Flash is a Python SDK for developing cloud-native Al apps where you define everything-hardware, remote functions, and0.98
    47. dependencies-using local code.1.00
    48. BEndpoint(name"hella-gpu", gpu=GpuType.wVIDIA_GEFORCE_RTx_4090, dependencies=[-torch"1)0.83
    49. async def helto(): # This function runs on Runpod0.96
    50. inport asyncio0.97
    51. froe runpod_flash isport Endpoint, GpuType0.97
    52. # Mark the function below for remote execution0.98
    53. Buld apps0.99
    54. Custom containers1.00
    55. Configure resources1.00
    56. gou_name = torch.cuda.get_device_nane(0)0.95
    57. print(f-Hello from your SPut (igpu_name})*)0.89
    58. return {"spu": gpu_nane}0.81
    59. inport torch0.96
    60. Execution model0.97
    61. Troubleshooting0.97
    62. asyncio.run(hello())0.99
    63. print("Done!") # This runs locally0.95
    64. Serverless1.00
    65. Overview0.99
    66. Quickstart0.96
    67. Write @Enepeint decorated Python functions on your local machine. Run them, and Flash automatically handles GPU/CPU0.97
    68. provisioning and worker scaling on Runpod Serverless.0.99
    69. Install SDKs0.97
    70. Pricing0.97
    71. Get started1.00
    72. Create handler functions0.98
    73. Runpod console0.98
    74. runpod/docs0.94
    75. Deploy workers1.00
    76. Manage endpoints0.99
    77. 30.55
    78. Write a Flash script for1.00
    79. instant access to Runpod0.97
    80. GPUs.1.00
    81. Quickstart1.00
    82. <>0.97
    83. Learn how to create0.97
    84. Create endpoints1.00
    85. endpoints of various types.1.00
    86. C0.69
    87. Browse example Flash1.00
    88. scripts and apps on GitHub.1.00
    89. Examples1.00
    90. Asik Al0.88
    91. Engineering the future of Al1.00
    92. AlEngineer0.98
    93. EUROPE1.00
  • 5:48 #19 done84 line(s)

    shot 19·sharpness 1277.7

    1. docs.runpod.lo0.98
    2. Chat1.00
    3. ment0.95
    4. runpod1.00
    5. 060.73
    6. Docs0.99
    7. Examples0.99
    8. Community1.00
    9. CLI API Models0.97
    10. Release notes0.99
    11. Q Search0.99
    12. MK0.63
    13. Flash1.00
    14. Get started0.99
    15. Overview1.00
    16. Copy page0.98
    17. Welcome1.00
    18. Build autoscaling Al/ML apps using local code with Runpod Flash.1.00
    19. Qulckstart0.96
    20. Concepts1.00
    21. Manage API keys0.93
    22. Flash is currently in beta. Join eur Discord to provide feedback and get support.0.99
    23. AIE1.00
    24. 1.00
    25. 1.00
    26. 1.00
    27. Flash0.99
    28. Agent skills NEW0.90
    29. MCP servers NEW0.97
    30. Overview META0.83
    31. Flash is a Python SDK for developing cloud-native Al apps where you define everything-hardware, remote functions, and0.99
    32. dependencies-using local code.0.99
    33. from runpod_flash inpoct Endpoint, SouType0.96
    34. inport asyncio0.99
    35. 1.00
    36. 1.00
    37. 1.00
    38. Pricing0.97
    39. Quickstart0.98
    40. Create endpoints0.98
    41. # Mark the function below for remote execution0.98
    42. @Endpoint(name="helto-gpu", gpu=GpuType.NVIDIA_SEFORCE_RTX_4090, dependencies=["torch"I)0.88
    43. async def hello(): # This function runs on Runpod0.97
    44. Custom containers1.00
    45. Configure resources1.00
    46. Bulld apps0.94
    47. gpu_name = torch.cuda.get_device_name(0)0.96
    48. print(f"metta from your GPut ((gpu_name})")0.89
    49. return {"gpu": gpu_nane}0.91
    50. inport torch0.93
    51. Troubleshooting0.98
    52. Execution model0.99
    53. asyncio.run(helta())0.94
    54. print("Done!") # This runs locally0.96
    55. Serverless0.98
    56. Overview1.00
    57. Quickstart0.99
    58. Write gEndpaint decorated Python functions on your local machine. Run them, and Flash automatically handles GPU/CPU0.98
    59. provisioning and worker scaling on Runpod Serverless.0.99
    60. Install SDKs1.00
    61. Pricing1.00
    62. Get started1.00
    63. Create handler functions0.99
    64. Runpod console0.97
    65. runpod/docs0.97
    66. Deploy workers1.00
    67. Manage endpoints1.00
    68. 40.65
    69. Write a Flash script for1.00
    70. Quickstart1.00
    71. instant access to Runpod0.99
    72. GPUs.1.00
    73. <小0.72
    74. Learn how to create1.00
    75. Create endpoints1.00
    76. endpoints of various types.0.97
    77. C0.52
    78. Browse example Flash0.98
    79. scripts and apps on GitHlub.0.98
    80. Examples1.00
    81. Asik Al0.86
    82. Engineering the future of Al1.00
    83. AlEngineer0.97
    84. EUROPE1.00
  • 6:23 #20 done30 line(s)

    shot 20·sharpness 1267.5

    1. C0.67
    2. docs.runpod.lo0.98
    3. Chat1.00
    4. ment0.98
    5. runpod1.00
    6. Docs0.99
    7. Examples1.00
    8. Community0.96
    9. CLI API Models0.96
    10. Release notes0.99
    11. Q Search0.99
    12. MK0.73
    13. Flash0.88
    14. Get started1.00
    15. Overview1.00
    16. Copy page0.99
    17. Welcome1.00
    18. Build autoscaling Al/ML apps using local code with Runpod Flash.0.99
    19. Quickstart0.98
    20. Manage API keys0.93
    21. Concepts1.00
    22. Flash is currentiy in beta. Join eur Discord to provide feedback and get support0.98
    23. AIE1.00
    24. 1.00
    25. 1.00
    26. 1.00
    27. Flash1.00
    28. Agent skils NwW0.84
    29. MCP servers NEW0.94
    30. Overviow META0.81
  • 7:01 #21 skipped

    shot 21·duplicate of #19

  • 7:34 #22 done

    shot 22·sharpness 1470.0

  • 7:41 #23 done

    shot 23·sharpness 1459.4

The page's on-screen-text budget of 600 lines is spent, so the last cards in this grid list fewer lines than they hold. Narrow the page with ?frames= to read them.

Transcript

225 cues· 2,423 words· 12,781 chars

  1. 0:14 Hey, everyone.
  2. 0:16 I'm Audrey.
  3. 0:17 I work at Rumpod.
  4. 0:21 Were any of you in my earlier session?
  5. 0:22 OK, good.
  6. 0:26 This intro is the same, but what I'm going to show is a little bit different.
  7. 0:31 Has anyone heard of Rumpod or used Rumpod before?
  8. 0:35 You have.
  9. 0:35 Do you mind if I ask you how you've used us or heard about us before?
  10. 0:45 Yeah, for LLM training.
  11. 0:45 LLM training?
  12. 0:46 OK, at your university?
  13. 0:46 And where do you go to uni?
  14. 0:48 Oxford.
  15. 0:49 Oxford?
  16. 0:49 I did a study abroad there one summer.
  17. 0:51 It's awesome there.
  18. 0:52 OK, love it.
  19. 0:54 OK, and your name is?
  20. 0:56 Yunus.
  21. 0:56 Yunus.
  22. 0:56 OK, so Yunus might know a little bit about this already, but I'll talk to you guys through a little intro.
  23. 1:02 What do we do?
  24. 1:04 We're a AI cloud infrastructure company.
  25. 1:08 And our mission is to build the foundational platform for
  26. 1:13 developers to scale their AI workloads.
  27. 1:16 And basically what that means is we bring the hardware, we bring the GPUs and the compute.
  28. 1:23 We make it easy for you guys to bring your code, bring your models and deploy as quickly as possible.
  29. 1:28 We don't want you spending time configuring infrastructure and thinking about things like scaling.
  30. 1:39 Why RemPod exists, a lot of teams that we've talked to, they are all wrestling with the same thing, that infrastructure.
  31. 1:45 They're spending more time with the infrastructure than they are with the models.
  32. 1:48 So things like CUDA version alignment, like what versions of PyTorch run well together, which
  33. 1:59 which new of the GPU skews have been tested and figuring out the bugs there.
  34. 2:04 So a lot of that are things that we try to take that configuration problem away from you guys.
  35. 2:11 So you guys could just focus on training your model or building your apps.
  36. 2:17 And a little bit of a backstory about our company.
  37. 2:20 So this is Zen and Pradeep, our two founders.
  38. 2:23 They started Rumpod in 2022.
  39. 2:26 They had a failed crypto mining venture.
  40. 2:30 So they had a bunch of spare GPUs in their basement.
  41. 2:34 They built a prototype of what is the foundation of Rumpod today.
  42. 2:39 And they just posted on Reddit and said, does anyone want some free GPUs in exchange for feedback?
  43. 2:47 And that is literally how our company started.
  44. 2:49 And ever since then, we've been building in public with the community.
  45. 2:54 So we've been revenue generating from the very beginning, which is very, very rare.
  46. 3:00 And even today, we have around 500 developers on our platform.
  47. 3:06 We're in 30-plus data centers across 10 countries.
  48. 3:10 In Europe, that includes France, Romania, Iceland, if that's part of Europe, Asia Pacific.
  49. 3:20 And we recently hit a pretty big milestone of $120 million in annual recurring revenue.
  50. 3:27 This is just a quick glance of some of the customers that we have.

Open at this second