Videos zDGHt0LB-dA
GPU Cloud Deployment Without Leaving Your IDE — Audry Hsu, RunPod
Scene timeline
62 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 225
- whisperx 225
- chunks
- 35
- from 225 cues
- keyframes
- 42
- kept of 62 captured
- frames with text
- 42
- 2,208 lines read
- chapters
- 0
- from the source metadata
- keyframe bytes
- 7.1 MB
- word timings on 225 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-11 10:52 | 1m 17s |
stt |
done | — | 2026-08-11 10:53 | 18s |
chunk |
done | — | 2026-08-11 10:54 | 0s |
text_embed |
done | — | 2026-08-11 10:54 | 0s |
keyframe |
done | — | 2026-08-11 10:54 | 1m 47s |
ocr |
done | — | 2026-08-11 10:56 | 32s |
frame_embed |
done | — | 2026-08-11 10:56 | 7s |
Frames, and what the machine read
-
- Al Engineer0.94
- EUROPE1.00
-
- PRESENTINGSPONSOR1.00
- Google DeepMind1.00
-
- PLATINUM SPONSORS0.98
- # Braintrust0.95
- WorkOS OpenAI0.95
-
- runpod0.99
- Introducing1.00
- Runpod1.00
- AlEngineer0.99
- EUROPE1.00
-
- runpod1.00
- Introducing1.00
- Runpod1.00
- AlEngineer0.99
- EUROPE1.00
-
- Chat1.00
- runpod1.00
- ***0.64
- Introducing1.00
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- Runpod1.00
- The foundational platform for building,0.99
- running, and scaling custom Al systems.1.00
- Engineering the future of Al0.99
- AlEngineer0.99
- EUROPE1.00
-
- Chat0.98
- Why Runpod Exists1.00
- ***0.63
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- Infrastructure eats1.00
- GPU access is0.97
- Builder primary focus1.00
- developer time1.00
- slow and opaque1.00
- should be building1.00
- ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.96
- Braintrust1.00
- WorkOS OpenAI0.95
- AlEngineer0.98
- EUROPE1.00
-
- 0Chat0.92
- Favorites0.98
- Built by builders1.00
- ***0.76
- AIE1.00
- ★1.00
- Two engineers, started in0.98
- ★1.00
- ★1.00
- ★1.00
- basement in 20221.00
- • Built in public with the community0.99
- • $120M ARR · 500K developers0.95
- in 20261.00
- ©2026 Runpod inc. All rights reserved. Confidential and proprietary.0.95
- AlEngineer0.97
- EUROPE1.00
- AlEngineer0.98
- EUROPE1.00
-
- 0Chat0.91
- Running on Runpod1.00
- *★*0.60
- AIE1.00
- ANTHROP\C1.00
- databricks1.00
- Microsoft1.00
- ★1.00
- ★1.00
- ★1.00
- perplexity1.00
- WIX1.00
- replit1.00
- TOYOTA1.00
- CIVITAI0.98
- 2Zillow0.94
- ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.97
- Engineering the future of Al0.99
- AlEngineer0.98
- EUROPE1.00
-
- Chat0.98
- How teams build on Runpod0.99
- Q0.56
- 890.94
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- Pods1.00
- Serverless1.00
- Clusters1.00
- Hub1.00
- Blink and it's ready1.00
- Bring your container0.95
- Instant or1.00
- Deploy in seconds1.00
- Dozens of GPU options1.00
- Network storage1.00
- reserved options1.00
- One-click deployment1.00
- Pay by the second0.99
- Scale globally1.00
- High-speed networking1.00
- Autoscaling endpoints0.99
- Slurm and PyTorch1.00
- ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.95
- Engineering the future of Al1.00
- AlEngineer0.98
- EUROPE1.00
-
- Chat0.99
- Serverless1.00
- Autoscaling inference without1.00
- infrastructure overhead1.00
- AIE1.00
- Best for1.00
- ★1.00
- ★1.00
- ★1.00
- Real-time inference1.00
- • Variable or spiky traffic0.97
- • User-facing Al products0.97
- Why teams use it0.99
- No pre-provisioning0.98
- • Scales automatically0.98
- Pay only for usage0.98
- ©2026 Runpod Inc. All rights reserved. Confidential and proprietary.0.97
- Engineering the future of Al0.97
- AlEngineer0.96
- EUROPE1.00
-
- Chat0.99
- *★*0.57
- AIE1.00
- ★1.00
- ★1.00
- ★0.99
- runpod1.00
- Engineering the future of Al0.99
- AlEngineer0.99
- EUROPE1.00
-
- System Settings1.00
- Edit0.98
- Window1.00
- Help1.00
- 508Al Engineer Booth open - 3h left0.90
- 80.79
- Apr 9 16:100.99
- Displays1.00
- about:blank1.00
- 00:09:171.00
- Reset0.99
- Audry Hsu1.00
- Slide 16s0.76
- Built-in Display0.95
- ExtronScalerD0.98
- Bluetooth1.00
- VPN1.00
- Battery1.00
- Network1.00
- Use as1.00
- 1920 × 1080 (Default)0.96
- 1600×9001.00
- Mirror for Bullt-in Display0.96
- d're building.*0.92
- AIE1.00
- ★1.00
- ★1.00
- runp1.00
- Accessibility0.98
- General1.00
- Appearance1.00
- Apple Intelligence &...0.97
- Show all resolutions1.00
- Color profile0.99
- 1280×7201.00
- 960×5400.97
- ExtronScalerD0.99
- ★1.00
- ★1.00
- Displays1.00
- Refresh rate0.99
- 60 Hertz1.00
- C0.75
- ★1.00
- ★1.00
- ★1.00
- Menu Bar1.00
- Rotation0.99
- Standard0.98
- Spotlight1.00
- Underscan0.99
- Wallpaper0.96
- Notifications0.95
- Advanced...0.96
- Night Shift..0.92
- Serverless0.97
- Focus1.00
- Sound1.00
- Screen Time0.99
- Lock Screen0.96
- Privacy & Security0.97
- Touch ID & Password0.96
- Users & Groups0.99
- Internet Accounts1.00
- Game Center0.99
- iCloud0.93
- Wallet & Apple Pay0.94
- Arrange1.00
- Engineering the future of Al0.99
- OR0.52
- AlEngineer0.99
- EUROPE1.00
-
- Bookmarks0.93
- History0.99
- Extensions Window Help0.99
- 508Al Engineer Booth open - 3h left0.92
- Apr 9 16:100.99
- out:blank1.00
- 00:09:191.00
- Reset0.99
- AUDIENCE TOOLS0.99
- SPEAKER NOTES0.97
- Side 160.97
- Slide 16 of 161.00
- That's a quick overview of Runpod and how teams are using it in production today. Happy to dive deeper into any part of0.97
- this, or talk through how this might fit with what you're building."0.97
- AIE1.00
- runpod1.00
- ★1.00
- ★1.00
- ★1.00
- Serverless0.97
- Engineering the future of Al1.00
- AlEngineer0.99
- EUROPE1.00
-
- System Settings1.00
- Edit View Window0.99
- Help1.00
- m0.57
- Q500.97
- B Al Engineer Booth open - 3h left0.95
- 80.84
- Apr 9 16:100.98
- 63°1.00
- London1.00
- H:71°L:47°0.95
- Cloudy1.00
- THURSDAY0.98
- 91.00
- Displays1.00
- Audry Hsu1.00
- 2026-0..16.47.080.93
- Screen Recording1.00
- 2026-0...02.300.95
- Screen Recording1.00
- 63*0.75
- 63*0.81
- Wi-Fi0.94
- Built-in Display0.97
- ExtronScalerD0.98
- Frl0.95
- 43°0.90
- 54*0.89
- Bluetooth1.00
- Sat1.00
- Sun1.00
- 45"0.82
- 42*0.97
- 54*0.76
- 56*0.88
- 55*0.82
- VPN1.00
- Battery1.00
- Network1.00
- Use as1.00
- Optimize for0.97
- Mirror for Bullt-in Display0.96
- MacBook Pro (3)1.00
- 2026-0..3.570.91
- Screen Recording1.00
- Tue1.00
- 401.00
- 60°0.79
- General1.00
- Color profile0.97
- ExtronScalerD0.98
- ★1.00
- ★1.00
- Appearance1.00
- Accessibility0.99
- Refresh rate1.00
- 60 Hertz0.99
- ★0.93
- AIE1.00
- ★1.00
- Apple Intelligence &.0.97
- Underscan1.00
- 2026-0..t 18.44.120.93
- ★1.00
- ★1.00
- Displays0.99
- Advanced..0.92
- Night Shift....0.83
- ★1.00
- ★1.00
- ★1.00
- Menu Bar1.00
- Spotlight1.00
- 2026-0... 17.04.4.520.90
- Screen Recording0.94
- after cpu bug0.97
- Wallpaper1.00
- Notifications0.97
- Sound1.00
- Focus1.00
- 2026-0..t14.13.520.99
- 鱼. Lock Screen0.91
- Privacy & Security0.99
- Touch ID & Password0.99
- Users & Groups1.00
- Internet Accounts1.00
- ICloud0.92
- Wallet & Apple Pay0.99
- Arrange0.94
- Engineering the future of Al1.00
- OR0.66
- AlEngineer0.99
- EUROPE1.00
-
- iTerm20.90
- Shell1.00
- Session1.00
- Scripts1.00
- Profiles0.98
- Window1.00
- Help1.00
- 80.96
- Apr 9 16:100.99
- 63°1.00
- London1.00
- Stay at The Rayal Horse..0.87
- BATURDAY0.97
- H:71°L:47°0.96
- 19:470.97
- 2026-0.16.47.080.96
- Screen Recording1.00
- 2026-0...0.300.92
- Screen Recording1.00
- 55*0.90
- 63*0.88
- Frl0.98
- 43°0.95
- 54*0.87
- Sat1.00
- 64*0.75
- Sun1.00
- 56*0.84
- 55*0.92
- 2026-0...333570.91
- Screen Recording1.00
- Tue1.00
- 60"0.78
- ★1.00
- ★1.00
- ★0.87
- AIE1.00
- 2026-0..t 18.44.1220.88
- ★1.00
- ★1.00
- $10.85
- 151.00
- ★1.00
- ★1.00
- ★1.00
- Dia0.99
- 2026-0...t17.04.4.520.89
- Screen Recording0.99
- after cpu bug0.99
- 2026-0..t14.113.520.83
- 2026-0..114.22.180.92
- 2026-0..t14.45.170.94
- Engineering the future of Al1.00
- OR0.65
- AlEngineer0.98
- EUROPE1.00
-
- docs.runpod.lo0.95
- Chat1.00
- wark0.98
- runpod1.00
- Docs0.97
- Examples1.00
- Community1.00
- CLI API Modeis Release notes0.97
- Runpod Biing0.91
- Pul Requests0.95
- Q Search0.94
- MK0.68
- Flash1.00
- prod0.95
- Get started1.00
- Overview1.00
- Copy page0.93
- Intro to runpod - Run:0.96
- Overview - Runpod D:0.97
- Welcome1.00
- Qulckstart0.97
- Concepts1.00
- Build autoscaling Al/ML. apps using local code with Runpod Flash.0.99
- Runpod Hub0.96
- Manage API keys0.96
- Flash is currenty in beta. Jein our Discord to provide feedtack and get support.0.97
- ★0.90
- ★1.00
- ★1.00
- ★1.00
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- ★1.00
- My Endpoint0.94
- New Tab0.99
- Flash0.97
- MCP servers NEW0.94
- Overview BETA0.86
- Quilckstart0.92
- Pricing1.00
- Agenit skills sW0.83
- Creato endpoints0.99
- Flash is a Python SDK for developing cloud-native Al apps where you define everything-hardware, remote functions, and0.98
- dependencies-using local code.1.00
- BEndpoint(name"hella-gpu", gpu=GpuType.wVIDIA_GEFORCE_RTx_4090, dependencies=[-torch"1)0.83
- async def helto(): # This function runs on Runpod0.96
- inport asyncio0.97
- froe runpod_flash isport Endpoint, GpuType0.97
- # Mark the function below for remote execution0.98
- Buld apps0.99
- Custom containers1.00
- Configure resources1.00
- gou_name = torch.cuda.get_device_nane(0)0.95
- print(f-Hello from your SPut (igpu_name})*)0.89
- return {"spu": gpu_nane}0.81
- inport torch0.96
- Execution model0.97
- Troubleshooting0.97
- asyncio.run(hello())0.99
- print("Done!") # This runs locally0.95
- Serverless1.00
- Overview0.99
- Quickstart0.96
- Write @Enepeint decorated Python functions on your local machine. Run them, and Flash automatically handles GPU/CPU0.97
- provisioning and worker scaling on Runpod Serverless.0.99
- Install SDKs0.97
- Pricing0.97
- Get started1.00
- Create handler functions0.98
- Runpod console0.98
- runpod/docs0.94
- Deploy workers1.00
- Manage endpoints0.99
- 30.55
- Write a Flash script for1.00
- instant access to Runpod0.97
- GPUs.1.00
- Quickstart1.00
- <>0.97
- Learn how to create0.97
- Create endpoints1.00
- endpoints of various types.1.00
- C0.69
- Browse example Flash1.00
- scripts and apps on GitHub.1.00
- Examples1.00
- Asik Al0.88
- Engineering the future of Al1.00
- AlEngineer0.98
- EUROPE1.00
-
- docs.runpod.lo0.98
- Chat1.00
- ment0.95
- runpod1.00
- 060.73
- Docs0.99
- Examples0.99
- Community1.00
- CLI API Models0.97
- Release notes0.99
- Q Search0.99
- MK0.63
- Flash1.00
- Get started0.99
- Overview1.00
- Copy page0.98
- Welcome1.00
- Build autoscaling Al/ML apps using local code with Runpod Flash.1.00
- Qulckstart0.96
- Concepts1.00
- Manage API keys0.93
- Flash is currently in beta. Join eur Discord to provide feedback and get support.0.99
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- Flash0.99
- Agent skills NEW0.90
- MCP servers NEW0.97
- Overview META0.83
- Flash is a Python SDK for developing cloud-native Al apps where you define everything-hardware, remote functions, and0.99
- dependencies-using local code.0.99
- from runpod_flash inpoct Endpoint, SouType0.96
- inport asyncio0.99
- ★1.00
- ★1.00
- ★1.00
- Pricing0.97
- Quickstart0.98
- Create endpoints0.98
- # Mark the function below for remote execution0.98
- @Endpoint(name="helto-gpu", gpu=GpuType.NVIDIA_SEFORCE_RTX_4090, dependencies=["torch"I)0.88
- async def hello(): # This function runs on Runpod0.97
- Custom containers1.00
- Configure resources1.00
- Bulld apps0.94
- gpu_name = torch.cuda.get_device_name(0)0.96
- print(f"metta from your GPut ((gpu_name})")0.89
- return {"gpu": gpu_nane}0.91
- inport torch0.93
- Troubleshooting0.98
- Execution model0.99
- asyncio.run(helta())0.94
- print("Done!") # This runs locally0.96
- Serverless0.98
- Overview1.00
- Quickstart0.99
- Write gEndpaint decorated Python functions on your local machine. Run them, and Flash automatically handles GPU/CPU0.98
- provisioning and worker scaling on Runpod Serverless.0.99
- Install SDKs1.00
- Pricing1.00
- Get started1.00
- Create handler functions0.99
- Runpod console0.97
- runpod/docs0.97
- Deploy workers1.00
- Manage endpoints1.00
- 40.65
- Write a Flash script for1.00
- Quickstart1.00
- instant access to Runpod0.99
- GPUs.1.00
- <小0.72
- Learn how to create1.00
- Create endpoints1.00
- endpoints of various types.0.97
- C0.52
- Browse example Flash0.98
- scripts and apps on GitHlub.0.98
- Examples1.00
- Asik Al0.86
- Engineering the future of Al1.00
- AlEngineer0.97
- EUROPE1.00
-
- C0.67
- docs.runpod.lo0.98
- Chat1.00
- ment0.98
- runpod1.00
- Docs0.99
- Examples1.00
- Community0.96
- CLI API Models0.96
- Release notes0.99
- Q Search0.99
- MK0.73
- Flash0.88
- Get started1.00
- Overview1.00
- Copy page0.99
- Welcome1.00
- Build autoscaling Al/ML apps using local code with Runpod Flash.0.99
- Quickstart0.98
- Manage API keys0.93
- Concepts1.00
- Flash is currentiy in beta. Join eur Discord to provide feedback and get support0.98
- AIE1.00
- ★1.00
- ★1.00
- ★1.00
- Flash1.00
- Agent skils NwW0.84
- MCP servers NEW0.94
- Overviow META0.81
The page's on-screen-text budget of 600
lines is spent, so the last cards in this grid list fewer lines than they
hold. Narrow the page with ?frames= to read them.
Transcript
225 cues· 2,423 words· 12,781 chars
- 0:14 Hey, everyone.
- 0:16 I'm Audrey.
- 0:17 I work at Rumpod.
- 0:21 Were any of you in my earlier session?
- 0:22 OK, good.
- 0:26 This intro is the same, but what I'm going to show is a little bit different.
- 0:31 Has anyone heard of Rumpod or used Rumpod before?
- 0:35 You have.
- 0:35 Do you mind if I ask you how you've used us or heard about us before?
- 0:45 Yeah, for LLM training.
- 0:45 LLM training?
- 0:46 OK, at your university?
- 0:46 And where do you go to uni?
- 0:48 Oxford.
- 0:49 Oxford?
- 0:49 I did a study abroad there one summer.
- 0:51 It's awesome there.
- 0:52 OK, love it.
- 0:54 OK, and your name is?
- 0:56 Yunus.
- 0:56 Yunus.
- 0:56 OK, so Yunus might know a little bit about this already, but I'll talk to you guys through a little intro.
- 1:02 What do we do?
- 1:04 We're a AI cloud infrastructure company.
- 1:08 And our mission is to build the foundational platform for
- 1:13 developers to scale their AI workloads.
- 1:16 And basically what that means is we bring the hardware, we bring the GPUs and the compute.
- 1:23 We make it easy for you guys to bring your code, bring your models and deploy as quickly as possible.
- 1:28 We don't want you spending time configuring infrastructure and thinking about things like scaling.
- 1:39 Why RemPod exists, a lot of teams that we've talked to, they are all wrestling with the same thing, that infrastructure.
- 1:45 They're spending more time with the infrastructure than they are with the models.
- 1:48 So things like CUDA version alignment, like what versions of PyTorch run well together, which
- 1:59 which new of the GPU skews have been tested and figuring out the bugs there.
- 2:04 So a lot of that are things that we try to take that configuration problem away from you guys.
- 2:11 So you guys could just focus on training your model or building your apps.
- 2:17 And a little bit of a backstory about our company.
- 2:20 So this is Zen and Pradeep, our two founders.
- 2:23 They started Rumpod in 2022.
- 2:26 They had a failed crypto mining venture.
- 2:30 So they had a bunch of spare GPUs in their basement.
- 2:34 They built a prototype of what is the foundation of Rumpod today.
- 2:39 And they just posted on Reddit and said, does anyone want some free GPUs in exchange for feedback?
- 2:47 And that is literally how our company started.
- 2:49 And ever since then, we've been building in public with the community.
- 2:54 So we've been revenue generating from the very beginning, which is very, very rare.
- 3:00 And even today, we have around 500 developers on our platform.
- 3:06 We're in 30-plus data centers across 10 countries.
- 3:10 In Europe, that includes France, Romania, Iceland, if that's part of Europe, Asia Pacific.
- 3:20 And we recently hit a pretty big milestone of $120 million in annual recurring revenue.
- 3:27 This is just a quick glance of some of the customers that we have.
loading