Videos -561cZmir5Q
From Tokens to Cells: Foundation Models for Single-Cell Biology - Akram Baharlouei, Altos Labs
Scene timeline
43 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 142
- whisperx 142
- chunks
- 29
- from 142 cues
- keyframes
- 30
- kept of 43 captured
- frames with text
- 30
- 725 lines read
- chapters
- 7
- from the source metadata
- keyframe bytes
- 3.7 MB
- word timings on 142 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-09 23:38 | 0s |
stt |
done | — | 2026-08-09 14:52 | 19s |
chunk |
done | — | 2026-08-09 14:53 | 0s |
text_embed |
done | — | 2026-08-10 19:42 | 0s |
keyframe |
done | — | 2026-08-09 14:53 | 1m 03s |
ocr |
done | — | 2026-08-09 14:54 | 18s |
frame_embed |
done | — | 2026-08-10 19:42 | 5s |
Frames, and what the machine read
-
- localhost:8765/From Tokens1.00
- X0.87
- +0.97
- Ask Gemini1.00
- ←0.93
- C0.57
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#11.00
- AI ENGINEER TALK1.00
- From Tokens to Cells0.99
- The engineering challenges of foundation models for single-cell biology1.00
- Akram Baharlouei1.00
- Altos Labs1.00
- 1/281.00
- Reset1.00
-
- S0.63
- localhost:8765/From Tokens1.00
- +0.95
- Ask Gemini1.00
- ←0.98
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#21.00
- OUTLINE1.00
- akram baharloue1.00
- 011.00
- Why single cells1.00
- What to measure0.99
- 020.88
- Why it's hard: heterogeneity1.00
- 030.98
- Modeling cells1.00
- 040.99
- Takeaways1.00
- 051.00
- FROM TOKENS TO CELLS1.00
- ALTOS LABS1.00
- 2/280.97
- Reset1.00
- R1.00
-
- localhost:8765/From Tokens1.00
- X0.82
- +0.97
- Ask Gemini1.00
- ←0.92
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#31.00
- SECTION 011.00
- Why single cells0.99
- Rejuvenation, the path to a virtual human, and a way to bend the cost0.99
- curve of medicine.1.00
- 40.70
- 3/281.00
- Reset1.00
-
- localhost:8765/From Tokens1.00
- X0.75
- +0.96
- Ask Gemini1.00
- K0.73
- C0.89
- G0.69
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#41.00
- CELLULAR REPROGRAMMING1.00
- Yamanaka factors reset a cell to a stem-like state1.00
- OSKM0.97
- ALTOS1.00
- OSKM binding DNA — reprogramming0.97
- YOUNG1.00
- PAUSE1.00
- REPLAY1.00
- REC1.00
- Oct40.99
- Sox21.00
- ●Klf40.83
- c-Myc0.99
- Oct4 - Sox2 - Klf4 - c-Myc are transcription-factor proteins. They enter an aged cell,0.97
- its epigenetic age toward an induced pluripotent stem cell.0.99
- Auto-orbit; click the scene to play / pause.0.99
-
- localhost:8765/From Tokens1.00
- X0.84
- +0.98
- Ask Gemini1.00
- K0.87
- C0.77
- G0.78
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#41.00
- CELLULAR REPROGRAMMING1.00
- Yamanaka factors reset a cell to a stem-like state0.99
- OSKM0.98
- ALTOS0.99
- OSKM binding DNA-reprogramming0.98
- YOUNG1.00
- PAUSE1.00
- REPLAY1.00
- REC1.00
- Oct41.00
- Sox21.00
- Oct4 - Sox2 - Klf4 - c-Myc are transcription-factor proteins. They enter an aged cell, dock onto DNA in the nucleus, and rewind its epigenetic age toward an induced pluripotent stem cell.0.99
- Auto-orbit; click the scene to play / pause.0.97
-
- localhost:8765/From Tokens0.98
- X0.76
- +0.98
- Ask Gemini1.00
- ←0.87
- C0.55
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#41.00
- CELLULAR REPROGRAMMING1.00
- Yamanaka factors reset a cell to a stem-like state0.99
- OSKM0.98
- ALTOS0.98
- akram baharlouei0.99
- Induced pluripotent stem cell(iPSC)0.97
- ERIGENETICAGE0.94
- OLD0.99
- YOUNG1.00
- PAUSE1.00
- REPLAY1.00
- REC1.00
- Oct40.99
- Sox21.00
- Klf40.92
- ●c-Myc0.91
- Oct4 · Sox2 - Klf4 - c-Myc are transcription-factor proteins. They enter an aged cell, dock onto DNA in the nucleus, and rewind its epigenetic age toward an induced pluripotent stem cell.0.99
- Auto-orbit; click the scene to play / pause.0.97
-
- localhost:8765/From Tokens0.99
- X0.72
- +0.97
- Ask Gemini1.00
- ←0.99
- C0.54
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#51.00
- 01. WHY SINGLE CELLS0.96
- How four factors reprogram a cell — step by step0.99
- STEP1.00
- akram baharloue1.00
- STEP 00.97
- Old skin cell1.00
- skin genes1.00
- ON1.00
- stem genes0.99
- = OFF0.89
- SKIN0.93
- 40.65
- old skin cell1.00
- I1 PAUSE0.89
- REPLAY1.00
- REC1.00
- old skin cell - iPSC . -2-4 weeks in vivo0.94
- 5/281.00
- Reset1.00
-
- localhost:8765/From Tokens1.00
- +0.98
- Ask Gemini1.00
- ←0.61
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#61.00
- 01· WHY SINGLE CELLS0.99
- Build the virtual human like a pyramid1.00
- akram baharloue0.99
- FOUNDATION1.00
- LAYER1.00
- PEAK1.00
- SCALE1.00
- Cell1.00
- Tissue0.99
- Organ1.00
- Body1.00
- Genes, transcripts, proteins0.98
- Cells talking to neighbors0.98
- Tissues strung together1.00
- A simulated population0.99
- Master the simulation of one unit and you gain the code to simulate the organism. (Sarah Teichmann & the0.99
- Human Cell Atlas.)1.00
- FROM TOKENS TO CELLS1.00
- ALTOS LABS0.99
-
- S0.69
- localhost:8765/From Tokens1.00
- X0.64
- +0.95
- Ask Gemini0.99
- ←0.98
- C0.67
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#70.99
- THE SCALING STRATEGY1.00
- From one cell to a virtual human1.00
- MASTER ONE CELL COMPOSE TO ANY0.99
- akram baharlouei1.00
- Single cell1.00
- 11 PAUSE0.89
- REPLAY1.00
- ● REC0.84
- neuronblood1.00
- immune0.98
- epithelial1.00
- muscle1.00
- One cell = a gene expression vector in -20,000 dimensions.0.99
- g organ -> full virtual human.0.97
- Master one cell - compose to any scale.1.00
- 7/281.00
- Reset1.00
-
- localhost:8765/From Tokens1.00
- X0.51
- +0.97
- Ask Gemini1.00
- C0.57
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#81.00
- 01· WHY SINGLE CELLS0.98
- Moore's Law vs Eroom's Law: the contradiction1.00
- MOORE'S LAW ↑ Technology1.00
- EROOM'S LAW ↓ Drug Output0.99
- Computing power doubles every ~2 years1.00
- Drug output halves every ~9 years since 19501.00
- 10*× more0.91
- 10× fewer0.96
- TRON0.92
- Transistors per chip→ exponential improvement0.98
- 19700.99
- 19821.00
- 19941.00
- 20061.00
- 20161.00
- 20241.00
- New drugs per $1B R&D → exponential decline0.96
- 19501.00
- 19771.00
- 20061.00
- 20200.99
- As computing improved exponentially, drug productivity got worse exponentially.0.99
- Single-cell AI is the lever to bend this curve back.1.00
- FROM TOKENS TO CELLS1.00
- RESTART1.00
- PAUSE1.00
- ● REC0.85
-
- S0.56
- localhost:8765/From Tokens1.00
- +0.97
- Ask Gemini1.00
- ←0.99
- C0.73
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#91.00
- Al at every stage of drug development0.99
- akram baharlouel0.97
- Research &1.00
- Preclinical1.00
- Clinical1.00
- Review &0.95
- Development1.00
- Studies1.00
- Trials1.00
- Approval1.00
- 3-6 years0.99
- 1-2 years0.97
- 4-7 years1.00
- 1-2 years0.98
- o0o0.54
- AAA0.95
- Target identification0.98
- In vitro studies1.00
- Phase I, II & III trials0.98
- Safety & efficacy review1.00
- Compound screening1.00
- In vivo animal models1.00
- Dosage & safety monitoring1.00
- Regulatory approval1.00
- Lead optimization1.00
- Toxicity testing1.00
- Patient recruitment0.99
- Post-market surveillance1.00
- ↓1.00
- ↓0.99
- ↓1.00
- →0.99
- AI REPLACES1.00
- AI REPLACES1.00
- AI REPLACES0.96
- AI REPLACES1.00
- Virtual cells1.00
- Virtual humans1.00
- Digital twins1.00
- Protein engineering models1.00
- Virtual tissues & organs1.00
- In silico trials1.00
- Adverse event prediction0.99
- Scientific reasoning agents0.98
- In silico toxicity0.98
- Synthetic patient cohorts0.99
- Continuous monitoring1.00
- FROM TOKENS TO CELLS1.00
- ALTOS LABS1.00
-
- localhost:8765/From Tokens0.98
- X0.77
- +0.99
- Ask Gemini1.00
- ←0.99
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#101.00
- SECTION 021.00
- What to measure0.99
- Different ways to read a cell — and why we focus on one.0.99
- Q0.70
-
- localhost:8765/From Tokens1.00
- +0.97
- Ask Gemini1.00
- ←0.58
- G0.59
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#111.00
- Many ways to read a cell1.00
- One cell — many measurement modalities, each capturing different biology.0.99
- akram baharlouei1.00
- SCRNA-SEQ OUR FOCUS0.97
- Morphology1.00
- Transcriptome1.00
- ~20,000-gene vector per cell - high throughput - millions of cells0.97
- cell shape & structure0.99
- Epigenomics1.00
- X0.94
- GENOMICS1.00
- The DNA code0.99
- chromatin access1.00
- Static sequence · same in every cell- genome-wide variants0.97
- Genomics1.00
- EPIGENOMICS1.00
- DNA sequence0.99
- scRNA-seq *0.94
- Which DNA regions are open - histone modifications0.99
- Chromatin accessibility1.00
- transcriptome1.00
- PROTEOMICS1.00
- Protein output0.99
- Actual functional molecules· low throughput · expensive0.98
- SPATIAL1.00
- Location in tissue1.00
- Proteomics1.00
- Gene expression + tissue coordinates0.99
- ell neighborhoods0.96
- protein output1.00
- MORPHOLOGY1.00
- Cell shape & structure1.00
- Spatial1.00
- Size, shape, organelle layout - light & electron microscopy0.99
- location in tissue0.99
- IMAGING1.00
- Fluorescence & microscopy1.00
- Protein localization, live-cell imaging · high-content screening0.98
- FROM TOKENS TO CELLS1.00
- ALTOS LABS1.00
-
- 60.56
- localhost:8765/From Tokens1.00
- X0.80
- +0.98
- Ask Gemini1.00
- ←0.97
- G0.54
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#121.00
- akram baharlouei1.00
- SECTION 031.00
- Why it's hard: heterogeneity1.00
- Two “identical” cells rarely read the same — and not all of it is signal.0.98
-
- S0.64
- localhost:8765/From Tokens1.00
- X0.58
- +0.97
- Ask Gemini0.93
- ←0.63
- G0.51
- localhost:8765/From%20Tokens%20to%20Cells%20v4.dc.html#131.00
- WHY SINGLE-CELL DATA IS NOISY1.00
- A cell is a movie — we only capture snapshots0.99
- POPULATION . SCRNA-SEQ SNAPS0.95
- akram baharlouei1.00
- scRNA-seq captures a snapshot1.00
- each cell frozen at a different moment in its cycle0.99
- same tissue . different gene expression = heterogeneity0.97
- G11.00
- G11.00
- G11.00
- M1.00
- S0.61
- S0.80
- G11.00
- G11.00
- M1.00
- C0.98
- G11.00
- G11.00
- G11.00
- S0.82
- I1I PAUSE0.84
- REPLAY0.98
- • REC0.81
- A cell continuously cycles: grow → copy DNA → split chromosomes → divide. scRNA-seq destroys the cell and reads its mRNA at one frozen moment - giving thousands of disconnected0.99
- snapshots at random cycle positions. That is the core source of noise and heterogeneity.0.99
Transcript
142 cues· 2,339 words· 12,729 chars
- 0:12 Okay, let's get started.
- 0:14 My name is Akram.
- 0:15 I'm a machine learning engineer at Altos Labs.
- 0:18 Altos Labs is a biotech startup and the goal is to restore cell health and resilience through cellular rejuvenation to inverse disease and disabilities that can happen throughout the life.
- 0:32 And the title of my talk is From Tokens to Cells.
- 0:37 And this is my kind of view as someone without bio background to kind of looking into the engineering challenges of foundation models for single cell biology.
- 0:51 And what I want to talk about first, what is single cell?
- 0:54 Why do we care about single cell?
- 0:56 How do we measure it?
- 0:57 What are the problems with the data, getting the data?
- 1:01 And then looking at current state of the art foundation models and then some takeaways in the end.
- 1:09 So what is single cell and why do we care about it?
- 1:12 I would like to start with my favorite example, Yamanaka factor.
- 1:17 In 2006, Shinya Yamanaka discovered four transcription factors.
- 1:22 There are four specific type of proteins that when they were overexpressed in a cell,
- 1:30 They did it in a cell, which was an age-old skin cell.
- 1:36 It could reprogram the skin cell, old skin cell, to embryonic stem cell-like state.
- 1:42 So basically, from cell type, skin cell, old, it could reprogram it back to a young embryonic stem cell type.
- 1:54 And this was a breakthrough for biology and then got him Nobel Prize later in 2012 because of the application and the new chapters possibilities for medicine, from regenerative medicine for like to be able to kind of regenerate tissues or organs when we can like reprogram a specific cell to any cell that we want to partially programming an aging application.
- 2:22 For partial programming specifically is that we can also turn out that we can also only change the age of the cell.
- 2:29 We don't have to change the type.
- 2:31 So by changing the age of the cell, the goal is, the hope is we can restore some of youthful function that we lose throughout life as we age.
- 2:41 And then kind of like having this as a medicine, maybe like an mRNA medicine.
- 2:47 for curing the disease that we encounter as we age.
- 2:51 And that's one example.
- 2:54 And then I think this year, 2026, we got the first type of reprogramming medicine.
- 3:00 I think it's OSK.
- 3:03 And it's going to be tested in a human.
- 3:06 So it took kind of like 20 years.
- 3:11 And the other reason is that why we want to study a single cell is that we would like to model to have this unified holistic view of single cell to be able to model cell.
- 3:25 And from there, hopefully we can model tissue
- 3:28 An organ and then the entire human.
- 3:31 And there are like projects like Human Cell Atlas that actually started this effort, this initiative.
- 3:37 And then they like, you know, they have mapped every single cell inside human.
- 3:44 And the goal ultimately is something like maybe for ultimately after some long time, we can actually model human body.
- 3:56 Or there are terminologies like virtual cell, virtual tissue, virtual human, virtual twins.
- 4:02 They all saying the same thing that the more that we can model these living organisms,
- 4:10 the better we are in understanding our body and then how we can treat medicine we can develop drugs and the other problem is that so we you know I think for this audience we know about Moore's law the compute is getting like double every year and then we have exact opposite on drug development
- 4:35 Basically, the number of drugs that develop each year is kind of declining, which is surprising with all the advances in technology, in AI.
- 4:45 And this is surprising to see.
- 4:47 And then drug development is a field that failure is, you know, very normal.
- 4:50 Maybe the acceptance rate is kind of like, you know, 5% or even less.
- 4:57 And when we're looking at drug development pipeline from the early research and development all the way to preclinical trial and then the final stage, the whole pipeline, it could take up to 10 years easily, and then it costs millions.
- 5:14 It can cost billions.
- 5:16 And the goal here is that with the advances of AI and also like with this virtual cell, virtual organ, virtual human, the goal is that we can kind of like reduce this time, improve, reduce this timeline and
- 5:32 and also we're looking at the entire timeline let's say if we only look at like research and development the models like you know proton design and stuff we might like save like you know few years here but at the end maybe it's not gonna help uh for the entire pipeline so it's important to have innovation and a breakthrough uh across all pipeline
- 5:56 Now that we know single cell is important, how can we measure single cell?
- 6:03 So looking at single, yeah, it's amazing.
- 6:05 This is just one single cell.
- 6:07 There is a lot going on inside that one little tiny organism.
loading