Videos 7jjudsEhBtM
Skills are new features: Building Skill-Centric Harness — Yogendra Miraje, FactSet
Scene timeline
52 shot(s).
keyframes kept every frame deduplicated
What was stored
- cues
- 136
- whisperx 136
- chunks
- 30
- from 136 cues
- keyframes
- 40
- kept of 52 captured
- frames with text
- 40
- 702 lines read
- chapters
- 12
- from the source metadata
- keyframe bytes
- 5.4 MB
- word timings on 136 cues
Provenance
| stage | state | model | started | took |
|---|---|---|---|---|
fetch |
done | — | 2026-08-09 23:11 | 0s |
stt |
done | — | 2026-08-09 13:32 | 16s |
chunk |
done | — | 2026-08-09 13:32 | 0s |
text_embed |
done | — | 2026-08-10 19:41 | 0s |
keyframe |
done | — | 2026-08-09 13:32 | 2m 23s |
ocr |
done | — | 2026-08-09 13:34 | 17s |
frame_embed |
done | — | 2026-08-10 19:41 | 7s |
Frames, and what the machine read
-
- AlEngineer0.95
- World's Fair0.97
-
- AlEngineer0.96
- World's Fair0.99
-
- LAB & PLATINUM SPONSORS0.97
- Amazon AGI Lab0.99
- ANTHROP\C1.00
- Google DeepMind1.00
- MINIMAX0.98
- OpenAl0.92
- Akamai1.00
- arize1.00
- aws1.00
- Braintrust bright data0.99
- B1.00
- Browserbase1.00
- docker1.00
- :neo4j0.91
- ORACLE1.00
- PayPal1.00
- qodo0.99
- reducto1.00
- Sonar1.00
- Makers of1.00
- together.ai0.98
- Unblocked1.00
- WorkOS1.00
- SonarQube1.00
-
- AlEngineer1.00
- World's Fair0.98
-
- AlEngineer0.98
- World'sFair1.00
- Skills are New Features0.99
- PRESENTED BY1.00
- Microsoft1.00
- Building Skill-Centric Agentic Products0.99
- Yogi Miraje1.00
- AIE WF 20261.00
- X0.90
- @YogiNotTheBear1.00
- Engineering the future of Al0.99
- AlEngineer1.00
- World's Fair0.96
-
- AlEngineer0.97
- World'sFair1.00
- How to Build Agents1.00
- without losing the Control0.99
- Yogi Miraje0.98
- PRESENTED BY1.00
- Microsoft1.00
- Retrieval: Summarize NVIDIA's previous earnings call.1.00
- Blueprint1.00
- Retrieval: Gather NVIDIA's latest EPS and revenue.0.99
- Tool: Task0.99
- Reasoning: Suggest questions for the next earnings call based on all the information fetched0.99
- Reporting: Generate a comprehensive report from fetched information0.99
- Engineering the future of Al1.00
- AlEnginee0.99
- World'sFair1.00
-
- AlEngineer0.98
- Equipping agents for the real world0.99
- World's Fair0.99
- with Agent Skills0.94
- PRESENTED BY1.00
- Published Oct 16, 20250.98
- Claude is powerful, but real work requires procedural knowledge and organizational0.99
- context. Introducing Agent Skill, a new way to build specialized agents using files0.99
- Microsoft1.00
- and folders.1.00
- Code Summit0.98
- ANTHROP\C1.00
- Claude1.00
- Agent1.00
- an0.57
- DON'T BUILD AGENTS!0.98
- BuildSkillsInstead1.00
- 16:221.00
- TRACK 3· JULY 2,20260.96
- AlEnginee0.96
- Al in Finance0.99
- World's Fair0.97
-
- AlEngineer0.97
- World'sFair0.96
- X0.85
- What it's NOT about0.99
- What it IS about0.99
- ×Coding harnesses0.98
- √ Skills in the context of Agentic products0.99
- Skills for coding agents0.99
- √ How to add support for skills in your own harness0.99
- × How to write Skills0.96
- √ How to scale skills across the enterprise0.99
- ⑤/Q1O0.52
- TRACK 3· JULY 2, 20260.93
- Alin Finance0.99
- World'sFair0.98
-
- AlEngineer0.99
- Traditional Product0.99
- World's Fair0.97
- Al Platform0.98
- Overview1.00
- May 1t- May t. 20240.72
- riers0.80
- Ovenview0.88
- Total Predictions0.95
- Total insights0.90
- Insights1.00
- Analytice0.90
- 2.45M1.00
- vs May S - May 10.84
- 92.4%+27%0.93
- vs May S - May 10.93
- ve May 5 - May t0.82
- 1281.00
- 71.00
- os May 5 – May 110.84
- + 12.5%0.72
- ② tnaights0.59
- Predictions Over Time0.95
- Duly0.67
- Predictions by Category0.99
- Reporns0.86
- Datinets0.98
- 88 Models0.70
- 2.45M1.00
- Active Workflows0.97
- Worktows0.76
- C0.79
- Settings0.97
- Recent Predictions1.00
- PRO-23810.67
- Input Date0.78
- 0.880.73
- May 18.204 10:224 AM0.78
- Mey 18. 224 1020 AM0.74
- Predicted At0.83
- Run Prediction0.97
- Select Model0.90
- Churn Model V210.77
- P90-7438100.79
- May 18.2004 10 15 AM0.75
- ar tte0.54
- 0.70.87
- May 181,202 12:10 AM0.71
- mer Phofle - May 20240.86
- 0.760.98
- May 18. 20410 AM0.81
- TRACK 3• JULY 2, 20260.96
- Al in Finance0.97
- AlEngineer1.00
- World's Fair0.99
-
- AlEngineer0.98
- Agentic Product1.00
- World's Fair0.99
- Q2 Market Entry Plan1.00
- $° Diaf updated ty Agein0.71
- Agent Workflow0.98
- Active0.97
- ② Saved just now0.91
- 1. Goal1.00
- Q2 Market Entry Plan0.99
- Create a concise market entry brief for Q20.98
- with recommended approach1.00
- Draft Brief - Last updlated by Agent just now0.92
- 2. Plan0.96
- Research market, define opportunity.0.99
- approach, and key considerations.0.98
- 1. Executive Summary1.00
- We recommend entering the German and Australian markets in Q2 with a phased approach,0.95
- focusing on segments where our solution offers clear differentiation and strong demand.0.98
- 3. Progress1.00
- 4/4 stps0.97
- 2. Opportunity1.00
- Reading notes & research0.96
- +:2.AM0.52
- High demand for ou olution in Germany n Australia driven by digitl transformmation0.81
- Drating brief0.89
- 00.52
- 9:07 AM0.82
- initiatves and a need for scalable, easy-to-integrate tools.0.99
- Revising outine0.96
- 9:51AM0.66
- 3. Recommended Approach1.00
- Preparing final draft0.93
- • Phase 1 (0-30 days): Validate ICP and buld local partnerships.0.97
- • Phese 2 30 90 days: Luch lot rorams and refie meossaging.0.73
- • Phase 3 (90-180 dys): Scae go-t-market ad epand chhanes.0.76
- 4. Evidence1.00
- completed this morning.0.95
- Based on 12 notes and market research0.99
- 4. Key Considerations1.00
- • Ensure localization for language and compliance.0.99
- • Align pricing with local market expectations.0.97
- of0.75
- 5. Decision1.00
- Pending revle0.92
- Waiting for your review and decision.0.99
- Review and approve this draft1.00
- ed the draft based on your goal and plar0.97
- Approve1.00
- Request Changes0.99
- × Deny0.93
- TRACK 3· JULY 2, 20260.93
- Al in Finance0.99
- AlEngineer1.00
- World's Fair0.98
-
- AlEngineer0.98
- World's Fair0.97
- If the agent is the interface,1.00
- where do the features live?0.98
- TRACK 3 · JULY 2, 20260.94
- Al in Finance0.97
- World'sFair1.00
-
- AlEngineer0.98
- Who, What, How of an Agent0.99
- World's Fair0.99
- Who1.00
- What1.00
- How1.00
- System Prompt1.00
- Tools1.00
- Skills1.00
- Who the Agent is1.00
- What it can connect to0.99
- How a task gets done0.98
- Defines the agent's identity, purpose, role,1.00
- External systems, data, and APIs the agent0.99
- Packaged know-how the agent follows to1.00
- and constraints.1.00
- uses to get things done.0.99
- do a specific task well.1.00
- TRACK 3· JULY 2, 20260.96
- Al in Finance0.99
- AlEngineer1.00
- World's Fair0.96
-
- AlEngineer0.98
- Skills are New Features1.00
- World's Fair0.98
- Equity Research1.00
- Wealth Management1.00
- catalyst-calendar1.00
- model-update1.00
- client-report0.99
- tax-loss-harvesting1.00
- earnings-analysis1.00
- morning-note1.00
- client-review1.00
- earnings-preview1.00
- sector-overview1.00
- financial-plan1.00
- idea-generation1.00
- thesis-tracker1.00
- investment-proposal1.00
- initiating-coverage1.00
- portfolio-rebalance1.00
- Source: Anthropic Financial Services Plugins1.00
- TRACK 3· JULY 2, 20260.96
- Al in Finance1.00
- AlEngineer1.00
- World's Fair0.96
-
- AlEngineer0.98
- World'sFair1.00
- Role of Product Engineers0.99
- Shipping Features1.00
- Shipping Harness1.00
- ⑤/Q10.59
- TRACK 3• JULY 2, 20260.97
- Al in Finance0.96
- World'sFair1.00
-
- AlEngineer0.99
- Definition of a Skill1.00
- skill1.00
- World's Fair0.99
- /skdl0.68
- noun1.00
- the abilit to do something well.0.98
- A standardized way to teach AI agents how to do specific tasks0.99
- PRESENTED BY1.00
- well.1.00
- Microsoft1.00
- A skill is a directory containing, at minimum, a skILL.md file:0.96
- skill-name/1.00
- SKILL.md0.97
- # Required: metadata + instructions0.99
- scripts/0.96
- # Optional: executable code0.99
- references/1.00
- # Optional: documentation0.98
- assets/1.00
- # Optional: templates, resources0.98
- # Any additional files or directories1.00
- TRACK 3· JULY 2,20260.96
- Al in Finance1.00
- AlEnginee1.00
- World's Fair0.96
-
- AlEngineer0.99
- Anatomy of a Skill1.00
- World's Fair0.99
- pdf/SKILL.md1.00
- pdf/reference.md1.00
- YAML Frontmatter0.97
- # PDF Processing Advanced Reference0.98
- name: pdf0.98
- description: Comprehensive PDF toolkit for extracting text and0.98
- tabtes, merging/splitting documents, and filling-out forms.0.99
- This document contains advanced PDF processing features,0.99
- detailed examples, and additional libraries not covered0.98
- in the main skill instructions.0.98
- # pypdfium2 Library (Apache/BSD License)0.99
- PRESENTED BY1.00
- Microsoft1.00
- Markdown1.00
- This guide covers essential PDF processing operations using Python0.99
- a8 Overview0.85
- pypdfium2 is a Python binding for POFium (Chromium's PDF0.94
- Library). It's excellent for fast PDF rendering, image0.97
- generation, and serves as ...0.96
- ### Overview0.88
- JavaScript libraries, and detailed examples, see /reference.nd.0.98
- libraries and command-line tools. For advanced features,0.99
- pdf/forms.md1.00
- If you need to fill out a PDF fors, read /forms.nd and follow its0.97
- instructions.1.00
- Quick Start0.97
- If you need to fill out a PoF forn, first check to see0.98
- if the POF has fillable fors fields. Run this script0.92
- from this file's directory:0.99
- python scripts/check_fillable_fields <file.pdf>,0.97
- from pypdf import PdfReader, Pafriter0.95
- # Read a POF0.99
- and depending on the result go to either the "Fillable1.00
- fields" or "Non-fillable fields" and follow those0.99
- instructions.1.00
- print(fPages: {len(reader.pages)}")0.81
- for page in reader.pages:0.99
- reader = PdfReader("document.pdf")0.97
- # Extract text0.97
- text =0.94
- text += page.extract_text()1.00
- # Fillable fields0.95
- If the POF has fillable fors fields:0.98
- <fields.json>.0.98
- - Run this script from this file's directory:0.99
- python scripts/extract_form_field_info.py <input.pdf>1.00
- Source: Anthropic Blog1.00
- TRACK 3· JULY 2, 20260.96
- Al in Finance0.99
- AlEngineer1.00
- World'sFair1.00
-
- AlEngineer0.97
- World'sFair1.00
- PRESENTED BY1.00
- Microsoft1.00
- Adding Skill Support in Harness1.00
- ⑤/Q0.57
- TRACK 3• JULY 2, 20260.96
- Alin Finance0.99
- AlEngineer0.99
- World'sFair0.96
-
- AlEngineer0.98
- Basic components1.00
- World's Fair0.99
- PRESENTED BY0.97
- REQUIRED1.00
- REQUIRED1.00
- REQUIRED1.00
- Microsoft1.00
- Skill Registry1.00
- System Prompt1.00
- File Read Tool1.00
- Where skills are loaded from0.99
- Controllable — where a skill gets0.99
- Loads skill bodies & resources on0.99
- injected1.00
- demand1.00
- TRACK 3· JULY 2, 20260.95
- Al in Finance0.99
- AlEnginee0.99
- World's Fair0.97
-
- AlEngineer0.98
- A simple Skill Registry1.00
- World's Fair0.96
- python1.00
- registry = [0.96
- frontmatter(open(f, encoding="utf-8").read()) I {"path": f}0.98
- for f in sorted(glob("skills/*/SKILL.md"))1.00
- Skill0.99
- Description1.00
- Path to SKILL.md1.00
- Creates a beginner-friendly research brief about a public1.00
- company-research1.00
- company.1.00
- skills/company-research/SKILL.md1.00
- Turns Markdown into a polished, standalone HTML report while1.00
- report-html1.00
- preserving all content and structure.0.98
- skills/build-report/SKILL.md1.00
- report-pdf1.00
- Fills, merges, and extracts data from PDF files.0.99
- skills/pdf/SKILL.md1.00
- TRACK 3· JULY 2,20260.94
- AlEngineer0.99
- Al in Finance0.99
- World's Fair0.98
-
- AlEngineer0.97
- World'sFair1.00
- name: company-research1.00
- description: Creates a beginner-friendly research brief0.99
- about a public company.0.99
- tools: web_search0.96
- 1. Make exactly three parallel web_search calls:0.99
- one query combining the business model and latest1.00
- financial results, one for a recent positive0.99
- development, and one for an important risk. Do not1.00
- request more searches afterward.1.00
- 2. Combine the results into a plain-language1.00
- brief. Separate facts from interpretation, cite0.98
- source links, and do not give buy or sell advice.1.00
- TRACK 3· JULY 2,20260.95
- Alin Finance0.98
- AlEngineer0.99
- World'sFair1.00
Transcript
136 cues· 2,124 words· 11,614 chars
- 0:13 Hi, everyone.
- 0:14 I'm Yogi.
- 0:15 I work at FactSet as principal AI engineer.
- 0:19 We are a financial data and research company.
- 0:23 I'm going to talk about how to build skill-centric agentic products.
- 0:29 And I'm going to post slides so you don't have to keep taking photos.
- 0:34 So that's my .
- 0:37 Yogi, not the bear.
- 0:40 So let's connect there, and let's begin.
- 0:49 So in the last year's talk in this very conference, I talked about blueprints and what blueprints were really a simple set of steps or recipe that you can hand over to agents so that agent doesn't have to discover its path every time.
- 1:10 And when I look back, it was simply a skill in a very naive form.
- 1:17 And a lot has changed since then.
- 1:20 Anthropic has shipped skills in last year, October, and even warned us not to build agents.
- 1:28 But on serious note, since Anthropic had already open sourced the skills, there was no point in trying to maintain our own standards.
- 1:38 So we moved away from blueprints and just adopted skills fully.
- 1:44 And this talk really inspired me to build skill-centric agent, and I'm going to share some of my learnings from that journey.
- 1:55 So a quick raise of hands, how many of you really build skills here?
- 2:02 So, almost all of you.
- 2:04 Now, lower your hands if you have built that only in context of Cloud Code and Codex, and raise your hand if you have built your own harness and added skills to that.
- 2:19 So OK, so I see a few hands.
- 2:21 So the reason I'm asking is when I see most of the online discourse, it's about coding harnesses and skills in context of the coding agents and how to write great skills.
- 2:35 So we need that, but today I'm not going to talk about that.
- 2:39 What I'm going to focus on is skills in the context of agentic products.
- 2:45 and how do you really add support for skills in your own harness, and how to scale it at enterprise scale.
- 2:55 So traditionally, product used to look like this, a surface made of screens, buttons, forms, and dashboards.
- 3:04 The user navigated this UI.
- 3:08 But nowadays, we are seeing more and more these kind of interfaces where agent is at the forefront.
- 3:15 The user either talks to the agent or agent behind the scene is the main decision maker, helping users navigate your product.
- 3:26 Now, if the agent becomes the main interface for your product, then where do features live?
- 3:37 This framing of who, what, and how really helps to answer that question.
- 3:42 Prompts define who the agent is, tools define what it can connect to, and skills really tell you how a task gets done.
- 3:53 And this is the great place to keep your business logic that shapes your agent's behavior.
- 4:00 So skills are the new features, and you can see this with this example.
- 4:06 So equity research and wealth management are two very important workflows in finance, and these all used to be the buttons, drop-downs, and screens, and now they are merely skills.
- 4:23 One of the most underrated thing about skills, especially when talking about agentic products, is how it has enabled to build skills for anyone who has good understanding of the product.
- 4:37 So if skills are new features, and these new features can be shipped by anyone in the company, the question is, what's the role of engineer then?
- 4:47 The role of engineer is shifting from shipping features to shipping harnesses, harnesses that are smooth vehicles for your skills to run.
- 4:57 But before diving into that, let's just get to the basics and try to understand what skill is.
- 5:04 The dictionary meaning of skill is the ability to do something well.
- 5:09 And what it means is that your model can live without it
- 5:14 but it's obviously going to do better in presence of skill.
- 5:20 A better definition for agent skill is a standardized way to teach AI agents how to do a specific task well.
- 5:29 And a simple skill could contain just like a markdown, but a very complex can have multiple references to the files and executable scripts.
- 5:43 The skill.md is the heart of your skill.
- 5:46 Name and description in the front matter are the key things that will help you to discover the skill.
- 5:54 And the business logic and instruction goes into the body of the skill, and which will also contain references to the files and scripts.
- 6:04 So let's see how to add a skill support in your harness.
- 6:08 So what do you need?
- 6:10 To do like a bare minimum skill in your harness, you only need these three things, like skill registry, a system prompt, and a basic file read tool.
- 6:21 If you're running scripts, then obviously you're gonna need either Bash or maybe a code running sandbox environment.
loading
Chapters
- 0:00 From blueprints to skills
- 1:46 Building skill centric agents
- 2:52 Skills in context at enterprise scale
- 3:46 Skills as the new features
- 5:04 Inside a skill: the skill.md
- 6:37 A minimal skill registry
- 7:42 Progressive disclosure
- 9:13 Trigger words and routing
- 12:17 Skills without evals drift
- 12:56 Search and embeddings past ten skills
- 13:46 Governance past a hundred skills
- 16:36 Skills as the product interface