The Gradient
The Gradient: Perspectives on AI
Kate Park: Data Engines for Vision and Language

Kate Park: Data Engines for Vision and Language

On the importance of data, training for vision vs. language models, and flywheels.

In episode 116 of The Gradient Podcast, Daniel Bashir speaks to Kate Park.

Kate is the Director of Product at Scale AI. Prior to joining Scale, Kate worked on Tesla Autopilot as the AI team’s first and lead product manager building the industry’s first data engine. She has also published research on spoken natural language processing and a travel memoir.

Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at

Subscribe to The Gradient Podcast:  Apple Podcasts  | Spotify | Pocket Casts | RSS
Follow The Gradient on Twitter


  • (00:00) Intro

  • (01:11) Kate’s background

  • (03:22) Tesla and cameras vs. Lidar, importance of data

  • (05:12) “Data is key”

  • (07:35) Data vs. architectural improvements

  • (09:36) Effort for data scaling

  • (10:55) Transfer of capabilities in self-driving

  • (13:44) Data flywheels and edge cases, deployment

  • (15:48) Transition to Scale

  • (18:52) Perspectives on shifting to transformers and data

  • (21:00) Data engines for NLP vs. for vision

  • (25:32) Model evaluation for LLMs in data engines

  • (27:15) InstructGPT and data for RLHF

  • (29:15) Benchmark tasks for assessing potential labelers

  • (32:07) Biggest challenges for data engines

  • (33:40) Expert AI trainers

  • (36:22) Future work in data engines

  • (38:25) Need for human labeling when bootstrapping new domains or tasks

  • (41:05) Outro


The Gradient
The Gradient: Perspectives on AI
Deeply researched, technical interviews with experts thinking about AI and technology.