#519: Data Science Cloud Lessons at Scale

#519: Data Science Cloud Lessons at Scale

0 Ratings
0
Episode
518 of 521
Duration
1H 2min
Language
English
Format
Category
Non-fiction

Today on Talk Python: What really happens when your data work outgrows your laptop. Matthew Rocklin, creator of Dask and cofounder of Coiled, and Nat Tabris a staff software engineer at Coiled join me to unpack the messy truth of cloud-scale Python. During the episode we actually spin up a 1,000 core cluster from a notebook, twice! We also discuss picking between pandas and Polars, when GPUs help, and how to avoid surprise bills. Real lessons, real tradeoffs, shared by people who have built this stuff. Stick around.

Episode sponsors

Seer: AI Debugging, Code TALKPYTHON

Talk Python Courses

Links from the show Matthew Rocklin: @mrocklin

Nat Tabris: tabris.us

Dask: dask.org

Coiled: coiled.io

Watch this episode on YouTube: youtube.com

Episode #519 deep-dive: talkpython.fm/519

Episode transcripts: talkpython.fm

Theme Song: Developer Rap

🥁 Served in a Flask 🎸: talkpython.fm/flasksong

---== Don't be a stranger ==---

YouTube: youtube.com/@talkpython

Bluesky: @talkpython.fm

Mastodon: @talkpython@fosstodon.org

X.com: @talkpython

Michael on Bluesky: @mkennedy.codes

Michael on Mastodon: @mkennedy@fosstodon.org

Michael on X.com: @mkennedy


Listen and read

Step into an infinite world of stories

  • Read and listen as much as you want
  • Over 1 million titles
  • Exclusive titles + Storytel Originals
  • 7 days free trial, then €9.99/month
  • Easy to cancel anytime
Try for free
Details page - Device banner - 894x1036
Cover for #519: Data Science Cloud Lessons at Scale

Other podcasts you might like ...