The Bad, the Good, and the Ugly: Navigating the New Waves of Machine Learning ft. Adi Polak

​‪@mehdio‬ chatted with Adi Polak, the author of "Scaling Machine Learning with Spark", right after the DATA+AI summit hosted by Databricks in San Francisco. We had an insightful discussion about ML, the basics of data, and where LLM fits into the bigger picture.
Hope you find it enjoyable!

☁️🦆 Start using DuckDB in the Cloud for FREE with MotherDuck : hubs.la/Q02QnFR40

📓 Resources
Link to Adi's book : www.oreilly.com/library/view/scaling-machine-learn…

➡️ Follow Us
Blog : motherduck.com/blog/
LinkedIn : www.linkedin.com/company/8192...
Twitter : twitter.com/motherduck

0:00 Intro
0:18 About Adi Polak
1:08 Challenges of transitioning between roles
4:29 Why writing this book ?
6:30 FOMO new data tools
8:24 How do you see company data maturity evolving ?
9:50 What LLM can do for data folks ?
13:21 The English SDK
16:09 Who would be the prompt engineer in data ?
17:40 Using LLM & Critical thinking
20:27 What's the biggest learning from writing your book ?
21:48 Is distributed compute still important to learn ?
23:34 Adi's next plans and short LLM book!
24:44 Out