Скачать или смотреть Saying the quiet part out loud about AI + Product Management? Shaun Clowes on Lenny's Podcast

Saying the quiet part out loud about AI + Product Management? Shaun Clowes does exactly that in his interview on Lenny’s Podcast. If you’re a PM and want to get better, this episode is most definitely for you.

If not, it’s probably not for you…😃 🤣 👍

As always, BIG shoutout to Lenny Rachitsky for another lights out interview.

1: Great PMs are intellectually honest about what LLMs are vs aren’t capable of.
“At the end of the day, these models are very, very, very smart, but they're also insanely dumb and everyone knows that, insanely dumb.”

“In other words, they really only know what they were trained on or what you bring to them right at that moment. In that millisecond, and then they will forget it immediately. And it's very easy to convince yourself that isn't true, but it is actually what really matters.”

2: Lean into the LLM horsepower to find more gaps, more opportunities, more common threads etc.
“We live in just the most amazing time for product managers right now in terms of being able to analyze vast quantities of information and see the common threads.”

“LLMs let you get to that really, really, really quickly in a very structured way, but only if you push at the edges, provoke the answers you don't want to hear, provoke the problems, try and prove to yourself that you are wrong.”

“I think is the easiest way to start trying to use some of these tools.”

“They don't do the job for you, they just help you do these things that are intricate in that job of finding the gaps, finding the opportunities, finding the common threads without necessarily having to do all of it just inside your brain.”

3: Leverage the “big synthesis machine” and watch out for data decay.
“And so when you think about the job which is synthesizing all of this very complicated information to make good decisions, what does that mean?”

“Well, you've got this synthesis machine, which is this LLM thing that's going to help you do synthesis, but if it hasn't got all that data to do synthesis on top of, it's got nothing.”

“And so it's a data management problem. It's getting access to good data, getting access to high quality data, getting access to timely data and getting it to the LLM to get the LLM to make a smart decision. That's where 90% of the calories go.”

“Data is more like a compass than a GPS.”

“So any new piece of data decays in its value to your decision-making very, very quickly, very, very quickly.”

“You can never have enough information to give to an LLM to truly gain its value. The more things you give it, the better it gets.”

4: Do hard things aka build Intelligent Systems.
“Nobody wants to hear it. Everybody wants to just think about these really cool models and how smart they are, and that the next one will be even smarter.”

“But really it's just the hard work of getting really good data to the LLMs to get them to do good things.”

Link to the interview: https://www.lennysnewsletter.com/p/wh...