I like how @misener puts it:

"Don’t start by asking how to build an audience for your podcast. Instead, ask how to build a podcast for your audience."