From Fallen London Wiki

Confirmed. If it helps anyone, once you've got the fifth Audience, the storylet no longer appears. So you don't need to worry about doing it unnecessarily if you happen to have lost count along the way.