From Fallen London Wiki

I think you misunderstand the reward mechanics. The Burden rewards are additive, not exclusive. If you collect all 4 Burdens, you claim all 4 Burden rewards before exiting. Optimal strategy is to claim as many as your stats can support.