for rewards wouldn't it be best to kill them both?

From Fallen London Wiki

If you don't care about story why not kill them both you get the cane and the cudgel and the companions are replaced but still give the same stats

Plus the Renown