Photogravimagnetic assists of light sails: a mixed blessing for Breakthrough Starshot?