The MMA fighter said it "wasn't my time" and that the driver couldn't see him because of a sun trap, before nabbing a lift home