Pulling out of a long shared driveway, as I got maybe 1/3 of the way towards the end, someone else started to pull in. Should they back up and let me out or should I have backed up the driveway to let them in?

Note that they would be backing up into a street but there was an open spot for street parking right next to the drive.