error: unable to unlink old 'sites/default/settings.php' (Permission denied)

Here's and easy one I keep forgetting.

Not only do you need to change the permission on the file but the folder too.