Wordpress file exceeds the maximum upload size for this site. Maximum upload file size: 2MB.

This isn't going to be a great solution for everyone, but it was a real quick fix for me.

And that was to FTP the file somewhere and use 'insert for URL' on the top left.