Today I learned that when performing SSH key authentication with OpenSSH. The client will look for the default key names id_rsa or id_dsa.
If you want to use a custom name you should specify it in the command line via the -i option or reference it in the config file ssh_config.