A server that I frequently use (and don’t have root access to) doesn’t start its ssh-agent automatically nor register the existing public keys.

To start the ssh agent:

eval "$(ssh-agent -s)"

To add your key to the ssh agent:

ssh-add ~/.ssh/id_rsa