Use an ssh-agent on Ubuntu

Use keychain package 

$ sudo apt-get install keychain

Then append to your ~/.bashrc

/usr/bin/keychain --nogui $HOME/.ssh/id_rsa

source $HOME/.keychain/$HOSTNAME-sh