Use the standard URL notation:
sftp://user@host:port/path
Authentication should work using GNOME keyring.