We have an issue where we cannot use ssh keys for gitlab at the moment. https://gitlab.com/gitlab-org/gitlab-ce/issues/32227