A few days ago, one of my servers that was hosting a community edition of Gitlab rebooted (because of a hosting provider maintenance). Since that moment, that GitLab instance is partially broken : sidekiq completely refuses to start.
It restarts in an endless loop, with the following trace in the logs (from gitlac-ctl tail
):
==> /var/log/gitlab/ci-sidekiq/current <==
2016-08-29_11:07:56.79639 bundler: failed to load command: sidekiq (/opt/gitlab/embedded/bin/sidekiq)
2016-08-29_11:07:56.79654 Bundler::GemfileNotFound: /opt/gitlab/embedded/service/gitlab-ci/Gemfile not found
2016-08-29_11:07:56.79655 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.12.5/lib/bundler/definition.rb:23:in `build'
2016-08-29_11:07:56.79655 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.12.5/lib/bundler.rb:123:in `definition'
2016-08-29_11:07:56.79655 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.12.5/lib/bundler.rb:91:in `setup'
2016-08-29_11:07:56.79656 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/bundler-1.12.5/lib/bundler/setup.rb:19:in `<top (required)>'
2016-08-29_11:07:56.79656 /opt/gitlab/embedded/lib/ruby/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
2016-08-29_11:07:56.79656 /opt/gitlab/embedded/lib/ruby/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
The problem occured on GitLab 8.5 (If I remember properly). I tried to uninstall the Omnibus package and update to the latest version (8.11), but it did not fixed the problem.
I checked by hand, the reported file (/opt/gitlab/embedded/service/gitlab-ci/Gemfile
) do not exists. Running gitlab-ctl reconfigure
also did not fixed the problem.
I'm really not familiar with Ruby ecosystem, so I'm asking for your help. Have you any idea how I can tackle this issue ? (I can provide more logs / informations if you think something relevant is missing).
I don't know what the answer was but as I was in a hurry, I switched to a the docker installation of GitLab which solved the problem (as well as bringing more isolation in my setup).