Search code examples
ruby-on-railscarrierwaveunicornfog

Don't have 'fog' gem installed in production using carrierwave and unicorn


I am trying to use Fog with Carrierwave and am getting this error in the Unicorn log. I have fog in my gemfile and my NodeImageUploader calls

storage :fog

Gemfile

source 'http://rubygems.org'

gem 'rails', '3.2.8'
gem 'bcrypt-ruby', '3.0.1'
gem 'jquery-rails'
gem 'fog', '1.8.0'
gem 'bootstrap-sass', '~> 2.2.1.1'
gem 'devise'
gem 'omniauth-facebook'
gem 'rails-backbone'
gem 'simple_form'
# gem 'newrelic_rpm'
# gem 'client_side_validations'
gem 'inherited_resources'
gem 'friendly_id', '~> 4.0.1'
gem 'carrierwave'
gem 'activeadmin'
gem 'meta_search', '>= 1.1.0.pre'
gem 'will_paginate'
gem 'bootstrap-will_paginate'
gem 'faker', '1.0.1'
gem 'rack-contrib'
gem 'soulmate', :git => "git://github.com/allotrop/soulmate.git", :require => 'soulmate/server'
gem 'httparty'
gem 'mini_magick'
gem 'mime-types'
gem 'redis'
gem 'pg', '0.12.2'
gem 'nokogiri', '1.5.5'
# gem "rmagick"

group :development, :test  do 
  gem 'rspec-rails', '2.11.0'
  gem 'guard-rspec', '0.5.5'
end

group :development do
  gem 'annotate', ">=2.5.0"
  #gem 'open-uri'
end

# Gems used only for assets and not required
# in production environments by default.
group :assets do
  gem 'sass-rails',   '~> 3.2.3'
  gem 'coffee-rails', '~> 3.2.1'
  # gem 'therubyracer', :platform => :ruby
  gem 'uglifier', '>= 1.0.3'
end

group :test do
  gem 'capybara', '1.1.2'
  gem 'guard-spork', '0.3.2'
  gem 'spork', '0.9.0'
  gem 'factory_girl_rails', '1.4.0'
  gem 'rb-inotify', '0.8.8'
  gem 'libnotify', '0.5.9'
  gem 'database_cleaner', '0.7.0'
  gem 'email_spec'
end

# To use ActiveModel has_secure_password
# gem 'bcrypt-ruby', '~> 3.0.0'

# To use Jbuilder templates for JSON
# gem 'jbuilder'

# Use unicorn as the app server
gem 'unicorn'

# Deploy with Capistrano
gem 'capistrano'

# To use debugger
 gem 'debugger', group: [:development, :test]
# gem 'rubber'
# gem 'open4'

config/carrierwave.rb

CarrierWave.configure do |config|
config.fog_credentials = {

 :aws_access_key_id => 'xxxx'
 :aws_secret_access_key => 'yyyy'
 :provider => 'AWS'
}
config.fog_directory = 'example-uploads'
config.fog_public = true
end

Doing bundle show fog gives me /home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/fog-1.3.1

Also, I am able to use Carrierwave's remote_image_url method in a rake task on production to successfully save images to S3. But, when I try to get any page of my app, I get this error.

unicorn.log

 E, [2012-12-11T20:49:28.872957 #23518] ERROR -- : You don't have the 'fog' gem installed (RuntimeError)
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/carrierwave-0.7.1/lib/carrierwave/uploader/configuration.rb:73:in `eval'
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/carrierwave-0.7.1/lib/carrierwave/storage/fog.rb:3:in `<top (required)>'
 (eval):1:in `storage'
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/carrierwave-0.7.1/lib/carrierwave/uploader/configuration.rb:73:in `eval'
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/carrierwave-0.7.1/lib/carrierwave/uploader/configuration.rb:73:in `storage'
/home/deployer/apps/allotrop/releases/20121211204621/app/uploaders/node_image_uploader.rb:24:in `<class:NodeImageUploader>'
/home/deployer/apps/allotrop/releases/20121211204621/app/uploaders/node_image_uploader.rb:5:in `<top (required)>'
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `require'
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `block in requi>
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:236:in `load_dependenc>
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `require'
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:359:in `require_or_loa>
/home/deployer/apps/allotrop/shared/bundle/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:502:in `load_mis

The application works fine if I switch the uploader to storage :file and even when I use storage :fog in development. Where am I going wrong?


Solution

  • After trying to fix this problem for the better part of the day, I fixed it by following the steps from Ryan Bates' Railscasts episode on zero downtime deployment. The changes mentioned by him are to add preload_app in your unicorn template and use a USR2 signal for unicorn restart.

    unicorn.rb.erb

    # Load rails+github.git into the master before forking workers
    # for super-fast worker spawn times
    preload_app true
    
    before_fork do |server, worker|
    
      # Disconnect since the database connection will not carry over
      if defined? ActiveRecord::Base
        ActiveRecord::Base.connection.disconnect!
      end
    
      ##
      # When sent a USR2, Unicorn will suffix its pidfile with .oldbin and
      # immediately start loading up a new version of itself (loaded with a new
      # version of our app). When this new Unicorn is completely loaded
      # it will begin spawning workers. The first worker spawned will check to
      # see if an .oldbin pidfile exists. If so, this means we've just booted up
      # a new Unicorn and need to tell the old one that it can now die. To do so
      # we send it a QUIT.
      #
      # Using this method we get 0 downtime deploys.
    
      old_pid = "#{server.config[:pid]}.oldbin"
      if File.exists?(old_pid) && server.pid != old_pid
        begin
          Process.kill("QUIT", File.read(old_pid).to_i)
        rescue Errno::ENOENT, Errno::ESRCH
          # someone else did our job for us
        end
      end
    end
    
    after_fork do |server, worker|
      ##
      # Unicorn master loads the app then forks off workers - because of the way
      # Unix forking works, we need to make sure we aren't using any of the parent's
      # sockets, e.g. db connection
      # Start up the database connection again in the worker
    
      if defined?(ActiveRecord::Base)
        ActiveRecord::Base.establish_connection
      end
    
      # Redis and Memcached would go here but their connections are established
      # on demand, so the master never opens a socket
    end
    

    unicorn_init.erb

    restart|reload)
      sig USR2 && echo reloaded OK && exit 0
      echo >&2 "Couldn't reload, starting '$CMD' instead"
      run "$CMD"
      ;;
    

    Then you need to run cap:unicorn:setup unicorn:stop unicorn:start. If anyone is facing this issue, I highly recommend seeing the Railscasts on Capistrano recipes and zero downtime deployment.