Search code examples
perlhttpsproxylwp

How do I force LWP to use Crypt::SSLeay for HTTPS requests?


My symptom is that I cannot use a proxy with HTTPS requests with LWP. This seems to be a common problem, and the hints on Google and even here all suggest a work-around for setting the HTTPS_PROXY environment variable for use by Crypt::SSLeay.

My specific problem appears to be that LWP::Protocol::https is loading IO::Socket::SSL rather than Crypt::SSLeay. How can I force Crypt::SSLeay's use instead?

My code:

#!/usr/bin/perl

use strict;
use warnings;
$ENV{HTTPS_PROXY} = 'http://10.0.3.1:3128';
use LWP::UserAgent;
my $ua = LWP::UserAgent->new();
my $req = HTTP::Request->new('GET','https://www.meritrustcu.org/');
my $res = $ua->request($req);
print "$_\n" for grep { $_ =~ /SSL/ } keys %INC;

And it's output, showing that Crypt::SSLeay is not being used:

Net/SSLeay.pm
IO/Socket/SSL.pm
/usr/lib/perl5/auto/Net/SSLeay/autosplit.ix
/usr/lib/perl5/auto/Net/SSLeay/set_proxy.al
/usr/lib/perl5/auto/Net/SSLeay/randomize.al

Simply adding an explicit use Crypt::SSLeay to my script has proven ineffective. It loads the module, but it continues to load IO::Socket::SSL, and use it for the HTTPS requests.


Solution

  • Try this:

    use strict;
    use warnings;
    
    use Net::SSL (); # From Crypt-SSLeay
    BEGIN {
      $Net::HTTPS::SSL_SOCKET_CLASS = "Net::SSL"; # Force use of Net::SSL
      $ENV{HTTPS_PROXY} = 'http://10.0.3.1:3128';
    }
    
    use LWP::UserAgent;
    my $ua = LWP::UserAgent->new();
    my $req = HTTP::Request->new('GET','https://www.meritrustcu.org/');
    my $res = $ua->request($req);
    print "$_\n" for grep { $_ =~ /SSL/ } keys %INC;
    

    I don't have a suitable proxy, so I haven't tried it myself.