Search code examples
perlparsingwww-mechanize

Mechanize example - quiete simple but too complex for me: need explanations


Good day dear community. I am new to programming. And i want to digg deeper into Perl. So i have a Mechanize example - quiete simple but too complex for me: need explanations. I need your help here with this!

use strict;
    $|++;

    use WWW::Mechanize;
    use File::Basename;

    my $m = WWW::Mechanize->new;

    $m->get("http://www.despair.com/indem.html");

    my @top_links = @{$m->links};

    for my $top_link_num (0..$#top_links) {
        next unless $top_links[$top_link_num][0] =~ /^http:/;

        $m->follow_link( n=>$top_link_num ) or die "can't follow $top_link_num";

        print $m->uri, "\n";
        for my $image (grep m{^http://store4}, map $_->[0], @{$m->links}) {
            my $local = basename $image;
            print " $image...", $m->mirror($image, $local)->message, "\n"
        }

        $m->back or die "can't go back";
    }

can anybody give me a line by line explanation?


Solution

  • I tried the first coupe of lines.

    However you need to make sure to first read and understand the following documentation:

    1) Perl Intro - especially variable scoping part

    2) Perl data

    3) Perl Data Structures Cookbook

    P.S. As Eric said in the comment, this code is definitely NOT a very good example for someone just starting. It's got way too many non-trivial ideas/concepts/moving parts.

    use strict; 
      # Does not allow undeclared global variables or other unsafe constructs.
      # You should ALWAYS code with "use strict; use warnings"
      # See http://perldoc.perl.org/strict.html
    $|++;
      # Turn on autoflush on STDOUT filehandle. 
      # See "http://perldoc.perl.org/perlvar.html" for "$|" and other special variables.
      # P.S. This "++" is a hack - it would be a lot more readable to do "$| = 1;"
      #      since $| only cares whether the value is zero or non-zero.
    
    use WWW::Mechanize; # Load the module for getting web sites.
    use File::Basename; # Load the module for finding script's name/path.
    
    my $m = WWW::Mechanize->new; # Create new object via a constructor (new)
    
    $m->get("http://www.despair.com/indem.html"); 
       # Retrieve the contents of the URL. 
       # See http://search.cpan.org/dist/WWW-Mechanize/lib/WWW/Mechanize.pm
       # for the module's documentation (aka POD)
    
    my @top_links = @{$m->links};
       # Declare a "@top_links" array, 
       # get the list of links on the above page (returns array reference)
       # and de-reference that array reference and store it in @top_links array
    
    for my $top_link_num (0..$#top_links) { 
        # Loop over all integers between 0 and the last index of @top_links array
        # (e.g. if there were 3 links, loop over 0,1,2
        # Assign the current loop value to $top_link_num variable
    
        next unless $top_links[$top_link_num][0] =~ /^http:/;
        # go to next iteration of the loop unless the current link's URL is HTTP protocol
        # Current link is the element of the array with current undex -
        #    $top_links[$top_link_num]
        # The link data is stored as an array reference,
        # with the link URL being the first element of the arrayref 
        # Therefore, $top_links[$top_link_num][0] - which is the shorthand 
        #    for $top_links[$top_link_num]->[0] as you learned
        #    from reading Data Structures Cookbook I linked - is the URL
        # To check if URL is HTTP prtocol, we check if it starts with http:
        # via regular expression - see "http://perldoc.perl.org/perlre.html"
    
        $m->follow_link( n=>$top_link_num ) or die "can't follow $top_link_num";
    
        print $m->uri, "\n";
        for my $image (grep m{^http://store4}, map $_->[0], @{$m->links}) {
            my $local = basename $image;
            print " $image...", $m->mirror($image, $local)->message, "\n"
        }
    
        $m->back or die "can't go back";
    }