Search code examples
phphtmlparsingscreen-scrapinghtml-content-extraction

HTML comment scraping in PHP


I've been looking around but have yet to find a solution. I'm trying to scrape an HTML document and get the text between two comments however have been unable to do this successfully so far.

I'm using PHP and have tried the PHP Simple DOM parser recommended here many times but can't seem to get it to do what I want.

Here's (part of) the page that I wish to parse:

<div class="class">
  <!-- blah -->
    text
  <!-- end blah -->

  Text I want

  <!-- blah -->
    text
  <!-- end blah -->
</div>

Thanks


Solution

  • Assuming that each comment is different (i.e. "blah" is not the same in the first and second sections), you can use some simple strpos to grab everything between them. Regular expressions are not necessary.

    $startStr = '<!-- end blah1 -->';
    $endStr = '<!-- start blah2 -->';
    
    $startPos = strpos($HTML, $startStr) + strlen($startStr);
    $endPos = strpos($HTML, $endStr );
    
    $textYouWant = substr($HTML, $startPos, $endPos-$startPos);
    

    If the two sets of comments are the same, you'll need to modify this to find the second "blah", using strpos's offset parameter