Search code examples
javahtmlparsingjsoup

How to avoid surrounding html head tags in Jsoup parse


Using Jsoup i try to parse the given html content. After Jsoup.parse() the html output append html, head and body tag to the input. I just want to ignore these.

Sample Input:

<p><b>This <i>is</i></b> <i>my sentence</i> of text.</p>

Java code:

import java.io.File;
import java.io.IOException;

import org.apache.commons.io.FileUtils;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class HTMLParse {

    public static void main(String args[]) throws IOException {
        try{
            File input = new File("/ab.html");
            String html = FileUtils.readFileToString(input, null);

            Document doc = Jsoup.parseBodyFragment(html);
            doc.outputSettings().prettyPrint(false);
            System.out.println(doc.html());
        }
        catch(Exception e){
            e.printStackTrace();
        }
    }
}

Actual output:

<html><head></head><body><p><b>This <i>is</i></b> <i>my sentence</i> of text.</p>
    </body></html>

Expected Output:

<p><b>This <i>is</i></b> <i>my sentence</i> of text.</p>

Please help.


Solution

  • The cause:

    parseBodyFragment() as well as all other parse()-methods use a HTML parser by default. And those add always the HTML-Shell (<html>…</html>, <head>…</head> etc.).

    The Solution:

    Just don't use a HTML-parser, use a XML-parser instead ;-)

    Document doc = Jsoup.parse(html, "", Parser.xmlParser());
    

    Replace that single line and your problem is solved.

    Example:

    final String html = "<p><b>This <i>is</i></b> <i>my sentence</i> of text.</p>";
    
    Document docHtml = Jsoup.parse(html);
    Document docXml = Jsoup.parse(html, "", Parser.xmlParser());
    
    System.out.println("******* HTML *******\n" + docHtml);
    System.out.println();
    System.out.println("*******  XML *******\n" + docXml);
    

    Output:

    ******* HTML *******
    <html>
     <head></head>
     <body>
      <p><b>This <i>is</i></b> <i>my sentence</i> of text.</p>
     </body>
    </html>
    
    *******  XML *******
    <p><b>This <i>is</i></b> <i>my sentence</i> of text.</p>