Search code examples
python-3.xutf-8httpserver

python3: UTF-8 encoding in http.server


I have encoding problems when serving a simple web page in python3, using BaseHTTPRequestHandler.

Here is a working example:

#!/usr/bin/python3
# -*- coding: utf-8 -*

from http.server import BaseHTTPRequestHandler, HTTPServer
from os import curdir, sep, remove
import cgi

HTML_FILE_NAME = 'test.html'
PORT_NUMBER = 8080

# This class will handles any incoming request from the browser
class myHandler(BaseHTTPRequestHandler):

    # Handler for the GET requests
    def do_GET(self):
        self.path = HTML_FILE_NAME
        try:
            with open(curdir + sep + self.path, 'r') as f:
                self.send_response(200)
                self.send_header('Content-type', 'text/html')
                self.end_headers()
                self.wfile.write(bytes(f.read(), 'UTF-8'))
            return
        except IOError:
            self.send_error(404, 'File Not Found: %s' % self.path)

try:
    # Create a web server and define the handler to manage the incoming request
    with open(HTML_FILE_NAME, 'w') as f:
        f.write('<!DOCTYPE html><html><body> <p> My name is Jérôme </p> </body></html>')
    print('Started httpserver on port %i.' % PORT_NUMBER)

    #Wait forever for incoming http requests
    HTTPServer(('', PORT_NUMBER), myHandler).serve_forever()

except KeyboardInterrupt:
    print('Interrupted by the user - shutting down the web server.')
    server.socket.close()
    remove(HTML_FILE_NAME)

The expected result is to serve a web page displaying My name is Jérôme.

Instead, I have: My name is Jérôme

As you can see, the html page is correctly encoded, with self.wfile.write(bytes(f.read(), 'UTF-8')), so I think the problem comes from the web server.

How to tell the web server to serve the page in UTF-8?


Solution

  • No problem if I add:

    <meta content="text/html;charset=utf-8" http-equiv="Content-Type">
    <meta content="utf-8" http-equiv="encoding">
    

    in my html head.