Search code examples
c++stlvisual-studio-2015char16-tchar32-t

Visual Studio C++ 2015 std::codecvt with char16_t or char32_t


This code compiled OK under VS2013:

std::string Unicode::utf16_to_utf8(std::u16string utf16_string)
{
    std::wstring_convert<std::codecvt_utf8_utf16<char16_t>, char16_t> convert;
    return convert.to_bytes(utf16_string);
}

Now with VS2015 I get:

1>unicode.obj : error LNK2001: unresolved external symbol "__declspec(dllimport) public: static class std::locale::id std::codecvt<char16_t,char,struct _Mbstatet>::id" (__imp_?id@?$codecvt@_SDU_Mbstatet@@@std@@2V0locale@2@A)

Solution

  • Old question, but for future reference: this is a known bug in Visual Studio 2015, as explained in the latest post (January 7th 2016) in this thread of MSDN Social.

    The workaround for your example looks like this (I implemented your method as a free function for simplicity):

    #include <codecvt>
    #include <locale>
    #include <string>
    #include <iostream>
    
    #if _MSC_VER >= 1900
    
    std::string utf16_to_utf8(std::u16string utf16_string)
    {
        std::wstring_convert<std::codecvt_utf8_utf16<int16_t>, int16_t> convert;
        auto p = reinterpret_cast<const int16_t *>(utf16_string.data());
        return convert.to_bytes(p, p + utf16_string.size());
    }
    
    #else
    
    std::string utf16_to_utf8(std::u16string utf16_string)
    {
        std::wstring_convert<std::codecvt_utf8_utf16<char16_t>, char16_t> convert;
        return convert.to_bytes(utf16_string);
    }
    
    #endif
    
    int main()
    {
        std::cout << utf16_to_utf8(u"Élémentaire, mon cher Watson!") << std::endl;
    
        return 0;
    }
    

    Hopefully, the problem will be fixed in future releases, otherwise the #if condition will need refining. UPDATE: nope, not fixed in VS 2017. Therefore, I've updated the preprocessor conditional to >= 1900 (initially was == 1900).