Item5990: WYSIWYG gives fatal error when saving UTF-8/Old editor works

TWiki detected an internal error - please check your TWiki logs and webserver logs for more information.

Cannot decode string with wide characters

Selecting the Pick, and then save (i.e. saving in the raw editor) works.

 
[Tue Sep 09 08:15:28 2008] [error] [client 10.193.21.87] TWiki is likely to have problems, referer: http://hsl-wiki/twiki
/bin/edit/PSTestandLP/TeamManagementMiraRa\xc5\xbeman?t=1220940797
UTF-8 not yet supported as site charset -TWiki is likely to have problems[Tue Sep  9 08:21:01 2008] -e: Wide character in
 print at /var/www/twiki/lib/TWiki/UI.pm line 185.
Cannot decode string with wide characters at /usr/lib/perl/5.8/Encode.pm line 166.
 at /usr/lib/perl/5.8/Encode.pm line 166
        Encode::decode('utf8', '<p>\x{010c}lanice tima: Tatjana Dari&scaron;, Tina Ravnikar, Mira Ra...') called at /usr/lib/per
l/5.8/Encode.pm line 206
        Encode::decode_utf8('<p>\x{010c}lanice tima: Tatjana Dari&scaron;, Tina Ravnikar, Mira Ra...') called at /var/www/twiki/
lib/TWiki/Plugins/WysiwygPlugin/HTML2TML.pm line 113
        TWiki::Plugins::WysiwygPlugin::HTML2TML::convert('TWiki::Plugins::WysiwygPlugin::HTML2TML=HASH(0x8d2f214)', '<p>\x{010c}
lanice tima: Tatjana Dari&scaron;, Tina Ravnikar, Mira Ra...', 'HASH(0x91b4e94)') called at /var/www/twiki/lib/TWiki/Plug
ins/WysiwygPlugin.pm line 228
        TWiki::Plugins::WysiwygPlugin::TranslateHTML2TML('<p>\x{010c}lanice tima: Tatjana Dari&scaron;, Tina Ravnikar, Mira Ra..
.', 'TeamManagementMiraRa\x{c5}\x{be}man', 'PSTestandLP') called at /var/www/twiki/lib/TWiki/Plugins/WysiwygPlugin.pm lin
e 196
        TWiki::Plugins::WysiwygPlugin::afterEditHandler('<!--WYSIWYG content - do not remove this comment, and never u...
', 'TeamManagementMiraRa\x{c5}\x{be}man', 'PSTestandLP', 'TWiki::Meta=HASH(0x91018b8)') called at /var/www/twiki/lib/TWik
i/Plugin.pm line 266
        TWiki::Plugin::invoke('TWiki::Plugin=HASH(0x8fe9504)', 'afterEditHandler', '<!--WYSIWYG content - do not remove t
his comment, and never u...', 'TeamManagementMiraRa\x{c5}\x{be}man', 'PSTestandLP', 'TWiki::Meta=HASH(0x91018b8)') called
 at /var/www/twiki/lib/TWiki/Plugins.pm line 344
        TWiki::Plugins::_dispatch('TWiki::Plugins=HASH(0x8d1b7a8)', 'afterEditHandler', '<!--WYSIWYG content - do not rem
ove this comment, and never u...', 'TeamManagementMiraRa\x{c5}\x{be}man', 'PSTestandLP', 'TWiki::Meta=HASH(0x91018b8)') c
alled at /var/www/twiki/lib/TWiki/Plugins.pm line 647
        TWiki::Plugins::afterEditHandler('TWiki::Plugins=HASH(0x8d1b7a8)', '<!--WYSIWYG content - do not remove this comm
ent, and never u...', 'TeamManagementMiraRa\x{c5}\x{be}man', 'PSTestandLP', 'TWiki::Meta=HASH(0x91018b8)') called at /var
/www/twiki/lib/TWiki/UI/Save.pm line 542
        TWiki::UI::Save::save('TWiki=HASH(0x8d16090)') called at /var/www/twiki/lib/TWiki/UI.pm line 159
        TWiki::UI::__ANON__() called at /usr/share/perl5/Error.pm line 380
        eval {...} called at /usr/share/perl5/Error.pm line 372
        Error::subs::try('CODE(0x8b064b8)', 'HASH(0x8d1b958)') called at /var/www/twiki/lib/TWiki/UI.pm line 197
        TWiki::UI::run('CODE(0x90bac00)', 'save', 1) called at /var/www/twiki/bin/save line 32
        ModPerl::ROOT::ModPerl::Registry::var_www_twiki_bin_save::handler('Apache2::RequestRec=SCALAR(0x9165068)') called
 at /usr/lib/perl5/ModPerl/RegistryCooker.pm line 203
        eval {...} called at /usr/lib/perl5/ModPerl/RegistryCooker.pm line 203
        ModPerl::RegistryCooker::run('ModPerl::Registry=HASH(0x912e124)') called at /usr/lib/perl5/ModPerl/RegistryCooker
.pm line 169
        ModPerl::RegistryCooker::default_handler('ModPerl::Registry=HASH(0x912e124)') called at /usr/lib/perl5/ModPerl/Re
gistry.pm line 30
        ModPerl::Registry::handler('ModPerl::Registry', 'Apache2::RequestRec=SCALAR(0x9165068)') called at -e line 0
        eval {...} called
[Tue Sep  9 08:21:01 2008] -e: Wide character in print at /var/www/twiki/lib/TWiki.pm line 1730.

Note: The same error came up as I was trying to save this bug report, so whatever version is running the BUG reporting web, has this error too...

-- TWiki:Main/MatijaGrabnar - 10 Sep 2008

It sounds like I get the similiar error. I am using TWiki 4.2.3. I have en_US.UTF-8 for my site locale and utf-8 for my site charset.

I create a new topic and enter Chinese text, for example, 你好, and when I click Save or Save and Continue, I get the error on the screen stating "Cannot decode string with wide characters".

It appears that if instead, before saving, I click the pickaxe and let it translate things to the TWiki markup language and then click save, things will work.

Are there any ideas on how to fix this issue?

-- TWiki:Main.DougCampbell - 04 Nov 2008

Sorry, no. It appears that some configurations have this problem, and others don't. I haven't had the time to try to reproduce it or investigate in detail.

-- TWiki:Main.CrawfordCurrie - 04 Nov 2008

Hi All, I've got the same problem but with hungarian national characters. I've tried a couple of encoding combinations, all of them result wrong displayed content. Raw editing works.

Perl: 5.8.7 Twiki: 4.2.4 OS: FreeBSD

Any suggestions?

-- TWiki:Main.AttilaRucz - 02 Jan 2009

Hello all, here's another data point for you. new wiki: twiki 4.2.3, perl 5.8.8, rhel5 and apache 2.2.3, site locale en-us.ISO-8859-1, site charset iso-8859-1 old wiki: twiki 4.2.0, perl 5.8.5, rhel4, apache 2.0.52, site locale en-us.ISO-8859-1

the older wiki has no problems inputting or displaying japanese characters using WSYIWYG. I don't even need to change the character encoding. Raw editing does work japanese characters previous edits of a page show up as some sort of code like this や

I'll be happy to provide perl module version numbers or whatever else is needed.

-- TWiki:Main.JoonhoSyn - 25 Feb 2009