How ANSI character map should behave on multibyte code pages

[Sam Bliss]

I am using Lazarus 0.9.27 r20911 FPC 2.2.5 i386-win32-win32/win64
The language of my computer is Chinese.
When I use ANSI charactor map and put the mouse on #128..#255,
the dialog shows.

                  Lazarus
============================================
Access voilation.

Press OK to ignore and risk data corruption.
Press Cancel to kill the program.
============================================
                 OK Cancel

Get screen shots and more information see here.

[skalogryz]

as Theo, already noted.
May be, it's enough to fix the Lazarus, so no access violation is risen.
And the half of ANSI table (128..255) should be left blank.

Because there're no 128..255 characters in windows Chinese code page.

[theo]

Yes, simply apply Patch #1 against IDE crash.
Ansi tab is sort of obsolete for UTF-8 systems anyway.
Lookup your code points in the unicode tab, in your case "Latin-1 Supplement"

[Sam Bliss]

Re: skalogryyz
Yes, I made a patch,
but it is not perfect.
See http://bugs.freepascal.org/view.php?id=14189.

[Sam Bliss]

Re: theo
Yes, but sometimes we need to search a character in ANSI tab,
it's fast and easy.

[Sam Bliss]

Re: theo
You replied that issue,
have you seen note 0029399 in that issue?
It means the #5 patch is broken.

[theo]

It means the #5 patch is broken.

I meant: apply charactermapdlg.pas.diff.fixcrash.zip and leave the rest.

[Sam Bliss]

Re: theo

Code: Pascal  [Select][+][-]

1. CharOrd := Ord(UTF8ToAnsi(StringGrid1.Cells[Col, Row])[1]);

Character #128..#255 need 2 bytes in UTF-8.
We need to convert UTF-8 to Unicode, then convert to ANSI,
or Col*16+Row-17.
Please test it by yourself, is it OK?

[theo]

Character #128..#255 need 2 bytes in UTF-8.

All I can say is, that the ANSI Tab works as expected on my Windows box (ANSI, German). It shows "?" on Linux for chars > 127 however. That's why we have the unicode tab.
I don't have the right to apply patches to the LCL/IDE anyway. So let some core-developer (Paul Ishenin?) decide what to do.

[skalogryz]

All I can say is, that the ANSI Tab works as expected on my Windows box (ANSI, German). It shows "?" on Linux for chars > 127 however. That's why we have the unicode tab.
I don't have the right to apply patches to the LCL/IDE anyway. So let some core-developer (Paul Ishenin?) decide what to do.

what's German Windows code page? shouldn't it be ANSI, so special German characters are shown?

[theo]

shouldn't it be ANSI, so special German characters are shown?

It does on windows, not on Linux (UTF-8) of course.

[Sam Bliss]

Germany systems use these charsets:

CP437 (United States)
CP1141 (IBM EBCDIC - Germany(20273 + Euro))
CP1250 (Eastern European)
CP20273 (IBM EBCDIC Germany)
CP20106 (IA5 Germany)
CP20127 (US-ASCII)
CP28592 (ISO 8859-2 - Eastern European)
CP65000 (UTF-7)^*
CP65001 (UTF-8)^*
...

[Vincent Snijders]

IMHO, the ansi character map is only valid for single byte code pages, or rather for characters that can be represented with one byte. I don't know mulitbyte code pages well enough, to say wat exactly should happen, but if say #130 is a valid (complete) character for your multibyte code page, it should be shown, if it is not a valid character, but just a partial character, a ? (or maybe empty) should be shown.

[skalogryz]

Sam Bliss, the patch is applied.
you should to use Unicode, to paste #128..#255 characters.
Half of the ANSI table will be empty.

[Sam Bliss]

I hope the ANSI charactor map will not be deleted in the future.
Maybe Unicode charactor map is more important,
but we also need ANSI charactor map.
Swap Unicode charactor map to the first, and ANSI to the second one is better.