Author Topic: Q: Bad handling of local language characters in UTF8  (Read 824 times)

Bamsen

  • Community Member
  • Posts: 66
  • Hero Points: 8
Q: Bad handling of local language characters in UTF8
« on: September 03, 2023, 09:04:30 AM »
      I am having an issue with handling of local language characters in UTF8.

        In attachment 1: This file is encoded as UTF8 showing the issue
        • The first image shows the cursor at column 4 which is correct.
        • The second image shows the cursor at column 7 which is NOT correct.
        • The third image shows what happens when I press Tab before the text. First line is indented correct. Second line gets double indent.
        • The fourth image shows the HEX view of the file.

        In attachment 2: This file is encoded as ACP showing the correct behavior
        • The first image shows the cursor at column 4 which is correct.
        • The second image shows the cursor at column 4 which is correct.
        • The third image shows what happens when I press Tab before the text. Both lines are indented correct.
        • The fourth image shows the HEX view of the file.

      The third and fourth attachment are the .txt files used for testing.

      My version of SlickEdit is SlickEdit Pro 2022 (v27.0.0.6 64-bit Qt5)

Clark

  • SlickEdit Team Member
  • Senior Community Member
  • *
  • Posts: 6942
  • Hero Points: 531
Re: Q: Bad handling of local language characters in UTF8
« Reply #1 on: September 03, 2023, 11:40:25 PM »
By default "Col" status for Unicode files is in Utf-8 bytes. You can configure this to Utf-8 (bytes), Utf-16,  or Utf-32. (Options>Editing>General>Col Status Units). Note that when you select characters within a single line, a Utf-32 count of characters is always displayed.

Not sure why Tab doesn't work correctly for the second line. We will look into this.

Clark

  • SlickEdit Team Member
  • Senior Community Member
  • *
  • Posts: 6942
  • Hero Points: 531
Re: Q: Bad handling of local language characters in UTF8
« Reply #2 on: September 04, 2023, 12:09:59 AM »
Indenting issue fixed for v28 beta 3. Also, hot fix added to v27.0.2 for this. Thanks for finding this.
« Last Edit: September 04, 2023, 02:16:33 PM by Clark »