寻找任何工具来检测字符串的类型为Unicode [关闭]

Question

I'm looking for any tool to detect the type of the string to it's Unicode !

I have data stored at the database in the format "سورة الناس" it equivalent to data in Arabic to "سورة الناس"

I 'm trying to do that because I'm working on Arabic framework and it uses a special kind of Unicode conversion that I don't know

Answer 1

From the example, it seems that the data is simply UTF-8 encoded. The string “"سورة الناس” is what you get if you have the text “سورة الناس” as UTF-8 encoded and you misinterpret it as windows-1252 encoded.

So if all data is like that, you don’t need any conversions. You should simply do all the character processing on the basis of the UTF-8 encoding.

When working with PHP, the answers to the question UTF-8 all the way through are probably very useful.