But there may be times when you want to hide these characters to view your document as it will be printed. We’ll show you to easily show and hide these characters. NOTE: We used Word 2. To display specific non- printing characters, click the “File” tab. On the backstage screen, click “Options” in the list of items on the left. How can I find corrupted characters in a text file? If you have a text file. From stackoverflow to just see the line of non ascii characters.

UTF-8 is Unicode with all the simple characters mapped back to their original ASCII. So most 'normal' characters are 1 byte, and anything special or unusual is 2 bytes wide. So pretty much anything should be acceptable. Can you give an example of one of the non-UTF-8 code points that is causing you problems? Steve 'Every program can be reduced by one instruction, and every program has at least one bug. Therefore, any program can be reduced to one instruction which doesn't work.' (Object::PerlDesignPatterns) RE: Find and remove non UTF-8 characters (Programmer).

DEZ = decimal We need to check the source, and work through the chain until we find where the bad conversion occurs. Look at the SQL Server table definition. Are the columns with the problem data defined as NCHAR, NVARCHAR, or NTEXT? Use Query Analyzer to select a few rows - do they look OK on the screen?

Then check the Access Table - do they look OK there? Steve 'Every program can be reduced by one instruction, and every program has at least one bug. Therefore, any program can be reduced to one instruction which doesn't work.' (Object::PerlDesignPatterns) RE: Find and remove non UTF-8 characters (Programmer). So does Chr(226) & Chr(128) & Chr(156/7) represent the fancy beginning and end double quotes?

It renders as other special characters. Is there a long that represents those values so I can replace them? Could I use the Asc function somehow to accomplish this? There are actually many special characters that could occur. What if I found out the length of the character in bytes and just removed anything that was longer than 1 byte? How would I figure out the length? RE: Find and remove non UTF-8 characters (Programmer) 7 Jun 07 16:41.

Ifmo114, Yes, and yes it will render as other characters if viewed in ASCII (single byte structure). You can do the conversion to a long value 226 x (256) 2 + 128 x (256) 1 + 116 = 14844060 which I tried but didn't work since the Replace() function expects the Replace value to be a string. If you could get the value from the table field into a byte array without the unicode padding (a simple assignement statement will take ASCII text and pad it to two bytes) you could use a loop of the byte array to pull out only the ASCII characters using the value of the first byte to determine the character length in bytes. In the following example b is a byte array I'm populating from a text file using a Get statement.

Not only would you want to read just a certain number of rows into a buffer (for processing) at a time, but there is no reason to rely on RegEx or string comparisons for discovering special characters. For better performance, simply take every two bytes (it's encoded as Unicode-16, right?) as a 16-bit number and check to see if it falls within the range of 48-57 (numbers), 65-90 (upper-case letters), or 97-122 (lower-case letters). See ASCII/Unicode table for more details. Hope that helps! UTF 16 is varriable lenght, 1 or 2 byte per Character/Code Point.

For string comparsion, never compare bytes! That is bound to fall on it's face. View it as a string. Compare it as a string. Process it as a string.

Yes it is slower, but only because it inlcudes all the special cases that byte comparsion will not. Let's talk about MVVM: http://social.msdn.microsoft.com/Forums/en-US/wpf/thread/b1a8bf14-4acd-4d77-9df8-bdb95b02dbe2. Hi Christopher; thanks for your response. Free Handbook Of Pulp And Paper Technology. The offered solution assumed that it was already known that the files were encoded with one 16-bit code unit per character. UTF-16 is variable length, but not as 1 or 2 bytes as you mentioned-- it's 1 or 2 code units, which in this case would be 1 or 2 16-bit code units.