Accented characters = white ?'s in black diamonds in some i/c messages

[HandsomeP]

When I receive some french emails, each accented letter is instead replaced by a white question mark inside a black diamond (�). This happens only with some incoming messages. Here is some data from the email header for one such message:

X-Mailer: AtMail 1.02
Content-Type: text/plain; charset="utf-8"

From what I've read, this is likely due to improper encoding by the mail program used to send the message, is that correct? Can this be rectified on my end?

With the message displayed, if I go to Other Actions -> Encoding and change the encoding from Unicode to Western European, the question marks are replaced by "é".

Thank you in advance for any help!

 

[GEWB]

The problem is you are not using the same character set as the sender.

If there's no equivalent for the code point they're trying to represent in the encoding you're trying to represent it in, you usually get a little question mark: ? or �.

Regards,
GEWB

 

[HandsomeP]

The problem is you are not using the same character set as the sender.

So even though I have configured Office to install/include the French "language pack" that won't help? I guess there's a fixed character set that is active, and Outlook cannot switch it on the fly before displaying an email based on some entry in the header of the message?

 

[GEWB]

This is the first time you said that Outlook is your email program - Outlook has been around about 15 years, what version are you using?

Can you open your email as Webmail (from your email provider)? If so, how do those emails look?

Regards,
GEWB

 

[HandsomeP]

I am using Outlook 2007. I'm not sure whether I have access to Webmail, I'll check.

Note that this issue affects approximately 10% of emails with accented characters. From what I can tell, the affected emails typically have UTF-8 at the start of the Subject line within the header file.

 

[GEWB]

(I hate Outlook, always have - I only use it for one mail account because I have to.)

Next, just to be sure, check to see that Outlook is indeed using unicode as upgrading from pre-2003 Outlook would use ANSI. From the Help:

Beginning with Microsoft Office Outlook 2003, a new Outlook Data File (.pst) format was introduced that supports multilingual Unicode data and offers greater storage capacity for items and folders. You can determine whether your Outlook Data Files (.pst) are in the current or earlier format.

1. Click the File tab.
2. On the Info tab, click Account Settings, and then click Account Settings.
3. On the Data Files tab, select the data file that you want to verify, and then click Settings.
4. Check the Format box to see if it contains the text Outlook Data File or Outlook Data File (97-2002). Outlook Data File indicates the new format that supports multilingual Unicode data and offers greater storage capacity for items and folders. This file format is incompatible with Outlook 97-2002. Outlook Data File (97-2002) indicates the earlier format that is compatible with all versions of Outlook.

From there one goes into user policies/settings and I'm not well versed in that related to Outlook.

Regards,
GEWB

 

[HandsomeP]

You're hunch was correct, I checked and the .pst file is in the earlier format (Personal Folders File (97-2002)). I just recently finished migrating my four PST files (different identities) from my old to my new computer, not sure if I'm up for the challenge of creating new ones again, importing each of the four PST's, configuring the four email accounts, etc. I also like having the pst files named a certain way (I have OCD)... In any case, I found the instructions to do it here:
Convert a non-Unicode data file (.pst) to a Unicode data file (.pst) - Outlook - Office.com

I'll post back again if I do the conversion. Thanks for your help in identifying the likely cause.

PS: Method 3 on:
http://www.slipstick.com/outlook/ansi-to-unicode.asp

might be a little more pain-free

 

[GEWB]

Great, I hope it works for you! If it does work, mark the thread as solved.

Note: close Outlook and copy your PST to a "safe" place just in case the conversion doesn't go as planned.

Regards,
GEWB