Hi

One of users of my extension send me a very strange bug report.
> I think I may have found a bug.  Was composing an email, and I saved it, and when I reopened it, there was the "greater than" character (HTML "&gt") inserted right before a capital F in the text:

After tests I found this bug is not related to my extension, but to 
Thunderbird itself.

Here are steeps required to reproduce this bug:

1) Open new HTML mail.
2) Type "From " (characters case and trailing space matters)
3) Press [CTRL+S], save in Drafts.
4) now go to Drafts, and see message... it become ">From " (">From " 
in HTML source)


My TB:
Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105

Can someone verify this bug?
I dig Bugzilla, but i don't found this ot similar bug.


-- 
Arivald

Hi Arivald,

can't see that with my TB version 2.0.0.18 (20081105) en-US installation.
Checked with composing a HTML and a plain msg. Also the 'view source' 
doesn't has that &gr.

Just to double check:
I have entered to the compose text area as the very first entry
From

.... nothing else

gW

On 25.11.2008 15:09 »Arivald« wrote
> Hi
>
> One of users of my extension send me a very strange bug report.
>> I think I may have found a bug.  Was composing an email, and I saved 
>> it, and when I reopened it, there was the "greater than" character 
>> (HTML "&gt") inserted right before a capital F in the text:
>
> After tests I found this bug is not related to my extension, but to 
> Thunderbird itself.
>
> Here are steeps required to reproduce this bug:
>
> 1) Open new HTML mail.
> 2) Type "From " (characters case and trailing space matters)
> 3) Press [CTRL+S], save in Drafts.
> 4) now go to Drafts, and see message... it become ">From " (">From 
> " in HTML source)
>
>
> My TB:
> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105
>
> Can someone verify this bug?
> I dig Bugzilla, but i don't found this ot similar bug.
>
>

gNeandr pisze:
> Hi Arivald,
> 
> can't see that with my TB version 2.0.0.18 (20081105) en-US installation.
> Checked with composing a HTML and a plain msg. Also the 'view source' 
> doesn't has that &gr.
> 
> Just to double check:
> I have entered to the compose text area as the very first entry
> From
> 
> ... nothing else
> 
> gW
> 


Thanks for checking, but...

1) Are you sure you do it in HTML mode? Plain-text is unaffected.

2) Tricky part:
   1) Save message in "Drafts",
   2) and then open it (again) from "Drafts".

Original message in Composer window You use to save will remain unchanged.
You may have opened two copies of message, one original, and one opened 
from "Drafts", and only copy from "Drafts" gets additional ">".

-- 
Arivald

Arivald wrote:
> Hi
>
> One of users of my extension send me a very strange bug report.
>   
>> I think I may have found a bug.  Was composing an email, and I saved it, and when I reopened it, there was the "greater than" character (HTML "&gt") inserted right before a capital F in the text:
>>     
>
> After tests I found this bug is not related to my extension, but to 
> Thunderbird itself.
>
> Here are steeps required to reproduce this bug:
>
> 1) Open new HTML mail.
> 2) Type "From " (characters case and trailing space matters)
> 3) Press [CTRL+S], save in Drafts.
> 4) now go to Drafts, and see message... it become ">From " (">From " 
> in HTML source)
>
>
> My TB:
> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105
>
> Can someone verify this bug?
> I dig Bugzilla, but i don't found this ot similar bug.
>
>
>   
Yes, I reproduce that, tb2 and 3, not using stationery (test profile in 3)


Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.18) 
Gecko/20081105 Lightning/0.9 Thunderbird/2.0.0.18 - Build ID: 2008110519

Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1b2pre) 
Gecko/20081124 Shredder/3.0b1pre ID:20081124033907

On Tue, 25 Nov 2008 15:09:28 +0100, Arivald wrote:

> One of users of my extension send me a very strange bug report.
>> I think I may have found a bug.  Was composing an email, and I saved it, and when I reopened it, there was the "greater than" character (HTML "&gt") inserted right before a capital F in the text:
> 
> After tests I found this bug is not related to my extension, but to 
> Thunderbird itself.
> 
> Here are steeps required to reproduce this bug:
> 
> 1) Open new HTML mail.
> 2) Type "From " (characters case and trailing space matters)
> 3) Press [CTRL+S], save in Drafts.
> 4) now go to Drafts, and see message... it become ">From " (">From " 
> in HTML source)
> 
> 
> My TB:
> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105
> 
> Can someone verify this bug?
> I dig Bugzilla, but i don't found this ot similar bug.

<http://homepages.tesco.net./~J.deBoynePollard/FGA/mail-mbox-formats.html>

This is a bug in the sense that the ">" shouldn't be escaped into &gt;
Actually I'm not sure how html mail should be stored in a mbox file so
this may be a bug on multiple levels.

Phil

-- 
Philip Chee <philip@aleytys.pc.my>, <philip.chee@gmail.com>
http://flashblock.mozdev.org/ http://xsidebar.mozdev.org
Guard us from the she-wolf and the wolf, and guard us from the thief,
oh Night, and so be good for us to pass.

Philip Chee wrote:
> On Tue, 25 Nov 2008 15:09:28 +0100, Arivald wrote:
>> One of users of my extension send me a very strange bug report.
>>     
>>> I think I may have found a bug.  Was composing an email, and I saved it, and when I reopened it, there was the "greater than" character (HTML "&gt") inserted right before a capital F in the text:
>>>       
>> After tests I found this bug is not related to my extension, but to 
>> Thunderbird itself.
>>
>> Here are steeps required to reproduce this bug:
>>
>> 1) Open new HTML mail.
>> 2) Type "From " (characters case and trailing space matters)
>> 3) Press [CTRL+S], save in Drafts.
>> 4) now go to Drafts, and see message... it become ">From " (">From " 
>> in HTML source)
>>
>>
>> My TB:
>> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105
>>
>> Can someone verify this bug?
>> I dig Bugzilla, but i don't found this ot similar bug.
>>     
>
> <http://homepages.tesco.net./~J.deBoynePollard/FGA/mail-mbox-formats.html>
>
> This is a bug in the sense that the ">" shouldn't be escaped into &gt;
> Actually I'm not sure how html mail should be stored in a mbox file so
> this may be a bug on multiple levels.
>
> Phil
>
>   

For me only on Local Folders, I see the '>From ' substitution. Drafts on
IMAP Folder work normally. Apparently only Local Folders use mboxo
format? In view source I also see normal '>', no escaping to &gt;...

Onno

On 25.11.2008 18:42 »Arivald« wrote
> Thanks for checking, but...
>
> 1) Are you sure you do it in HTML mode? Plain-text is unaffected.
>
> 2) Tricky part:
>   1) Save message in "Drafts",
>   2) and then open it (again) from "Drafts".
>
> Original message in Composer window You use to save will remain 
> unchanged.
> You may have opened two copies of message, one original, and one 
> opened from "Drafts", and only copy from "Drafts" gets additional ">".
>
Also the others have seen that situation, I have double checked and 
don't have it !

Yes, I was in HTML mode, yes I stored to Drafts. Yes, I closed the 
compose and open the stored draft from DRAFTS!


With 'view source' pointing on the Drafts folder with the message/draft 
I get:

    From - Tue Nov 25 20:13:50 2008
    X-Mozilla-Status: 0000
    X-Mozilla-Status2: 00000000
    X-Mozilla-Keys:                                                                                 
    FCC: mailbox://nobody@Local%20Folders/Sent
    X-Identity-Key: id1
    X-Mozilla-News-Host: news.mozilla.com
    Date: Tue, 25 Nov 2008 20:13:49 +0100
    From: gNeandr <neandr_NO@SPAM_gmx_._de>
    X-Mozilla-Draft-Info: internal/draft; vcard=0; receipt=0; uuencode=0
    User-Agent: Thunderbird 2.0.0.18 (Windows/20081105)
    MIME-Version: 1.0
    Newsgroups: mozilla.dev.apps.thunderbird
    X-Mozilla-News-Host: news.mozilla.com
    Subject: from in news
    Content-Type: text/html; charset=UTF-8
    Content-Transfer-Encoding: 7bit

    <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
    <html>
    <head>
    </head>
    <body bgcolor="#ffffff" text="#000000">
    <font face="Arial">From<br>
    <br>
    </font>
    </body>
    </html>
      

.... which seems to be OK. Also the opened draft has only the "From" in the compose window. And that's right FMPOV!??

</html>

On 25.11.2008 20:16 �Onno Ekker� wrote
> Philip Chee wrote:
>   
>> On Tue, 25 Nov 2008 15:09:28 +0100, Arivald wrote:
>>     
>>> One of users of my extension send me a very strange bug report.
>>>     
>>>       
>>>> I think I may have found a bug.  Was composing an email, and I saved it, and when I reopened it, there was the "greater than" character (HTML "&gt") inserted right before a capital F in the text:
>>>>       
>>>>         
>>> After tests I found this bug is not related to my extension, but to 
>>> Thunderbird itself.
>>>
>>> Here are steeps required to reproduce this bug:
>>>
>>> 1) Open new HTML mail.
>>> 2) Type "From " (characters case and trailing space matters)
>>> 3) Press [CTRL+S], save in Drafts.
>>> 4) now go to Drafts, and see message... it become ">From " (">From " 
>>> in HTML source)
>>>
>>>
>>> My TB:
>>> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105
>>>
>>> Can someone verify this bug?
>>> I dig Bugzilla, but i don't found this ot similar bug.
>>>     
>>>       
>> <http://homepages.tesco.net./~J.deBoynePollard/FGA/mail-mbox-formats.html>
>>
>> This is a bug in the sense that the ">" shouldn't be escaped into &gt;
>> Actually I'm not sure how html mail should be stored in a mbox file so
>> this may be a bug on multiple levels.
>>
>> Phil
>>
>>   
>>     
>
> For me only on Local Folders, I see the '>From ' substitution. Drafts on
> IMAP Folder work normally. Apparently only Local Folders use mboxo
> format? In view source I also see normal '>', no escaping to &gt;...
>
> Onno
>   
As said before I don't see it .. not with IMAP account, not with POP. 
But my setup is that ALL storing of drafts go into one DRAFT folder 
located in the 'Local Folders'

gNeandr pisze:
> On 25.11.2008 18:42 »Arivald« wrote
>> Thanks for checking, but...
>>
>> 1) Are you sure you do it in HTML mode? Plain-text is unaffected.
>>
>> 2) Tricky part:
>>   1) Save message in "Drafts",
>>   2) and then open it (again) from "Drafts".
>>
>> Original message in Composer window You use to save will remain 
>> unchanged.
>> You may have opened two copies of message, one original, and one 
>> opened from "Drafts", and only copy from "Drafts" gets additional ">".
>>
> Also the others have seen that situation, I have double checked and 
> don't have it !
> 
> Yes, I was in HTML mode, yes I stored to Drafts. Yes, I closed the 
> compose and open the stored draft from DRAFTS!
> 
> 
> With 'view source' pointing on the Drafts folder with the message/draft 
> I get:
> 
[...]
>    <body bgcolor="#ffffff" text="#000000">
>    <font face="Arial">From<br>
>    <br>
>     
> ... which seems to be OK. Also the opened draft has only the "From" in 
> the compose window. And that's right FMPOV!??
> 

As i check: <font> tag before "From " prevents '>' insertion. Maybe 
other tags works similar too.
Also, in your source HTML, there is no space _after_ "From".

-- 
Arivald

>>
>> This is a bug in the sense that the ">" shouldn't be escaped into >
>> Actually I'm not sure how html mail should be stored in a mbox file so
>> this may be a bug on multiple levels.
>>
>> Phil
>>
>>   
> 
> For me only on Local Folders, I see the '>From ' substitution. Drafts on
> IMAP Folder work normally. Apparently only Local Folders use mboxo
> format? In view source I also see normal '>', no escaping to >...
> 

In fact, in mbox message source it is ">From ".
">From " appears only when i reopen mail in composer, so i suspect 
composer/<editor> do '>' => '&gt;' substitution.

-- 
Arivald

Philip Chee pisze:
> On Tue, 25 Nov 2008 15:09:28 +0100, Arivald wrote:
> 
>> One of users of my extension send me a very strange bug report.
>>> I think I may have found a bug.  Was composing an email, and I saved it, and when I reopened it, there was the "greater than" character (HTML "&gt") inserted right before a capital F in the text:
>> After tests I found this bug is not related to my extension, but to 
>> Thunderbird itself.
>>
>> Here are steeps required to reproduce this bug:
>>
>> 1) Open new HTML mail.
>> 2) Type "From " (characters case and trailing space matters)
>> 3) Press [CTRL+S], save in Drafts.
>> 4) now go to Drafts, and see message... it become ">From " (">From " 
>> in HTML source)
>>
>>
>> My TB:
>> Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.18) Gecko/20081105
>>
>> Can someone verify this bug?
>> I dig Bugzilla, but i don't found this ot similar bug.
> 
> <http://homepages.tesco.net./~J.deBoynePollard/FGA/mail-mbox-formats.html>
> 
> This is a bug in the sense that the ">" shouldn't be escaped into &gt;
> Actually I'm not sure how html mail should be stored in a mbox file so
> this may be a bug on multiple levels.
> 
> Phil
> 

I check link you give... now i understand why it happen in mbox. But i 
think additional '>' should be stripped while message HTML is extracted 
from mbox.
Or maybe space (' ') should be used, like in plain-text messages? And 
this additional space is correctly removed from plain-text mails.

-- 
Arivald

Arivald wrote:
>>>
>>> This is a bug in the sense that the ">" shouldn't be escaped into >
>>> Actually I'm not sure how html mail should be stored in a mbox file so
>>> this may be a bug on multiple levels.
>>>
>>> Phil
>>>
>>>   
>>
>> For me only on Local Folders, I see the '>From ' substitution. Drafts on
>> IMAP Folder work normally. Apparently only Local Folders use mboxo
>> format? In view source I also see normal '>', no escaping to >...
>>
>
> In fact, in mbox message source it is ">From ".
> ">From " appears only when i reopen mail in composer, so i suspect
> composer/<editor> do '>' => '&gt;' substitution.

What exactly is Composer? Is it the same as "Insert HTML"? Is it an
extension?

Every '<', '>', and '&' is escaped when you edit a message as HTML,
because they have special meaning in HTML.

The only strange thing I see is that 'From ' lines get substituted by
'>From ' and it seems to happen
 in an irreversible way. On re-opening the editor can't just strip each
'>' from '>From ', because it would also strip that character from a
real line starting with '>From '...

From what I read in Phil's link, this only holds for the "mboxo" and
"mboxcl" formats. This line might get substituted in '>From what...'
when replying to this message. So you'll get lines like:
>From ...
>>From ...

Maybe Thunderbird could change the way internal messages are saved, so
it doesn't save them in an irreversible way. Maybe "mboxrd" or "mboxcl2"
is more convenient, because they don't change messages irreversibly?

Or maybe Thunderbird could change from mailbox to maildir format for
local messages?

Onno