Hey DM,
Do you recall a while ago I reported that if I received email whilest reading email, the when I go to the newly received email that it would render blank?
IE: If I was reading 3 of 5 messages, and message number 6 came in. When I read the next message, it would say 4 of 6, and message 6 would render blank.
At first I thought it was related to email, but it is also related to incoming netmail.
Well, I havent revisted debugging this for a while, but today I was ping ponging areafix messages with a hub and noticed the issue again - it happened everytime I was reading (E-R), however the newly rendered messages were not always blank. In some cases it was a message (or part therof) of an echomail, or it was some old netmails. IE: I think there is a message pointer corruption of some sort.
Threw me off for a bit, because I was getting human messages from areafix :)
Re: Blank Netmail revisited
By: Digital Man to Alterego on Sat Sep 21 2019 10:46 am
Interesting. If you give me steps on how to reproduce/observe the issue, then I'm sure it can be fixed.
So, we tried this a bit last time, and you couldnt reproduce it on Vert - the things that I recall that are different:
* I'm in linux
* I'm using pure defaults - so my email reading is not the new lightbar navigation (that I think you are working on) - its the old "Mail Waiting" with the list.
* My mail waiting list was "Oldest First", whereas you had "Newest First". That kinda does make a difference, because, when reading I go from 4 of 5, to 5 of 6 to 6 of 6. (where 6 is not correctly rendered). Its only rendered properly if I leave reading messages and go back in again.
* While still reading messages, I've posted a message on the console using jsexec postmsg. (Thats how I intereact with areafix - so binkd has sent something out and gets a reply).
* The incoming response to areafix generates a Telegram (normal)
* Reading the new message (whether it is 1 or more), results in either blank rendering, or rendering the incorrect content of each new message (but the message header (subject to, from, date appear appropriate - and dont match the email rendered (if one is)).
* I'm not using SyncTerm when reading messages - I'm using iTerm on my mac.
So the two areas that I thought might be related are:
* I'm reading email, when one is posted in the console. That send message doesnt appear visible to me - I can only see it from ;mail
* I'm not using a CP437 terminal.
I'm happy to test those two scenarios further if they may be related.
If there is debugging that can show messages id's(?) of the message posted by jsexec and the replies that come in via sbbsecho and what the email reader is rendering - I can turn that tracing on.
Interesting. If you give me steps on how to reproduce/observe the issue,then I'm sure it can be fixed.
So the two areas that I thought might be related are:
* I'm not using a CP437 terminal.
Re: Blank Netmail revisited
By: Alterego to Digital Man on Sun Sep 22 2019 11:14 am
Re: Blank Netmail revisited
By: Digital Man to Alterego on Sat Sep 21 2019 10:46 am
Interesting. If you give me steps on how to reproduce/observe the issue, then I'm sure it can be fixed.
So, we tried this a bit last time, and you couldnt reproduce it on Vert - the things that I recall that are different:
* I'm in linux
Yeah, me too.
* I'm using pure defaults - so my email reading is not the new lightbar navigation (that I think you are working on) - its the old "Mail Waiting" with the list.
Yeah, me too.
* My mail waiting list was "Oldest First", whereas you had "Newest First". That kinda does make a difference, because, when reading I go from 4 of 5, to 5 of 6 to 6 of 6. (where 6 is not correctly rendered). Its only rendered properly if I leave reading messages and go back in again.
What if you use the command (!) to toggle the reading order? Does that fix the issue or what happens?
* While still reading messages, I've posted a message on the console using jsexec postmsg. (Thats how I intereact with areafix - so binkd has sent something out and gets a reply).
* The incoming response to areafix generates a Telegram (normal)
* Reading the new message (whether it is 1 or more), results in either blank rendering, or rendering the incorrect content of each new message (but the message header (subject to, from, date appear appropriate - and dont match the email rendered (if one is)).
* I'm not using SyncTerm when reading messages - I'm using iTerm on my mac.
So the two areas that I thought might be related are:
* I'm reading email, when one is posted in the console. That send message doesnt appear visible to me - I can only see it from ;mail
Unless you indicate that the sender of the message is you (your user number), then yes, you won't be able to see/kill that mail without using ;mail.
* I'm not using a CP437 terminal.
I don't see the relevance.
I'm happy to test those two scenarios further if they may be related.
I don't think so. It sounds like more of an issue with the *incoming* mail, not the new outgoing mail that you're creating with jsexec.
If there is debugging that can show messages id's(?) of the message posted by jsexec and the replies that come in via sbbsecho and what the email reader is rendering - I can turn that tracing on.
I'm guessing it has something to do with the auto-reloading of the mail base when new messages (for you) arrive. However, that should trigger a reload of the mail base in the same way that the '!' and 'V' commands do. And I haven't observed any issues with using those commands.
Have you run chksmb on your mailbase to check for corruption?
What if you use the command (!) to toggle the reading order? Does that fixthe issue or what happens?
I'm guessing it has something to do with the auto-reloading of the mailbase when new messages (for you) arrive. However, that should trigger a reload
of the mail base in the same way that the '!' and 'V' commands do. And Ihaven't observed any issues with using those commands.
Have you run chksmb on your mailbase to check for corruption?
2019-09-22 15:29:18 AREAFIX (432:1/100) To: Deon George (432:1/142) Imported
smbutil showed this as #772 (101) (but I've sent this message twice over thelast 2 days).
smbutil showed this as #774 (103)...ëîå*
Re: Blank Netmail revisited
By: Digital Man to Alterego on Sat Sep 21 2019 08:07 pm
What if you use the command (!) to toggle the reading order? Does that fix the issue or what happens?
I'm guessing it has something to do with the auto-reloading of the mail base when new messages (for you) arrive. However, that should trigger a reload
of the mail base in the same way that the '!' and 'V' commands do. And I haven't observed any issues with using those commands.
No difference (IE: still renders incorrectly). I pressed "!" and "V" after I received a new message - the message rendered was incorrect. IE: The rendered message had the same text, but it was not the right text for the message, and pressing "!", and "V", if they refresh reading the messages, it continued to read the wrong message content (but it was the same content each time).
Have you run chksmb on your mailbase to check for corruption?
I have chkcmb -p mail.[0-4] showed no errors.
What may be related(?), as I say, I jsexec postmsg from the CLI using this:
jsexec postmsg.js -t${TO} -n${FTN} "-f${FROM}" "-s${PASS}" mail
$FROM = "Deon George" - which is my "Real Name" according to uedit.(I cannot see those messages unless I use ";mail" - shouldnt I?).
They replies come back to Deon George - and I can see the replies. IE: sbbsecho.log shows:
2019-09-22 15:29:18 AREAFIX (432:1/100) To: Deon George (432:1/142) Imported
So I'm wondering why I cant see those messages using E-K (yet I can see replies addressed to that name).
Also, I'm thinking the incorrectly rendered content is the content in the "sent" netmail - but that might just be a coincidence. I've seen it a few times now.
IE: On my last test, the message content showed:
=VK_ECHOIRLP D=365
smbutil showed this as #772 (101) (but I've sent this message twice over the last 2 days).
When I went out and reviewed the message again, it was:
Your AREAFIX request has been processed
Command: =VK_PEDALRADIO [D=365]
Result: Rescanned 1 messages
smbutil showed this as #774 (103)
Re: Blank Netmail revisited
By: Digital Man to Alterego on Sun Sep 22 2019 12:32 am
It's the from user *number* that indicates mail sent from you, not the name:
-e<number> set 'from' user number
So you'd have to use that postmsg.js option to indicate *your* user number as the sender.
So what does it default to if not specified?
I haven't been able to reproduce the problem with the given information. Have you tried reproducing it here on Vertrauen or on any other BBS?
No. I did try on vert a while ago, but didnt try too hard, as it was too slow getting netmail to it.
It's the from user *number* that indicates mail sent from you, not thename:
-e<number> set 'from' user numberas the sender.
So you'd have to use that postmsg.js option to indicate *your* user number
I haven't been able to reproduce the problem with the given information.Have you tried reproducing it here on Vertrauen or on any other BBS?
So what does it default to if not specified?0 (not a local user).
Can you reproduce it by just sending yourself email messages usingpostmsg.js?
Re: Blank Netmail revisited
By: Digital Man to Alterego on Sun Sep 22 2019 04:33 pm
So what does it default to if not specified?0 (not a local user).
Hmm... ok.
Can you reproduce it by just sending yourself email messages using postmsg.js?
I can.
I can only see the message if I have -u1 (ie: "-tDeon George" or "-tAlterego" I cannot see the message unless I use ;mail - this to me doesnt seem right).
But, if I have -u1 I see that there is another message ready for me to read, however, when I get to it, it has rendered the content of another message). Leaving mail and going back in, I can see the correct content.
Should I try this as another user, and not use 1?
That's the same test case I've been using and have not been able toreproduce the reported problem.
Re: Blank Netmail revisited
By: Digital Man to Alterego on Sun Sep 22 2019 07:55 pm
That's the same test case I've been using and have not been able to reproduce the reported problem.
OK, I've done some more digging.
"chksmb mail" dumps a heap of info but says "mail Message Base is OK" - so based on this I thought it was ok right?
I have never done any message base maintenance - and I read somewhere that "mail" is handled by sbbs directly so there is no need right?
So I spun up another instance of sbbs (no existing data, ie: new install) - and confirm that the problem I'm having does NOT exist.
So I copied my users.dat to my new instance - and still no problem. (Couldnt log in with my user though, had to login with "1"?)
I then copied my mail.* files (mail.??? and mail.[0-4].???) to my new instance and the problem existed - so mail corruption? chksmb didnt think so.
I then ran "smbutil m mail" - it did its thing, didnt show an error, but problem still exists.
I then ran "smbutil p mail" - it did its thing, didnt show an error, problem resolved!
So, should I need to do smbutil p mail - did I read that netmail mail database is managed automatically?
Before I do smbutil p mail on my live bbs, did you want me to do any more analysis on my mail files - as it appears it is not happy with something in those files?
You could send me the mail.* files that are bad and I could have alook-see.
Re: Blank Netmail revisited
By: Digital Man to Alterego on Mon Sep 23 2019 12:09 pm
You could send me the mail.* files that are bad and I could have a look-see.
OK, I uploaded my mail.* files.
Here is what I could do to reproduce the issue.
I had a script "testmail.sh"
#!/bin/bash
TO="Deon George"
FROM="Deon George"
PASS="Test"
echo $@ |jsexec postmsg.js "-t${TO}" -u1 "-f${FROM}" "-s${PASS}" mail
===
while reading message 2:
* ./testmail.sh test19
* ENTER
* ENTER (now message 4) - renders correctly
* ./testmail.sh test20
* "R"
* ENTER (now message 5)
Message 5 renders "Hey th" (a past message).
Re: Blank Netmail revisited
By: Digital Man to Alterego on Mon Sep 23 2019 10:57 pm
OK, I uploaded my mail.* files.Where?
I looked onto vert, and did E-A (from the main menu) to user id 1
Re: Blank Netmail revisited
By: Digital Man to Alterego on Mon Sep 23 2019 10:57 pm
echo $@ |jsexec postmsg.js "-t${TO}" -u1 "-f${FROM}" "-s${PASS}" mailWhy's the echo $@ needed?
So I dont have to do echo $1 $2 (and an arbitary number of positional parameters).
echo $@ |jsexec postmsg.js "-t${TO}" -u1 "-f${FROM}" "-s${PASS}" mailWhy's the echo $@ needed?
OK, I uploaded my mail.* files.Where?
I looked onto vert, and did E-A (from the main menu) to user id 1Okay, got it.
Re: Blank Netmail revisited
By: Digital Man to Alterego on Mon Sep 23 2019 11:47 pm
I looked onto vert, and did E-A (from the main menu) to user id 1Okay, got it.
Cool - did you find anything?
Not yet. You sent me multiple versions of your mail base. (mail.*,mail.0.*, etc.). Which of these sets demonstrate the issue?
You said the issue went away after packing the base, were these archivedbefore you packed the base or after?
Re: Blank Netmail revisited
By: Alterego to Digital Man on Tue Sep 24 2019 03:50 pm
Re: Blank Netmail revisited
By: Digital Man to Alterego on Mon Sep 23 2019 12:09 pm
You could send me the mail.* files that are bad and I could have a look-see.
OK, I uploaded my mail.* files.
Where?
Here is what I could do to reproduce the issue.
I had a script "testmail.sh"
#!/bin/bash
TO="Deon George"
FROM="Deon George"
PASS="Test"
echo $@ |jsexec postmsg.js "-t${TO}" -u1 "-f${FROM}" "-s${PASS}" mail
Why's the echo $@ needed?
| Sysop: | sneaky |
|---|---|
| Location: | Ashburton,NZ |
| Users: | 31 |
| Nodes: | 8 (0 / 8) |
| Uptime: | 102:00:02 |
| Calls: | 2,071 |
| Calls today: | 1 |
| Files: | 11,134 |
| Messages: | 946,994 |