• Mutil Use Text import to message base

    From Beery@21:4/109 to All on Tuesday, May 29, 2018 21:58:54
    Got a question before I do an import to a message base.

    I will soon launch a script that will write out an INI file for Mutil to add approximately 15,000 files (text files) from a former usenet newsgroup into a message base. It is setup as an echmomail group linked to a usenet feed.

    Does anyone know that when I do this, will my system try to send out these
    new messages out? What if I temporarily have it set as local mail then
    change it back out to echomail? Will changing the group out as echomail trigger those messages to be sent out?

    Thanks for any feedback.

    Beery

    --Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

    --- Mystic BBS v1.12 A39 2018/04/21 (Windows/64)
    * Origin: 9640 News BBS (21:4/109)
  • From apam@21:1/125 to Beery on Wednesday, May 30, 2018 12:18:39
    Got a question before I do an import to a message base.

    I will soon launch a script that will write out an INI file for Mutil
    to add approximately 15,000 files (text files) from a former usenet newsgroup into a message base. It is setup as an echmomail group
    linked to a usenet feed.

    Does anyone know that when I do this, will my system try to send out
    these new messages out? What if I temporarily have it set as local
    mail then change it back out to echomail? Will changing the group
    out as echomail trigger those messages to be sent out?

    I think it will send them out. If it has a local flag set and no sent
    flag set, then they will send I think.

    Maybe try 1 or 2 and see what happens before importing 15k

    Andrew

    --- MagickaBBS v0.11alpha (Linux/x86_64)
    * Origin: Exotica BBS - telnet://exoticabbs.com:2023/ (21:1/125)
  • From Beery@21:4/109 to apam on Wednesday, May 30, 2018 07:11:37
    Yeah, will definitely need to do some testing.

    Not sure what happens if a group is "local", then the configuration changed
    to be echomail. It would be interesting to see/know what happens with the
    sent flag if it would think all the messages in that area would need to be sent.

    And if it still thinks they need to be sent, not exactly sure how to override it other than a timely shutdown of the server and deleting the packets.

    Beery

    --Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

    --- Mystic BBS v1.12 A39 2018/04/21 (Windows/64)
    * Origin: 9640 News BBS (21:4/109)
  • From Vk3jed@21:1/109 to Beery on Wednesday, May 30, 2018 13:33:00
    Beery wrote to All <=-

    Got a question before I do an import to a message base.

    I will soon launch a script that will write out an INI file for Mutil
    to add approximately 15,000 files (text files) from a former usenet newsgroup into a message base. It is setup as an echmomail group
    linked to a usenet feed.

    Does anyone know that when I do this, will my system try to send out
    these new messages out? What if I temporarily have it set as local

    Yes, text file postings appear as local messages to be scanned and packed up for all of your links.

    mail then change it back out to echomail? Will changing the group out
    as echomail trigger those messages to be sent out?

    Don't know about that. You could mark your links inactive, import the messages, run mutil to scan the messages (should update the export pointers), then re-activate your links.

    Or, poll affected links first, until no mail flows, then disable all polling. Import messages, scan the messagebase, delete all outbound mail bundles (which should now only contain the newly scanned messages), then re-enable polling.

    Just a couple of ideas.


    ... The manner in which it is given is worth more than the gift.
    === MultiMail/Win32 v0.49
    --- SBBSecho 3.03-Linux
    * Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)
  • From Avon@21:1/101 to Beery on Thursday, May 31, 2018 20:20:21

    On 05/29/18, Beery pondered and said...

    I will soon launch a script that will write out an INI file for Mutil to add approximately 15,000 files (text files) from a former usenet
    newsgroup into a message base. It is setup as an echmomail group linked to a usenet feed.

    How are you planning to do this? I mean are you importing a JAM base or are
    you posting txt files as messages in to a JAM base?

    --- Mystic BBS v1.12 A39 2018/04/21 (Windows/32)
    * Origin: Agency BBS | Dunedin, New Zealand | agency.bbs.nz (21:1/101)
  • From Beery@21:4/109 to Avon on Thursday, May 31, 2018 21:03:42
    I am posting text files into a JAM base. Previously, these were messages on that comp.sys.ti usenet newsgroup. Someone ran some web crawler software for me and was able to dump everything (15,000+) messages for me.

    It's not the same as getting the feeds as a lot of formatting has been lost, however it is all I have at the moment, and something is better than nothing.

    Beery


    On 05/29/18, Beery pondered and said...

    I will soon launch a script that will write out an INI file for Mutil add approximately 15,000 files (text files) from a former usenet newsgroup into a message base. It is setup as an echmomail group lin to a usenet feed.

    How are you planning to do this? I mean are you importing a JAM base or are you posting txt files as messages in to a JAM base?

    --- Mystic BBS v1.12 A39 2018/04/21 (Windows/32)
    * Origin: Agency BBS | Dunedin, New Zealand | agency.bbs.nz (21:1/101)

    --Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

    --- Mystic BBS v1.12 A39 2018/04/21 (Windows/64)
    * Origin: 9640 News BBS (21:4/109)
  • From Beery@21:4/109 to Avon on Thursday, May 31, 2018 21:10:26
    I should also mention the web crawler dumped the messages as individual
    files. The user that did this, then did some kind of import that gave me the author of the message, subject, date, and body of the message and put it into an Excel database.

    From there, I was able to run a script that wrote out an INI file, and
    15,000+ text files. The INI file was formatted to bring those messages into the JAM base with all the configuration settings. That INI file had
    something like 90,000+ lines.

    I've done this for a YahooGroup in the past without issue. This is the first time for a usenet newsgroup.

    My first time running MUTIL and the INI file, something hung up and didn't
    get past the first message. Gotta figure out what is different. The one
    thing I know for sure that is different, is it is a different version of
    MUTIL. Need to dig more to figure out if it is me, or if something has changed...........

    Beery

    --Beery Miller -- 9640 News BBS -- 9640news.ddns.net:9640 --

    --- Mystic BBS v1.12 A39 2018/04/21 (Windows/64)
    * Origin: 9640 News BBS (21:4/109)