From: jason@HDCBBS.remove-11kl-this

To: Digital Man
Re: The future of SMB (Synchr
By: Digital Man to Nightfox on Mon Apr 08 2019 05:03 pm

They're just ideas. Performance, reliability, and extensibility. That's the main thing I'm after in any changes to any file formats (where it matters).

Are you thinking of using 1 sqlite database for all the message areas or are you thinking of having a sqlite file for each area specifically?

Well I'm mainly interested in input from folks who've designed database schemas. I want to try to do it right the first time (naturally).

I've been working with SQL for several years and have built out entire online CRM systems from scratch using PHP, MySQL, and more recently using Laravel and sqlite database files. I have also built Windows based client/server apps using Microsoft SQL Server on the backend, but that is way overkill compared to SQLite.

Needless to say, I would be happy to try and help in any way I can.

Thanks,
Jason

---
þ Synchronet þ Hard Drive Cafe - hdcbbs.com
--- Synchronet 3.17c-Win32 NewsLink 1.110
* Vertrauen - Riverside County, California - telnet://vert.synchro.net

--- SoupGate-Win32 v1.05
* Origin: www.darkrealms.ca (1:229/2)

From: digital.man@vert.synchro.net.remove-u6w-this

To: Jason
Re: The future of SMB (Synchr
By: Jason to Digital Man on Mon Apr 29 2019 10:48 pm

Re: The future of SMB (Synchr
By: Digital Man to Nightfox on Mon Apr 08 2019 05:03 pm

They're just ideas. Performance, reliability, and extensibility. That's the main thing I'm after in any changes to any file formats (where it matters).

Are you thinking of using 1 sqlite database for all the message areas or are you thinking of having a sqlite file for each area specifically?

One sqlite file for each area.

Well I'm mainly interested in input from folks who've designed database schemas. I want to try to do it right the first time (naturally).

I've been working with SQL for several years and have built out entire online CRM systems from scratch using PHP, MySQL, and more recently using Laravel and sqlite database files. I have also built Windows based client/server apps using Microsoft SQL Server on the backend, but that is way overkill compared to SQLite.

Needless to say, I would be happy to try and help in any way I can.

I plan to do a lot more research before designing the database schema. You can see the other discussions here already on this topic. If you have anything valuable to add in regards to data de-duplication, I'm all ears.

digital man

Synchronet/BBS Terminology Definition #3:
ASCII = American Standard Code for Information Interchange
Norco, CA WX: 56.9øF, 85.0% humidity, 6 mph ESE wind, 0.00 inches rain/24hrs --- Synchronet 3.17c-Win32 NewsLink 1.110
* Vertrauen - Riverside County, California - telnet://vert.synchro.net

--- SoupGate-Win32 v1.05
* Origin: www.darkrealms.ca (1:229/2)

From: jason@HDCBBS.remove-c1i-this

To: Digital Man
Re: The future of SMB (Synchr
By: Jason to Digital Man on Mon Apr 29 2019 10:48 pm

Re: The future of SMB (Synchr
By: Digital Man to Nightfox on Mon Apr 08 2019 05:03 pm

They're just ideas. Performance, reliability, and extensibility. That's the main thing I'm after in any changes to any file formats (where it matters).

Are you thinking of using 1 sqlite database for all the message areas or are you thinking of having a sqlite file for each area specifically?

Well I'm mainly interested in input from folks who've designed database schemas. I want to try to do it right the first time (naturally).

I've been working with SQL for several years and have built out entire online CRM systems from scratch using PHP, MySQL, and more recently using Laravel and sqlite database files. I have also built Windows based client/server apps using Microsoft SQL Server on the backend, but that is way overkill compared to SQLite.

Needless to say, I would be happy to try and help in any way I can.

Thanks,
Jason

Lol.. I guess i was very late to the game on this one.. my bad!! :)

Jason

---
þ Synchronet þ Hard Drive Cafe - hdcbbs.com
--- Synchronet 3.17c-Win32 NewsLink 1.110
* Vertrauen - Riverside County, California - telnet://vert.synchro.net

--- SoupGate-Win32 v1.05
* Origin: www.darkrealms.ca (1:229/2)

From: jason@HDCBBS.remove-qul-this

To: Digital Man
Re: The future of SMB (Synchr
By: Digital Man to Jason on Mon Apr 29 2019 09:42 pm

I plan to do a lot more research before designing the database schema. You can see the other discussions here already on this topic. If you have anything valuable to add in regards to data de-duplication, I'm all ears.

Other than thinking about using a json field in the table to say who the message belongs to, or what headers belong to the post using a json field so you don't have to create multiple records to say which headers belong to a message or to whom the message is meant for... In all the messages i read here, i don't think i have seen anyone mention using a json field.. Maybe thats helpful? would prevent a lot of records from being needlessly created..

As far as the 1 database or multiple databases, i can see the advantages and potential drawbacks to both, but i think they are both sound arguments. Of course this is just an opinion not a statement of fact.

I do see that either way you go, you'll still probably end up having to update or create a new "SMBUTIL" helper to do maintenance on the databases either way... There is an auto vacuum mode, but i have experienced performance issues using it.. So kind of like you have now "Self Packing" and "Fast Allocation".. Then for funzies, you could create a "Hyper Allocation" mode where all the message areas are put into 1 file rather than multiple.. And like it's current setup, you can't switch between them without starting over for that message area...

Hope some of that was helpful... :)

Jason

---
þ Synchronet þ Hard Drive Cafe - hdcbbs.com
--- Synchronet 3.17c-Win32 NewsLink 1.110
* Vertrauen - Riverside County, California - telnet://vert.synchro.net

--- SoupGate-Win32 v1.05
* Origin: www.darkrealms.ca (1:229/2)