• More boring stuff...

    From Spectre@21:3/101 to Anyone on Wednesday, June 24, 2020 01:13:00
    How does everyone store their bulk data these days? Was a time I could just have a monster drive for "data" mount the smaller drives off that and let her rip, and that kept me going for years...

    More recently I fiddled about with jbod, probably NQR configuration led to troubles for me, where it didn't want to swap to new drives when there was some space it couldn't fit someting into so I'd get volume full all the time, and of course, I couldn't be sure where any actual data was stored... took a lot to unscramble that....

    Also thought about RAID for a bit, but I really don't have enough similar capacity devices of sufficient size to make it all worthwhile. Plus I hear bad things about MTBF and monster sized RAID arrays. If you have enough of an error on one drive, chances are theres another one somewhere due to the amount of space in use rendering your RAID array dud.

    I do have a tendency to like one monolithic slab of data, but that too comes with its own issues, when you inevitably have to shuffle data around... it never fits nicely onto smaller drives in order to re-arrange things.

    And this is the problem I find myself with now. I haven't managed a good run with drives over 2TB. They tend to like to fail for me :( I've been handed a 2.0TB drive which is mostly full, and find myself unable to copy the whole thing.... <sigh> Hence shuffling... and boy does it take time...

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Arelor@21:2/138 to Spectre on Saturday, June 27, 2020 15:38:25
    Re: More boring stuff...
    By: Spectre to Anyone on Wed Jun 24 2020 01:13 am

    How does everyone store their bulk data these days? Was a time I could just have a monster drive for "data" mount the smaller drives off that and let he rip, and that kept me going for years...

    If you are really dead serious you build a NAS (for home storage). Something like RAID 10 should do for monster deployments. FreeNAS with ZFS is a popular option. Prepare to spend kilobucks.

    For dead serious enterprise it would be Ceph or some cluster monster filesystem.

    I have an OpenBSD server (no raid) and just store data on different filesystems located on different raids. There are administrative reasons for that. Backup is done to external drives that are stored cold. OpenBSD is not the greatest platform if you want cool filesystem features which is by so many people chooses FreeBSD with ZFS.

    --
    gopher://gopher.operationalsecurity.es
    --- SBBSecho 3.11-Linux
    * Origin: Palantir * palantirbbs.ddns.net * Pensacola, FL * (21:2/138)
  • From Warpslide@21:3/110 to Spectre on Saturday, June 27, 2020 17:51:52
    On 24 Jun 2020, Spectre said the following...

    How does everyone store their bulk data these days?

    Also thought about RAID for a bit, but I really don't have enough
    similar capacity devices of sufficient size to make it all worthwhile.

    I do IT all day everyday & didn't want to have to end up "fixing" something
    at home or frankenstein'ing something together, so I ended up buying a Drobo
    5N NAS. The cool thing with Drobo is you can mix & match different sized drives and it'll "just work". I started out with three drives (2 1TB WD
    Black drives and one other Seagate 1TB I had laying around) - as needs
    changed I bought two more 4TB WD Red drives to fill the two remaining bays
    and (over time) swapped out the original 3 drives for 4TB Red's as well. (5 x 4TB = 20TB w/ 14.35TB usable after redundancy).

    There is an option to turn on dual drive redundancy if I wanted to be able to loose two drives at once, costing more free space, but I haven't seen
    the need to do that.

    Drobo isn't the most powerful NAS out there, but it serves my needs. The 5N2 has since come out with dual Ethernet jacks which would have been nice, along with a faster processor.

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From Nodoka Hanamura@21:2/106 to Spectre on Saturday, June 27, 2020 20:42:37
    On 24 Jun 2020, Spectre said the following...

    And this is the problem I find myself with now. I haven't managed a
    good run with drives over 2TB. They tend to like to fail for me :(
    I've been handed a 2.0TB drive which is mostly full, and find myself unable to copy the whole thing.... <sigh> Hence shuffling... and boy
    does it take time...

    I know how that is. A friend was kind enough to donate to me a 4TB SSHD, but the fucking thing kept having bad writes and locking up. I still need to get around to shipping that fucking thing back to Seagate. Yeah - it was a
    Seagate. Fucking piece of garbage.

    Born too late to experience the scene.
    Born just in time to see it come back.
    Nodoka Hanamura - NeoCincinnati BBS SYSOP - neocinci.bbs.io

    --- Mystic BBS v1.12 A44 2020/02/04 (Linux/32)
    * Origin: NeoCincinnati BBS - neocinci.bbs.io:23 (21:2/106)
  • From alterego@21:2/116 to Spectre on Sunday, June 28, 2020 10:51:41
    Re: More boring stuff...
    By: Spectre to Anyone on Wed Jun 24 2020 01:13 am

    How does everyone store their bulk data these days? Was a time I could just have a monster drive for "data" mount the smaller drives off that and let her rip, and that kept me going for years...

    So I used to have a QNAP with 1 drive with "files", 1 drive with personal data,
    and 1 drive which was a backup of the personal data.

    My data and personal data drives were filling, so I've invested in 3x8TB drives
    that I've put in my server (running ESXi), and installed freeNAS. Since I access the data mostly from my server, I thought I'd take one power device out of the loop.

    hear bad things about MTBF and monster sized RAID arrays. If you have enough of an error on one drive, chances are theres another one somewhere due to the amount of space in use rendering your RAID array dud.

    This is true - in the past I had a 2TB drive fail in a 3 drive RAID5 array, only to have the another drive fail during rebuild. Fortunately I was able to force the array to start with just the 2 drives and copied the data off to another drive.

    So yes, this is the bad thing with whole drive arrays, rebuild time is forever (even if the drives are under utilised) and during rebuild is the only time it touches every sector (and an error takes the drive offline).

    Switching over to FreeNAS and ZFS, the array is done at the file placement level (I believe), so a failed drive only needs to reassemble the array to the utilised capacity, not the capacity of the drive. Plus (IIRC), ZFS regularly checks write stripes, yells when it senses problems and moves the data while it
    can still be read with the other drives.

    (I'm new at FreeNAS - but remember reading up on ZFS years ago...)

    ...ëîåï

    ... For every action, there is an equal and opposite criticism.
    --- SBBSecho 3.11-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)
  • From Spectre@21:3/101 to Arelor on Sunday, June 28, 2020 13:45:00
    If you are really dead serious you build a NAS (for home storage). Something like RAID 10 should do for monster deployments.
    FreeNAS with ZFS is a popular option. Prepare to spend kilobucks.

    Hmm I'm not dead serious. Also seeing as most of my equipment comes off the side of the road, I need to make the most of what I have rather then just buying more equipment. That said, occasionally throwing money at the problem does seem to help.

    I spose I'm looking for ideas as much as anything. I'm presently poking about trying to organise 3 storage options.

    brightmatter - server with ~4gb in assorted drives
    T NAS - with 2 x 2Gb drives
    Sophos Router - with 1Gb on board and a 4Gb USB drive.

    All in, I don't think I have enough of the same size drives to make RAID any sort of real possibility and although I like the idea, I tend to try and maximuse the capacity over redundancy.

    I'm probably storing around 4-5Tb of data, somewhat inefficiently across all this mess, so theres some attempted consolidation going on to.. There's a good slab of this data which is monolithic and doesn't change, that same data although I'd miss it if it all went missing, is not mission critical. And about the only stuff I do backup at the moment is the website and bbs.

    At the moment, I'm considering someway to just jbod all of the devices into one unified front for sharing. Run them across their own backbone, and have 1 device facing out into userland portion of my network.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Spectre@21:3/101 to Warpslide on Sunday, June 28, 2020 13:55:00
    I do IT all day everyday & didn't want to have to end up "fixing" something at home or frankenstein'ing something together, so I ended
    up buying a Drobo 5N NAS. The cool thing with Drobo is you can mix
    & match different sized drives and it'll "just work". I started
    out with three drives (2 1TB WD Black drives and one other Seagate
    1TB I had laying around) - as needs changed I bought two more 4TB
    WD Red drives to fill the two remaining bays and (over time) swapped
    out the original 3 drives for 4TB Red's as well. (5 x 4TB = 20TB
    w/ 14.35TB usable after redundancy).

    Sounds nice but out of my price range. Best I could probably expect in a similar fashion would be to mount everything I can in "brightmatter" and try something like mergefs. I think last time I had some issues with mergefs wanting to segfault, and mhhdfs not quite working as expected, it didn't always move to a drive with more space on it, just said the volume was full.

    My lil networks middle name is Frankenstein, it used to grow out of control when I'd bring home anything I could just hang off the side. :) Had to cut that back a bit it was getting outrageous.

    I was handed a 2 bay Thecus which appears to be a nice jigger, shame it doesn't support more drives. Its what also gave me the thought of trying to hide all the storage in the back end somewhere with a unified front, apparently it has some kind of support for mounting other NAS devices.

    Alrighty, so at the end of this spiel I have a rather convuluted bit of network, would like to hide all the storage out the back so it just looks like one large volume from userland.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From poindexter FORTRAN@21:4/122 to Arelor on Saturday, June 27, 2020 21:36:00
    Arelor wrote to Spectre <=-


    If you are really dead serious you build a NAS (for home storage). Something like RAID 10 should do for monster deployments. FreeNAS with
    ZFS is a popular option. Prepare to spend kilobucks.

    RAID 10 seems like overkill with SSDs. I started building RAID 5
    arrays with SSDs to maximize disk space and use RAID 10 for the
    larger SAS arrays to give them a bit of a speed boost. Raid 5 with
    SSDs seems plenty fast. But, I'm just supporting development work,
    nothing production or revenue generating.





    ... Faced with a choice, do both.
    --- MultiMail/XT v0.52
    * Origin: realitycheckBBS.org -- information is power. (21:4/122)
  • From poindexter FORTRAN@21:4/122 to Warpslide on Saturday, June 27, 2020 21:37:00
    Warpslide wrote to Spectre <=-

    There is an option to turn on dual drive redundancy if I wanted to be
    able to loose two drives at once, costing more free space, but I
    haven't seen the need to do that.

    There's a lot to be said for staggering drive build times and lot
    numbers. I built my home RAID 1 with two drives from the same lot,
    and they both failed within weeks of each other - albeit after 3
    years.



    ... Change ambiguities to specifics
    --- MultiMail/XT v0.52
    * Origin: realitycheckBBS.org -- information is power. (21:4/122)
  • From Arelor@21:2/138 to Spectre on Sunday, June 28, 2020 03:30:35
    Re: More boring stuff...
    By: Spectre to Arelor on Sun Jun 28 2020 01:45 pm

    All in, I don't think I have enough of the same size drives to make RAID any
    sort of real possibility and although I like th
    idea, I tend to try and maximuse the capacity over redundancy.

    Then I think you can just create a volume group spanning all your spare drives using LVM. But that does not look very solid to
    me. I hope you have a good backup plan if you try.

    At some point you either start deleting unused data or you have to upgrade your
    storage. I suggested RAID 10 because it allows
    between 1 failure and n/2 failures (depending on curcumpstances) without crashig your system, with good recovers.The issue is
    you have to get twice the storage you are actually going to access.

    --
    gopher://gopher.operationalsecurity.es
    --- SBBSecho 3.11-Linux
    * Origin: Palantir * palantirbbs.ddns.net * Pensacola, FL * (21:2/138)
  • From pokeswithastick@21:2/159 to Spectre on Sunday, June 28, 2020 08:59:10

    On Jun 28th 4:04 am Spectre said...
    I spose I'm looking for ideas as much as anything. I'm presently poking about trying to organise 3 storage options.

    I have a RAID 1 mirror on one server at home but I almost prefer my little raspberry PI NAS for it's simplicity. Two 2.5 inch USB drives plugged in and a
    nightly rsync job in cron to sync between primary and backup. I don't need realtime replication, just some protection against a drive failing. The primary was starting to have issues so I just changed the fstab entry to make the secondary the primary and rebooted. Then bought a replacement for the old primary (now secondary) and overnight the files re-sync'd.

    I also recently sync'd a third drive and drove it a couple of hundred miles to my folks house and plugged it in to a Pi there. Now each night it also syncs over a VPN. Having offsite backup is quite important to me in case of fire, theft etc.

    I am reminded of one of Andrew Tanenbaum's quotes: "Never underestimate the bandwith of a station wagon full of tapes hurtling down the highway".

    --- ENiGMA 1/2 v0.0.12-beta (linux; arm; 12.16.1)
    * Origin: sbb systems ~ https://bbs.sbbsystems.com (21:2/159)
  • From Warpslide@21:3/110 to poindexter FORTRAN on Sunday, June 28, 2020 07:20:13
    On 27 Jun 2020, poindexter FORTRAN said the following...

    There's a lot to be said for staggering drive build times and lot
    numbers. I built my home RAID 1 with two drives from the same lot,
    and they both failed within weeks of each other - albeit after 3
    years.

    Especially when the manufacturer has a bug that would cause some of their enterprise SSD drives to fail after exactly 40,000 hours of operation:

    https://www.zdnet.com/article/hpe-says-firmware-bug-will-brick-some-ssds-starti ng-october-this-year/

    Imagine being that IT guy... Everything is chugging along nicely and then suddenly every drive in your RAID fails at almost exactly the same time.
    Lets home they tested their disaster recovery!

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From Weatherman@21:1/132 to Nodoka Hanamura on Sunday, June 28, 2020 08:25:38

    to get around to shipping that fucking thing back to Seagate. Yeah - it
    was a Seagate. Fucking piece of garbage.

    I have owned lots of hard drives over the years - all different manufacturers. Lots of years/decades of running lots of different drives and measuring how long they last (both at home and work). Mostly running them 24x7, no off/on.

    Seagate drives that I have owned generally last 4-5 years at the most. I had built several RAID arrays using Seagate drives and after 4-5 years, had to replace 85% of them due to errors.

    The best hard drive (spinning disk) that money can buy is Hitachi HGST drives. The enterprise drives, even better. They almost never fail. That is all I buy
    now - nothing else. One of my HGST drives is almost 14 years old, still works perfect with zero errors. I also have a huge 36 drive array of 2TB HGSTs that I use for temporary backups and all those drives are 9 years old and work perfect.

    Nothing else comparies - most decent quality SANs use HGST/Hitachi drives (which I believe is now owned by Western Digital).

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From Warpslide@21:3/110 to pokeswithastick on Sunday, June 28, 2020 08:26:57
    On 28 Jun 2020, pokeswithastick said the following...

    I also recently sync'd a third drive and drove it a couple of hundred miles to my folks house and plugged it in to a Pi there. Now each night it also syncs over a VPN. Having offsite backup is quite important to
    me in case of fire, theft etc.

    That's actually a clever idea. My Mom now has fibre to the home provided by the local hydro company. She pays a lot less for 1Gb up & down than I do for 1Gb down/30Mb up over coax. I wonder if I could convince her to let me set something like that up.

    I also have a 1TB OneDrive that comes with my O365 subscription, so I've been using that for a lot of my off-site backups.

    My BBS backup has slowly been growing since I re-started my board, mostly because of the messages flowing in. That being said, my message bases are
    only ~150MB unzipped and about ~15MB 7-zipped. My total backup .7z was about ~35MB. (I can only imagine the size of some of the boards that have been online a lot longer than mine!)

    I then noticed that one day that my backup ballooned to about 300MB. That's when I remembered that I started adding some files to the file bases. Still, these days 300MB is nothing. Though this might have started making me
    anxious on my 486 DX2-66 which had a 500MB hard drive...

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From Weatherman@21:1/132 to Alterego on Sunday, June 28, 2020 08:31:32

    Switching over to FreeNAS and ZFS, the array is done at the file placement level (I believe), so a failed drive only needs to reassemble the array to the utilised capacity, not the capacity of the drive. Plus (IIRC), ZFS regularly checks write stripes, yells when it senses problems and moves
    the data while it can still be read with the other drives.

    That is pretty cool and an advantage to hardware arrays. I use MegaRAID SAS 9261-8i controllers in all my home servers (and workstation). It has some cache and battery backup and has worked well. The controllers are not very expensive on Ebay and will do 6Gbps SATA with the proper cabling.

    At home I use a combination of block and CIFS storage. The block is used for ESXi via iSCSI.

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From Weatherman@21:1/132 to Poindexter Fortran on Sunday, June 28, 2020 08:36:27

    RAID 10 seems like overkill with SSDs. I started building RAID 5
    arrays with SSDs to maximize disk space and use RAID 10 for the
    larger SAS arrays to give them a bit of a speed boost. Raid 5 with
    SSDs seems plenty fast. But, I'm just supporting development work,
    nothing production or revenue generating.

    One of the new home servers I built using (2) 1TB SSD drives in a mirror (for the server OS boot drive). Eventually the plan is to get (8) more Samsung 1TB SSDs in a RAID5 for my new ESXi datastore. Maybe go with larger SSDs if they price makes sense.

    The goal is to use SSD for all normal I/O intensive stuff at home and keep spinning disks for archive storage only.

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From Arelor@21:2/138 to pokeswithastick on Sunday, June 28, 2020 08:30:30
    Re: RE: More boring stuff...
    By: pokeswithastick to Spectre on Sun Jun 28 2020 08:59 am


    On Jun 28th 4:04 am Spectre said...
    I spose I'm looking for ideas as much as anything. I'm presently poki about trying to organise 3 storage options.

    I have a RAID 1 mirror on one server at home but I almost prefer my little raspberry PI NAS for it's simplicity. Two 2.5 inch USB drives plugged in an

    Fun fact, I once considered doing something like that. Howeve, the PI has very slow I/O. If you want to access a big ammount of data at once I suspect you will be up for some waiting.

    How is such setting working for you?

    --
    gopher://gopher.operationalsecurity.es
    --- SBBSecho 3.11-Linux
    * Origin: Palantir * palantirbbs.ddns.net * Pensacola, FL * (21:2/138)
  • From Nodoka Hanamura@21:2/106 to Weatherman on Sunday, June 28, 2020 12:40:58
    On 28 Jun 2020, Weatherman said the following...


    to get around to shipping that fucking thing back to Seagate. Yeah - i was a Seagate. Fucking piece of garbage.

    I have owned lots of hard drives over the years - all different manufacturers. Lots of years/decades of running lots of different drives and measuring how long they last (both at home and work). Mostly
    running them 24x7, no off/on.

    Seagate drives that I have owned generally last 4-5 years at the most.
    I had built several RAID arrays using Seagate drives and after 4-5
    years, had to replace 85% of them due to errors.

    The best hard drive (spinning disk) that money can buy is Hitachi HGST drives. The enterprise drives, even better. They almost never fail.
    That is all I buy now - nothing else. One of my HGST drives is almost
    14 years old, still works perfect with zero errors. I also have a huge
    36 drive array of 2TB HGSTs that I use for temporary backups and all
    those drives are 9 years old and work perfect.

    I've got a few hitachis and they're very good. Reliable, not too slow, not to mention affordable. I may forgo that RMA I've filed and just buy a 4TB
    Hitachi.

    Born too late to experience the scene.
    Born just in time to see it come back.
    Nodoka Hanamura - NeoCincinnati BBS SYSOP - neocinci.bbs.io

    --- Mystic BBS v1.12 A44 2020/02/04 (Linux/32)
    * Origin: NeoCincinnati BBS - neocinci.bbs.io:23 (21:2/106)
  • From Ogg@21:4/106.21 to Warpslide on Sunday, June 28, 2020 13:33:00
    Hello Warpslide!

    ** On Sunday 28.06.20 - 08:26, Warpslide wrote to pokeswithastick:

    On 28 Jun 2020, pokeswithastick said the following...

    I also recently sync'd a third drive and drove it a couple of hundred
    miles to my folks house and plugged it in to a Pi there. Now each night
    it also syncs over a VPN. Having offsite backup is quite important to
    me in case of fire, theft etc.

    That's actually a clever idea. My Mom now has fibre to the home provided by the local hydro company. She pays a lot less for 1Gb up & down than I do for 1Gb down/30Mb up over coax. I wonder if I could convince her to
    let me set something like that up.

    Is the "fibre.. by the local hydro company" in Ontario?

    At one point, I read that the hydro companies were poised to offer
    internet services over the power lines (since they already have a wired network). But then I never heard of this again. That was over 15 years
    ago.






    --- OpenXP 5.0.45
    * Origin: (} Pointy McPointFace (21:4/106.21)
  • From Weatherman@21:1/132 to Nodoka Hanamura on Sunday, June 28, 2020 14:55:30

    I've got a few hitachis and they're very good. Reliable, not too slow,
    not to mention affordable. I may forgo that RMA I've filed and just buy a 4TB Hitachi.

    Awhile back I bought a bulk amount of enterprise HGST drives (which were probably running in a data center/SAN). I picked up (30) 3TB HGST enterprise drives for $25 each. All were clean refurbs and looked brand new with no errors. This was about 1 1/2 years ago. It is very rare for the HGST/Hitachi drives to fail. I have yet to have one go out vs at least 6-7 Seagate drives failed over the years. I expect it with Seagate, though. They are less expensive (new) but not enterprise grade.

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From Adept@21:2/108 to pokeswithastick on Sunday, June 28, 2020 19:49:29
    miles to my folks house and plugged it in to a Pi there. Now each night it also syncs over a VPN. Having offsite backup is quite important to
    me in case of fire, theft etc.

    I'll put in a plug for Resilio Sync, which is a program that you run on a couple (or more) computers, and share a directory.

    Mind you, it currently doesn't work for me because I can't get my brother to keep my other computer on, but if you can find someone to host a computer,
    it's a nice solution.

    Mind you, your solution already does that, so thanks for letting me hijack
    your post, I guess. :)

    --- Mystic BBS v1.12 A45 2020/02/18 (Linux/64)
    * Origin: Storm BBS (21:2/108)
  • From Warpslide@21:3/110 to Ogg on Sunday, June 28, 2020 16:26:28
    On 28 Jun 2020, Ogg said the following...

    Is the "fibre.. by the local hydro company" in Ontario?

    Yup, Lakeland Networks in Muskoka:

    https://www.lakelandnetworks.com

    It's even available at my Dad's house now "in the middle of nowhere". Not
    that he'd ever get internet. Up until this, his only option was a wireless solution, whether "cottage" internet (LTE) or a fixed tower based setup.

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From pokeswithastick@21:2/159 to Arelor on Sunday, June 28, 2020 21:02:43

    On Jun 28th 1:32 pm Arelor said...
    Fun fact, I once considered doing something like that. Howeve, the PI has very slow I/O. If you want to access a big ammount of data at once I suspect you will be up for some waiting.

    I think the PI4 is meant to have a much better USB bus than previous models but
    to be fair I have never tried it under heavy load. It's more to hold small config files like my home assisant configuration, BBS database and such. Probably the largest file I have sync'd between the 3 disks is an 11 GB SD card
    image for a Jetson nano. VPN was definitely the bottleneck there at around 50 Mb/s and that's with the Ubiquiti routers doing IPSEC offloading.

    I'm wondering about FreeNAS next time I upgrade my Ubuntu server which currently runs the RAID mirror.


    --- ENiGMA 1/2 v0.0.12-beta (linux; arm; 12.16.1)
    * Origin: sbb systems ~ https://bbs.sbbsystems.com (21:2/159)
  • From pokeswithastick@21:2/159 to Warpslide on Sunday, June 28, 2020 21:08:37

    On Jun 28th 12:27 pm Warpslide said...
    do for 1Gb down/30Mb up over coax. I wonder if I could convince her to let me set something like that up.

    I showed up one Christmas with a box full of networking goodies. "Dad this is your new router. Please don't turn it off."

    He is slightly nervous though ever since I messed up a remote firmware upgrade while he was on holiday and he could no longer see his security cameras.

    --- ENiGMA 1/2 v0.0.12-beta (linux; arm; 12.16.1)
    * Origin: sbb systems ~ https://bbs.sbbsystems.com (21:2/159)
  • From pokeswithastick@21:2/159 to Adept on Sunday, June 28, 2020 21:17:03

    On Jun 28th 7:50 pm Adept said...
    I'll put in a plug for Resilio Sync, which is a program that you run on a couple (or more) computers, and share a directory.
    Mind you, it currently doesn't work for me because I can't get my brother to keep my other computer on, but if you can find someone to host a

    Sounds like you need something that can work with a 'sometimes on' peer. I would have thought that if Resilio is built around the Bittorrent protocol that
    this should in theory be possible.

    --- ENiGMA 1/2 v0.0.12-beta (linux; arm; 12.16.1)
    * Origin: sbb systems ~ https://bbs.sbbsystems.com (21:2/159)
  • From Ogg@21:4/106.21 to Warpslide on Sunday, June 28, 2020 17:11:00
    Hello Warpslide!

    ** On Sunday 28.06.20 - 16:26, Warpslide wrote to Ogg:

    On 28 Jun 2020, Ogg said the following...

    Is the "fibre.. by the local hydro company" in Ontario?

    Yup, Lakeland Networks in Muskoka:

    https://www.lakelandnetworks.com

    It's even available at my Dad's house now "in the middle of nowhere". Not that he'd ever get internet. Up until this, his only option was a
    wireless solution, whether "cottage" internet (LTE) or a fixed tower based setup.

    It is not clear on that site that that is a HydroOne initiatiative (or, I can't spot it).

    The site says:

    "In 2011, the Canadian Federal Government set an expectation for all Canadians to have minimum internet speeds of 5Mbps download and 1 Mbps upload. Many of the areas we are expanding into have never seen these
    minimum speeds. We believe this initiative will have an immediate impact
    for residents in these communities."

    If a minimum of 5DL/1UL is the goal, that has been reached several years
    ago now. But fibre is supposed to do much better.

    However this site:

    https://www.hydroonetelecom.com/ ..is interesting.

    It sounds like they are offering leasing opportunities to resell data transmission via their established fibre networks. Maybe *that* is how LakelandNetworks is doing it?


    --- OpenXP 5.0.45
    * Origin: (} Pointy McPointFace (21:4/106.21)
  • From Adept@21:2/108 to pokeswithastick on Monday, June 29, 2020 00:09:19
    Sounds like you need something that can work with a 'sometimes on' peer.
    I would have thought that if Resilio is built around the Bittorrent protocol that this should in theory be possible.

    Eh, Resilio works just fine. It's just a matter of having the computer turned on when my computer is on a good network connection.

    I don't imagine there's any way around it, short of involving another
    computer. Which Resilio could also do.

    --- Mystic BBS v1.12 A45 2020/02/18 (Linux/64)
    * Origin: Storm BBS (21:2/108)
  • From Warpslide@21:3/110 to Ogg on Sunday, June 28, 2020 20:33:19
    On 28 Jun 2020, Ogg said the following...

    It is not clear on that site that that is a HydroOne initiatiative (or,
    I can't spot it).

    It sounds like they are offering leasing opportunities to resell data transmission via their established fibre networks. Maybe *that* is how LakelandNetworks is doing it?

    I know Lakeland Power is the local utility in Bracebridge, but my Dad who
    lives outside of the town is with Hydro One. Could be a bit of both? In
    town has cheaper pricing than out of town, maybe because they're using
    leased fibre?

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From poindexter FORTRAN@21:4/122 to Weatherman on Sunday, June 28, 2020 08:35:00
    Weatherman wrote to Poindexter Fortran <=-

    One of the new home servers I built using (2) 1TB SSD drives in a
    mirror (for the server OS boot drive). Eventually the plan is to get
    (8) more Samsung 1TB SSDs in a RAID5 for my new ESXi datastore. Maybe
    go with larger SSDs if they price makes sense.

    They are getting cheaper.

    What I really need to do is wire my office to my home router. I'm
    going to be working from home until later this year full-time and
    possibly 2-3 days a week after that, so it's time to get rid of my
    Powerline network and get real copper running between floors.

    I get 60/20 over powerline, but it drops out, making a NAS a problem.
    Would love to get all of my storage off of my desktop and onto the
    network, but need a proper network first.



    ... Start where you are. Use what you have. Do what you can.
    --- MultiMail/XT v0.52
    * Origin: realitycheckBBS.org -- information is power. (21:4/122)
  • From Weatherman@21:1/132 to Poindexter Fortran on Monday, June 29, 2020 08:21:01

    They are getting cheaper.

    They were until early this year. A 1TB Samsung SSD was $99 from Best Buy a year ago and is not $139. Seems the prices went up this year, hopefully only temporary.

    I get 60/20 over powerline, but it drops out, making a NAS a problem.
    Would love to get all of my storage off of my desktop and onto the
    network, but need a proper network first.

    Wired is a must for solid performance. Yesterday evening I spent some time getting my new servers ready with the 10G fiber NICs. Those won't be able to get maxed with the hardware I have in place, even with SSD drives due to the controller speed limitation.

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From poindexter FORTRAN@21:4/122 to Weatherman on Monday, June 29, 2020 10:33:00
    Weatherman wrote to Poindexter Fortran <=-

    Wired is a must for solid performance. Yesterday evening I spent some time getting my new servers ready with the 10G fiber NICs. Those won't
    be able to get maxed with the hardware I have in place, even with SSD drives due to the controller speed limitation.

    I finally figured out a path from my downstairs router to my upstairs
    office. I'll need to go under the house, along the basement, through
    a foundation vent, then up through the floor.

    The only problem? I think I have a skunk living under there... We've
    had an uneasy truce so far.



    ... Look at the order in which you do things
    --- MultiMail/XT v0.52
    * Origin: realitycheckBBS.org -- information is power. (21:4/122)
  • From poindexter FORTRAN@21:4/122 to Adept on Monday, June 29, 2020 10:55:00
    Adept wrote to pokeswithastick <=-

    I'll put in a plug for Resilio Sync, which is a program that you run on
    a couple (or more) computers, and share a directory.

    I bought licenses for Bittorrent Sync and like having a copy of my
    data in sync on my laptop - I have it with me when I work from a
    remote site, and I have another backup saved in case I lose one of
    the computers.

    What was a nice surprise was finding the btsecrets subreddit, where
    people were sharing a ton of stuff.


    ... Look at the order in which you do things
    --- MultiMail/XT v0.52
    * Origin: realitycheckBBS.org -- information is power. (21:4/122)
  • From Ogg@21:4/106.21 to Warpslide on Monday, June 29, 2020 14:16:00
    Hello Warpslide!

    ** On Sunday 28.06.20 - 20:33, Warpslide wrote to Ogg:

    I know Lakeland Power is the local utility in Bracebridge, but my Dad who lives outside of the town is with Hydro One. Could be a bit of both? In town has cheaper pricing than out of town, maybe because they're using leased fibre?

    Yes.. so Lakeland Networks is probably the ISP and they have fibre strung
    up on the hydro poles maintained and serviced by Lakeland Power.

    I kinda wish there was a similar initiative in my area for stringing up
    fibre on the exisiting poles so that I could get off my capped at 5GB/mo mobile ISP solution.



    --- OpenXP 5.0.45
    * Origin: (} Pointy McPointFace (21:4/106.21)
  • From Adept@21:2/108 to poindexter FORTRAN on Monday, June 29, 2020 19:24:09
    What was a nice surprise was finding the btsecrets subreddit, where
    people were sharing a ton of stuff.

    Is it somewhere other than /r/btsecrets? That _seems_ like the right
    subreddit, but I'm only seeing the BTS videos and the side bar about it being
    a sub-reddit for sharing BTSync secrets keys.

    Mind you, I'll probably have no interest in actually downloading things - my BitTorrent usage is pretty uniformly not-even-grey-area legal things - but
    the idea sounds interesting.

    --- Mystic BBS v1.12 A45 2020/02/18 (Linux/64)
    * Origin: Storm BBS (21:2/108)
  • From Warpslide@21:3/110 to poindexter FORTRAN on Monday, June 29, 2020 15:34:37
    On 29 Jun 2020, poindexter FORTRAN said the following...

    The only problem? I think I have a skunk living under there... We've
    had an uneasy truce so far.

    If you do decide to run this cable, PLEASE film it so we can can all see it
    on YouTube... ;)

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From Warpslide@21:3/110 to Ogg on Monday, June 29, 2020 15:54:38
    On 29 Jun 2020, Ogg said the following...

    I kinda wish there was a similar initiative in my area for stringing up fibre on the exisiting poles so that I could get off my capped at 5GB/mo mobile ISP solution.

    I remember reading about municipal broadband awhile back so decided to look
    it up again. It looks like Lakeland is listed as a "success story" on one of their pages, along with some other communities. Seems like the majority of them are in Ontario:

    https://community-broadband.ca/success-stories

    It's good to see some of the northern communities taking the initiative.

    Jay

    --- Mystic BBS v1.12 A46 2020/06/11 (Windows/32)
    * Origin: Northern Realms BBS | bbs.nrbbs.net | Binbrook, ON (21:3/110)
  • From poindexter FORTRAN@21:4/122 to Warpslide on Monday, June 29, 2020 14:41:11
    Re: Re: More boring stuff...
    By: Warpslide to poindexter FORTRAN on Mon Jun 29 2020 03:34 pm

    If you do decide to run this cable, PLEASE film it so we can can all see it on YouTube... ;)

    Yeah, so I can be known as that "got sprayed with a skunk, screamed like a little girl, knocked himself unconscious on a overhead floor joist and ended up
    face down with plumber's butt" guy.
    --- SBBSecho 3.11-Win32
    * Origin: realitycheckBBS.org -- information is power. (21:4/122)
  • From Weatherman@21:1/132 to Poindexter Fortran on Tuesday, June 30, 2020 08:48:31

    I finally figured out a path from my downstairs router to my upstairs office. I'll need to go under the house, along the basement, through
    a foundation vent, then up through the floor.

    Some network cable runs can be pretty creative like what you are dealing with. I have a few cable runs that are pretty interesting, too. I have (6) of them running above the basement ceiling, through the exterior of the house, under the deck following the frame of the house, around the size tucked under the siding, and back into the garage. Have many using an old gas exhaust vent from old hot water heater to get cables into the attic and down walls in the 2nd floor.

    The only problem? I think I have a skunk living under there... We've
    had an uneasy truce so far.

    lol, hopefully they don't eat network cables.

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From Weatherman@21:1/132 to Poindexter Fortran on Tuesday, June 30, 2020 11:36:13

    Yeah, so I can be known as that "got sprayed with a skunk, screamed like
    a little girl, knocked himself unconscious on a overhead floor joist and ended up face down with plumber's butt" guy.

    If it is possible, the local ER has probably seen it happen before.. :)

    - Mark
    ÿÿÿ
    --- WWIVToss v.1.52
    * Origin: http://www.weather-station.org * Bel Air, MD -USA (21:1/132.0)
  • From Spectre@21:3/101 to Anybody on Sunday, June 28, 2020 14:22:00
    Was just tidying up... no idea whats in it at the moment, but my next available device to use as a backup is probably a G3 Mac...if I recall right its got 4 SATA ports in it, so it could manage some kind of 3 drive raid setup maybe for backup purposes... wouldn't be a massive amount of space but probably enough for what I consider to be critical.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Spectre@21:3/101 to Arelor on Sunday, June 28, 2020 21:18:00
    Then I think you can just create a volume group spanning all your spare drives using LVM. But that does not look very solid to me. I hope
    you have a good backup plan if you try.

    Things change, but I see with LVM if one drive goes it takes the whole volume with it. I have my eye on mergerfs in this dept, so if one goes it only takes its own data...

    In actual fact out of the Tbs of junk I have and call data, only about ~150Gb is worth backing up. Stuff that I'm wanting to keep for reliabilities sake like
    the BBS, and some other impossible to replace data mostly photos.. although some of the Muzac might be harder to track down now though too.

    Something that has come to light though... is I'm sitting on 5x2Tb drives that'd RAID5 nicely, and brightmatter has sufficient power and ports to hold it all. Off hand I'm not sure what the motherboard supports, might have to mdadm it.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)