Kitz Forum

Computers & Hardware => Networking => Topic started by: Chunkers on November 30, 2016, 01:43:55 PM

Title: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on November 30, 2016, 01:43:55 PM

I love it when I find new things I can geek with......

I have 2 NASes on my home network, I probably only need one + offsite backup, but I have 2  :P.  They are both Synology NASes, my most recent a 2Tb DS214+ and my old DS211j.  The DS211j is very slow and just does backup and security cameras - it really struggles with the HD video security camera duties, it spends a lot of its time at 100% CPU, poor thing, but seems to work.  The DS214+ does all the heavy lifting - streaming video, downloading, file hosting, log-server, music server etc etc

I love Synology NASes because I think the interface is great and the web-based software and addons work really well, you pay a premium, but you get a premium product ... great!  The downside is that if you want to get a NAS with 4 drive bays and a decent CPU capable of transcoding etc the prices are really high.  I am currently running out of storage on both my NASes .....

Recently (today!) I discovered Xpenology (http://xpenology.org/), its an opensource bootloader which, for free, let’s you run the Synology DSM software on pretty much any hardware \o/

I have known about FreeNAS for some time and toyed with the idea of self-building a NAS before but now I know I can have the Synology software and interface I am definitely going to give it a try!

I have any number of horrible old PC's lying around including a Q8200 quad core, an Intel i3, an E6600  - am thinking I'll give it a try.  If it works well I can look at a more custom lower-power build.  Have any of you done this / tried Xpenology?

Chunks
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: phi2008 on November 30, 2016, 01:51:41 PM
I'm running Xpenology, main advantage over FreeNAS is that since FreeNAS likes to use ZFS you can't easily expand storage - with  Xpenology you just add a disk and it grinds away for a while and expands. I'm also running it with a 10Gb Mellanox card which works out of the box.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Ronski on November 30, 2016, 03:54:32 PM
I'm running my own server which I built,  which runs windows home server 2011, it currently has 4 x 3TB drives setup as a drive pool wit iimportant stuff duplicated. It's got room for another 6 drives, and if I bought another drive bay cage it could take a total of 15. But given the ever increasing capacity  of disks I doubt I'll ever need to.

It also runs Mediaportal TV  server, so does all our tv recording, as well as central file storage and cloud backup.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chrysalis on November 30, 2016, 04:10:14 PM
Word of warning, be careful where you buy hdd's from.

I got 2 3tb WD Red's last week which came from a 3rd party seller on amazon.

I had noticed oddities such as.

One drive bigger than the other (gig bigger)
Weird firmware versions
No NCQ or 4k sector support which is at odds with official WD spec
Hot temps

Then finally after some advice on hardforum I checked the serial's on wd's warranty page and both were invalid.

I then noticed the seller was located in Leics so I paid him a visit today and he was shocked I took the time to visit him, instead of saying he would investigate etc. he then started trying to sell me a story that the warranty is provided by HP and is why the check failed, suggested he is knowingly selling counterfeit drives.  He did refund me there and then tho.

The workplace where he had a couple of guys building pc's was a mountain of dust.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on November 30, 2016, 06:57:46 PM
I'm running Xpenology, main advantage over FreeNAS is that since FreeNAS likes to use ZFS you can't easily expand storage - with  Xpenology you just add a disk and it grinds away for a while and expands. I'm also running it with a 10Gb Mellanox card which works out of the box.
Cool, sounds great but,  erm,  I don't really  know what a Mellanox card is. Don't worry though,  I never allow a lack of research or background knowledge to get in the way of me trying to do stuff  😁

Sent from my Nexus 7 using Tapatalk

Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on November 30, 2016, 07:00:33 PM
I'm running my own server which I built,  which runs windows home server 2011, it currently has 4 x 3TB drives setup as a drive pool wit iimportant stuff duplicated. It's got room for another 6 drives, and if I bought another drive bay cage it could take a total of 15. But given the ever increasing capacity  of disks I doubt I'll ever need to.

It also runs Mediaportal TV  server, so does all our tv recording, as well as central file storage and cloud backup.
Snap! I also have a Mediaportal TV server,  but it runs Windows so I'll probably try to keep it separate.

Also thanks for the tip about the bogus drives @Chrysalis I didn't realise there are fake ones,  I'll get them from Scan to make sure they are proper ones.

Sent from my Nexus 7 using Tapatalk
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Ronski on November 30, 2016, 09:13:50 PM
@Chrysalis - great tip on checking the warranty/serial numbers, I bet his face was a picture and I hope you've reported him to Amazon. So far I've only used online retailers like CCL/Scan/Ebuyer for them - I also use the WD Red's. A good tip is not to buy your drives all at the same time, if there's a bad batch they could fail at similar times. I fairly regularly replace mine one at a time.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: phi2008 on November 30, 2016, 10:34:03 PM
Cool, sounds great but,  erm,  I don't really  know what a Mellanox card is. Don't worry though,  I never allow a lack of research or background knowledge to get in the way of me trying to do stuff  😁

Sent from my Nexus 7 using Tapatalk

Cheap e.g. $15,  SFP+ cards you can get from eBay (http://www.ebay.co.uk/itm/LOT-OF-2-671798-001-MNPA19-XTR-HP-10GB-CONNECTX2-PCI-ETHERNET-CARD-HIGH-PROFILE-/172301322538?hash=item281df5892a:g:FhcAAOSwLnBX2Gal) - so you could do a point-to-point 10Gb link(extra for cable+transceivers) for around $30+shipping(think you can get a dual port 10Gb SFP+ card for around $50 that you could probably(drivers?) stick in your NAS). Mellanox works with Windows, Linux, FreeBSD - but not OS X(I have a Solarflare dual port SFP+ card in my hackintosh which works fine- cost £40).

Writes to NAS under fibre approach the 10Gb limit because they go to RAM before being written, reads are slower because they're limited by disk speed.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on December 01, 2016, 04:29:10 AM
Cheap e.g. $15,  SFP+ cards you can get from eBay (http://www.ebay.co.uk/itm/LOT-OF-2-671798-001-MNPA19-XTR-HP-10GB-CONNECTX2-PCI-ETHERNET-CARD-HIGH-PROFILE-/172301322538?hash=item281df5892a:g:FhcAAOSwLnBX2Gal) - so you could do a point-to-point 10Gb link(extra for cable+transceivers) for around $30+shipping(think you can get a dual port 10Gb SFP+ card for around $50 that you could probably(drivers?) stick in your NAS). Mellanox works with Windows, Linux, FreeBSD - but not OS X(I have a Solarflare dual port SFP+ card in my hackintosh which works fine- cost £40).

Writes to NAS under fibre approach the 10Gb limit because they go to RAM before being written, reads are slower because they're limited by disk speed.

Faster than Gb speeds is very cool, not sure i need this just yet but to be honest I didn't know what the options were for going faster and now I see it is Infiniband - thanks for the advice and info!

C
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chrysalis on December 01, 2016, 05:09:46 AM
@Chrysalis - great tip on checking the warranty/serial numbers, I bet his face was a picture and I hope you've reported him to Amazon. So far I've only used online retailers like CCL/Scan/Ebuyer for them - I also use the WD Red's. A good tip is not to buy your drives all at the same time, if there's a bad batch they could fail at similar times. I fairly regularly replace mine one at a time.

yeah.

I will post pics of the 2 drives later, and also of the warranty page screenshot.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: phi2008 on December 01, 2016, 12:13:44 PM
Faster than Gb speeds is very cool, not sure i need this just yet but to be honest I didn't know what the options were for going faster and now I see it is Infiniband - thanks for the advice and info!

C

This isn't InfiniBand, that's something different and a bit more exotic, SFP+ is a common standard that typically runs at 10Gb(SFP ran at 1Gb - many basic switches have at least a couple of these). There is a lot of cheap InfiniBand stuff out there(typically US eBay), and you can do impressive things(apparently-never tried) like buy a couple of $145 dual 56Gb port cards (http://www.ebay.com/itm/DELL-CONNECTX-3-CX354A-NIC-QDR-40GBE-FDR-56GB-S-INFINIBAND-NETWORK-6RKNM-LOW-P-/191803038606?hash=item2ca85a1b8e:g:wlMAAOSwQYZWupvu) - team the ports - and effectively run a 112Gbit link.  Yes, apparently InfiniBand does work with FreeNAS!

Basically SFP+ is cheap, common, and does the job ... which is why I'm using it.  :)
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: adrianw on January 19, 2017, 04:34:38 AM
... main advantage over FreeNAS is that since FreeNAS likes to use ZFS you can't easily expand storage ...

You can add a mirrored pair of drives quite rapidly.

With ZFS

You can have one or more storage pools. You can control what goes in to each pool (e.g. by different shares).

A storage pool is supported by one or more vdevs (virtual devices), which can be of different types. Data is spread uncontrollably over the vdevs.

A vdev contains disks (or disk partitions), and can be of two main types:
* mirror - every disk (from 1 upwards) contains the same data.
* raidz, raidz-2, raidz-3 - the data is spread across the entire vdev, using 1, 2 or 3 drives worth of space for redundancy. The size of the smallest drive currently in the vdev controls the maximum amount of space available. You cannot add another disk to a vdev, only replace the disks one by one with a bigger disk and resilver it. Until you replace the last disk you don't gain any more space.

So, to expand a pool the easiest and smallest resilient way is to add a mirror vdev containing 2 disks.

I have two FreeNAS servers - a HP Microserver with 4 * 2 TB disks in a RAIDZ vdev (~ 6 TB available, used for backup and experimentation, currently broken) and a FreeNAS Mini with 4 * 6 TB disks in a RAIDZ-2 vdev (~ 10 TB available, my main NAS). With hindsight I should have set up the FreeNAS Mini with 2 mirror vdevs, each containing 2 disks.

I think FreeNAS/ZFS are wonderful. ZFS's checking parity information whenever data is accessed (and scrubs to force access) helps to detect rotting disks before you loose data. Compression can help (depends how compressible your data is - I get 1.40 on a NFS share used mainly for email, but 1.00 on a big MP3 collection). Snapshots (allowing you to recover deleted or corrupted files) can be a life saver. Replication allows a copy of your data to be kept on another machine, possibly off-site. I also back up the important stuff to a rotating pair of UFS formatted external USB3 disks with rsync.

FreeNAS 10, still in beta and not going to be released until it is ready, is looking pretty good.

There are downsides
* ZFS eats memory. 8 GB is the practical minimum.
* If you use NFS or iSCSI you will probably want to use a (possibly mirrored) SSD as an intent log (ZIL).
* People assume that a L2ARC cache SSD will help performance. It usually won't, and will instead impair performance because memory which could be used to cache data is instead used to hold information about the L2ARC content. Measure your workload before you buy. I did not, and wasted my money.
* Deduplication really gobbles memory and how much bit-identical data do you have anyway? Really only appropriate where people are storing many VMs of the same type on the NAS.

When I can afford it, I intend to build/buy a machine with many more SAS/SATA ports and drive bays and a lot of memory. Plus of course a lot of disks.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: phi2008 on January 23, 2017, 08:39:36 AM
You can add a mirrored pair of drives quite rapidly.


Maybe I should clarify, little storage planning is necessary with Xpenology. You buy a disk, add it, storage expands. No need to worry about anything else(and no need to purchase all your disks at once, just add them as necessary).

Anyone who is considering ZFS for their NAS should really read this first -

The 'Hidden' Cost of Using ZFS for Your Home NAS (http://louwrentius.com/the-hidden-cost-of-using-zfs-for-your-home-nas.html)

And then decide.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: adrianw on January 24, 2017, 03:19:37 AM
I confess that Xpenology / Spenology looks quite good. Being able to make effective use of different sized disks is a neat trick. Adding another disk to a striped RAID is another.

Free NAS choice for home systems is quite hard. Ideally one would evaluate several before committing to one. The most recent comparative review I can find is http://www.how2shout.com/tools/best-free-open-source-nas-software.html which mentions 8 (including FreeNAS but not Xpenology).

One important point, whatever NAS you choose, is that you have a means of backing it up, or at least the data you care about. My choice has always been (preferably on-box) rsync to UFS (FreeBSD) formatted external hard disks. In emergency I can always cobble together something to access them. General growth has meant that these have risen in size to 6 TB (using WD drives in StarTech enclosures). I also back up some of the Windows stuff to AWS with the pay-for version of S3 Browser. FTTC upload rates make it infeasible to back up the whole thing this way, as does the sheer number of files (everything I have found so far uses more memory the more files you have in the backup). I wish I could afford rsync.net.

My preference for FreeNAS comes from having run a FreeBSD / ZFS system for quite a few years on what had been a state of the art system, but had become a power hungry old clunker. Over time, I have reduced the number of FreeBSD systems I maintain myself to just 3, switched to binary updates rather than building everything from source, and use FreeBSD based "appliances" for NASs and firewalls.

Perhaps if Walnut Creek hadn't had a delay with Slackware when I ordered FreeBSD 2.2(?) and Slackware from them I would have jumped from SCO OpenDeathTrap to LINUX. As it was, FreeBSD suited my needs then, and aside from a few forays with netbooks and Ubuntu in VMs and a works desktop, I have stuck with it.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chrysalis on January 24, 2017, 07:19:00 AM
When I got my 2 most recent WD Red drives I spent some time in considering whether to get a NAS unit, and ended up against the idea as to me they seem overpriced for what you get.

Of course in my situation I have the following, and not everyone will be in the same situation as me.

My main desktop PC which has space for 8 x 3.5 inch drives is on 24/7 anyway.
I typically only need to access my storage from the desktop PC.

If I was going to get a NAS tho I would for sure want a FreeNAS unit as zfs to me is the king of filesystem's at the moment, its an incredible filesystem.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: phi2008 on January 24, 2017, 10:32:12 PM
Good cashback deals happen at least a few times a year for HP Microservers or Dell T20 Servers(four 3.5 bays) - about £100 after cashback.

Alternatively you can get a cheap chassis - X-Case do some cheap ones -

https://www.xcase.co.uk/products/x-case-extra-value-208-2u-with-8-hotswap-bays
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: adrianw on January 25, 2017, 06:02:37 AM
I have a couple of old (N40L Generation 7) HP Microservers which I have used in various roles (FreeBSD+IPFW firewall, ESXi host, FreeNAS) and was fairly happy with. They are both off and distant to me at present, so I cannot check the specs. As far as I remember I expanded them both to to 8 GB memory and added a second NIC.

Upsides
Fairly quiet.
Good build quality.
Having drive screws and a screwdriver on the inside of the case door is a nice touch.
You can cram a 5th disk into the optical bay. I have not done this.
6 external USB 2.0 sockets.

Downsides:
Very fiddly to fit memory or an expansion card.
Getting an official BIOS upgrade may well require a HP support contract. This was enough to stop me from buying HP ever again. But see http://www.nathanielperez.us/blog/hp-proliant-n40l-bios-modification-guide if you find that you really need to update your BIOS (enable hot swap, higher throughput for a 5th drive, lord knows what else).
No serial port - so you need a VGA monitor and USB keyboard for a console, or an IPMI card.

I read that the while HP say 2 a TB drive limit, they will work with bigger drives but not be able to boot from them, so I may well resurrect at least one of the N40Ls with 4*6 TB WD Red disks (with FreeNAS booting from internal USB, maybe with a second USB plugged in at the back).

There seems to be a £60 cash back running for the Generation 8 at the moment. Need to have an invoice dated prior to the end of January 2017.

As for cost, yes a NAS box can be expensive, even before you start stuffing big disks in to it.  But how much is your data worth? I chose a FreeNAS Mini rather than building my own partially because it wasn't that much more expensive then building something with similar components.

Size is also an issue - 6 bay or more towers tend to be big, but you can at least stuff them under a desk or table. Rack mounts (like the interesting X-case one above) tend not to fit too well into a home. For some time I had a works HP DL360 sitting on a desk at home. Not too high, not to wide, but the depth, and the noise! I only powered it up when I needed to us it.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: phi2008 on January 25, 2017, 09:11:24 AM
I sold my Microserver(after fitting a new, quiet, fan) because I wanted normal size expansion slots(now have T20).

... Rack mounts (like the interesting X-case one above) tend not to fit too well into a home. For some time I had a works HP DL360 sitting on a desk at home. Not too high, not to wide, but the depth, and the noise! I only powered it up when I needed to us it.

Really suggested for the kind of person who buys rack equipment - nerd/pro. The noise is an issue with larger NAS - if it's close by at least, was toying with the idea of a rack in the garage(with fibre link).
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on January 25, 2017, 11:00:28 PM
Well, I got my wifes old PC out of the cupboard (its a Q8200 with 4Gb RAM), bunged in some old HD's I had lying around and installed Xopenology to a memory stick and Bingo! My new "Test" NAS is up and running with 500Gb RAID 1 and DSM ver 6.02-8451.  I also bunged in an old 60Gb SSD I had lying around and configured it as a cache, just for fun really and to see if it would work.

(http://i43.photobucket.com/albums/e352/Jolltax/Crap/NAS_zps5efl5drs.gif)

It identifies as a Synology DS3615 (https://www.amazon.co.uk/Synology-DS3615xs-Network-Attached-Storage/dp/B00PJZ6NNY), yours for £2300 on Amazon, snigger.

It was a bit of a pain trying to follow the rather haphazard instructions sets on Xopenology forums which are a bit patchy. If anyone is planning to do this then let me know and I can probably save you a bit of head-scratching.

Its been running for a few hours now so its early days but ...

Going to leave it cooking overnight and see if its still working in the morning,

 :fingers:

Chunks
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: burakkucat on January 25, 2017, 11:09:41 PM
The board / CPU has no onboard graphics - do you think it will boot if I remove the gfx card altogether?

I think it would be worth a try. If successful, then less noise and less power consumption!  ;)
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: roseway on January 25, 2017, 11:14:37 PM
If not, you could get a cheap low performance fanless graphics card.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: adrianw on January 26, 2017, 12:08:48 AM
... was toying with the idea of a rack in the garage(with fibre link).
Best make sure the garage is environmentally adequate. Long ago I turned half a 2 bay garage into a study. One dank winter afternoon I went to the garage, turned on my till then trusty Osborne 1, only to hear a dull thud from inside it as it arced over and died.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Ronski on January 26, 2017, 06:15:18 AM
I'd be very surprised if it booted without a GPU, I think the BIOS checks for a GPU.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on January 26, 2017, 06:31:34 AM
I'd be very surprised if it booted without a GPU, I think the BIOS checks for a GPU.
Yep, thats what I was thinking too.  I'll give it a try later today.

C
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chrysalis on January 26, 2017, 11:10:09 AM
no harm in trying, if it fails look for a low powered low end part to replace it.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: BigJ on February 07, 2017, 09:56:04 PM
A few years back I ran Xpenology on a HP Microserver N54L and loved it compared to a few other NAS OS' I checked out. I only gave up on it because each major verion update needed a driver hack for the N54L. I switched to FreeNAS but it's GUI just isn't as easy to use.

I may have to check out the latest state of Xpenology and compare it to FreeNAS 10 beta which has a completely rewritten frontend
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: broadstairs on March 08, 2017, 07:31:33 PM
I just had an email suggesting I take a look at NAS4Free (https://sourceforge.net/projects/nas4free/), looks interesting if I need to build my own, it has ZFS by the way.

Stuart
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chunkers on March 13, 2017, 01:04:47 PM
I keep reading how awesome ZFS is, but it makes the hardware really expensive e.g. lots of RAM etc
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: Chrysalis on March 13, 2017, 08:18:58 PM
you can probably run zfs with 4 gig of non ECC ram, its not the best setup but it will work.

Regarding cost on the flipside ZFS offers features that you normally would only get on a dedicated raid card which saves money.

My pfsense unit with 4 gig of ram uses zfs.
I also use zfs on a virtual machine that has 4 gig of ram allocated to it.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: BigJ on March 13, 2017, 08:55:02 PM
Compared to the 0.5 or 1 GB of memory you get in a home Synology NAS, 8GB as the minimum recommended for FreeNAS is a lot. The NAS4Free website suggests (https://www.nas4free.org/wiki/doku.php?id=documentation%3asetup_and_user_guide%3ahardware_requirements) "an absolute minimum of 4GB for ZFS.

I seem to dimly remember initially testing FreeNAS with less than 8GB without problem. I upgraded before using it in anger though!

EDIT: I guess you have to decide if going ZFS is worth the extra cost in memory.
Title: Re: "To Build or To Not build your own NAS" - Xpenology vs Synology
Post by: currytop on March 17, 2017, 12:17:19 PM
To add to the meltpot...

Like some others I've used ZFS based servers for many years, starting with FreeNAS, NAS4Free, a raw OpenIndiana system, and an Omnios NappIT server. There's also a couple of WD MyBook ext4 style servers that turned out to be multifunction gems, very low power but now long in the tooth. There are drawbacks with ZFS but overall I've never lost any data despite occasional hardware failures. Oops that's tempting fate!

But most of my servers do double or triple duty and adding software, especially custom, isn't so easy on the fixed software appliances. So a few years ago I started flirting with Linux based ZFS installations on Intel hardware. I've grown to trust them and now all but one are ZFS based Linux systems.

In the main they're low end Fujitsu Xeon mini towers, mostly bought on special offer, with 16Gb RAM and 6x 4Gb WD drives in 3 mirrors, and run fairly quietly. They boot from a USB stick with the OS on the ZFS filesystem. I'm more familiar with CLI use of Linux than I am with BSD and Solaris derivatives so that's turned out to be a big plus. I know my way around Debian & derivatives so adding features is easy.

I think ZFS is a solution for more technical users, maybe a Linux OpenServer type solution for rather less technical types, and an off the shelf Synology type product for folk who just want a file server that works without needing to know how.

I didn't know about Xpenology, I must look it up, thanks for that.