chaos (Offline file server)
Table of Contents
- Summary
- Notes
- Hardware
- Software
- Links
- Log
- Initial configuration
- Intel CPU upgrade
- More drives
- Some Red Drives
- AMD Upgrade and workstation duty
- Extra storage for video intake
- Optane ZFS cache
- Video drive upgrade
- A proper motherboard
- Modern graphics
- AMD CPU Upgrade plus RAM
- Power supply replaced
- Memory issues with all 4 slots populated
- An improper motherboard
- Cheap RAM
Summary
Chaos is my offline file server. It used to be my main workstation.
Notes
- Previously, used Mountain Mods 120mm fan mount adapter to hold two extra drives on the R4's bottom fan mount. It's a bit tricky to install screws on the motherboard tray side due to tight spaces.
- SuperMicro SAS controller is a backwards PCIe card (components mounted on wrong side). I bought it already flashed with LSI firmware, and a proper bracket for standard cases.
Hardware
Make | Custom |
Year | 2018 |
Model | Asus ROG Strix B350-F Gaming |
Chassis | Fractal Design Define R4 |
Power Supply | Seasonic Focus+ 750W 80+ |
Processor | AMD Ryzen 5 2600 |
Memory | 32GB DDR4 3200 (Hirvod D4-16) |
Ports | PS/2 keyboard or mouse |
DisplayPort 1.2 (N/A) | |
HDMI 1.4b (N/A) | |
RJ-45 LAN | |
2x USB A 3.1 gen 2 | |
USB C 3.1 gen 1 | |
5x USB A 3.1 Gen 1 | |
Optical S/PDIF out | |
5x Audio jacks | |
Graphics | AMD Radeon Pro WX 2100 |
Storage | 250GB M.2 Inland PRIME NVMe SSD |
4x 2TB SATA WD Red WD20EFRX | |
4x 4TB SATA WD Red WD40EFRX | |
Display | 2x 24" Dell U2414H 1920x1080 |
25" Dell U2515H 2560x1440 | |
Int. Peripherals | SuperMicro AOC-USA-S2-L8I 8-port w/LSI Firmware |
Syba SD-PEX24066 Dual 2.5 Gigabit Ethernet | |
Realtek S1220A Audio | |
Ext. Peripherals | |
Dimensions | |
Length/Depth | 53.2 cm |
Width | 23.2 cm |
Height/Thickness | 46.8 cm |
Weight | Heavy TODO kg (lbs oz) |
Software
Operating System | Debian 10 |
Unique applications |
Links
Log
Initial configuration
Chaos started as a low power server to be paired with a Gigabyte Brix (NUC-like) workstation. Original specs were Asus H97I-Plus, Core i3-4370, 8GB memory, 3ware 9650se 16-port raid controller. I think the original arrays were 4x 2TB WD Red, 4x 1.5TB WD Green, 4x 500GB WD Green, and a pair of 500GB Seagate "hybrid" drives.
Intel CPU upgrade
Bought a spare PC for kids gaming, but swapped my i3-4370 for the i5-4670k CPU (4 real cores, instead of 2 + hyperthreading).
More drives
Added 2x 1TB WD Red 2.5" drives as a mirrored array.
Some Red Drives
Retired 500GB drives for a new set of 4x 4TB WD Red. Probably got rid of the 1.5TB array too, but I'm not sure when.
AMD Upgrade and workstation duty
Chaos became a workstation too. Intel setup was replaced with Asus B350-F, Ryzen 5 2400g, 16GB DDR4, Crucial 250GB M.2 SSD.
Extra storage for video intake
Added a pair of 6TB WD Elements drives (shucked). Started storing optical disk images (dvd, bd) on them.
Optane ZFS cache
Added a 16GB Intel Optane M.2 module as cache for the main array. Not much noticeable speed difference. Maybe helps with building software/LaTeX.
Moved to Supermicro/LSI SAS controller (AOC-USAS2-L8I). Migrated to ZFS from the ext4 on top of 3ware raid.
Video drive upgrade
Traded 6TB pair for an 8TB pair of shucked drives. 6TB drives went into the new enclosures and became offline backup.
The drives were mounted to the bottom 120mm fan space using a pair of brackets from Mountain Mods.
A proper motherboard
Upgraded motherboard to Asus Prime X470-PRO for better pci-e expansion. Still found lots of limitations due to the Ryzen 2400g's internal GPU. Lots of video card hopping around this time because of kernel driver issues with older cards that I was using for extra displays. Tried FireMV 2100 (locked up I think), FirePro W2100 (worked ok, but the fan spun full speed on boot until the kernel took over), Quadro NVS420 (drawing issues, especially in terminals).
Modern graphics
Got a Radeon Pro WX 2100. This card was generally a lot better (more modern drivers). I still had issues with it causing an Xorg crash until mid-2020. Eventually settled out between newer backports kernel, and pulling newer firmware from the kernel git repo.
Comparison with the previous FiroPro W2100:
AMD CPU Upgrade plus RAM
Upgraded to Ryzen 5 2600, and extra 16GB DDR4.
Power supply replaced
The Seasonic Platinum power supply I bought used on ebay would die occasionally. It had boot issues, and I had to unplug to get it to reset properly. Finally gave in and picked up a Seasonic Focus 750W.
Memory issues with all 4 slots populated
I was doing some testing of other DRAM, and wanted to be sure it wasn't my other components so I tested my original DRAM. It had a lot of failures in Memtest86+, particularly test #6 (Moving inversions, 64 bit pattern).
So I started testing pairs and individual sticks, but the issue only seemed to come with all 4 sticks installed.
Based on some comments in this thread I changed the voltage (to 1.38V), and Trfc (to 800), and even tried running the RAM at 2133 (3200 sticks). Memtest86+ continued to fail so I guess I'm back to 16GB.
This machine is primarily an offline storage machine at this point so the memory loss isn't a big hit, but I did like having a more beefy machine for heavy tasks when needed.
An improper motherboard
I was moving dreadnought to an ATX case, and since chaos is a mostly offline fileserver these days I decided to put back the old Asus B350-F motherboard.
I took the time to remove unnecessary expansion cards (firewire, USB, 1G ethernet) which helps cut down on cabling.
This machine also got a different set of RAM as a result of shifting stick around. It was the set that was in justice. After doing some memtest I'm somewhat convinced this Ryzen 2600 just has memory controller issues. Whereas before I had problems running 4 DIMMS in the X470-PRO board, dreadnought has absolutely no issue with it. Now I'm running memtest and producing errors with only 2 DIMMS, even after I swapped and reseated them. I've reduced speed to 3000 to get a reliable setup.
Cheap RAM
I got a 32GB kit (2x16GB) for review. The brand is Hirvod.
It was sold as DDR4 3200 1.35V CL18. The chips are FBGA code D9ZFW, or Micron part number MT40A1G16KD-062E:E. These chips are DDR4 3200 CL22 1.2V chips. The actual XMP profile on these is 3200 1.35V CL19.
The set did 10 passes of Memtest86+.
Good thing is I managed to get 32GB with only two sticks (see previous trouble with 4 DIMMS). Unfortunately it is overvolted which is not ideal for longevity.