Motherboard Selection

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
Hello,

I'm looking for recommendations on the Motherboard. Supermicro is the preferred brand. I want to know what is ideally recommended i.e. a workstation grade Motherboard or a pure Server grade Motherboard or they do not matter as long as the Motherboard has ECC support.

Thanks
 

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,996
That will depend on if you want IPMI. That is a huge feature for Server grade MB's. If your NAS will be remote, meaning in a different room like the basement, or even off site, IPMI is very nice to have. I love it and my server is upstairs. I never have to visit it.
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
That will depend on if you want IPMI. That is a huge feature for Server grade MB's. If your NAS will be remote, meaning in a different room like the basement, or even off site, IPMI is very nice to have. I love it and my server is upstairs. I never have to visit it.
Yes, indeed.
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
@Etorix and @probain Guys, would it be a wise choice to use a Workstation grade Motherboard and CPU such as SuperMicro X12SPA-TF paired with W3375 CPU or a server grade Motherboard with the server grade CPU such as Intel Xeon Silver/Gold/Platinum with a compatible Motherboard?

The reason to select a Workstation grade Motherboard is with a single socket CPU, it can offer up to 16 DIMMS so it will be future proof for me for a long long time.
 

ChrisRJ

Wizard
Joined
Oct 23, 2020
Messages
1,919
The reason to select a Workstation grade Motherboard is with a single socket CPU, it can offer up to 16 DIMMS so it will be future proof for me for a long long time.
That does not make sense to me. The number of DIMM slots on server boards is potentially at least on par with a workstation. Unless, of course, you only take the "wrong" server boards into account. But, as an example, in my case I have 8 DIMM slots.
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
That does not make sense to me. The number of DIMM slots on server boards is potentially at least on par with a workstation. Unless, of course, you only take the "wrong" server boards into account. But, as an example, in my case I have 8 DIMM slots.
Well, that's not true. Have a look at SuperMicro X12SPA-TF. It has 16 DIMMs for a single socket in the LGA4189 supporting W-33xx CPUs for the Ice Lake lineup. This is quite flexible if you have like 16/32 sticks, it would be 16x16GB = 256 and 16x32GB = 512GB. 16GB and 32GB are easy to source. Now, if you take the same thing on a server where it has 8 DIMMs per socket, that would be 8x16GB = 128GB and 8x32GB=256GB. Now suppose if i have to utilize the 512GB on the same board, either i will have to source 64GB stick or install another CPU in the other socket to utilize the rest of the 8DIMMs. Do you get my point now?
 

ChrisRJ

Wizard
Joined
Oct 23, 2020
Messages
1,919
I think there is simply a slight misunderstanding here :smile:.

What I disagree with is the general statement that workstation boards offer more DIMM slots than server boards. At least that is how I read your post. Of course, the board you have chose does offer a great number of slots. And 16 slots is also more than many server boards have. But as a general rule it is wrong in my opinion. That's all I wanted to convey.
 

probain

Patron
Joined
Feb 25, 2023
Messages
211
I haven't researched those boards. But basically, I went server due a couple of factors as listed below:
Good deal on H12SSL-i + Epyc 7302p on ebay.
I wanted PCIe 4.0 for future proofing for NVME's and such.
Lots of PCIe-lanes (128)
I like what AMD is doing in the server space.
IPMI/BMC, a big must for me. Since the server is running headless.

Looking at the board. It looks like a good choice. You'll most likely be happy with that one. Just have a think through regarding the PCIe lanes, slots and other connectivity. Having more lanes and such, is in my oppinion a better way of "future proofing". Since you can always buy bigger DIMMS. But you can't install more lanes after the fact.
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
I think there is simply a slight misunderstanding here :smile:.

What I disagree with is the general statement that workstation boards offer more DIMM slots than server boards. At least that is how I read your post. Of course, the board you have chose does offer a great number of slots. And 16 slots is also more than many server boards have. But as a general rule it is wrong in my opinion. That's all I wanted to convey.
Oh, i see. So, as per you, using a Workstation board with 16 DIMM slots is wrong or just using a Workstation board is not ideal?
 

ChrisRJ

Wizard
Joined
Oct 23, 2020
Messages
1,919
Oh, i see. So, as per you, using a Workstation board with 16 DIMM slots is wrong or just using a Workstation board is not ideal?
I have meant to say neither. I would likely prefer a server boards because of IPMI. And since I personally don't need 512 GB of RAM the 16 slots do not provide value to me. But that may be different for others.
 

probain

Patron
Joined
Feb 25, 2023
Messages
211
Also. Read the manual and se how much PCIe bifurcation you'll have access to. Which is essential for instance if you want to populate more with NVME-drives, or similar
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
I haven't researched those boards. But basically, I went server due a couple of factors as listed below:
Good deal on H12SSL-i + Epyc 7302p on ebay.
I wanted PCIe 4.0 for future proofing for NVME's and such.
Lots of PCIe-lanes (128)
I like what AMD is doing in the server space.
IPMI/BMC, a big must for me. Since the server is running headless.
I love IPMI.

Looking at the board. It looks like a good choice. You'll most likely be happy with that one. Just have a think through regarding the PCIe lanes, slots and other connectivity. Having more lanes and such, is in my oppinion a better way of "future proofing". Since you can always buy bigger DIMMS. But you can't install more lanes after the fact.
If you read my previous post, that's the main reason to go with such Workstation boards offering up to 16DIMM and as ZFS loves RAM, it is quite easy to source 16GB/32GB sticks. Yes, thanks for reminding me the lanes thingy, i almost forgot that. Thank you for the big help!
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
I have meant to say neither. I would likely prefer a server boards because of IPMI. And since I personally don't need 512 GB of RAM the 16 slots do not provide value to me. But that may be different for others.
The model i mentioned has IPMI. It's Supermicro ;)

I get ya.
 

probain

Patron
Joined
Feb 25, 2023
Messages
211
Also, be aware that Supermicro have their own front-panel connector. So if you're not using a SM-case, then you'll have to source an adapter cable for a few $. They're not expensive. But it would be extremely frustrating to have that being the thing keeping you from using the front panel (and power button) properly.
 

Fastline

Patron
Joined
Jul 7, 2023
Messages
358
Also, be aware that Supermicro have their own front-panel connector. So if you're not using a SM-case, then you'll have to source an adapter cable for a few $. They're not expensive. But it would be extremely frustrating to have that being the thing keeping you from using the front panel (and power button) properly.
Damn shit. I see so much sadness here ;(
 

Davvo

MVP
Joined
Jul 12, 2022
Messages
3,222
That's likely true for rack motherboards only, I had no issues with my front panel connector.

Go with server boards, IPMI is a must have (ie can flash the BIOS in order to support the CPU you have without buying another) and they are more likely to be found used.
 

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,996
Always download the manual for the motherboard and read it completely. Make sure you understand what it offers you and what it does not. With the money you are spending, it's the smart thing to do.
I had no issues with my front panel connector.
Same for me, no issues.
 

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,996
I don't know what the difference is between a Workstation and Server motherboard for Supermicro but the X12SPA-TF to me could pass as a server board. I too would not need 16 slots for RAM, 8 would be fine for my needs (or 4). I guess a workstation may need that kind of capacity due to what it may need to do, and major development can eat up all kinds of memory. I'm thinking it could be running 4 different OS's on VMWare and those have video editing or virtual modeling, programming, etc. Memory hogs. Maybe that is the difference between Workstation and Server.

EDIT: 4TB of RAM ! Now that is a NAS!
 

Davvo

MVP
Joined
Jul 12, 2022
Messages
3,222
Likely the video outputs integrated into the motherboard, lots of PCIe slots with full x16 lanes and additional lanes/ports for NVMe?
 
Top