Network Plan | Two Networks with 10GB NIC for internal

[K1LLA_KING_KONG]

Can I please get some guidence to set this up.

Purpose:

Blue line is standard Gigabit LAN for internet access
Red Line is 10GB for internal access to server (QLogic BCM57810 10 Gigabit Ethernet)
Server will still require internet access for remote SMB file access, I hope to use Tailscale

1. Is it viable?
2. Where do I begin?

 

[sretalla]

You've said it in the title... two networks.

Have you specified different network addresses for the 1 and 10G networks?

like 192.168.0.0/24 for 1G and 192.168.1.0/24 for 10G

 

[danb35]

Can I please get some guidence to set this up.

Add a switch like the Mikrotik CRS305 and eliminate the gigabit links. Run 10G links from the two PCs and your server to the switch, and run a gigabit connection from the switch to your router.

 

[jgreco]

Red Line is 10GB for internal access to server (QLogic BCM57810 10 Gigabit Ethernet)

Neither of these are recommended and you will likely end up having problems with them. Please refer to the 10 Gig Networking Primer in the Resources section for recommended 10G hardware.

 

[K1LLA_KING_KONG]

You've said it in the title... two networks.

Have you specified different network addresses for the 1 and 10G networks?

like 192.168.0.0/24 for 1G and 192.168.1.0/24 for 10G

Yes I've just got this done now. So now I have 2 different IP's I can connect to Truenas with via the browser

 

[sretalla]

OK, but looking again at the advice above and at your design...

You'll actually need each of the 10G interfaces to be on its own network, so TrueNAS to PC1 on 192.168.1.0/24 and TrueNAS to PC2 on 192.168.2.0/24. This way, TrueNAS will route properly to each.

You could consider getting the switch mentioned above to avoid the need for that.

You should also consider that your experience is likely to be sub-optimal if you continue with that card... YMMV.

 

[K1LLA_KING_KONG]

Add a switch like the Mikrotik CRS305 and eliminate the gigabit links. Run 10G links from the two PCs and your server to the switch, and run a gigabit connection from the switch to your router.

Ah OK, I was trying to avoid buying a switch if I didn't need it, but I can see how that makes more sense.

 

[danb35]

I was trying to avoid buying a switch if I didn't need it

It's possible to make something like this work without a switch, but it's so much simpler to use one.

 

[K1LLA_KING_KONG]

You'll actually need each of the 10G interfaces to be on its own network, so TrueNAS to PC1 on 192.168.1.0/24 and TrueNAS to PC2 on 192.168.2.0/24. This way, TrueNAS will route properly to each.

Theres all 3 set up now.
I'll look into a switch, but either way I still need to learn:

How do you direct the file sharing through the 10GB network and not the gigabit?

 

[K1LLA_KING_KONG]

It's possible to make something like this work without a switch, but it's so much simpler to use one.

With a switch involved, Id have the same question as above: How do you direct the SMB file sharing through the 10GB network and not the gigabit?

 

[Patrick M. Hausen]

192.168.2.0/24 and 192.168.4.0/24 are not valid IP addresses for a host. You need to start with .1 respectively.

Then with your PC having another address in that same network simply use that IP address to mount the share. Then the 10 G link will be used.

 

[K1LLA_KING_KONG]

192.168.2.0/24 and 192.168.4.0/24 are not valid IP addresses for a host. You need to start with .1 respectively.

So you mean 192.168.1.0 and 192.168.2.0 ?

Then with your PC having another address in that same network simply use that IP address to mount the share. Then the 10 G link will be used.

Can you please elaborate on where do I allocate an IP for the share?

 

[danb35]

With a switch involved, Id have the same question as above: How do you direct the SMB file sharing through the 10GB network and not the gigabit?

With a switch involved as I'm suggesting, the only connection between the PCs and the NAS would be 10 GB--there would be no gigabit network for the data to go through.

 

[Patrick M. Hausen]

No, 192.168.2.1 for the NAS and 192.168.2.2 for your PC. Then use \\192.168.2.1\sharename to connect.

 

[sretalla]

Can you please elaborate on where do I allocate an IP for the share?

Services | SMB | Edit... then on the right side, "Bind IP Adresses"

Or as @danb35 suggests, forget all that and have a switch and only 10G connections.

 

[Patrick M. Hausen]

Services | SMB | Edit... then on the right side, "Bind IP Adresses"

That alone does not necessarily mean that the transfer is using that particular interface as @jgreco has been arguing quite insistingly.

But if client and server share a broadcast domain, i.e. directly attached network and these two IP addresses are used for communication, than the underlying layer 2 link will be used, too.

 

[K1LLA_KING_KONG]

No, 192.168.2.1 for the NAS and 192.168.2.2 for your PC. Then use \\192.168.2.1\sharename to connect.

Thats works great. Thank you

 

[K1LLA_KING_KONG]

Services | SMB | Edit... then on the right side, "Bind IP Adresses"

Or as @danb35 suggests, forget all that and have a switch and only 10G connections.

Yeah think I will, found it, cheers

 

[K1LLA_KING_KONG]

With a switch involved as I'm suggesting, the only connection between the PCs and the NAS would be 10 GB--there would be no gigabit network for the data to go through.

roger that

 

[K1LLA_KING_KONG]

With a switch involved as I'm suggesting, the only connection between the PCs and the NAS would be 10 GB--there would be no gigabit network for the data to go through.

Hey, just question about this switch, the ETH port says its for management access. Can it still accept incoming internet data? How else would it work?
And SFP is not an option from the router / modem

EDIT:
Taken from the manual:

Extension Slots and Ports​

• Four SFP+ cages, which accept both 1.25 Gb SFP and 10 Gb SFP+ modules.
• One Gigabit Ethernet port, suggested to be used for management (Supports Auto MDI/X so you can use either straight or cross-over cables for connecting to other network devices). The Ethernet port (ETH/BOOT) can also be used for network booting and recovery with Netinstall.
  
  With that stated, I would fee confident it can accept data from the router