Other Devices get 77MB/s Sabnzbd gets 7MB/s

[Kohmei Kadoya]

Hi,

I am running Sabnzbd in my freenas box, however only get about 7MB/s max download speed when I download from usenet using sickrage/cp. When I run a speed test from other WiFi connected devices on the network, i get up to 77MB/s (EDIT it was actually 77mb/s). I can't seem the figure out why there is such a big difference in download speeds. Could it be memory?

Thanks in advance,

Here are some specs:
GA-Z87X-UDH3 motherboard, using the built in intel gigabit ethernet.
8GB crucial memory
4 * 3TB WD Red in RAID 10
Intel G3258 Pentium

Usenet provider: Newshosting
Sab:

Here are some images:
Speedtest from my laptop:

FreeNAS reporting tab:

Here is what happens when I run ifconfig:

em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=40098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,VLAN_HWTSO>
ether 74:d4:35:1e:42:59
inet 192.168.3.2 netmask 0xffffff00 broadcast 192.168.3.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>
status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 02:06:57:c3:e3:00
nd6 options=1<PERFORMNUD>
id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
member: epair2a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 6 priority 128 path cost 2000
member: epair1a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 5 priority 128 path cost 2000
member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 4 priority 128 path cost 2000
member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 1 priority 128 path cost 20000
epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=8<VLAN_MTU>
ether 02:ff:20:00:04:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active
epair1a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=8<VLAN_MTU>
ether 02:ff:20:00:05:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active
epair2a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=8<VLAN_MTU>
ether 02:ff:20:00:06:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active

 

[Gnome]

Firstly: 77 megabits (Mbps) is equivalent to 9,17912 mebibytes (written MiB)
SABnzbd is measuring 6.1 MiB/s which is only 2 MiB away from your actual speed test.

Secondly, speed test is a bad approximation.
Service providers often put SpeedTest on a prioritized list just to make your connection speed look better than it is
Run SABnzbd on one of your computers to see what results you get and compare that instead

 

[Kohmei Kadoya]

Firstly: 77 megabits (Mbps) is equivalent to 9,17912 mebibytes (written MiB)
SABnzbd is measuring 6.1 MiB/s which is only 2 MiB away from your actual speed test.

Secondly, speed test is a bad approximation.
Service providers often put SpeedTest on a prioritized list just to make your connection speed look better than it is
Run SABnzbd on one of your computers to see what results you get and compare that instead

Thanks for the clarification. I thought speedtest also measured in megabytes.
2 Questions:
Is there a better way to test network speed other than speed test? Perferably something I can also run in FreeNAS. (I can't seem to find any without making another server somewhere outside of you lan)

I pay for a 1Gigabit connection to my ISP. Is 77megatibits or 7megabites reasonable?

Thanks again,

 

[Nick2253]

Thanks for the clarification. I thought speedtest also measured in megabytes.
2 Questions:
Is there a better way to test network speed other than speed test? Perferably something I can also run in FreeNAS. (I can't seem to find any without making another server somewhere outside of you lan)

I pay for a 1Gigabit connection to my ISP. Is 77megatibits or 7megabites reasonable?

Thanks again,

I would say that 77 Mbps is very unreasonable, since it less than 8% of 1Gbps. However, without knowing more about your ISP, it's difficult to say what's going on for sure.

My preferred method for testing ISP connection speed is to download a large file (like an ISO) directly from a large company (like Google or Microsoft). Their connections are incredibly fast, and I am able to saturate my "slow" 100Mbps connection. For example, you could download a Windows 10 trial VM (https://developer.microsoft.com/en-us/microsoft-edge/tools/vms/) or the Android Studio (however, that might be too small for a good 1Gbps connection). Testing your upload is much more difficult, unless you have a friend with a similarly high download speed.

 

[Kohmei Kadoya]

I would say that 77 Mbps is very unreasonable, since it less than 8% of 1Gbps. However, without knowing more about your ISP, it's difficult to say what's going on for sure.

My preferred method for testing ISP connection speed is to download a large file (like an ISO) directly from a large company (like Google or Microsoft). Their connections are incredibly fast, and I am able to saturate my "slow" 100Mbps connection. For example, you could download a Windows 10 trial VM (https://developer.microsoft.com/en-us/microsoft-edge/tools/vms/) or the Android Studio (however, that might be too small for a good 1Gbps connection). Testing your upload is much more difficult, unless you have a friend with a similarly high download speed.

I just download a file from the website (from the wifi connected laptop) and got about 8MB/s. Is there a way to downloads this file to my Freenas machine? I feel like the wifi connection is slowing the download speed so I want to test with a ethernet connection. And my freenas macine is the only pc that has a ethaernet connector.

 

[Nick2253]

You can use wget or curl to download files. I'm not at my FreeNAS server at the moment, so I'm not sure if either of those are available, but I'd assume that at least one of them are. (http://www.thegeekstuff.com/2012/07/wget-curl/)

 

[Valdhor]

I had the same thing happen to me. Sabnzbd seemed to be limited to 8MB/s from UsenetServer even though the connection to my ISP is 200Mb/s (About 20 MB/s). I didn't change anything except to update to the latest 9.10 STABLE on June 26 2016. Now I get a consistent 19MB/s.

 

[Kohmei Kadoya]

First off, thanks to everyone who has been helping me. I really appreciate the help - it would take me much longer to figure this out myself.

When I use curl to download a test file from Microsoft, it gives me 2419k/s, and correct me if I'm wrong but thats 2.3MB/s. Which is even slower than what I get in Sabnzbd.

Another thing that might or might not be related to this is that when I click check for update in the freenas update tab it gives me a error:

I am using a router/wifi access-point that came from my isp. Unfortunately I cant find any specs of my router but I assume it is capable transferring at 1Gb/s since it came with a cat 5e cable.

Please help me find the part that is slowing down my network.

Thanks

 

[ttabbal]

What is the speed like when you connect a single WIRED connection to the router? Keep testing with the Microsoft file. Or a download from another known fast source.

Check the wired link speed. It's entirely possible that the router wired ports are 100Mb, or some other issue is forcing lower speeds.

If your connection on the WAN side of the router is ethernet, try connecting a computer directly to that. Perhaps the router isn't up to the task. You need to eliminate variables to narrow down where the problem is.

 

[Kohmei Kadoya]

What is the speed like when you connect a single WIRED connection to the router? Keep testing with the Microsoft file. Or a download from another known fast source.

Check the wired link speed. It's entirely possible that the router wired ports are 100Mb, or some other issue is forcing lower speeds.

If your connection on the WAN side of the router is ethernet, try connecting a computer directly to that. Perhaps the router isn't up to the task. You need to eliminate variables to narrow down where the problem is.

Thank you for the tips.

So when I disable wifi on my router and only connect my FreeNAS box via Ethernet, I still get about 2600kb/s. Which is the same as when I have other devices connected by wifi.

My connection to the Internet comes from a "modular jack" from the wall which is much smaller the regual Ethernet ports. And that cable goes though a converter thing which has the modular imput and 1 lan Ethernet output.

When I tried connecting that lan output from the converter to my FreeNAS machine, and try downloading the test file, it says can't resolve host name and basically won't connect to the Ethernet.

However the surprising thing is that when I got a old laptop and connect it directly via Ethernet to the router. I get about 10MB/s when using curl to download the test file. Also I can connect to the Internet here.

But when I connect the old laptop directly to the modem, I can't connect to the Internet but I can still download files with curl at the same speed as before (10MB/s).

Thanks

 

[Nick2253]

So when I disable wifi on my router and only connect my FreeNAS box via Ethernet, I still get about 2600kb/s. Which is the same as when I have other devices connected by wifi.

Precise language is extremely important here. You were getting ~2500kB/s (capital B=bytes) before, but now you say you are getting 2600kb/s (lowercase b=bits). I'm assuming you mean 2600kB/s, but I hate assuming anything, especially when I've seen more than once where a confusion over bits and bytes was the source of the problem.

But when I connect the old laptop directly to the modem, I can't connect to the Internet but I can still download files with curl at the same speed as before (10MB/s).

If you can download the file, then you are connecting to the Internet. What you probably mean is that, without your router, which is your DNS server, you can't resolve DNS queries, unless they've been cached by your system already. What kind of laptop are we dealing with here? Linux, Mac?

I think, with this test, we've pretty much concluded that you have no problems with your FreeNAS. If you're maxing out at 10MB/s with the laptop, then you're right in the same ballpark as what Sabnzbd is getting.

However, I would review your contract with your ISP. My guess is that your service is ~80Mbps, not 1Gbps. Make sure you're not confusing your internet connection speed with what your ethernet link is negotiated at.

 

[Kohmei Kadoya]

Precise language is extremely important here. You were getting ~2500kB/s (capital B=bytes) before, but now you say you are getting 2600kb/s (lowercase b=bits). I'm assuming you mean 2600kB/s, but I hate assuming anything, especially when I've seen more than once where a confusion over bits and bytes was the source of the problem.



If you can download the file, then you are connecting to the Internet. What you probably mean is that, without your router, which is your DNS server, you can't resolve DNS queries, unless they've been cached by your system already. What kind of laptop are we dealing with here? Linux, Mac?

I think, with this test, we've pretty much concluded that you have no problems with your FreeNAS. If you're maxing out at 10MB/s with the laptop, then you're right in the same ballpark as what Sabnzbd is getting.

However, I would review your contract with your ISP. My guess is that your service is ~80Mbps, not 1Gbps. Make sure you're not confusing your internet connection speed with what your ethernet link is negotiated at.

Thank you for all the information and sorry about kb/s and KB/s. I meant to say 2600KB/s.

I called my ISP yesterday and they told me that I have a gigabit connection.

One thing I want you to know is that I get 2600KB/s downloading the test file to my freenas server while I get 10MB/s to my 2010 Mac Book Pro. With both of them one by one plugged in via Ethernet in the exact same setup, is there a way to be sure that there is no problem with the freenas machine?

Also I know it will be pretty hard to test this but is it possible that my modular to Ethernet converter box have a 100mb/s or 10MB/s limit? It seems odd that all my downloads speeds stop exactly at 10MB/s.

 

[Nick2253]

One thing I want you to know is that I get 2600KB/s downloading the test file to my freenas server while I get 10MB/s to my 2010 Mac Book Pro. With both of them one by one plugged in via Ethernet in the exact same setup, is there a way to be sure that there is no problem with the freenas machine?

There could be some problem, but since you can get 7Mb/s with your Sabnzbd server, we know that you can connect faster than that. I would assume it's something weird with FreeNAS, or it could be because you are connecting with the other services, and that's limiting your bandwidth.

Also I know it will be pretty hard to test this but is it possible that my modular to Ethernet converter box have a 100mb/s or 10MB/s limit? It seems odd that all my downloads speeds stop exactly at 10MB/s.

Were both your DSL modem and router provided by your ISP? Or did you have to procure them yourself? If the modem is from your ISP, I would call and complain. However, if it's not, then you probably need a better modem, or perhaps your current modem was damaged somehow, so you just need a replacement.

The easiest way to tell if the ethernet jack on the modem is the problem is if you check what speed your network adapter negotiates at when you connect directly to the modem. If you negotiate to 100Mbps, then you've found your problem.

 

[Kohmei Kadoya]

There could be some problem, but since you can get 7Mb/s with your Sabnzbd server, we know that you can connect faster than that. I would assume it's something weird with FreeNAS, or it could be because you are connecting with the other services, and that's limiting your bandwidth.

Were both your DSL modem and router provided by your ISP? Or did you have to procure them yourself? If the modem is from your ISP, I would call and complain. However, if it's not, then you probably need a better modem, or perhaps your current modem was damaged somehow, so you just need a replacement.

The easiest way to tell if the ethernet jack on the modem is the problem is if you check what speed your network adapter negotiates at when you connect directly to the modem. If you negotiate to 100Mbps, then you've found your problem.

The modem and router/acess point combo were both provided to me by the ISP. I will call them later today and ask them about this.

The problem with directly connecting to the modem to see the negotiation speed is that when my freenas box connects and tries to download a test file, it tells me that it can't resolve hostname. Another weird thing is that it says https://0.0.0.0 in the lan address part. (I tried typing ifconfig on my macbook but that dosent show me anything)

Any idea how to fix this?

 

[Nick2253]

The modem and router/acess point combo were both provided to me by the ISP. I will call them later today and ask them about this.

The problem with directly connecting to the modem to see the negotiation speed is that when my freenas box connects and tries to download a test file, it tells me that it can't resolve hostname. Another weird thing is that it says https://0.0.0.0 in the lan address part. (I tried typing ifconfig on my macbook but that dosent show me anything)

Any idea how to fix this?

I'm not sure what you're trying to do, but you don't need to download anything or resolve any hostnames to check the negotiated speed: http://www.cyberciti.biz/faq/find-freebsd-nic-speed-ifconfig-network-tool/

 

[Kohmei Kadoya]

Yeah sorry about that, for some reason I was trying to download the test file to check the negotiation speed.
Anyways here are the results I got this is my freeNAS machine and my laptop connected directly to the modem one by one.
(I think the freenas one is 1000kb/s and my laptop is 100kb/s but please double check)

FreeNAS:

Code:

em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
    ether 74:d4:35:1e:42:59
    inet 192.168.3.3 netmask 0xffffff00 broadcast 192.168.3.255
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
    options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
    inet6 ::1 prefixlen 128
    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
    inet 127.0.0.1 netmask 0xff000000
    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

MAC:

Code:

lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384
    options=3<RXCSUM,TXCSUM>
    inet6 ::1 prefixlen 128
    inet 127.0.0.1 netmask 0xff000000
    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
    nd6 options=1<PERFORMNUD>
gif0: flags=8010<POINTOPOINT,MULTICAST> mtu 1280
stf0: flags=0<> mtu 1280
en0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
    options=10b<RXCSUM,TXCSUM,VLAN_HWTAGGING,AV>
    ether 70:cd:60:f2:7e:ae
    inet6 fe80::72cd:60ff:fef2:7eae%en0 prefixlen 64 scopeid 0x4
    inet6 2400:2413:8c20:d700:72cd:60ff:fef2:7eae prefixlen 64 autoconf
    inet6 2400:2413:8c20:d700:a504:a1de:be1b:5157 prefixlen 64 autoconf temporary
    inet 169.254.128.187 netmask 0xffff0000 broadcast 169.254.255.255
    nd6 options=1<PERFORMNUD>
    media: autoselect (100baseTX <full-duplex>)
    status: active
en1: flags=8822<BROADCAST,SMART,SIMPLEX,MULTICAST> mtu 1500
    ether e0:f8:47:13:31:3e
    media: autoselect (<unknown type>)
    status: inactive
en3: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
    options=60<TSO4,TSO6>
    ether d2:00:16:dd:3f:60
    media: autoselect <full-duplex>
    status: inactive
fw0: flags=8822<BROADCAST,SMART,SIMPLEX,MULTICAST> mtu 4078
    lladdr c8:2a:14:ff:fe:6d:d3:f6
    media: autoselect <full-duplex>
    status: inactive
p2p0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 2304
    ether 02:f8:47:13:31:3e
    media: autoselect
    status: inactive
bridge0: flags=8822<BROADCAST,SMART,SIMPLEX,MULTICAST> mtu 1500
    options=63<RXCSUM,TXCSUM,TSO4,TSO6>
    ether 72:cd:60:2f:49:00
    Configuration:
        id 0:0:0:0:0:0 priority 0 hellotime 0 fwddelay 0
        maxage 0 holdcnt 0 proto stp maxaddr 100 timeout 1200
        root id 0:0:0:0:0:0 priority 0 ifcost 0 port 0
        ipfilter disabled flags 0x2
    member: en3 flags=3<LEARNING,DISCOVER>
            ifmaxaddr 0 port 6 priority 0 path cost 0
    media: <unknown type>
    status: inactive
ham0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1404
    ether 7a:79:19:6e:9d:22
    inet 25.110.157.34 netmask 0xff000000 broadcast 25.255.255.255
    inet6 fe80::7879:19ff:fe6e:9d22%ham0 prefixlen 64 scopeid 0xa
    inet6 2620:9b::196e:9d22 prefixlen 96
    nd6 options=1<PERFORMNUD>
    open (pid 75)

My MAC is a mac book pro 2010 so it has a gigabit ethernet port. I don't know why its saying 100kb/s. Also both of them used a cat 5e cable.

Thanks

 

[ttabbal]

Yes, freenas is connected at 1gb, mac at 100mb. Not enough information to say why. Try plugging the mac into the freenas cable. Could be a bad cable, switch port, a 100mb switch port, or the mac ethernet controller might have an issue.

What's the model number of the modem and router? Google might be able to find out what the port capabilities are on them.

 

[Kohmei Kadoya]

Yes, freenas is connected at 1gb, mac at 100mb. Not enough information to say why. Try plugging the mac into the freenas cable. Could be a bad cable, switch port, a 100mb switch port, or the mac ethernet controller might have an issue.

What's the model number of the modem and router? Google might be able to find out what the port capabilities are on them.

I rebooted my freenas and now it's says 100mb/s.

Also when I googled my modem it's says that my modem's maximum connection speed was 100mb/s. So I called the ISP and they said that apparently there is a box under my apartment which has 1gb/s but that box splits the connection at 100mb/s to each room. So that was limiting my connection speed.

Thanks for everyone's help on this!

I am now looking into getting my own 1gb connection.

Again thanks a lot for everything.