All apps stuck at deploying after Bluefin RC1 Update ...

[pixelwave]

I updated today to Bluefin RC1 but now all apps are stuck at deploying state? I already tried stop/start and whole system reboot but no change ...? Also no Shell / Log output ...

 

[cwagz]

It is probably what is discussed in this thread:

Post in thread 'Plex won't allow its data path to be SMB shared'
https://www.truenas.com/community/t...data-path-to-be-smb-shared.105556/post-726552

 

[pixelwave]

Awesome ... yes that was the solution! I deactivated the kubernetes setting:

Now all is up again ... plus the Web Portal Quick Link addition in bluefin is quite helpful! :)

... since I access / edit most of my docker container shares via SMB I have to always leave that feature disabled if I understand correctly?

 

[Snow]

This Fixed my issues as well!
@pixelwave Are you doing driect connect 40GB/s or are you running a switch?

 

[Snow]

I am having a problem with Couch Potato stuck at deploying. I do not see the problem in the log.

Code:

 2023-01-03 0:28:21
Deleting load balancer
2023-01-03 0:28:21
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-75c4a241
2023-01-03 0:28:21
Deleted load balancer
2023-01-03 0:28:21
Scaled down replica set couch-couchpotato-6d958d844 to 0 from 1
2023-01-03 0:28:21
Deleted pod: couch-couchpotato-6d958d844-z5hgc
2023-01-03 0:16:54
Startup probe failed: dial tcp 172.16.0.112:5050: connect: connection refused
2023-01-03 0:16:40
Container image "tccr.io/truecharts/couchpotato:v2021.11.22" already present on machine
2023-01-03 0:16:40
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-03 0:16:40
Created container couch-couchpotato
2023-01-03 0:16:40
Started container couch-couchpotato
2023-01-03 0:16:39
Add eth0 [172.16.0.112/16] from ix-net
2023-01-03 0:16:39
Container image "tccr.io/truecharts/ubuntu:jammy-20221101@sha256:4b9475e08c5180d4e7417dc6a18a26dcce7691e4311e5353dbb952645c5ff43f" already present on machine
2023-01-03 0:16:39
Created container prepare
2023-01-03 0:16:39
Started container prepare
2023-01-03 0:16:38
Ensuring load balancer
2023-01-03 0:16:38
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-75c4a241
2023-01-03 0:16:38
Scaled up replica set couch-couchpotato-6d958d844 to 1 from 0
2023-01-03 0:16:38
Created pod: couch-couchpotato-6d958d844-z5hgc
2023-01-03 0:16:38
Successfully assigned ix-couch/couch-couchpotato-6d958d844-z5hgc to ix-truenas
2023-01-03 0:16:33
Deleting load balancer
2023-01-03 0:16:33
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-293259ce
2023-01-03 0:16:33
Deleted load balancer
2023-01-03 0:16:33
Deleted pod: couch-couchpotato-d5d6d74f-brdxt
2023-01-03 0:16:33
Stopping container couch-couchpotato
2023-01-03 0:15:01
Startup probe failed: dial tcp 172.16.0.108:5050: connect: connection refused
2023-01-03 0:14:59
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-03 0:14:58
Job completed
2023-01-03 0:14:58
Ensuring load balancer
2023-01-03 0:14:58
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-293259ce
2023-01-03 0:14:49
Add eth0 [172.16.0.109/16] from ix-net
2023-01-03 0:14:49
Container image "tccr.io/truecharts/kubectl:v1.26.0@sha256:6d6e0e50f28b961ed1c1c6a9c140553238641591fbdc9ac7c1a348636f78c552" already present on machine
2023-01-03 0:14:49
Created container couch-couchpotato-manifests
2023-01-03 0:14:49
Started container couch-couchpotato-manifests
2023-01-03 0:14:48
Created pod: couch-couchpotato-manifests-8v2pq
2023-01-03 0:14:48
Successfully assigned ix-couch/couch-couchpotato-manifests-8v2pq to ix-truenas
2023-01-03 0:14:47
Add eth0 [172.16.0.108/16] from ix-net
2023-01-03 0:14:47
Container image "tccr.io/truecharts/couchpotato:v2021.11.22@sha256:8ae544711733eb7b9cffc7c98d08e5ae863615b4c2ce01921130e53cc0c3126a" already present on machine
2023-01-03 0:14:47
Created container couch-couchpotato
2023-01-03 0:14:47
Started container couch-couchpotato
2023-01-03 0:14:46
Created pod: couch-couchpotato-d5d6d74f-brdxt
2023-01-03 0:14:46
Successfully assigned ix-couch/couch-couchpotato-d5d6d74f-brdxt to ix-truenas
2023-01-03 0:14:39
Deleting load balancer
2023-01-03 0:14:39
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-5af7f8ee
2023-01-03 0:14:39
Deleted load balancer
2023-01-03 0:14:39
Deleted pod: couch-couchpotato-d5d6d74f-f286b
2023-01-03 0:10:57
Startup probe failed: dial tcp 172.16.0.105:5050: connect: connection refused
2023-01-03 0:10:56
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-03 0:10:55
Job completed
2023-01-03 0:10:55
Ensuring load balancer
2023-01-03 0:10:55
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-5af7f8ee
2023-01-03 0:10:45
Started container couch-couchpotato-manifests
2023-01-03 0:10:44
Created pod: couch-couchpotato-manifests-bphqr
2023-01-03 0:10:44
Successfully assigned ix-couch/couch-couchpotato-manifests-bphqr to ix-truenas
2023-01-03 0:10:44
Add eth0 [172.16.0.106/16] from ix-net
2023-01-03 0:10:44
Container image "tccr.io/truecharts/kubectl:v1.26.0@sha256:6d6e0e50f28b961ed1c1c6a9c140553238641591fbdc9ac7c1a348636f78c552" already present on machine
2023-01-03 0:10:44
Created container couch-couchpotato-manifests
2023-01-03 0:10:43
Add eth0 [172.16.0.105/16] from ix-net
2023-01-03 0:10:43
Container image "tccr.io/truecharts/couchpotato:v2021.11.22@sha256:8ae544711733eb7b9cffc7c98d08e5ae863615b4c2ce01921130e53cc0c3126a" already present on machine
2023-01-03 0:10:43
Created container couch-couchpotato
2023-01-03 0:10:43
Started container couch-couchpotato
2023-01-03 0:10:42
Created pod: couch-couchpotato-d5d6d74f-f286b
2023-01-03 0:10:42
Successfully assigned ix-couch/couch-couchpotato-d5d6d74f-f286b to ix-truenas
2023-01-03 0:09:30
Deleting load balancer
2023-01-03 0:09:30
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-6a3b213e
2023-01-03 0:09:30
Deleted load balancer
2023-01-03 0:09:30
Deleted pod: couch-couchpotato-d5d6d74f-xnrxh
2023-01-02 23:45:44
Ensuring load balancer
2023-01-02 23:45:44
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-6a3b213e
2023-01-02 23:45:44
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-02 23:45:44
Startup probe failed: dial tcp 172.16.0.102:5050: connect: connection refused
2023-01-02 23:45:43
Job completed
2023-01-02 23:45:36
Add eth0 [172.16.0.103/16] from ix-net
2023-01-02 23:45:36
Container image "tccr.io/truecharts/kubectl:v1.26.0@sha256:6d6e0e50f28b961ed1c1c6a9c140553238641591fbdc9ac7c1a348636f78c552" already present on machine
2023-01-02 23:45:36
Created container couch-couchpotato-manifests
2023-01-02 23:45:36
Started container couch-couchpotato-manifests
2023-01-02 23:45:35
Created pod: couch-couchpotato-manifests-b4pd8
2023-01-02 23:45:35
Successfully assigned ix-couch/couch-couchpotato-manifests-b4pd8 to ix-truenas
2023-01-02 23:45:34
Add eth0 [172.16.0.102/16] from ix-net
2023-01-02 23:45:34
Container image "tccr.io/truecharts/couchpotato:v2021.11.22@sha256:8ae544711733eb7b9cffc7c98d08e5ae863615b4c2ce01921130e53cc0c3126a" already present on machine
2023-01-02 23:45:34
Created container couch-couchpotato
2023-01-02 23:45:34
Started container couch-couchpotato
2023-01-02 23:45:33
Created pod: couch-couchpotato-d5d6d74f-xnrxh
2023-01-02 23:45:33
Successfully assigned ix-couch/couch-couchpotato-d5d6d74f-xnrxh to ix-truenas
2023-01-02 23:40:29
Deleted pod: couch-couchpotato-d5d6d74f-q5mhc
2023-01-02 23:40:28
Deleting load balancer
2023-01-02 23:40:28
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-344a1109
2023-01-02 23:40:28
Deleted load balancer
2023-01-02 23:38:19
Startup probe failed: dial tcp 172.16.0.96:5050: connect: connection refused
2023-01-02 23:38:18
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-02 23:38:17
Job completed
2023-01-02 23:38:17
Ensuring load balancer
2023-01-02 23:38:17
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-344a1109
2023-01-02 23:38:11
Started container couch-couchpotato-manifests
2023-01-02 23:38:10
Created pod: couch-couchpotato-manifests-7smz7
2023-01-02 23:38:10
Successfully assigned ix-couch/couch-couchpotato-manifests-7smz7 to ix-truenas
2023-01-02 23:38:10
Add eth0 [172.16.0.97/16] from ix-net
2023-01-02 23:38:10
Container image "tccr.io/truecharts/kubectl:v1.26.0@sha256:6d6e0e50f28b961ed1c1c6a9c140553238641591fbdc9ac7c1a348636f78c552" already present on machine
2023-01-02 23:38:10
Created container couch-couchpotato-manifests
2023-01-02 23:38:09
Add eth0 [172.16.0.96/16] from ix-net
2023-01-02 23:38:09
Container image "tccr.io/truecharts/couchpotato:v2021.11.22@sha256:8ae544711733eb7b9cffc7c98d08e5ae863615b4c2ce01921130e53cc0c3126a" already present on machine
2023-01-02 23:38:09
Created container couch-couchpotato
2023-01-02 23:38:09
Started container couch-couchpotato
2023-01-02 23:38:08
Created pod: couch-couchpotato-d5d6d74f-q5mhc
2023-01-02 23:38:08
Successfully assigned ix-couch/couch-couchpotato-d5d6d74f-q5mhc to ix-truenas
2023-01-02 23:34:03
Deleting load balancer
2023-01-02 23:34:03
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-064dce36
2023-01-02 23:34:03
Deleted load balancer
2023-01-02 23:34:03
Deleted pod: couch-couchpotato-d5d6d74f-7gwpc
2023-01-02 23:34:03
Scaled down replica set couch-couchpotato-d5d6d74f to 0 from 1
2023-01-02 23:31:54
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-02 23:31:53
Job completed
2023-01-02 23:31:53
Ensuring load balancer
2023-01-02 23:31:53
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-064dce36
2023-01-02 23:31:52
Startup probe failed: dial tcp 172.16.0.84:5050: connect: connection refused
2023-01-02 23:31:43
Add eth0 [172.16.0.85/16] from ix-net
2023-01-02 23:31:43
Container image "tccr.io/truecharts/kubectl:v1.26.0@sha256:6d6e0e50f28b961ed1c1c6a9c140553238641591fbdc9ac7c1a348636f78c552" already present on machine
2023-01-02 23:31:43
Created container couch-couchpotato-manifests
2023-01-02 23:31:43
Started container couch-couchpotato-manifests
2023-01-02 23:31:42
Created pod: couch-couchpotato-manifests-7pdpl
2023-01-02 23:31:42
Successfully assigned ix-couch/couch-couchpotato-manifests-7pdpl to ix-truenas
2023-01-02 23:31:42
Add eth0 [172.16.0.84/16] from ix-net
2023-01-02 23:31:42
Container image "tccr.io/truecharts/couchpotato:v2021.11.22@sha256:8ae544711733eb7b9cffc7c98d08e5ae863615b4c2ce01921130e53cc0c3126a" already present on machine
2023-01-02 23:31:42
Created container couch-couchpotato
2023-01-02 23:31:42
Started container couch-couchpotato
2023-01-02 23:31:40
Created pod: couch-couchpotato-d5d6d74f-7gwpc
2023-01-02 23:31:40
Successfully assigned ix-couch/couch-couchpotato-d5d6d74f-7gwpc to ix-truenas
2023-01-02 23:31:40
Scaled up replica set couch-couchpotato-d5d6d74f to 1 from 0
2023-01-02 23:23:37
Deleting load balancer
2023-01-02 23:23:37
Deleted LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-4152210b
2023-01-02 23:23:37
Deleted load balancer
2023-01-02 23:23:37
Scaled down replica set couch-couchpotato-d5d6d74f to 0 from 1
2023-01-02 23:23:37
Deleted pod: couch-couchpotato-d5d6d74f-bjt77
2023-01-02 23:17:53
Updated LoadBalancer with new IPs: [] -> [192.168.1.40]
2023-01-02 23:17:52
Ensuring load balancer
2023-01-02 23:17:52
Applied LoadBalancer DaemonSet kube-system/svclb-couch-couchpotato-4152210b
2023-01-02 23:17:51
Job completed
2023-01-02 23:17:41
Started container couch-couchpotato-manifests
2023-01-02 23:17:40
Add eth0 [172.16.0.64/16] from ix-net
2023-01-02 23:17:40
Container image "tccr.io/truecharts/kubectl:v1.26.0@sha256:6d6e0e50f28b961ed1c1c6a9c140553238641591fbdc9ac7c1a348636f78c552" already present on machine
2023-01-02 23:17:40
Created container couch-couchpotato-manifests
2023-01-02 23:17:40
Error: Error response from daemon: invalid volume specification: '/mnt/ZFSRZ/Media:/media': Invalid mount path. /mnt/ZFSRZ/Media. Following service(s) uses this path: `SMB Share`.
2023-01-02 23:17:38
Created pod: couch-couchpotato-manifests-lb7sz
2023-01-02 23:17:38
Successfully assigned ix-couch/couch-couchpotato-manifests-lb7sz to ix-truenas
2023-01-02 23:17:38
Add eth0 [172.16.0.63/16] from ix-net
2023-01-02 23:17:38
Container image "tccr.io/truecharts/couchpotato:v2021.11.22@sha256:8ae544711733eb7b9cffc7c98d08e5ae863615b4c2ce01921130e53cc0c3126a" already present on machine
2023-01-02 23:17:35
Scaled up replica set couch-couchpotato-d5d6d74f to 1 from 0
2023-01-02 23:17:35
Created pod: couch-couchpotato-d5d6d74f-bjt77
2023-01-02 23:17:35
Successfully assigned ix-couch/couch-couchpotato-d5d6d74f-bjt77 to ix-truenas

 

[pixelwave]

This Fixed my issues as well!
@pixelwave Are you doing driect connect 40GB/s or are you running a switch?

Currently direct connect. I have a main 1 GBe connection to the TrueNAS server and a secondary 40 GBe that goes directly to my Workstation. When I need that fast file transfer I attach a drive via the IP of the 40 GBe NIC…

Switch upgrade is planned …

 

[Snow]

Currently direct connect. I have a main 1 GBe connection to the TrueNAS server and a secondary 40 GBe that goes directly to my Workstation. When I need that fast file transfer I attach a drive via the IP of the 40 GBe NIC…

Switch upgrade is planned …

Did you just run fiber?

 

[pixelwave]

Did you just run fiber?

1 meter DAC cable .. which connects both Mellanox cards. Server and Workstation are both in one rack.

 

[sretalla]

Error: Error response from daemon: invalid volume specification: '/mnt/ZFSRZ/Media:/media': Invalid mount path. /mnt/ZFSRZ/Media. Following service(s) uses this path: `SMB Share`.

I am having a problem with Couch Potato stuck at deploying. I do not see the problem in the log.

I think that issue is well documented elsewhere... you need to stop SMB sharing that path.

 

[Snow]

I think that issue is well documented elsewhere... you need to stop SMB sharing that path.

Smb shares service has been disable and removed. All smb paths have been removed/changed. 4 out of 5 have deployed but couchp is stuck in deployed.

Ok so I have to change the mnt point?

 

[sretalla]

Smb shares service has been disable and removed. All smb paths have been removed/changed. 4 out of 5 have deployed but couchp is stuck in deployed.

Do you still see the same error reported for that app?

 

[Daisuke]

Awesome ... yes that was the solution!

That’s not a solution at all, iXsystems clearly states to avoid disabling that option. Please read the release notes, as everyone should do. See also the SMB Shares section of this thread, for a proper fix.

 

[Snow]

I got it to deploy