Some Apps wont Deploy after Pool Change

[Zain]

Hello,

I had to move apps over to new pool while I change raid type and add drives. After doing so, some of the apps fail to deploy (stuck on deploying). When looking at the pod shell, I see the following:

Code:

error: unable to upgrade connection: container not found ("AppNameHere")

Any help you have on this is much appreciated! TIA!

 

[Zain]

While trying to edit the app and saving changes, the following error populates:

Code:

Error: [EFAULT] Failed to update chart release: Error: UPGRADE FAILED: error validating "": error validating data: unknown object type "nil" in ConfigMap.data.port 

 

[morganL]

Apps are tied to a pool... you would have to be very surgical in this move.
What did you do?

 

[truecharts]

Apps are tied to a pool... you would have to be very surgical in this move.
What did you do?

Actually there is a build-in migration feature ;-)

While trying to edit the app and saving changes, the following error populates:

Code:

Error: [EFAULT] Failed to update chart release: Error: UPGRADE FAILED: error validating "": error validating data: unknown object type "nil" in ConfigMap.data.port 

It might be really worthwhile to be more specific which Apps and which Catalog you're refering to.
It's also good to state how you tried to move your Apps to another pool.

 

[Zain]

I used the built-in migration tool. Official tagged apps (Plex and manually installed apps) seem to work still, just not the TC apps. Radarr, Sonarr, Lidarr, Tautulli, Handbrake, Teamspeak.

 

[truecharts]

Might be best to file a bugreport on the iX Systems Jira.

 

[Zain]

Might be best to file a bugreport on the iX Systems Jira.

Well poo, I just created a ticket in your discord. Suppose I'll do this too.

 

[morganL]

@truecharts It would be useful to know if this is a problem for all truecharts apps and not just @Zain

Any idea why the problem exists?

 

[truecharts]

@truecharts It would be useful to know if this is a problem for all truecharts apps and not just @Zain

Any idea why the problem exists?

We cannot answer that, only @Zain can.
We're also not actively testing our Apps towards your migration scripting. Because even if that doesn't work, we're not the one able/needing to fix it anyway...

But technically speaking: It could be all sorts of things, but most likely a similair case as with the backup and restore (which was/is utterly broken on RC2). With Backup and Restore your scripting didn't take some kubernetes objects into account and did more agressive linting than on install.

Not even sure if this is a fluke, as we do not have many reports of migration working or not working, either way... :(

 

[Zain]

It’s all the TC apps on my server. Official apps (Plex and manually installed apps) work.

 

[truecharts]

Most likely PVC related.

 

[Zain]

Most likely PVC related.

Ideas on a fix?

 

[truecharts]

Ideas on a fix?

Get iX to review their code.
Sorry, it's not something we handle or even CAN handle and we currently do not have developers available to go fully review iX migration code.

 

[Zain]

Get iX to review their code.
Sorry, it's not something we handle or even CAN handle and we currently do not have developers available to go fully review iX migration code.

What are the odds, in your opinion, that I'm going to have to reinstall these apps? If this is going to be the case, do you know of a way that it can be performed in a way that I won't lose app settings/data?

 

[Zain]

This one isn't going to fall between the cracks is it? I can see a situation that has the potential of occurring here where IX stuff is working properly and migrates fine but third party apps does not and did not, respectively, possibly resulting in both sides not wanting to explore what the root cause is, simply because of well, what was stated above.

I could also see where IX could have a stance to say something along the lines of it being the third parties (TC) responsibility to make sure things (apps) are compatible with their (IX) software and thus absolve themselves of any responsibility to the issue at hand.

With that, How are IX Official apps, and those that are manually installed, installations different than TCs?

 

[stavros-k]

This one isn't going to fall between the cracks is it? I can see a situation that has the potential of occurring here where IX stuff is working properly and migrates fine but third party apps does not and did not, respectively, possibly resulting in both sides not wanting to explore what the root cause is, simply because of well, what was stated above.

I could also see where IX could have a stance to say something along the lines of it being the third parties (TC) responsibility to make sure things (apps) are compatible with their (IX) software and thus absolve themselves of any responsibility to the issue at hand.

With that, How are IX Official apps, and those that are manually installed, installations different than TCs?

Right now, TC Apps are the only apps using the storage provider from SCALE (PVC's).
Official apps (AFAIK) does not use those yet.

PVC's is like a docker volume. TC Apps request X storage from the host (scale) and wait until this is given.

That's why TC can't do much here, as the PVC's used in TC apps are handled by the host.

 

[Zain]

Right now, TC Apps are the only apps using the storage provider from SCALE (PVC's).
Official apps (AFAIK) does not use those yet.

PVC's is like a docker volume. TC Apps request X storage from the host (scale) and wait until this is given.

That's why TC can't do much here, as the PVC's used in TC apps are handled by the host.

Makes sense. Seems like this is pretty important for them to look in to then, if they plan on using PVC's in the near future.

 

[stavros-k]

Makes sense. Seems like this is pretty important for them to look in to then, if they plan on using PVC's in the near future.

Yes it is!
Also user bug reports on this, with actual debugs, will speed things up and also make it easier for devs to trace things!

 

[Zain]

Yes it is!
Also user bug reports on this, with actual debugs, will speed things up and also make it easier for devs to trace things!

They have all that from me.

 

[Zain]

Looks like I'll be left hanging in regards to a fix for my issue...

Muhammad Rehan added a comment - 1 hour ago

I have verified migrating applications from old pool to new pool and can confirm that PVCs and pods deploy correctly to the newly migrated pool in the nightlies..

https://jira.ixsystems.com/browse/NAS-114756 - **Marked as Closed, like they are done reviewing what happened?

Guess I'm stuck with re-installing the apps since it appears IX doesn't want to actually look into what actually happened to my migration. Thanks...