Pool out of space - but it's empty

Joined
Apr 13, 2015
Messages
23
FreeNAS-11.3-U1

I have a "scratch" pool (temporary space, only used as the download location before it's moved to a Media pool) that appears to be full but doesn't have any content in it.
Annotation 2020-05-03 112438.png


Below I'm using 12.9GB because I've paused a download. But it's no where near the 900GB capacity of the pool.
1588530380450.png


I thought maybe it was a problem of snapshots filling the drive but when I go in FreeNAS/Storage/Snapshot and filter by "Scratch" nothing shows and SSH confirms:
1588531449056.png


zpool status (for Scratch):
1588531896158.png

zpool get all Scratch
1588532049066.png

zpool list:
1588532130305.png

zfs list Scratch:
1588532227042.png

df -h Scratch:
1588532459251.png

And I've attached a
Code:
zfs get all
log to this post.

I'm just not seeing the problem because I don't see any space being used on the Scratch pool. Any ideas?

thank you for looking.
 

Attachments

  • ZFS GET ALL.txt
    1.5 MB · Views: 272

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
Snapshots... they take up space (particularly for deleted files).
 
Joined
Apr 13, 2015
Messages
23
How would I go about finding that content? When I "ls" into /mnt/Scratch/.zfs/snapshot nothing shows. Do the deleted items snapshots reside in a folder that root can't see?
1588539065312.png
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
I'm not on a device where I can spell it out for you now, but searching zfs set visible should show up something which may populate that structure you can see.

Also, look at the GUI under Storage | Snapshots
 
Joined
Apr 13, 2015
Messages
23
Oh yeah - zfs is visible; did that a few days ago. GUI doesn't show any snapshots for "Scratch" (same as what SSH shows - notta)

Thx
 
Last edited:

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
Then maybe it's a dataset-directory collision.
Are you certain there are no child datasets of Scratch?
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
Restart your downloader jail.
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
I am also impacted by that bug where items deleted within the downloader jail don't register as deleted on the host and the used space isn't decremented until the jail is restarted... I haven't given it a lot of attention recently, but it was a reported bug perhaps more than a year ago which was supposed to be fixed in a version that's probably already out... seems not fixed to me.
 
Joined
Apr 13, 2015
Messages
23
I am also impacted by that bug where items deleted within the downloader jail don't register as deleted on the host and the used space isn't decremented until the jail is restarted... I haven't given it a lot of attention recently, but it was a reported bug perhaps more than a year ago which was supposed to be fixed in a version that's probably already out... seems not fixed to me.
Restarting the jail solved it. Thank you!
1588616266975.png
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,700
You'll need to periodically do that to stop the jail/pool thinking it's out of space until the bug gets sorted... you may wait a while for that.
 
Joined
Apr 13, 2015
Messages
23
You'll need to periodically do that to stop the jail/pool thinking it's out of space until the bug gets sorted... you may wait a while for that.
Yeah. At least I now know what's going on. I appreciate your help over those few days. Have a good one.
 
Top