You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Kian Mohageri <ki...@gmail.com> on 2021/08/06 22:30:27 UTC

WARN on free space across data volumes (false positive)

When running a "nodetool scrub" to repair a table, the following warning
appears:

---

WARN 22:23:44,257 Only 40.420GiB free across all data volumes. Consider
adding more capacity to your cluster or removing obsolete snapshots
---

However, our storagedir has >2TB free space.

---
Filesystem      Size  Used Avail Use% Mounted on
overlay          47G  5.7G   39G  13% /
/dev/nvme0n1p9   47G  5.7G   39G  13% /alloc
/dev/nvme1n1    4.0T  1.3T  2.7T  34% /srv/var
---

I verified that cassandra is running with only a single
"-Dcassandra.storagedir=/srv/var/data" option, so I am not sure why the
warning is appearing.

Any help would be appreciated.  Thank you.

Kian

Re: WARN on free space across data volumes (false positive)

Posted by Jim Shaw <jx...@gmail.com>.
I will try cd to all directories of data files of this table, do
pwd  ---- get path
df -h "above path"

to see whether all have 2.7 TB ?


Thanks,
Jim

On Fri, Aug 6, 2021 at 6:31 PM Kian Mohageri <ki...@gmail.com>
wrote:

> When running a "nodetool scrub" to repair a table, the following warning
> appears:
>
> ---
>
> WARN 22:23:44,257 Only 40.420GiB free across all data volumes. Consider
> adding more capacity to your cluster or removing obsolete snapshots
> ---
>
> However, our storagedir has >2TB free space.
>
> ---
> Filesystem      Size  Used Avail Use% Mounted on
> overlay          47G  5.7G   39G  13% /
> /dev/nvme0n1p9   47G  5.7G   39G  13% /alloc
> /dev/nvme1n1    4.0T  1.3T  2.7T  34% /srv/var
> ---
>
> I verified that cassandra is running with only a single
> "-Dcassandra.storagedir=/srv/var/data" option, so I am not sure why the
> warning is appearing.
>
> Any help would be appreciated.  Thank you.
>
> Kian
>

Re: WARN on free space across data volumes (false positive)

Posted by Erick Ramirez <er...@datastax.com>.
Out of curiosity, does that mean that your `data_file_directories` is
different to `storageDir`?

Re: WARN on free space across data volumes (false positive)

Posted by Kian Mohageri <ki...@gmail.com>.
Thanks all - it looks to be a bug as Dmitry pointed out.

On Sat, Aug 7, 2021 at 4:40 AM Dmitry Saprykin <sa...@gmail.com>
wrote:

> I had the same warning for nodetool upgradesstables. Nodetool just checks
> wrong location. CASSANDRA-16104
>
>
> On Fri, Aug 6, 2021 at 9:28 PM Erick Ramirez <er...@datastax.com>
> wrote:
>
>> I'd say that your `data_file_directories` is pointing at
>> /var/lib/cassandra/data and is mounted on the root volume instead of
>> /srv/var. Cheers!
>>
>

Re: WARN on free space across data volumes (false positive)

Posted by Dmitry Saprykin <sa...@gmail.com>.
I had the same warning for nodetool upgradesstables. Nodetool just checks
wrong location. CASSANDRA-16104


On Fri, Aug 6, 2021 at 9:28 PM Erick Ramirez <er...@datastax.com>
wrote:

> I'd say that your `data_file_directories` is pointing at
> /var/lib/cassandra/data and is mounted on the root volume instead of
> /srv/var. Cheers!
>

Re: WARN on free space across data volumes (false positive)

Posted by Erick Ramirez <er...@datastax.com>.
I'd say that your `data_file_directories` is pointing at
/var/lib/cassandra/data and is mounted on the root volume instead of
/srv/var. Cheers!