You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Surbhi Gupta <su...@gmail.com> on 2020/03/05 23:20:23 UTC
Upgradesstables - PerSSTableIndexWriter.java:211 - Rejecting value
Hi,
We are in process of upgrading from 3.11.0 to 3.115 .
While upgrading SSTables we are noticing messages like below in system.log.
What are the significance of these messages?
INFO [CompactionExecutor:3] 2020-03-05 16:12:41,393
PerSSTableIndexWriter.java:211 - Rejecting value (size 1.022KiB, maximum
1.000KiB) for column body (analyzed true) at
/mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
INFO [CompactionExecutor:3] 2020-03-05 16:12:41,396
PerSSTableIndexWriter.java:211 - Rejecting value (size 1.178KiB, maximum
1.000KiB) for column body (analyzed true) at
/mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
INFO [CompactionExecutor:3] 2020-03-05 16:12:41,400
PerSSTableIndexWriter.java:211 - Rejecting value (size 2.808KiB, maximum
1.000KiB) for column body (analyzed true) at
/mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
PerSSTableIndexWriter.java:211 - Rejecting value (size 1.562KiB, maximum
1.000KiB) for column body (analyzed true) at
/mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
PerSSTableIndexWriter.java:211 - Rejecting value (size 1.182KiB, maximum
1.000KiB) for column body (analyzed true) at
/mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
INFO [CompactionExecutor:3] 2020-03-05 16:12:41,404
PerSSTableIndexWriter.java:211 - Rejecting value (size 1.848KiB, maximum
1.000KiB) for column body (analyzed true) at
/mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
Thanks
Surbhi
Re: Upgradesstables - PerSSTableIndexWriter.java:211 - Rejecting value
Posted by Surbhi Gupta <su...@gmail.com>.
Just to add further , I could get the code reference as below:
https://github.com/xedin/sasi/blob/master/src/java/org/apache/cassandra/db/index/sasi/disk/PerSSTableIndexWriter.java
while (analyzer.hasNext())
{
ByteBuffer token = analyzer.next();
int size = token.remaining();
if (token.remaining() >= OnDiskIndexBuilder.MAX_TERM_SIZE)
{
logger.info("Rejecting value (size {}, maximum {} bytes) for column {}
(analyzed {}) at {} SSTable.",
term.remaining(),
OnDiskIndexBuilder.MAX_TERM_SIZE,
columnIndex.getColumnName(),
columnIndex.getMode().isAnalyzed,
descriptor);
continue;
}
On Mon, 9 Mar 2020 at 09:36, Surbhi Gupta <su...@gmail.com> wrote:
>
> https://javadoc.io/static/org.apache.cassandra/cassandra-all/3.11.4/constant-values.html#org.apache.cassandra.index.sasi.disk.OnDiskIndexBuilder.MAX_TERM_SIZE
> The MAX_TERM_SIZE value is 1024
>
> Can we change it ?
>
>
> The messages below is INFO but because it is saying "Rejecting value" , I
> would like to understand the impact of this rejection.
>
> On Mon, 9 Mar 2020 at 08:47, Surbhi Gupta <su...@gmail.com>
> wrote:
>
>> We have SASI index .
>> Any solution ?
>>
>> On Thu, 5 Mar 2020 at 15:20, Surbhi Gupta <su...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> We are in process of upgrading from 3.11.0 to 3.115 .
>>> While upgrading SSTables we are noticing messages like below in
>>> system.log.
>>> What are the significance of these messages?
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,393
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.022KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,396
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.178KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,400
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 2.808KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.562KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.182KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,404
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.848KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> Thanks
>>> Surbhi
>>>
>>
Re: Upgradesstables - PerSSTableIndexWriter.java:211 - Rejecting value
Posted by Surbhi Gupta <su...@gmail.com>.
https://javadoc.io/static/org.apache.cassandra/cassandra-all/3.11.4/constant-values.html#org.apache.cassandra.index.sasi.disk.OnDiskIndexBuilder.MAX_TERM_SIZE
The MAX_TERM_SIZE value is 1024
Can we change it ?
The messages below is INFO but because it is saying "Rejecting value" , I
would like to understand the impact of this rejection.
On Mon, 9 Mar 2020 at 08:47, Surbhi Gupta <su...@gmail.com> wrote:
> We have SASI index .
> Any solution ?
>
> On Thu, 5 Mar 2020 at 15:20, Surbhi Gupta <su...@gmail.com>
> wrote:
>
>> Hi,
>>
>> We are in process of upgrading from 3.11.0 to 3.115 .
>> While upgrading SSTables we are noticing messages like below in
>> system.log.
>> What are the significance of these messages?
>>
>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,393
>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.022KiB, maximum
>> 1.000KiB) for column body (analyzed true) at
>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>
>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,396
>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.178KiB, maximum
>> 1.000KiB) for column body (analyzed true) at
>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>
>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,400
>> PerSSTableIndexWriter.java:211 - Rejecting value (size 2.808KiB, maximum
>> 1.000KiB) for column body (analyzed true) at
>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>
>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.562KiB, maximum
>> 1.000KiB) for column body (analyzed true) at
>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>
>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.182KiB, maximum
>> 1.000KiB) for column body (analyzed true) at
>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>
>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,404
>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.848KiB, maximum
>> 1.000KiB) for column body (analyzed true) at
>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>
>> Thanks
>> Surbhi
>>
>
Re: Upgradesstables - PerSSTableIndexWriter.java:211 - Rejecting value
Posted by Surbhi Gupta <su...@gmail.com>.
We have SASI index .
Any solution ?
On Thu, 5 Mar 2020 at 15:20, Surbhi Gupta <su...@gmail.com> wrote:
> Hi,
>
> We are in process of upgrading from 3.11.0 to 3.115 .
> While upgrading SSTables we are noticing messages like below in system.log.
> What are the significance of these messages?
>
> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,393
> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.022KiB, maximum
> 1.000KiB) for column body (analyzed true) at
> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>
> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,396
> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.178KiB, maximum
> 1.000KiB) for column body (analyzed true) at
> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>
> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,400
> PerSSTableIndexWriter.java:211 - Rejecting value (size 2.808KiB, maximum
> 1.000KiB) for column body (analyzed true) at
> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>
> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.562KiB, maximum
> 1.000KiB) for column body (analyzed true) at
> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>
> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.182KiB, maximum
> 1.000KiB) for column body (analyzed true) at
> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>
> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,404
> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.848KiB, maximum
> 1.000KiB) for column body (analyzed true) at
> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>
> Thanks
> Surbhi
>