You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "ankitsultana (via GitHub)" <gi...@apache.org> on 2023/05/26 20:49:15 UTC

[GitHub] [pinot] ankitsultana opened a new issue, #10811: Pinot Handling of Special Characters in Realtime Ingestion

ankitsultana opened a new issue, #10811:
URL: https://github.com/apache/pinot/issues/10811

   We are seeing an issue where if some rows have a special character in one of the string columns (carriage return), then the row doesn't get ingested and seems to be getting dropped silently.
   
   We do see this log line because we have some segmentPartitionConfig setup, but I don't see any logs or metrics indicating the row has been dropped:
   
   ```
   [table__91__500__20230526T1220Z] WARN  o.a.p.s.l.i.m.MutableSegmentImpl_table__91__500__20230526T1220Z_my-topic  - Found new partition: 14 from partition column: user_uuid, value: sdfssdfs-5850-4c07-b725-05b36ace4a1e
   ```
   
   What's the expected behavior in these cases?
   
   cc: @Jackie-Jiang 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] ankitsultana commented on issue #10811: Pinot Handling of Special Characters in Realtime Ingestion

Posted by "ankitsultana (via GitHub)" <gi...@apache.org>.
ankitsultana commented on issue #10811:
URL: https://github.com/apache/pinot/issues/10811#issuecomment-1564981405

   Oh nvm. Looks like the ingestion is happening. This can be ignored.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] ankitsultana closed issue #10811: Pinot Handling of Special Characters in Realtime Ingestion

Posted by "ankitsultana (via GitHub)" <gi...@apache.org>.
ankitsultana closed issue #10811: Pinot Handling of Special Characters in Realtime Ingestion
URL: https://github.com/apache/pinot/issues/10811


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org