Apache Pinot Daily Email Digest (2021-11-25)

[Pinot Slack Email Digest <ap...@gmail.com>]

### _#general_

  
 **@kanishka:** @kanishka has joined the channel  
 **@linjiabao001:** @linjiabao001 has joined the channel  

###  _#random_

  
 **@kanishka:** @kanishka has joined the channel  
 **@linjiabao001:** @linjiabao001 has joined the channel  

###  _#troubleshooting_

  
 **@deemish2:** Hi Team , I am working on backfill data using spark ingestion
job and the segment name should be same which is stored under offline table
(which is moved from realtime table using minion) , segment name is like
tablename_wxc_18924_18924_0. while pushing backfill data using spark ingestion
job , segment name is like tablename _OFFLINE_18924_18924_0 . In spark
ingestion YAML file , for segmentNameGeneratorSpec: type :simple , i can’t use
type- normalizedDate becuase it gives in different format. Is there any way to
remove OFFLINE(tablename _OFFLINE_18924_18924_0) text from segment name  
 **@kanishka:** @kanishka has joined the channel  
 **@vibhor.jain:** Hi Team, We are facing one issue in the query where one of
our col values contains single quotes and we are getting
CalciteSqlToPinotQuery exception. For example, one of the values is *L'hôp
Test*. Since it contains a single quote, how to handle this and query the data
for this value?  
**@mayanks:** Have you tried escaping the single quote? If I am not wrong it
would be something like `L''hop Test`?  
**@vibhor.jain:** Hi @mayanks, I see putting 2 single quotes is working. Is
this the recommended way?  
**@mark.needham:** Yeh, that's the way to escape quotes. Have updated the
documentation -  
**@vibhor.jain:** Awesome, thanks @mark.needham and @mayanks  
 **@linjiabao001:** @linjiabao001 has joined the channel  
 **@lrhadoop143:** Hi Team, I'm not able to run controller and server of pinot
in docker with config file ,i have to read data from s3 for that i have to run
server and controller with config file .i'm trying to run the server and
controller by using this commands.sudo docker run --rm -ti \ \--network=pinot-
demo \ \--name pinot-controller \ -p 9010:9010 \ -e
JAVA_OPTS="-Dplugins.dir=/opt/pinot/plugins -Xms1G -Xmx4G -XX:+UseG1GC
-XX:MaxGCPauseMillis=200 -Xloggc:gc-pinot-controller.log" \ -d
apachepinot/pinot:latest StartController -configFileName
"/home/mahesh/Documents/pinot/s3-pinot/controller.conf" \ -zkAddress pinot-
zookeeper:2181  
**@xiangfu0:** You need to mount your local disk t docker container  
**@xiangfu0:** docker run --rm -ti \ \--name pinot-controller \
\--network=pinot-demo \ -p 9000:9000 \ \--env AWS_ACCESS_KEY_ID=<aws-access-
key-id> \ \--env AWS_SECRET_ACCESS_KEY=<aws-secret-access-key> \ \--mount
type=bind,source=/tmp/pinot-s3-docker,target=/tmp \
apachepinot/pinot:0.6.0-SNAPSHOT-ca8545b29-20201105-jdk11 StartController \
-configFileName /tmp/controller.conf  
**@xiangfu0:**  
**@xiangfu0:** See that -mount option on docker  
 **@alihaydar.atil:** Hi, when upsert functionality enabled, would it update
the records in the segments of the offline table for hybrid tables?  
**@mark.needham:** I think upsert is only for real-time tables, it won't
affect offline tables  
**@alihaydar.atil:** @mark.needham thank you, i realized that
RealtimeToOffline task and upsert configs are not allowed at the same time in
table config  

###  _#pinot-dev_

  
 **@atri.sharma:** Folks, please review:  
**@ashish:** @ashish has joined the channel  

###  _#getting-started_

  
 **@linjiabao001:** @linjiabao001 has joined the channel  
\--------------------------------------------------------------------- To
unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org For additional commands,
e-mail: dev-help@pinot.apache.org