Apache Pinot Daily Email Digest (2021-08-31)

[Pinot Slack Email Digest <ap...@gmail.com>]

### _#general_

  
 **@senthh:** @senthh has joined the channel  
 **@vibhor.jain:** Hi Team, for our use cases, we were trying out Apache
Pinot. Since the use cases involved nested queries we thought of integrating
it with some connector like Presto. As per Pinot doc, looks like the
recommended connector is PrestoDB. Can anyone confirm if PrestoSQL (Trino) is
recommended or not? P.S: We are reaching out to other communities (Trino) also
to check their view.  
**@g.kishore:** Pinot works with both presto and trino.. we recommend trying
out both and pick one that works best for you  
**@brianolsen87:** @elon.azoulay works on the Trino-Pinot connector and uses
this in production. He will be able to help here.  
**@brianolsen87:** @g.kishore any way we could get Trino added to the docs?  
**@brianolsen87:** So folks can see Presto and Trino are both options?  
**@srini:** @brianolsen87 lets add it in ourselves! :smile:  
**@mayanks:** That ^^ works too :slightly_smiling_face:.  
**@brianolsen87:** fair enough :slightly_smiling_face:  
**@brianolsen87:** I'll can certainly add a PR but wanted some "permission"
first :smile:  
**@mayanks:** `Integrations` would be the right place to add. I see superset
already there:  
**@karinwolok1:** :wave: Welcome to all the newest :wine_glass: Pinot
community members! :heart: :wave: Please tell us who you are and what brought
you here. @spolisetti @email @jaykhatra21 @pushp2910 @miteshmangaonkar
@sandeep908 @senthh @ciano4fr @francis.west @ankit.itassociate @saadkhan
@farheenanjumb786 @zixi.bwang @thiago.pereira.net @danny @rhodges @dxasonntag
@shubhambhattar @albertobeiz @luisfernandez @s.swaminathan @art.artik
@kavya8428 @sulthon.poetra.ahmad @grvmakkar @cjfudge @rgoyal2191 @nawazshahm
@hasanat.muztaba @mark.r.watkins @banlinhlinhcon @diogo.baeder
@rbalaji.crescent @gabrielweich.dev @albertopang @sidarthar @stuart.edgington
@jzanko @mosiac @fangsheng.ferris.li @wentjin @tiger @dineaz @mownikajothi
@msoni6226 @ananth.durai @tahirozdemir34 @tugce.dinc12 @ilker.mutluer
@abdullah.velioglu @ahmet.lekesiz @hatice.ozdemir @sachin @roberto  
 **@email:** :wave: Hello – I’m a software engineer working in the metered
billing space. Came across Pinot after watching a  about how Stripe uses it
for their financial data. Mostly joined the channel to observe and learn more
as I’m investigating options to power user-facing dashboards.  
 **@deep:** @deep has joined the channel  
 **@mitn.azn:** @mitn.azn has joined the channel  
 **@mayur.bagwe:** @mayur.bagwe has joined the channel  
 **@steve.reed:** @steve.reed has joined the channel  

###  _#random_

  
 **@senthh:** @senthh has joined the channel  
 **@deep:** @deep has joined the channel  
 **@mitn.azn:** @mitn.azn has joined the channel  
 **@mayur.bagwe:** @mayur.bagwe has joined the channel  
 **@steve.reed:** @steve.reed has joined the channel  

###  _#troubleshooting_

  
 **@senthh:** @senthh has joined the channel  
 **@deep:** @deep has joined the channel  
 **@mitn.azn:** @mitn.azn has joined the channel  
 **@mayur.bagwe:** @mayur.bagwe has joined the channel  
 **@steve.reed:** @steve.reed has joined the channel  

###  _#pinot-dev_

  
 **@mitn.azn:** @mitn.azn has joined the channel  

###  _#presto-pinot-streaming_

  
 **@mitn.azn:** @mitn.azn has joined the channel  

###  _#thirdeye-pinot_

  
 **@mitn.azn:** @mitn.azn has joined the channel  

###  _#getting-started_

  
 **@jeking.dev:** @jeking.dev has joined the channel  
 **@jeking.dev:** I'm having issues running the basic scripts in the 0.8.0
apache pinot release with windows 7 and java 8 using git-bash-here as the
terminal. I'm following this link for setup  It seems like it can not find the
java class files correctly. I currently only have JAVA_HOME set to pointed to
the JDK8. I noticed in the 0.3.0 release notes there was something regarding
java 8 (see image attached). Is there something special I need to do to get
this to work?  
**@mayanks:** Are you running the Pinot-admin.sh from distribution or did you
build from source?  
**@jeking.dev:** the 0.8.0 binary distribution  
**@mayanks:** I noticed you mentioned `0.3.0` above, just want to ensure you
defined `PINOT_VERSION` as `0.8.0`?  
**@jeking.dev:** Yeah. I'm using 0.8.0 but I was just referencing .3 because
the changelog mentioned java 8 and wasn't sure if it was related  
**@mayanks:** Wondering if this could be related to windows env, most folks
here don't really use Windows.  
**@kulbir.nijjer:** Looks like OOB scripts are not able to set java classpath
properly, looking at scripts we do seem to have stuff specific to formatting
classpath etc. for windows OS when using cygwin, for e.g ```if $cygwin; then [
-n "$CLASSPATH" ] && CLASSPATH=`cygpath --path --windows "$CLASSPATH"` [ -n
"$JAVA_HOME" ] && JAVA_HOME=`cygpath --path --windows "$JAVA_HOME"` [ -n
"$HOME" ] && HOME=`cygpath --path --windows "$HOME"` [ -n "$BASEDIR" ] &&
BASEDIR=`cygpath --path --windows "$BASEDIR"` [ -n "$REPO" ] && REPO=`cygpath
--path --windows "$REPO"```` Instead of using `git-bash` can you try using
cygwin instead ?  
**@xiangfu0:** if you use jdk8, you can still build latest pinot ``````  
**@jeking.dev:** Thanks for the responses. I'll try to use cygwin instead of
git-bash when I get back to it and see if that makes a difference  
**@jeking.dev:** Using cygwin gets past the classpath issue but now its
mentioning a JNI error between version 55 and 52. This makes it sounds like
the JAR files were compiled with java 11 and are not compatible with java 8.
Again this is running the `pinot-admin.sh`and it's saying it was compiled with
java 11 and I'm running on Java 8. This makes me think I'm forced to build
from source and compile it with a -target of 1.8 and I can't use any of the
binary scripts to start and learn pinot  
**@xiangfu0:** You need to build from sound with maven and jdk.version tag  
**@xiangfu0:** From source *  
**@xiangfu0:** Or you can use 0.7.1 release  
**@xiangfu0:** That is the last version we release using jdk 8  
**@jeking.dev:** That may be true, but that doesn't help that the 'quick-
start' guide is not accessible to those who are working with a different
version of java  
**@jeking.dev:** Ok, Thanks. I'll try `0.7.1` and see if that works. I don't
see in the release notes for either `0.7.1`or `0.8.0` regarding the java 8
deprecation  
**@kulbir.nijjer:** Pinot v0.8 has added support for Java11:  Mentioned in
release notes as well ```After the 0.8.0 release, we will officially support
jdk 11, and can now safely start to use jdk 11 features. Code is still
compilable with jdk 8 (#6424)``` Will also update the getting started page to
clarify this:  
**@jeking.dev:** Does this mean I have to build from source to use JDK8? It
seems like using `0.8.0`binary download and running those scripts they are not
compatible with JDK8 right now. When I go back to `0.7.1` like it was
suggested I am able to use JDK8 with the binary download and scripts. Again -
thanks for all the help  
**@xiangfu0:** for 0.8.0, if you want to use it on jdk8, then you need to
build it from source code  
**@xiangfu0:** 0.8.0 release binary is on jdk 11  
**@jeking.dev:** Thanks!!!!  
 **@luisfernandez:** question, if we have to scale pinot servers horizontally
(where data is stored) do we rebalance the data the segments within that
server host? how does that work?  
**@g.kishore:** Add nodes and invoke the rebalance api.. Pinot will take care
of rebalancing the segments  
**@npawar:**  
**@luisfernandez:** thank you very much!  
\--------------------------------------------------------------------- To
unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org For additional commands,
e-mail: dev-help@pinot.apache.org