Apache Pinot Daily Email Digest (2020-08-04)

[Pinot Slack Email Digest <sn...@apache.org>]

<h3><u>#general</u></h3><br><strong>@bhavik.ambani.edu: </strong>@bhavik.ambani.edu has joined the channel<br><strong>@bhavikkumar.ambani: </strong>@bhavikkumar.ambani has joined the channel<br><strong>@anthonypt87: </strong>@anthonypt87 has joined the channel<br><strong>@renatoj.marroquin: </strong>@renatoj.marroquin has joined the channel<br><h3><u>#random</u></h3><br><strong>@bhavik.ambani.edu: </strong>@bhavik.ambani.edu has joined the channel<br><strong>@bhavikkumar.ambani: </strong>@bhavikkumar.ambani has joined the channel<br><strong>@anthonypt87: </strong>@anthonypt87 has joined the channel<br><strong>@renatoj.marroquin: </strong>@renatoj.marroquin has joined the channel<br><h3><u>#troubleshooting</u></h3><br><strong>@steotia: </strong>Yes. I will add soon<br><strong>@pradeepgv42: </strong>thanks a lot<br><strong>@quietgolfer: </strong>I'm hitting an issue where the offline data I loaded into does not match the query results from Pinot.

I run `select * from metrics limit 20000`

and I see
```numDocsScanned = 15400
totalDocs = 17118```
totalDocs matches my raw data size (what I'd expect).  The query results match numDocsScanned (which is wrong).  I'm happy to share data and schema in a private message.<br><strong>@sosyalmedya.oguzhan: </strong>hi,

Is `isSingleValueField` value of `BYTES` data type is always true?<br><strong>@mayanks: </strong>Yes multi-valued BYTES are not supported yet, iirc<br><strong>@elon.azoulay: </strong>We are using pinot to store log data and noticed that string columns are truncated at 512 characters. Is there another datatype or setting we should use to increase the length?<br><h3><u>#pinot-dev</u></h3><br><strong>@steotia: </strong>This PR's travis build <https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMSfW2QiSG4bkQpnpkSL7FiK3MHb8libOHmhAW89nP5XKhNi-2BX-2Bn8DPfCtjwnPYm8yw-3D-3DsNMP_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaatI5cvE11YqOgto7tgG3AimUMTZZgt1VPW2-2FIqZd1vfuN6bOiDCbaf0Cieua-2FtEGuJl4-2Fy39jBSHO5Lvnr4hVQ7kQD21hWGqx9WoYc4iNM1wG8wUT47E6E5NPdyrCtnC1HEdOmodf9T6A0pj1xlWuPAQWXjWE3bFkfY3czUflK3p4-3D> is repeatedly failing with the following error:
```Uploading reports
    url: <https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMfXondT2jVRHWcTcC-2FKJB10-3Doh8t_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaatohXq8ZITB09OrNjMas8EJp69DbGBzo-2FJfW9tVC9WY9FDBBf4lPgVjWgAEyPzDrhV8WYQ49mjZCMtTQiMTCxArEpqtiMXyROSbOc3y7wUxu3RXhIiAV4N1iZ7A6U5ZAUSlkah-2FUXwAJYTcccoSKmx5LRtzrjx-2BvVkwCE2AyP-2BcMw-3D>
    query: branch=master&amp;commit=82d5cd333f30dfd404011b4b21c176697e02a92a&amp;build=18227.2&amp;build_url=&amp;tag=&amp;slug=apache%2Fincubator-pinot&amp;yaml=.codecov.yml&amp;service=travis&amp;flags=&amp;pr=5796&amp;job=714640980
    -&gt; Pinging Codecov
    -&gt; Uploading to S3 <https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMbsnN-2FK5ufjMM5bxFo-2Fw2tQiIygw7t3EHC6Sn8YoSSdkMVps_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaatNE2TiuYz8zbnTaZTbpsbpI9Bb52IFkCPcL0-2BEO8tHD1R2tF6PN4KvyK69FFjCdbrpoOtRn5lHQykry7HhuPV1Xd6dudnP4R6d1tcUmliV6-2BF64xXdu8YSwjkuhpTNIzZrHjFvHHp3mX-2BLqSumJ2KUvafcTFCzReRaScWbSW13Gs-3D>
    -&gt; View reports at <https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMcO00EkGbMLTlWc2-2Ft7Pw5nXTJPpHPp9SVrpxNAfCdhV3WKYQuvq7ghVDygZYS1LFpfpcUr5WqeEvTgWgsX322WqID2Rfmh9nR7FuLxqYiV5oejkdpQ0l6f-2F7jzZ3mIViA-3D-3D3pMP_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaat-2B4L-2FTxF-2FcdzL8EUN04o71IT1yscEvYrLT9iZkhCg11heA-2BHeUV-2BAFhHigcp3K7S6KZrsEaJiMNn0HaithaJ2GIX9tICrUNHOGU30BboMGAMn9Jh7y4GnpYM-2BkB7KoVYnYL-2FFp4wHEWyRVEaMv-2FGseIk-2F3EqTPomCHcYSIAaNWEc-3D>
+exit 0
The command "./.travis/.travis_test.sh" exited with 0.
before_cache
0.05s$ rm -rf $HOME/.m2/repository/org/apache/pinot
store build cache
0.00s
The job exceeded the maximum time limit for jobs, and has been terminated.```<br><strong>@steotia: </strong>I have rerun it like 4 times<br><strong>@steotia: </strong>and no luck<br><strong>@steotia: </strong>@guo.980 ran all the tests locally as well and it's all good<br><strong>@guo.980: </strong>@guo.980 has joined the channel<br><strong>@steotia: </strong>anyone else seen this problem?<br><strong>@steotia: </strong>The PR simply moves around a bit of code<br><strong>@guo.980: </strong>Thanks @steotia<br><strong>@mayanks: </strong>I have been running into intermittent failures lately. It takes 2-3 re-runs for them to pass<br><strong>@guo.980: </strong>We’ve also seen test failure during the travis code coverage stage.<br><strong>@mayanks: </strong>And yes, I saw the same code-coverage related issue with my latest run (it passed on re-run)<br><strong>@steotia: </strong>Yes, sometimes the code coverage upload also fails (like it is currently failing for Neha's PR).<br><strong>@fx19880617: </strong>I have a fix for codecov <br><strong>@fx19880617: </strong><https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMSfW2QiSG4bkQpnpkSL7FiK3MHb8libOHmhAW89nP5XKqZvGlUCnkm3O0uz8Bw1rEwH1Rckr9tNfnpTOxIXEDNA-3DfC9m_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaatG5YTvLS4t7VjVTrZuRIPx65cbVxJW808XPD2HcUT6FlnVywqXR3rOMrRThQrhvDd-2FGwQsEqAFvODQnfqH4IOHAyEUOBz75ZegwcIR9Hs2-2FyHjkzF2z-2B6ShZcuqwUfMokPQlaf8Uuk20ECbJshZkSX6YWg-2Blo3vu97AFoYCox66c-3D><br><strong>@fx19880617: </strong>I will separate to another PR<br><strong>@fx19880617: </strong><https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMSfW2QiSG4bkQpnpkSL7FiK3MHb8libOHmhAW89nP5XKXHWjDTpjKOBVCkBFl2k8Ow-3D-3D0b7A_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaatrYxpH5VECr1yeFuSjBnzMkpNszwcBGQtHNmFWw2idume2vKQ32ykhMq-2FZfrkzOgDDOoB1SkFJ0iGfTQPJdm0LH2emjr4QH5mrkZeHyvpe-2BjuXJytRorlsXE6F-2BnAd81tlY3p-2BOxfNcVjUzS6bLkESTdBhk-2FhNaLdKkjDmwXYrVA-3D> @guo.980 @steotia<br><strong>@guo.980: </strong>Thanks!<br><strong>@surendra: </strong>@surendra has joined the channel<br><h3><u>#presto-pinot-streaming</u></h3><br><strong>@jackie.jxt: </strong>@elon.azoulay Did you try out the streaming query on Presto? Does it work as expected?<br><strong>@elon.azoulay: </strong>I'll try it out shortly and let you know<br><h3><u>#pinot-0-5-0-release</u></h3><br><strong>@tingchen: </strong>I did a first cut of the 0.5.0 release at this commit: <https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMSfW2QiSG4bkQpnpkSL7FiK3MHb8libOHmhAW89nP5XKdyOgIulJ6ZPj-2FlktBYccQAalr0tO-2BpWwt0sbgbRqk8RtCVBiQidah88z5sYflVZGrMWGK-2FHvJAmFYzgPO7VRFw-3D-3DgTjJ_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTzBVAm8Lq7-2Bglvhsq2nBaatN5LDyDKDHC5JNrJL5IvyfG6j-2FQHWD4Sh9yrJSRQPiP7Fgaz6HK96cvaDnHeaZ7GNtM1cZoPgIy0MEB4Zttc7Rn7X8y2NQhgZCU8pF-2B4BuandT6ctzaMQy6e6N0DAl2cPwhHQDykU-2BMGrYqcv7U8bvAOL7sxTscbvXCflCiSlp3o-3D>. It is under test now.<br><strong>@tingchen: </strong>Meanwhile still waiting for my apache id to be activated -- filed 10 days ago. Looked like they are pretty busy.<br>