Re: [Discuss] Release of 0.10.0

[Xiangdong Huang <sa...@gmail.com>]

Hi,

I want to maintain the client-py module before releasing v0.10, but I am
not familiar with python...

In v0.10, we introduce a new API for inserting data: insertRecord(), which
requires a byte array as its parameter, but I do not know how to convert a
list with various data types to a byte array...

As client-py still uses stale API, I think we need to wait for fixing it
before we release v0.10.. Otherwise users will be misled.

[1] https://issues.apache.org/jira/browse/IOTDB-764

Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Xiangdong Huang <sa...@gmail.com> 于2020年5月29日周五 下午5:18写道：

> Hi all,
>
> I see all PRs attached with the "before_rel/0.10" label have been merged.
>
> Are there any other PRs?
>
> Best,
> -----------------------------------
> Xiangdong Huang
> School of Software, Tsinghua University
>
>  黄向东
> 清华大学 软件学院
>
>
> Xiangdong Huang <sa...@gmail.com> 于2020年5月27日周三 上午9:40写道：
>
>> Hi,
>>
>> As there are several bug-fix PRs unmerged, I'd like to wait for them to
>> be merged before releasing v0.10.
>>
>> All these PRs are labeled as "before_rel/0.10" on [1]
>>
>> Please leave your suggestion if you think some other PRs should also be
>> included in v0.10.0.
>>
>> [1] https://github.com/apache/incubator-iotdb/pulls
>>
>> Best,
>> -----------------------------------
>> Xiangdong Huang
>> School of Software, Tsinghua University
>>
>>  黄向东
>> 清华大学 软件学院
>>
>>
>> Haonan Hou <hh...@outlook.com> 于2020年5月27日周三 上午12:06写道：
>>
>>> Hi,
>>>
>>> I have one more New Feature to add into the list.
>>> IOTDB-243 create measurements with same name and different types in the
>>> same storage group
>>>
>>> Best,
>>>
>>> Haonan
>>>
>>>
>>> > On May 25, 2020, at 11:46 PM, Jialin Qiao <qj...@mails.tsinghua.edu.cn>
>>> wrote:
>>> >
>>> > Hi,
>>> >
>>> > The highly anticipated version 0.10.0 is coming soon!
>>> >
>>> > I summarize the release notes, please have a check :)
>>> >
>>> > # Apache IoTDB (incubating) 0.10.0
>>> >
>>> > ## New Features
>>> >
>>> > * IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from
>>> root.sg.d1.s1 GROUP BY ([1, 50), 5ms)
>>> > * IOTDB-220 Add hot-load configuration function
>>> > * IOTDB-275 allow using user defined JAVA_HOME and allow blank space
>>> in the JAVA_HOME
>>> > * IOTDB-287 Allow domain in JDBC URL
>>> > * IOTDB-292 Add load external tsfile feature
>>> > * IOTDB-297 Support "show flush task info"
>>> > * IOTDB-298 Support new Last point query. e.g, select last * from root
>>> > * IOTDB-305 Add value filter function while executing align by device
>>> > * IOTDB-309 add Dockerfiles for 0.8.1, 0.9.0, and 0.9.1
>>> > * IOTDB-313 Add RandomOnDiskUsableSpaceStrategy
>>> > * IOTDB-323 Support insertRecords in session
>>> > * IOTDB-337 Add timestamp precision properties for grafana
>>> > * IOTDB-343 Add test method in session
>>> > * IOTDB-396 Support new query clause: disable align, e.g., select *
>>> from root disable align
>>> > * IOTDB-447 Support querying non-existing measurement and constant
>>> measurement
>>> > * IOTDB-448 Add IN operation, e.g., where time in (1,2,3)
>>> > * IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1)
>>> from root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast])
>>> > * IOTDB-467 The CLI displays query results in a batch manner
>>> > * IOTDB-497 Support Apache Flink Connector with IoTDB
>>> > * IOTDB-558 add text support for grafana
>>> > * IOTDB-560 Support Apache Flink connecter with TsFile
>>> > * IOTDB-565 MQTT Protocol Support, disabled by default, open in
>>> iotdb-engine.properties
>>> > * IOTDB-574 Specify configuration when start iotdb
>>> > * IOTDB-588 Add tags and attributes management
>>> > * IOTDB-607 add batch create timeseries in native interface
>>> > * IOTDB-612 add limit&offset to show timeseries
>>> > * IOTDB-617 Support alter one time series's tag/attribute
>>> > * IOTDB-630 Add a jdbc-like way to fetch data in session
>>> > * IOTDB-640 Enable system admin sql (flush/merge) in JDBC or Other API
>>> > * IOTDB-671 Add clear cache command
>>> > * Support open and close time range in group by, e.g, [), (]
>>> > * Online upgrade from 0.9.x
>>> > * Support speical characters in path: -/+&%$#@
>>> > * IOTDB-446 Support path start with a digit, e.g., root.sg.12a
>>> > * enable rpc compression in session pool
>>> > * Make JDBC OSGi usable and added a feature file
>>> > * Python: Support pypi distribution for Python Client
>>> >
>>> > ## Incompatible changes
>>> >
>>> > * IOTDB-138 Move All metadata query to usual query
>>> > * IOTDB-322 upgrade to thrift 0.12.0-0.13.0
>>> > * IOTDB-325 Refactor Statistics in TsFile
>>> > * IOTDB-419 Refactor the 'last' and 'first' aggregators to
>>> 'last_value' and 'first_value'
>>> > * IOTDB-506 upgrade the rpc protocol to v2 to reject clients or
>>> servers that version < 0.10
>>> > * IOTDB-587 TsFile is upgraded to version 2
>>> > * IOTDB-593 add metaOffset in TsFileMetadata
>>> > * IOTDB-597 Rename methods in Session: insertBatch to insertTablet,
>>> insertInBatch to insertRecords, insert to insertRecord
>>> > * RPC is incompatible, you can not use client-v0.9 to connect with
>>> server-v0.10
>>> > * TsFile format is incompatible, will be upgraded when starting 0.10
>>> > * Refine exception code in narive api
>>> >
>>> > ## Miscellaneous changes
>>> >
>>> > * IOTDB-190 upgrade from antlr3 to antlr4
>>> > * IOTDB-418 new query engine
>>> > * IOTDB-429 return empty dataset instead of throw exception, e.g.,
>>> show child paths root.*
>>> > * IOTDB-445 Unify the keyword of "timestamp" and "time"
>>> > * IOTDB-450 Add design documents
>>> > * IOTDB-498 Support date format "2020-02-10"
>>> > * IOTDB-503 Add checkTimeseriesExists in java native api
>>> > * IOTDB-605 Add more levels of index in TsFileMetadata for handling
>>> too many series in one device
>>> > * IOTDB-625 Change default level number: root is level 0
>>> > * IOTDB-628 rename client to cli
>>> > * IOTDB-621 Add Check isNull in Field for querying using session
>>> > * IOTDB-632 Performance improve for PreviousFill/LinearFill
>>> > * Allow "count timeseries" without a prefix path
>>> > * Add max backup log file number
>>> > * add rpc compression api in client and session module
>>> > * Continue writing the last unclosed file
>>> > * Move the vulnera-checks section into the apache-release profile to
>>> accelerate compile
>>> > * Add metaquery in python example
>>> >
>>> > ## Bug Fixes
>>> >
>>> > * IOTDB-125 Potential Concurrency bug while deleting and inserting
>>> happen together
>>> > * IOTDB-185 fix start-client failed on WinOS if there is blank space
>>> in the file path; let start-server.bat suport jdk12,13 etc
>>> > * IOTDB-304 Fix bug of incomplete HDFS URI
>>> > * IOTDB-341 Fix data type bug in grafana
>>> > * IOTDB-346 Fix a bug of renaming tsfile in loading function
>>> > * IOTDB-370 fix a concurrent problem in parsing sql
>>> > * IOTDB-376 fix metric to show executeQuery
>>> > * IOTDB-392 fix export CSV
>>> > * IOTDB-393 Fix unclear error message for no privilege users
>>> > * IOTDB-401 Correct the calculation of a chunk if there is no data in
>>> the chunk, do not flush empty chunk
>>> > * IOTDB-412 Paths are not correctly deduplicated
>>> > * IOTDB-420 Avoid encoding task dying silently
>>> > * IOTDB-425 fix can't change the root password.
>>> > * IOTDB-459 Fix calmem tool bug
>>> > * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile
>>> > * IOTDB-529 Relative times and NOW() operator cannot be used in Group
>>> By
>>> > * IOTDB-531 fix issue when grafana visualize boolean data
>>> > * IOTDB-546 Fix show child paths statement doesn't show quotation
>>> marks
>>> > * IOTDB-643 Concurrent queries cause BufferUnderflowException when
>>> storage in HDFS
>>> > * IOTDB-663 Fix query cache OOM while executing query
>>> > * IOTDB-664 Win -e option
>>> > * IOTDB-669 fix getting two columns bug while ”show devices“ in session
>>> > * fix concurrent auto create schema conflict bug
>>> > * fix meet incompatible file error in restart
>>> > * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS
>>> storage
>>> > * fix execute flush command while inserting bug
>>> > * Fix sync schema pos bug
>>> > * Fix batch execution bug, the following sqls will all fail after one
>>> error sql
>>> >
>>> >
>>> > Thanks,
>>> > --
>>> > Jialin Qiao
>>> > School of Software, Tsinghua University
>>> >
>>> > 乔嘉林
>>> > 清华大学 软件学院
>>> >
>>> >> -----原始邮件-----
>>> >> 发件人: "Xiangdong Huang" <sa...@gmail.com>
>>> >> 发送时间: 2020-05-25 23:36:42 (星期一)
>>> >> 收件人: dev@iotdb.apache.org
>>> >> 抄送:
>>> >> 主题: Re: [Discuss] Release of 0.10.0
>>> >>
>>> >> Hi all,
>>> >>
>>> >> Though we introduced the feature that supporting time-based data
>>> partition,
>>> >> it may have some side-effect for query performance in some cases.
>>> >> So, I'd like to mark this feature as experimental and disable it by
>>> >> default. We can enable it by default until we fixed the performance
>>> issue
>>> >> in next version.
>>> >>
>>> >> Then, I'd like to start to organize the change list of v0.10 with
>>> @Jialin.
>>> >>
>>> >> Best,
>>> >> -----------------------------------
>>> >> Xiangdong Huang
>>> >> School of Software, Tsinghua University
>>> >>
>>> >> 黄向东
>>> >> 清华大学 软件学院
>>> >>
>>> >>
>>> >> Xiangdong Huang <sa...@gmail.com> 于2020年5月21日周四 上午9:34写道：
>>> >>
>>> >>> Hi,
>>> >>>
>>> >>> I suggest to run a performance comparison for v0.9 and v0.10 first
>>> and
>>> >>> then start the release.
>>> >>> We are doing that.
>>> >>>
>>> >>> Best,
>>> >>> -----------------------------------
>>> >>> Xiangdong Huang
>>> >>> School of Software, Tsinghua University
>>> >>>
>>> >>> 黄向东
>>> >>> 清华大学 软件学院
>>> >>>
>>> >>>
>>> >>> Xiangdong Huang <sa...@gmail.com> 于2020年5月20日周三 下午3:08写道：
>>> >>>
>>> >>>> Hi,
>>> >>>>
>>> >>>>> Are there any features left that one NEEDS in 0.10 that are
>>> currently
>>> >>>> in work?
>>> >>>>
>>> >>>> IMO, we do not need to wait for developing other features anymore
>>> before
>>> >>>> releasing v0.10.0, but we can "merge as many PRs as possible"
>>> especially
>>> >>>> for those bug-fix PRs.
>>> >>>>
>>> >>>> Best,
>>> >>>>
>>> >>>> -----------------------------------
>>> >>>> Xiangdong Huang
>>> >>>> School of Software, Tsinghua University
>>> >>>>
>>> >>>> 黄向东
>>> >>>> 清华大学 软件学院
>>> >>>>
>>> >>>>
>>> >>>> Julian Feinauer <j....@pragmaticminds.de> 于2020年5月20日周三
>>> 下午2:33写道：
>>> >>>>
>>> >>>>> Hi,
>>> >>>>>
>>> >>>>> I suggest to always to a release branch as best practice as it
>>> always
>>> >>>>> help you if you need to create a fix release like 0.10.1 (if you
>>> want to
>>> >>>>> keep working on features on master branch).
>>> >>>>> But yes I agree, we should try to merge as many PRs as possible.
>>> >>>>>
>>> >>>>> Are there any features left that one NEEDS in 0.10 that are
>>> currently in
>>> >>>>> work?
>>> >>>>>
>>> >>>>> Julian
>>> >>>>>
>>> >>>>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" <sainthxd@gmail.com
>>> >:
>>> >>>>>
>>> >>>>>    Hi,
>>> >>>>>
>>> >>>>>    The grafana issue has been fixed.
>>> >>>>>
>>> >>>>>    As we have so many PRs opened now, we need to check when to
>>> fork a
>>> >>>>> new
>>> >>>>>    branch rel/0.10.
>>> >>>>>
>>> >>>>>    Actually, only one PR needs to be pay attention [1].
>>> >>>>>
>>> >>>>>    IMO, I want to merge it into the master ASAP to avoid more
>>> conflicts.
>>> >>>>>    Otherwise, there will be  too many differences between rel/0.10
>>> and
>>> >>>>> master.
>>> >>>>>    But as it modified many codes and not all of them are tested, I
>>> am
>>> >>>>> afraid
>>> >>>>>    whether it brings unstable factors.
>>> >>>>>
>>> >>>>>    [1] https://github.com/apache/incubator-iotdb/pull/1169
>>> >>>>>
>>> >>>>>    Best,
>>> >>>>>    -----------------------------------
>>> >>>>>    Xiangdong Huang
>>> >>>>>    School of Software, Tsinghua University
>>> >>>>>
>>> >>>>>     黄向东
>>> >>>>>    清华大学 软件学院
>>> >>>>>
>>> >>>>>
>>> >>>>>    Julian Feinauer <j....@pragmaticminds.de> 于2020年5月18日周一
>>> >>>>> 下午6:44写道：
>>> >>>>>
>>> >>>>>> Hey,
>>> >>>>>>
>>> >>>>>> that looks pretty cool indeed.
>>> >>>>>> Has anyone tested the IoTDB Grafana Bridge?
>>> >>>>>> I had issues with it at some point in master branch, not sure
>>> >>>>> about the
>>> >>>>>> latest version?
>>> >>>>>>
>>> >>>>>> But sounds really cool!
>>> >>>>>>
>>> >>>>>> Julian
>>> >>>>>>
>>> >>>>>> Am 18.05.20, 12:08 schrieb "Haonan Hou" <hh...@outlook.com>:
>>> >>>>>>
>>> >>>>>>    Hi,
>>> >>>>>>
>>> >>>>>>    Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10
>>> >>>>> has
>>> >>>>>> been developed. We have also finished the tests about it and
>>> >>>>> everything
>>> >>>>>> works great. I think it’s the right time to release the v0.10.0.
>>> >>>>>>
>>> >>>>>>    Anyone hope to be the RM of 0.10.0?
>>> >>>>>>
>>> >>>>>>    Best,
>>> >>>>>>    Haonan Hou
>>> >>>>>>
>>> >>>>>>
>>> >>>>>
>>> >>>>> --
>>> >> -----------------------------------
>>> >> Xiangdong Huang
>>> >> School of Software, Tsinghua University
>>> >>
>>> >> 黄向东
>>> >> 清华大学 软件学院
>>>
>>>