You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datasketches.apache.org by le...@apache.org on 2023/11/30 19:54:41 UTC

(datasketches-java) branch master updated (007f35b5 -> e06ae7de)

This is an automated email from the ASF dual-hosted git repository.

leerho pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/datasketches-java.git


    from 007f35b5 Merge pull request #476 from apache/test_flow_changes
     add 405cb762 Initial fixes for getPartitionBoundaries.
     add 0097699a Merge branch 'master' into Fixes_for_getPartitionBoundaries
     add a5767748 This applies the same fix that eliminates duplicate entries when using getPartitionBoundaries(...) in all the quantile sketches for small values of N.
     add e263fe6f update Fixes for getPartitionBoundaries
     add 3b4778e8 Merge branch 'master' into Fixes_for_getPartitionBoundaries
     add 23e36acc This commit includes a number of enhancements for the 5.0 release:
     add 4747f67f Fix javadoc issues.
     add 9237a28d Fixed the CodeQL issues.
     add c57b3613 added Maximum absolute error %
     add 56e3bd9c Improved the user access to the two partition test classes.
     add 6ecbf503 This commit is the result of the first round of reviews.
     add 0aecf1f5 Changes due to 2nd round of review feedback.
     add 7a727b4f Removed the normalized ranks array from all the Sorted Views.
     add 327d6217 Fixed CodeQL issues
     add 51aef3cc Updated class javadoc to include the following comment:
     new e06ae7de Merge pull request #475 from apache/Fixes_for_getPartitionBoundaries

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 README.md                                          |   2 +-
 pom.xml                                            |   7 +
 .../java/org/apache/datasketches/common/Util.java  |  81 +++----
 .../apache/datasketches/kll/KllDoublesSketch.java  |  16 --
 .../datasketches/kll/KllDoublesSketchIterator.java |  42 +---
 .../kll/KllDoublesSketchSortedView.java            |  54 +++--
 .../kll/KllDoublesSketchSortedViewIterator.java    |  79 -------
 .../apache/datasketches/kll/KllFloatsSketch.java   |  16 --
 .../datasketches/kll/KllFloatsSketchIterator.java  |  42 +---
 .../kll/KllFloatsSketchSortedView.java             |  54 +++--
 .../kll/KllFloatsSketchSortedViewIterator.java     |  79 -------
 .../apache/datasketches/kll/KllItemsSketch.java    |  21 +-
 .../datasketches/kll/KllItemsSketchIterator.java   |  42 +---
 .../datasketches/kll/KllItemsSketchSortedView.java | 158 +++++++++----
 ...sSketchIterator.java => KllSketchIterator.java} |  39 ++--
 .../BoundsRule.java}                               |  20 +-
 .../datasketches/partitions/Partitioner.java       | 216 +++++++++++++++++
 .../datasketches/partitions/SketchFillRequest.java |  46 ++++
 .../{fdt => partitions}/package-info.java          |   4 +-
 .../datasketches/quantiles/DoublesSketch.java      |  16 --
 .../quantiles/DoublesSketchSortedView.java         |  53 +++--
 .../quantiles/DoublesSketchSortedViewIterator.java |  77 -------
 .../apache/datasketches/quantiles/ItemsSketch.java |  85 +------
 .../quantiles/ItemsSketchSortedView.java           | 131 ++++++++---
 .../quantilescommon/DoublesSortedView.java         |  24 +-
 .../quantilescommon/DoublesSortedViewIterator.java |  18 +-
 .../quantilescommon/FloatsSortedView.java          |  22 +-
 .../quantilescommon/FloatsSortedViewIterator.java  |  18 +-
 .../GenericPartitionBoundaries.java                | 136 +++++++++++
 .../quantilescommon/GenericSortedView.java         |  23 +-
 .../quantilescommon/GenericSortedViewIterator.java |  54 +----
 .../quantilescommon/InequalitySearch.java          | 255 ++++++++++++++++++++-
 .../quantilescommon/PartitionBoundaries.java       |  67 ++++++
 .../quantilescommon/PartitioningFeature.java       |  85 +++++++
 .../datasketches/quantilescommon/QuantilesAPI.java |  15 +-
 .../quantilescommon/QuantilesDoublesAPI.java       |  50 ----
 .../quantilescommon/QuantilesFloatsAPI.java        |  54 +----
 .../quantilescommon/QuantilesGenericAPI.java       |  87 -------
 .../quantilescommon/QuantilesUtil.java             |  64 +++++-
 .../datasketches/quantilescommon/SortedView.java   |  29 +--
 .../quantilescommon/SortedViewIterator.java        |  55 +++--
 .../org/apache/datasketches/req/BaseReqSketch.java |  18 --
 .../datasketches/req/ReqSketchSortedView.java      |  48 +++-
 .../req/ReqSketchSortedViewIterator.java           |  80 -------
 .../org/apache/datasketches/common/UtilTest.java   |   9 +-
 .../KllDirectCompactItemsSketchIteratorTest.java   |   8 +-
 .../kll/KllDirectDoublesSketchTest.java            |  16 --
 .../kll/KllDirectFloatsSketchTest.java             |  16 --
 .../kll/KllDoublesSketchIteratorTest.java          |   8 +-
 .../datasketches/kll/KllDoublesSketchTest.java     |  27 +--
 .../kll/KllFloatsSketchIteratorTest.java           |   8 +-
 .../datasketches/kll/KllFloatsSketchTest.java      |  27 +--
 .../kll/KllItemsSketchSortedViewString.java        |   7 +-
 .../datasketches/kll/KllItemsSketchTest.java       |  38 +--
 .../kll/KllItemsSketchiteratorTest.java            |   8 +-
 .../datasketches/kll/KllMiscDirectDoublesTest.java |  13 --
 .../datasketches/kll/KllMiscDirectFloatsTest.java  |  13 --
 .../apache/datasketches/kll/KllMiscItemsTest.java  |   4 +-
 .../partitions/ClassicPartitionsTest.java          | 122 ++++++++++
 .../ItemsSketchFillRequestLongAsString.java        |  83 +++++++
 .../KllItemsSketchFillRequestLongAsString.java     |  84 +++++++
 .../datasketches/partitions/KllPartitionsTest.java | 122 ++++++++++
 .../datasketches/partitions/PartitionResults.java  | 114 +++++++++
 .../quantiles/CustomQuantilesTest.java             |  70 +++---
 .../datasketches/quantiles/DoublesSketchTest.java  |   7 +-
 .../quantiles/HeapUpdateDoublesSketchTest.java     |  32 +--
 .../quantiles/ItemsSketchSortedViewString.java     |   6 +-
 .../datasketches/quantiles/ItemsSketchTest.java    |  12 +-
 .../datasketches/quantiles/SkewedDataTest.java     | 114 +++++++++
 .../quantilescommon/CrossCheckQuantilesTest.java   |  49 ++--
 .../quantilescommon/LongsAsOrderableStrings.java   |  70 ++++++
 .../quantilescommon/QuantilesUtilTest.java         |  27 ++-
 .../quantilescommon/ReflectUtilityTest.java        |  14 +-
 .../datasketches/req/ReqSketchSortedViewTest.java  |  21 +-
 .../org/apache/datasketches/req/ReqSketchTest.java |  20 +-
 75 files changed, 2382 insertions(+), 1369 deletions(-)
 delete mode 100644 src/main/java/org/apache/datasketches/kll/KllDoublesSketchSortedViewIterator.java
 delete mode 100644 src/main/java/org/apache/datasketches/kll/KllFloatsSketchSortedViewIterator.java
 copy src/main/java/org/apache/datasketches/kll/{KllItemsSketchIterator.java => KllSketchIterator.java} (68%)
 copy src/main/java/org/apache/datasketches/{tuple/SummaryFactory.java => partitions/BoundsRule.java} (73%)
 create mode 100644 src/main/java/org/apache/datasketches/partitions/Partitioner.java
 create mode 100644 src/main/java/org/apache/datasketches/partitions/SketchFillRequest.java
 copy src/main/java/org/apache/datasketches/{fdt => partitions}/package-info.java (91%)
 delete mode 100644 src/main/java/org/apache/datasketches/quantiles/DoublesSketchSortedViewIterator.java
 create mode 100644 src/main/java/org/apache/datasketches/quantilescommon/GenericPartitionBoundaries.java
 create mode 100644 src/main/java/org/apache/datasketches/quantilescommon/PartitionBoundaries.java
 create mode 100644 src/main/java/org/apache/datasketches/quantilescommon/PartitioningFeature.java
 delete mode 100644 src/main/java/org/apache/datasketches/req/ReqSketchSortedViewIterator.java
 create mode 100644 src/test/java/org/apache/datasketches/partitions/ClassicPartitionsTest.java
 create mode 100644 src/test/java/org/apache/datasketches/partitions/ItemsSketchFillRequestLongAsString.java
 create mode 100644 src/test/java/org/apache/datasketches/partitions/KllItemsSketchFillRequestLongAsString.java
 create mode 100644 src/test/java/org/apache/datasketches/partitions/KllPartitionsTest.java
 create mode 100644 src/test/java/org/apache/datasketches/partitions/PartitionResults.java
 create mode 100644 src/test/java/org/apache/datasketches/quantiles/SkewedDataTest.java
 create mode 100644 src/test/java/org/apache/datasketches/quantilescommon/LongsAsOrderableStrings.java


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org


(datasketches-java) 01/01: Merge pull request #475 from apache/Fixes_for_getPartitionBoundaries

Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

leerho pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/datasketches-java.git

commit e06ae7de4d4f6faa3a79840c34b5615a77ba056d
Merge: 007f35b5 51aef3cc
Author: Lee Rhodes <le...@users.noreply.github.com>
AuthorDate: Thu Nov 30 11:54:35 2023 -0800

    Merge pull request #475 from apache/Fixes_for_getPartitionBoundaries
    
    Fixes for get partition boundaries

 README.md                                          |   2 +-
 pom.xml                                            |   7 +
 .../java/org/apache/datasketches/common/Util.java  |  81 +++----
 .../apache/datasketches/kll/KllDoublesSketch.java  |  16 --
 .../datasketches/kll/KllDoublesSketchIterator.java |  42 +---
 .../kll/KllDoublesSketchSortedView.java            |  54 +++--
 .../kll/KllDoublesSketchSortedViewIterator.java    |  79 -------
 .../apache/datasketches/kll/KllFloatsSketch.java   |  16 --
 .../datasketches/kll/KllFloatsSketchIterator.java  |  42 +---
 .../kll/KllFloatsSketchSortedView.java             |  54 +++--
 .../kll/KllFloatsSketchSortedViewIterator.java     |  79 -------
 .../apache/datasketches/kll/KllItemsSketch.java    |  21 +-
 .../datasketches/kll/KllItemsSketchIterator.java   |  42 +---
 .../datasketches/kll/KllItemsSketchSortedView.java | 158 +++++++++----
 ...sSketchIterator.java => KllSketchIterator.java} |  39 ++--
 .../datasketches/partitions/BoundsRule.java}       |  27 +--
 .../datasketches/partitions/Partitioner.java       | 216 +++++++++++++++++
 .../datasketches/partitions/SketchFillRequest.java |  46 ++++
 .../datasketches/partitions/package-info.java}     |  17 +-
 .../datasketches/quantiles/DoublesSketch.java      |  16 --
 .../quantiles/DoublesSketchSortedView.java         |  53 +++--
 .../quantiles/DoublesSketchSortedViewIterator.java |  77 -------
 .../apache/datasketches/quantiles/ItemsSketch.java |  85 +------
 .../quantiles/ItemsSketchSortedView.java           | 131 ++++++++---
 .../quantilescommon/DoublesSortedView.java         |  24 +-
 .../quantilescommon/DoublesSortedViewIterator.java |  18 +-
 .../quantilescommon/FloatsSortedView.java          |  22 +-
 .../quantilescommon/FloatsSortedViewIterator.java  |  18 +-
 .../GenericPartitionBoundaries.java                | 136 +++++++++++
 .../quantilescommon/GenericSortedView.java         |  23 +-
 .../quantilescommon/GenericSortedViewIterator.java |  54 +----
 .../quantilescommon/InequalitySearch.java          | 255 ++++++++++++++++++++-
 .../quantilescommon/PartitionBoundaries.java       |  67 ++++++
 .../quantilescommon/PartitioningFeature.java       |  85 +++++++
 .../datasketches/quantilescommon/QuantilesAPI.java |  15 +-
 .../quantilescommon/QuantilesDoublesAPI.java       |  50 ----
 .../quantilescommon/QuantilesFloatsAPI.java        |  54 +----
 .../quantilescommon/QuantilesGenericAPI.java       |  87 -------
 .../quantilescommon/QuantilesUtil.java             |  64 +++++-
 .../datasketches/quantilescommon/SortedView.java   |  29 +--
 .../quantilescommon/SortedViewIterator.java        |  55 +++--
 .../org/apache/datasketches/req/BaseReqSketch.java |  18 --
 .../datasketches/req/ReqSketchSortedView.java      |  48 +++-
 .../req/ReqSketchSortedViewIterator.java           |  80 -------
 .../org/apache/datasketches/common/UtilTest.java   |   9 +-
 .../KllDirectCompactItemsSketchIteratorTest.java   |   8 +-
 .../kll/KllDirectDoublesSketchTest.java            |  16 --
 .../kll/KllDirectFloatsSketchTest.java             |  16 --
 .../kll/KllDoublesSketchIteratorTest.java          |   8 +-
 .../datasketches/kll/KllDoublesSketchTest.java     |  27 +--
 .../kll/KllFloatsSketchIteratorTest.java           |   8 +-
 .../datasketches/kll/KllFloatsSketchTest.java      |  27 +--
 .../kll/KllItemsSketchSortedViewString.java        |   7 +-
 .../datasketches/kll/KllItemsSketchTest.java       |  38 +--
 .../kll/KllItemsSketchiteratorTest.java            |   8 +-
 .../datasketches/kll/KllMiscDirectDoublesTest.java |  13 --
 .../datasketches/kll/KllMiscDirectFloatsTest.java  |  13 --
 .../apache/datasketches/kll/KllMiscItemsTest.java  |   4 +-
 .../partitions/ClassicPartitionsTest.java          | 122 ++++++++++
 .../ItemsSketchFillRequestLongAsString.java        |  83 +++++++
 .../KllItemsSketchFillRequestLongAsString.java     |  84 +++++++
 .../datasketches/partitions/KllPartitionsTest.java | 122 ++++++++++
 .../datasketches/partitions/PartitionResults.java  | 114 +++++++++
 .../quantiles/CustomQuantilesTest.java             |  70 +++---
 .../datasketches/quantiles/DoublesSketchTest.java  |   7 +-
 .../quantiles/HeapUpdateDoublesSketchTest.java     |  32 +--
 .../quantiles/ItemsSketchSortedViewString.java     |   6 +-
 .../datasketches/quantiles/ItemsSketchTest.java    |  12 +-
 .../datasketches/quantiles/SkewedDataTest.java     | 114 +++++++++
 .../quantilescommon/CrossCheckQuantilesTest.java   |  49 ++--
 .../quantilescommon/LongsAsOrderableStrings.java   |  70 ++++++
 .../quantilescommon/QuantilesUtilTest.java         |  27 ++-
 .../quantilescommon/ReflectUtilityTest.java        |  14 +-
 .../datasketches/req/ReqSketchSortedViewTest.java  |  21 +-
 .../org/apache/datasketches/req/ReqSketchTest.java |  20 +-
 75 files changed, 2384 insertions(+), 1387 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org