You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by je...@apache.org on 2019/03/07 21:39:32 UTC

[incubator-pinot] branch hadoopParamFileFormat updated (ae55405 -> 47fcdd0)

This is an automated email from the ASF dual-hosted git repository.

jenniferdai pushed a change to branch hadoopParamFileFormat
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard ae55405  Changing ORC-specific file format to be general
 discard 350c60b  Making record reader instantiation general
 discard af5653c  Adding orc configurability in hadoop jobs
     new 52a9559  [TE] frontend - fix some bugs with alert details graph on range change (#3876)
     new 3b09d27  [TE] Endpoint to delete a complete application (#3888)
     new 3b92bee  [TE] Minor fix in template (#3889)
     new 6fc48ce  [TE] frontend - harleyjj/alert-details - limit number of anomalies displayed in graph (#3890)
     new caef8f6  Replace deprecated ZkClient APIs (#3894)
     new 9791a3d  [TE] frondend - hide anomaly legend if the anomalies is too much. (#3896)
     new 4964f91  Actively check cluster changes if there is no callback for a long time (#3885)
     new 97f0a86  hadern DateTimeFormatSpecTest with locale (#3785)
     new 9dda23f  In ClusterChangeMediator, remove sleep and make it notify based (#3898)
     new 4dc59ff  Reduce MAX_SEGMENT_COMPLETION_TIME_MILLIS to 5 minutes (#3893)
     new ca72055  [TE] migration - bucket period conversion  (#3902)
     new 8bf4011  [TE] Hide Linkedin URLs and add an inlab wiki reference for creating an alert in UI (#3901)
     new ce551eb  [TE] Add cron validator and make detection cron configurable (#3903)
     new bab7926  [TE] frontend - explore dimensions in new alert overview (#3897)
     new 3b95a64  [TE] frontend harleyjj/create-alert turn form off for create-alert (#3905)
     new ec22501  Update read-the-docs high level organization. More changes to follow (#3906)
     new 0e111e6  Remove references that we don't need (#3907)
     new 91237aa  [TE] pinot -harleyjj/email-content update view/edit linke to edit-new route (#3909)
     new dbf02c8  [TE] frontend - harleyjj/alert-overview - handle empty responses better (#3908)
     new a7a8bb6  Fix the RecordReader to pick incoming time column (#3895)
     new 0c59c28  [TE] frontend - harleyjj/alert-overview - fix response parsing error in alert overview and edit alert (#3911)
     new 867edcf  Update the display for sidebar navigation to include section names (#3910)
     new 06da717  Log actual configurations for SegmentCreationMapper (#3914)
     new cda36d7  [TE] Option to retain/force delete anomalies during replay (#3916)
     new 6a1feab  [TE] detection - merger max duration (#3915)
     new db89922  [TE] detection - add default values for duration filter (#3917)
     new b3bd35b  Fix SegmentGeneratorConfig where the time format in schema is not picked up (#3912)
     new 74c5b9b  [TE] Include description and last detection time in alert header, remove application (#3918)
     new 5feb3a9   readthedocs: Fill in dev-guide sections (#3919)
     new d9bbd68  Remove pinot from LICENSE-binary file (#3922)
     new e6dfb05  Fix formatting issues and figures used (#3923)
     new 63f0d3d  readthedocs: Add contribution guidelines (#3925)
     new b2a348c  Adding orc configurability in hadoop jobs
     new 01c5714  Making record reader instantiation general
     new c30b4da  Changing ORC-specific file format to be general
     new 47fcdd0  Adding better error checking

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (ae55405)
            \
             N -- N -- N   refs/heads/hadoopParamFileFormat (47fcdd0)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 5809 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 LICENSE                                            |     1 -
 LICENSE-binary                                     |     2 -
 config/suppressions.xml => docs/README.md          |    16 +-
 docs/{reference.rst => admin_guide.rst}            |     8 +-
 docs/client_api.rst                                |     6 +-
 docs/code_modules.rst                              |   156 +
 docs/conf.py                                       |    14 +-
 docs/contribution_guidelines.rst                   |   211 +
 docs/{reference.rst => customizations.rst}         |    11 +-
 docs/dev_env.rst                                   |    86 +
 docs/{reference.rst => dev_guide.rst}              |    11 +-
 docs/{coding_guidelines.rst => extensions.rst}     |    34 +-
 docs/{trying_pinot.rst => getting_started.rst}     |     4 +-
 docs/img/PinotBroker.png                           |   Bin 0 -> 40314 bytes
 docs/img/PinotController.png                       |   Bin 0 -> 47991 bytes
 docs/img/PinotFoundation.png                       |   Bin 0 -> 44122 bytes
 docs/img/PinotMinionHadoop.png                     |   Bin 0 -> 38638 bytes
 docs/img/PinotServer.png                           |   Bin 0 -> 55062 bytes
 docs/img/eclipse_style.png                         |   Bin 0 -> 137578 bytes
 docs/img/import_scheme.png                         |   Bin 0 -> 164276 bytes
 docs/index.rst                                     |    40 +-
 docs/index_techniques.rst                          |     1 +
 docs/{reference.rst => tuning_pinot.rst}           |     8 +-
 docs/{reference.rst => user_guide.rst}             |     6 +-
 .../pinot/broker/broker/BrokerServerBuilder.java   |    10 +-
 .../broker/broker/helix/ClusterChangeHandler.java  |    11 +-
 .../broker/broker/helix/ClusterChangeMediator.java |   218 +-
 .../broker/helix/ExternalViewChangeHandler.java    |    43 +
 .../broker/broker/helix/HelixBrokerStarter.java    |    32 +-
 .../broker/helix/InstanceConfigChangeHandler.java  |    28 +-
 ...nerImpl.java => LiveInstanceChangeHandler.java} |    56 +-
 .../ConnectionPoolBrokerRequestHandler.java        |    11 +-
 .../queryquota/TableQueryQuotaManagerTest.java     |     2 +-
 .../broker/routing/TimeBoundaryServiceTest.java    |     2 +-
 .../common/data/DateTimeFormatPatternSpec.java     |     4 +-
 .../apache/pinot/common/metrics/BrokerMeter.java   |     4 +-
 .../apache/pinot/common/metrics/BrokerTimer.java   |     4 +-
 .../pinot/common/utils/helix/HelixHelper.java      |    17 +
 .../pinot/common/data/DateTimeFormatSpecTest.java  |     5 +-
 .../common/partition/IdealStateBuilderUtil.java    |     6 +
 .../realtime/PinotLLCRealtimeSegmentManager.java   |    60 +-
 .../pinot/controller/helix/HelixHelperTest.java    |    43 +-
 .../PinotLLCRealtimeSegmentManagerTest.java        |    65 +
 .../pinot/core/data/readers/AvroRecordReader.java  |    16 +-
 .../pinot/core/data/readers/CSVRecordReader.java   |    26 +-
 .../pinot/core/data/readers/JSONRecordReader.java  |    26 +-
 .../pinot/core/data/readers/RecordReader.java      |     2 +
 .../core/data/readers/RecordReaderFactory.java     |     7 +-
 .../pinot/core/data/readers/RecordReaderUtils.java |   215 +-
 .../core/data/readers/ThriftRecordReader.java      |   145 +-
 .../generator/SegmentGeneratorConfig.java          |    53 +-
 .../converter/RealtimeSegmentConverter.java        |     4 -
 .../impl/kafka/AvroRecordToPinotRowGenerator.java  |    17 +-
 .../creator/impl/SegmentColumnarIndexCreator.java  |    16 +-
 .../java/org/apache/pinot/core/util/AvroUtils.java |    57 -
 .../data/readers/RecordReaderSampleDataTest.java   |   233 +
 .../core/data/readers/RecordReaderUtilsTest.java   |    60 +
 .../core/data/readers/ThriftRecordReaderTest.java  |     1 -
 .../generator/SegmentGeneratorConfigTest.java      |    55 +
 .../pinot/index/persist/AvroDataPublisherTest.java |   167 -
 .../src/test/resources/data/test_sample_data.csv   | 10002 +++++++++++++++++++
 .../hadoop/job/mapper/SegmentCreationMapper.java   |    41 +-
 .../app/pods/components/alert-details/component.js |   165 +-
 .../app/pods/components/alert-details/template.hbs |     6 -
 .../self-serve-alert-yaml-details/template.hbs     |    17 +-
 .../pods/components/timeseries-chart/component.js  |     2 +
 .../app/pods/components/yaml-editor/component.js   |    23 +-
 .../app/pods/components/yaml-editor/template.hbs   |     4 +-
 .../app/pods/manage/explore-new/route.js           |    61 +-
 .../app/pods/manage/explore-new/template.hbs       |     1 +
 .../app/pods/manage/yaml/route.js                  |     4 +-
 .../app/pods/self-serve/create-alert/controller.js |     3 +-
 .../app/pods/self-serve/create-alert/template.hbs  |     2 +-
 thirdeye/thirdeye-frontend/app/utils/constants.js  |     2 +-
 thirdeye/thirdeye-frontend/config/environment.js   |     6 +
 .../acceptance/self-serve-import-metric-test.js    |     4 +-
 .../tests/acceptance/self-serve-onboarding-test.js |   187 -
 .../api/application/ApplicationResource.java       |   117 +
 .../dashboard/ThirdEyeDashboardApplication.java    |     4 +
 .../detection/DetectionMigrationResource.java      |     4 +
 .../thirdeye/detection/DetectionResource.java      |    46 +-
 .../thirdeye/detection/algorithm/MergeWrapper.java |    56 +-
 .../detection/spec/DurationAnomalyFilterSpec.java  |     4 +-
 .../validators/DetectionConfigValidator.java       |     7 +
 .../validators/SubscriptionConfigValidator.java    |     8 +-
 .../wrapper/ChildKeepingMergeWrapper.java          |    25 +-
 .../yaml/CompositePipelineConfigTranslator.java    |     4 +-
 .../thirdeye/detector/holiday-anomaly-report.ftl   |     4 +-
 .../api/application/ApplicationResourceTest.java   |   160 +
 .../detection/algorithm/MergeWrapperTest.java      |    51 +-
 .../components/DurationAnomalyFilterTest.java      |    12 +
 .../wrapper/ChildKeepingMergeWrapperTest.java      |     4 +-
 ...multiple-anomalies-email-content-formatter.html |     4 +-
 93 files changed, 12238 insertions(+), 1138 deletions(-)
 copy config/suppressions.xml => docs/README.md (66%)
 copy docs/{reference.rst => admin_guide.rst} (92%)
 create mode 100644 docs/code_modules.rst
 create mode 100644 docs/contribution_guidelines.rst
 copy docs/{reference.rst => customizations.rst} (86%)
 create mode 100644 docs/dev_env.rst
 copy docs/{reference.rst => dev_guide.rst} (89%)
 rename docs/{coding_guidelines.rst => extensions.rst} (56%)
 rename docs/{trying_pinot.rst => getting_started.rst} (99%)
 create mode 100644 docs/img/PinotBroker.png
 create mode 100644 docs/img/PinotController.png
 create mode 100644 docs/img/PinotFoundation.png
 create mode 100644 docs/img/PinotMinionHadoop.png
 create mode 100644 docs/img/PinotServer.png
 create mode 100644 docs/img/eclipse_style.png
 create mode 100644 docs/img/import_scheme.png
 copy docs/{reference.rst => tuning_pinot.rst} (86%)
 rename docs/{reference.rst => user_guide.rst} (92%)
 copy pinot-core/src/main/java/org/apache/pinot/core/io/writer/DataFileWriter.java => pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/ClusterChangeHandler.java (78%)
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/ExternalViewChangeHandler.java
 copy pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/IntegerLiteralAstNode.java => pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/InstanceConfigChangeHandler.java (58%)
 rename pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/{LiveInstancesChangeListenerImpl.java => LiveInstanceChangeHandler.java} (66%)
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/RecordReaderSampleDataTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/RecordReaderUtilsTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/indexsegment/generator/SegmentGeneratorConfigTest.java
 delete mode 100644 pinot-core/src/test/java/org/apache/pinot/index/persist/AvroDataPublisherTest.java
 create mode 100644 pinot-core/src/test/resources/data/test_sample_data.csv
 delete mode 100644 thirdeye/thirdeye-frontend/tests/acceptance/self-serve-onboarding-test.js
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/api/application/ApplicationResource.java
 create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/api/application/ApplicationResourceTest.java


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org