You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/05/12 20:21:00 UTC
[jira] [Commented] (NIFI-4289) Implement put processor for InfluxDB
[ https://issues.apache.org/jira/browse/NIFI-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473262#comment-16473262 ]
ASF GitHub Bot commented on NIFI-4289:
--------------------------------------
Github user david-streamlio commented on the issue:
https://github.com/apache/nifi/pull/2614
`Davids-MacBook-Pro:nifi david$ git rebase
First, rewinding head to replay your work on top of it...
Applying: NIFI-4289 - InfluxDB Put processor
Applying: NIFI-4827 Added support for reading queries from the flowfile body to GetMongo.
Applying: NIFI-4910 Fixing slight spelling mistake in error message, needs a space
Applying: NIFI-3502:
Applying: NIFI-4876 - Adding Min Object Age to ListS3
Applying: NIFI-4839 Creating nifi-toolkit-cli to provide a CLI for interacting with NiFi and NiFi Registry
Applying: NIFI-4839 - Rename the registry group to `registry` for better UX
Applying: NIFI-4839 - Fixing completer unit test
Applying: NIFI-4839 - Implemented auto-layout when importing the PG. Will find an available spot on a canvas which doesn't overlap with other components and is as close to the canvas center as possible.
Applying: NIFI-4839
Applying: NIFI-4839 - Support both public URLs and local files as inputs for import actions.
Applying: NIFI-4839 - Updating README and cleaning up descriptions and comments
Applying: NIFI-4839 - Implemented nice dynamic table output for all list-XXX commands (in simple mode)
Applying: NIFI-4839 - Added abbreviation in simple output for name, description, and comments
Applying: NIFI-4839 - Fixed handling of a connection object position - it doesn't have one and just returns null (calculated by the UI dynamically)
Applying: NIFI-4839 - Switching standalone mode to default to simple output
Applying: NIFI-4839 - The "Disabled" column had incorrect size and skewed the header
Applying: NIFI-4839 Improving back-ref support so that ReferenceResolver is passed the option being resolved
Applying: NIFI-4880: Add the ability to map record based on the aliases. This closes #2474
Applying: Fixed failing unit tests: Changed the queues used to unique names so that one test won't interfere with another; also changed JMSPublisherConsumerTest to JMSPublisherConsumerIT since it is an integration test between the publisher and consumer with ActiveMQ as the broker
Applying: NIFI-4916 - ConvertExcelToCSVProcessor inherit parent attributes. This closes #2500.
Applying: NIFI-2630 Allow PublishJMS to send TextMessages
Applying: NIFI-2630: Changed name of queue in unit test to be unique in order to avoid getting messages from another test if the other tests fails to properly shutdown the connection. This closes #2458.
Applying: NIFI-4920 Skipping sensitive properties when updating component properties from versioned component. This closes #2505.
Applying: NIFI-4773 - Fixed column type map initialization in QueryDatabaseTable
Applying: NIFI-4922 - Add badges to the README file
Applying: NIFI-4872 Added annotation for specifying scenarios in which components can cause high usage of system resources.
Applying: NIFI-4925:
Applying: NIFI-4855:
Applying: NIFI-4893 Cannot convert Avro schemas to Record schemas with default arrays
Applying: NIFI-4928 Updated BouncyCastle dependencies to version 1.59.
Applying: NIFI-4929 Converted the majority of MongoDB unit tests to integration tests so they can be reliably run with 'mvn -Pintegration-tests integration-test'
Applying: NIFI-4948 - MongoDB Lookup Service throws an exception if there is no match
Applying: NIFI-4859 Corrects Swagger Spec VersionedFlowState allowableValues
Applying: NIFI-4835 Corrects Swagger spec response types in FlowResource
Applying: NIFI-4949 Converted nifi-mongodb-services' unit tests into integration tests so that the @Ignore annotation doesn't have to be removed to make them run.
Applying: NIFI-4870 Upgraded activemq-client and activemq-broker versions to 5.15.3.
Applying: NIFI-4945:
Applying: NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max
Applying: NIFI-3039 Provenance Repository - Fix PurgeOldEvent and Rollover Size Limits
Applying: NIFI-4960: fix object setting. This closes #2531.
Applying: NIFI-4936:
Applying: NIFI-4944: Guard against race condition in Snappy for PutHiveStreaming
Applying: NIFI-4885:
Applying: NIFI-4953 - FetchHBaseRow - update log level for "not found" to DEBUG instead of ERROR
Applying: NIFI-4958 - This closes #2529. Fix Travis job status + atlas profile
Applying: NIFI-4885 fixing checkstyle issue
Applying: NIFI-4800 Expose the flattenMode as property in FlattenJSON processor
Applying: NIFI-3402 - Added etag support to InvokeHTTP
Applying: NIFI-4833 Add ScanHBase Processor
Applying: NIFI-4774: Allow user to choose which write-ahead log implementation should be used by the WriteAheadFlowFileRepository
Applying: NIFI-4969 Fixing error when importing versioned flow with a processor that uses event driven scheduling. This closes #2539
Applying: NIFI-4864 Fixing Additional Resources property pointing at a directory won't find new JARs
Applying: NIFI-4864 - Additional improvements to additonal resource loading
Applying: NIFI-4968: fix printing indefinite log errors
Applying: NIFI-4966 - JacksonCSVRecordReader - NPE with some CSV formats
Applying: NIFI-4967 - CSVRecordReader does not read header with specific formats
Applying: NIFI-4955 - Preserve columns ordering with CSV and ValidateRecord
Applying: NIFI-4962 FlattenJson processor add unexpected backslash after flatten
Applying: NIFI-4821 - Upgrade poi to 3.17
Applying: NIFI-4972 - SelectHiveQL to emit FETCH provenance event
Applying: NIFI-4976: If unable to retrieve message content, warn an error but acknowledge message.
Applying: NIFI-4849: Implemented REST Endpoint and associated backend code to generate a Diagnostics Report for a Processor
Applying: NIFI-4809 - Implement a SiteToSiteMetricsReportingTask
Applying: NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy
Applying: Fixed checkstyle violation
Applying: NIFI-4978: Fixed ReportLineageToAtlas NPE when unscheduled
Applying: Changed some unit tests to Integration Tests because they are creating embedded JMS Brokers (implicitly) and commnicating with it. This becomes brittle in a full build, especially if any other unit test attempts to create a broker implicitly due to the way that the activemq broker implicit creation works.
Applying: NIFI-4959: Remove flowfiles and close connection for Bad Requests causing IOException
Applying: NIFI-4973:
Applying: NIFI-4951: Update convertToAvroObject to use the DataTypeUtils conversion function
Applying: NIFI-4950 Defining behavior for MergeContent when more than 1 FlowFile has the same fragment.index value
Applying: NIFI-4918: looping over several methods to try and fit the dynamic attribute.
Applying: NIFI-4973 Added license comment to new file RemoteProcessGroupEntityMergerTest.java
Applying: NIFI-4981 Allow using FF's content as message in PutEmail
Applying: NIFI-4777: get schema by id even if not latest
Applying: NIFI-4912: This closes #2494. Update jackson version to latest stable version (2.9.4)
Applying: NIFI-4902: This closes #2485. Updated ConsumeAMQP, PublishAMQP to use one connection per concurrent task instead of a single connection shared by all concurrent tasks. This offers far better throughput when the network latency is non-trivial. Also refactored to simplify code
Applying: NIFI-4991 This closes #2564.
Applying: NIFI-4979 - Fix ReportLineageToAtlas documentation errors
Applying: NIFI-4557 Added Expression Language support for PGP private keyring passphrase in EncryptContent.
Applying: Revert "NIFI-4809 - Implement a SiteToSiteMetricsReportingTask"
Applying: NIFI-4995 release process exposed this item doesn't get updated by versions mechanism so using project version instead
Applying: NIFI-4885:
Applying: NIFI-4999: Added request URI into the "restlistener.request.uri" attribute
Applying: NIFI-4917: Externalize Keytab and Principal configuration from Processors to a Controller Service. This gives us the ability to allow users to interact with those Keytabs/Principals to which they've been given access without allowing them access to all Keytabs and Principals
Applying: NIFI-4882: Resolve issue with parsing custom date, time, and timestamp formats in CSV files
Applying: NIFI-4989 Made PutMongo able to use nested lookup keys, a query param and multiple lookup keys.
Applying: NIFI-4631: Use java.nio.file.Files in ListFile to improve performance
Applying: NIFI-5011: Fixed threading bug in TestFileSystemRepository
Applying: NIFI-5013 create test jar for standard processors
Applying: NIFI-5009:
Applying: NIFI-4864: Improvements to PR #2470
Applying: NIFI-5012: When connecting to cluster, esure that controller services appropriately enabled/disabled
Applying: NIFI-4743 - Added configurable null suppression to PutElasticsearchHttpRecord
Applying: NIFI-4325 Added new processor that uses the JSON DSL.
Applying: NIFI-4977 Adding expression language support to the Sender properties of PutSyslog
Applying: NIFI-4995 updating copyright year on all notices
Applying: NIFI-4388: Modules Not Honored
Applying: NIFI-4895: Added backend code to give users the ability to forcibly terminate a processor if the processor does not complete after clicking Stop
Applying: NIFI-4993: Accept null user at querying ProvenanceRepository
Applying: [NIFI-4998] update node and npm version
Applying: NIFI-5030: If ControlRate encounters a FlowFile that cannot be transferred, it should continue processing other FlowFiles that have different group attribute values
Applying: NIFI-5026: Refactored StandardPreparedQuery so that instead of a List of Strings that may or may not correspond to compiled expressions and a Map of String to Compiled Expression, the StandardPreparedQuery now just takes a List of Expression objects, and those Expressions can be evaluated to return the proper result
Applying: NIFI-5032: This closes #2596.
Applying: NIFI-5017 - ConvertExcelToCSVProcessor - EL support for rows and columns to skip
Applying: NIFI-5021 Moving nifi-elasticsearch-client-service-api to nifi-elasticsearch-bundle and creating NAR for the API
Applying: NIFI-5033:
Applying: NIFI-4883: Updated ValidateRecord to allow an optional Record Writer to be configured for invalid records that differs from the Record Writer used for writing valid records
Applying: NIFI-5035 Moving MongoDB services out of standard services
Applying: NIFI-4658 set Maximum Number of Entries to required and allow FlowFiles having fragment.count greater than Max Entries property
Applying: NIFI-5037 - ConsumeEWS Fails to Read Emtpy Message Body Emails
Applying: NIFI-5034:
Applying: NIFI-5034:
Applying: NIFI-4788 This closes #2427. Exposing nifi.web.proxy.host configuration for Docker containers.
Applying: NIFI-4995-RC3 prepare release nifi-1.6.0-RC3
Applying: NIFI-4995-RC3 prepare for next development iteration
Applying: NIFI-4932: Enable S2S work behind a Reverse Proxy
Applying: NIFI-5027 Adding commands pg-get-services, pg-enable-services, and pg-disable-services
Applying: NIFI-3599 Allow back pressure object count and data size to be configurable in nifi.properties. This closes #2497
Applying: NIFI-5043: TailFile in Multifile mode should not open new readers in onTrigger
Applying: NIFI-5045: Fixed error code handling in PutHiveQL. This closes #2608
Applying: NIFI-4149 - Indicate if EL is evaluated against FFs or not
Applying: NIFI-4149: Minor tweaks to verbiage
Applying: NIFI-4149 - fixed contrib-check errors
Applying: NIFI-5048 Corrected typo in KeytabCredentialsService controller service description
Applying: NIFI-5047 Fixed a bug in PutMongo that prevented it from working if the mode is insert and the query/query key are not set.
Applying: NIFI-5050 update frontend-maven-plugin
Applying: NIFI-4995 update docker image and text info for next release
Applying: NIFI-4862: Keep incoming flowfile attributes in outgoing flowfiles from SelectHiveQL
Applying: NIFI-5042 Added section Restricted Components in Versioned Flows and edited related section in Adding Components to the Canvas
Applying: NIFI-4857: Support String<->byte[] conversion for records
Applying: NIFI-4941 Updated nifi.sensitive.props.additional.keys description to refer to nifi.properties
Applying: NIFI-5063 Added screenshots and supporting text for Primary Node processors
Applying: NIFI-5055 added ability to unpenalize MockFlowFile directly or from MockProcessSession
Applying: NIFI-5065: HTTP Site-to-Site fails sending data more than 2GB at once
Applying: NIFI-4927 - InfluxDB Query Processor
Applying: NIFI-5074 Added section Variables in Versioned Flows to User Guide
Applying: NIFI-4809 - Implement a SiteToSiteMetricsReportingTask
Applying: NIFI-4997:
Applying: NIFI-1706: Extend QueryDatabaseTable to support arbitrary queries
Applying: NIFI-4942 [WIP] Added skeleton for secure hash handling in encrypt-config toolkit. Added test resource for Python scrypt implementation/verifier. Added unit tests.
Applying: NIFI-5089: Exclude Maven progress output from Travis builds
Applying: NIFI-5085 In InvokeHttp, moving the OkHttp Response object to a try with resources
Applying: NIFI-4516 Added QuerySolr after rebase
Applying: NIFI-4647: Fix support for strings in unions for ConvertAvroToORC
Applying: NIFI-5097 This closes #2647. add client-side HTTP redirect to error index.jsp
Applying: NIFI-4942 Fixes Travis CI build
Applying: NIFI-5062: Removed hbase-client dependecy from hbase bundle
Applying: NIFI-5095: Suppress SET property parse failure at Hive processors
Applying: NIFI-5078 - added source/destination connection info in S2SStatusRT
Applying: NIFI-5096: Periodically poll ZooKeeper to determine the leader for each registered role in Leader Election. This avoids a condition whereby a node may occasionally fail to receive notification that it is no longer the elected leader.
Applying: Added provenance reporting
Applying: NIFI-5082: Added support for custom Oracle timestamp types to Avro conversion
Applying: NIFI-5099 - Update flow differences when updating a connection
Applying: NIFI-5075: Do not execute Funnels with no outgoing connections
Applying: NIFI-4185: Add XML Record Reader
Applying: NIFI-4185: Minor tweaks to XML Record Reader, around documentation and error handling
Applying: NIFI-3576 Support for QueryInfo relationship, can be used to track no-hits
Applying: NIFI-4561 ExecuteSQL returns no FlowFile for some queries
Applying: NIFI-4035 - Adding PutSolrRecord Processor that reads NiFi records and indexes them into Solr as SolrDocuments
Applying: NIFI-5108 Updated all explicit refs and media nar usage of commons-compress to latest version and updated spring redis client
Applying: NIFI-5000 - ListHDFS properly lists files from updated directory path
Applying: NIFI-5015: Implemented Azure Queue Storage processors
Applying: NIFI-5066:
Applying: NIFI-4923 Updated nifi-hadoop-libraries-nar, nifi-hdfs-processors, and nifi-hadoop-utils dependency on hadoop-client from 2.7.3 to 3.0.0
Applying: NIFI-5060 Updated SubstringAfter record processing to support multi-character search trimming
Applying: NIFI-1295:
Applying: NIFI-5092 - Removed local state management for S2S Bulletins RT
Applying: NIFI-5120 AbstractListenEventProcessor supports expression language
Applying: NIFI-5116 Implemented logic to translate nifi.properties file to CLI properties format.
Applying: NIFI-5123: Move SchemaRegistryService to nifi-avro-record-utils
Applying: NIFI-5090: Create move target dir dynamically at FetchFTP and FetchSFTP
Applying: NIFI-5105: Improvements for nifi-aws-bundle
Applying: NIFI-5129: AWS Processors now displays proper region names
Applying: NIFI-5124:
Applying: NIFI-4456: Support multiple JSON objects in JSON record reader/writers
Applying: NIFI-5142: Do not allow a connection's destination to be changed to a funnel if the source is the same funnel. Also fixed some typos in StandardFunnel. This closes #2669
Applying: NIFI-4393: Handle database specific identifier escape characters
Applying: NIFI-5134 Explicitly requesting UGI to relogin before attempting to get a DB connection in HiveConnectionPool
Applying: NIFI-5130 ExecuteInfluxDBQuery processor chunking support
Applying: NIFI-4980: Typo in ReportAtlasLineage kafka kerberos service name property
Applying: NIFI-5135:
Applying: NIFI-5150: Fixed bug that caused StandardProcessSession.append() to copy too much data when called on an incoming flowfile
Applying: NIFI-5152: MoveHDFS now works even with no upstream connection
Applying: NIFI-5153: If a node is disconnected due to failure to complete mutable request, the node should be allowed to rejoin
Applying: NIFI-5154: When Processor or Controller Service is added to a Process Group, remove any references from it to any other Controller Service that is not reachable from the newly assigned Process Group
Applying: NIFI-5163 Clearing version control info when creating a template
Applying: NIFI-5161 - Moved filename escaping method to TlsHelper.java to allow use by the different Tls modes.
Applying: NIFI-5136 Ensure processor references are removed from LogRepository and from ProcessScheduler
Applying: NIFI-5146 Only support HTTP or HTTPS operation for NiFi API/UI
Applying: NIFI-5156: Updated GCP SDK to latest version
Applying: NIFI-5138: Bug fix to ensure that when we have a CHOICE between two or more REOCRD types that we choose the appropriate RECORD type when creating the Record in the JSON Reader.
Applying: NIFI-5168 - ReplaceText Processor Should Use Single FlowFile Processing Instead of Batch
Applying: NIFI-5064 - Fixes and improvements to PutKudu processor
Applying: NIFI-4942 This closes #2690. Resolved test failures in JCE limited mode.
Applying: NIFI-5167:
Applying: NIFI-5180: update JMS additional details to set Destination Type to Required, default 'QUEUE'
Applying: NIFI-4938 Upgraded org.eclipse.paho.client.mqttv3 dependency version to 1.2.0
Applying: NIFI-4637 Added support for visibility labels to the HBase processors.
Applying: NIFI-4637: HBase visibility lables
Applying: NIFI-5121: Added DBCPService API method for passing in flow file attributes when available
Applying: NIFI-5049 Fix handling of Phonenix datetime columns
Davids-MacBook-Pro:nifi david$ `
> Implement put processor for InfluxDB
> ------------------------------------
>
> Key: NIFI-4289
> URL: https://issues.apache.org/jira/browse/NIFI-4289
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Affects Versions: 1.3.0
> Environment: All
> Reporter: Mans Singh
> Assignee: Mans Singh
> Priority: Minor
> Labels: insert, measurements,, put, timeseries
> Fix For: 1.6.0
>
>
> Support inserting time series measurements into InfluxDB.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)