You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@nifi.apache.org by 刘岩 <li...@richinfo.cn> on 2016/03/17 17:55:52 UTC

Direct Support for Avro flowfile transfer to other database




Hi  All




  1.  Currently i39m doing an example , which is  DB -> DB  , and in my case , i have used 4 processors,  and the flow is like this 




  ExecuteSQL -> ConvertAvroToJson -> ConvertJsonToSql -> PutSQL  




   the flow works just fine ,but such converting in the midway is not an optimized way for achieve that. 




  Just  wondering is there going to have a ConvertAvroToSql processor availiable?








  2. moreover , i have another dataflow which is DB -> Hive ， the flow is shown below 





  ExecuteSQL ->ConvertAvroToJson -> PutHDFS  




  i  want to optimize this to    ExecuteSQL -> PutHDFS   but Hive can only read the header, all fields are "null".    



  Does anyone have some solution for that ? 





Thank you guys very much in advance 



Yan Liu

Hortonworks Service Division

Richinfo，Shenzhen，China（PR）

18/03/2016