You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Subash Prabakar <su...@gmail.com> on 2019/04/20 14:13:02 UTC

Feature engineering ETL for machine learning

Hi,

I have a series of queries to extract from multiple tables in hive and do a
feature engineering on the extracted final data.. I can run queries using
spark sql  and use mllib to perform the feature transformation I needed.
The question is do you guys use any kind of tool to perform this workflow
for executing the query or is there any tool which on giving a
template/JSON will construct the spark sql queries for me?


Thanks
Subash