You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ravisankar Mani <rr...@gmail.com> on 2015/08/12 05:50:38 UTC
Exception in spark
Hi all,
We got an exception like
“org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call
to dataType on unresolved object” when using some where condition queries.
I am using 1.4.0 version spark. Is this exception resolved in latest spark?
Regards,
Ravi
Re: Exception in spark
Posted by Ravisankar Mani <rr...@gmail.com>.
Hi Josh
Please ignore the last mail stack trace. Kindly refer the exception details.
{"org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call
to dataType on unresolved object, tree: 'Sheet1.Teams"}
Regards,
Ravi
On Wed, Aug 12, 2015 at 1:34 AM, Ravisankar Mani <rr...@gmail.com> wrote:
> Hi Rosan,
>
> Thanks for your response. Kindly refer the following query and stack
> trace. I have checked same query in hive, It works perfectly. In case i
> have removed "in" in where class, it works in spark
>
>
> SELECT If(ISNOTNULL(SUM(`Sheet1`.`Runs`)),SUM(`Sheet1`.`Runs`),0) AS
> `Sheet1_Runs` ,`Sheet1`.`Teams` AS `Sheet1_Teams` FROM
> default.Dashboard_Sheet1_20150812010131201 AS `Sheet1` INNER JOIN (SELECT
> `Sheet1`.`Teams` AS
> `Teams_0`,If(ISNOTNULL(COUNT(`Sheet1`.`Teams`)),COUNT(`Sheet1`.`Teams`),0)
> AS `Measure_0` FROM default.Dashboard_Sheet1_20150812010131201 AS `Sheet1`
> WHERE ((((`Sheet1`.`Teams` IN ('Chennai Super Kings')) AND
> (`Sheet1`.`Teams` <> '' )) AND (NOT(`Sheet1`.`Teams` IS NULL)))) GROUP BY
> `Sheet1`.`Teams` ORDER BY `Measure_0` DESC LIMIT 5 ) `T_0` ON (
> `Sheet1`.`Teams` =`T_0`.`Teams_0` ) WHERE ((((`Sheet1`.`Teams` IN ('Chennai
> Super Kings')) AND (`Sheet1`.`Teams` <> '' )) AND (NOT(`Sheet1`.`Teams` IS
> NULL)))) GROUP BY `Sheet1`.`Teams`
>
>
>
> at Syncfusion.ThriftHive.Base.HqlCommand.ExecuteReader()
> at
> Syncfusion.Dashboard.Base.Data.HiveQueryBuilder.ExecuteReaderQuery(String
> query, String connectionString) in
> f:\Back_To_Svn\source\base\dashboard.base\src\Data\HiveServer.cs:line 409
> at Syncfusion.Dashboard.Base.Data.ServerDataProvider.GetTable(String
> tableName, List`1 schemaInfoCollection, List`1
> originalSchemaInfoCollection, List`1 initialFilterList, List`1
> viewerFilterList, Boolean isSelectQueryForServerModeFilterPopup, Boolean
> isNestedFilter) in
> f:\Back_To_Svn\source\base\dashboard.base\src\Data\Data.cs:line 536
> at
> Syncfusion.Dashboard.Base.Engine.RelationalEngine.GetDataFromMainSource(List`1
> schemaInfos, List`1 viewerFilterList) in
> f:\Back_To_Svn\source\base\dashboard.base\src\Engine\RelationDataEngine.cs:line
> 902
> at
> DashboardService.DashboardService.ApplyFilterServerMode(RelationalEngine
> engine, String ReportName, Boolean Drilled, Boolean& useDefaultProperties,
> Boolean isParamsColumn, SchemaInfo paramsSchema) in
> f:\Back_To_Svn\source\js\dashboardsamples\wcf\Common\DataProcessor.cs:line
> 1030
> at DashboardService.DashboardService.ApplyFilter(RelationalEngine
> engine, String ReportName, Boolean Drilled, Boolean& useDefaultProperties,
> Boolean isParamsColumn, SchemaInfo paramsSchema) in
> f:\Back_To_Svn\source\js\dashboardsamples\wcf\Common\DataProcessor.cs:line
> 1047
> at DashboardService.DashboardService.GetProcessedControlData(List`1
> elements, RelationalEngine dataEngine, DashboardItem control,
> RelationalReport currentReport) in
> f:\Back_To_Svn\source\js\dashboardsamples\wcf\Common\DataProcessor.cs:line
> 205
> at DashboardService.DashboardService.GetGridControlData(DashboardItem
> controlObj, List`1& columnList, List`1& gridSchemaInfos, Dictionary`2&
> barData, Dictionary`2& formattedColumns, List`1& colourSaturationColumns)
> in
> f:\Back_To_Svn\source\js\dashboardsamples\wcf\Controls\DashboardGrid.cs:line
> 115
> at DashboardService.DashboardService.GetGridData(DashboardItem
> controlObj, Boolean isLoadGrid) in
> f:\Back_To_Svn\source\js\dashboardsamples\wcf\Controls\DashboardGrid.cs:line
> 47
> at DashboardService.DashboardService.ControlConfigHelper(DashboardItem
> control, Boolean IsLoad, DataFetcherGrid fn) in
> f:\Back_To_Svn\source\js\dashboardsamples\wcf\DashboardService.svc.cs:line
> 1269
>
>
> Regards,
> Ravi
>
>
> On Tue, Aug 11, 2015 at 11:53 PM, Josh Rosen <ro...@gmail.com> wrote:
>
>> Can you share a query or stack trace? More information would make this
>> question easier to answer.
>>
>> On Tue, Aug 11, 2015 at 8:50 PM, Ravisankar Mani <rr...@gmail.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We got an exception like
>>> “org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call
>>> to dataType on unresolved object” when using some where condition queries.
>>> I am using 1.4.0 version spark. Is this exception resolved in latest spark?
>>>
>>>
>>> Regards,
>>> Ravi
>>>
>>
>>
>
Re: Exception in spark
Posted by Ravisankar Mani <rr...@gmail.com>.
Hi Rosan,
Thanks for your response. Kindly refer the following query and stack trace.
I have checked same query in hive, It works perfectly. In case i have
removed "in" in where class, it works in spark
SELECT If(ISNOTNULL(SUM(`Sheet1`.`Runs`)),SUM(`Sheet1`.`Runs`),0) AS
`Sheet1_Runs` ,`Sheet1`.`Teams` AS `Sheet1_Teams` FROM
default.Dashboard_Sheet1_20150812010131201 AS `Sheet1` INNER JOIN (SELECT
`Sheet1`.`Teams` AS
`Teams_0`,If(ISNOTNULL(COUNT(`Sheet1`.`Teams`)),COUNT(`Sheet1`.`Teams`),0)
AS `Measure_0` FROM default.Dashboard_Sheet1_20150812010131201 AS `Sheet1`
WHERE ((((`Sheet1`.`Teams` IN ('Chennai Super Kings')) AND
(`Sheet1`.`Teams` <> '' )) AND (NOT(`Sheet1`.`Teams` IS NULL)))) GROUP BY
`Sheet1`.`Teams` ORDER BY `Measure_0` DESC LIMIT 5 ) `T_0` ON (
`Sheet1`.`Teams` =`T_0`.`Teams_0` ) WHERE ((((`Sheet1`.`Teams` IN ('Chennai
Super Kings')) AND (`Sheet1`.`Teams` <> '' )) AND (NOT(`Sheet1`.`Teams` IS
NULL)))) GROUP BY `Sheet1`.`Teams`
at Syncfusion.ThriftHive.Base.HqlCommand.ExecuteReader()
at
Syncfusion.Dashboard.Base.Data.HiveQueryBuilder.ExecuteReaderQuery(String
query, String connectionString) in
f:\Back_To_Svn\source\base\dashboard.base\src\Data\HiveServer.cs:line 409
at Syncfusion.Dashboard.Base.Data.ServerDataProvider.GetTable(String
tableName, List`1 schemaInfoCollection, List`1
originalSchemaInfoCollection, List`1 initialFilterList, List`1
viewerFilterList, Boolean isSelectQueryForServerModeFilterPopup, Boolean
isNestedFilter) in
f:\Back_To_Svn\source\base\dashboard.base\src\Data\Data.cs:line 536
at
Syncfusion.Dashboard.Base.Engine.RelationalEngine.GetDataFromMainSource(List`1
schemaInfos, List`1 viewerFilterList) in
f:\Back_To_Svn\source\base\dashboard.base\src\Engine\RelationDataEngine.cs:line
902
at
DashboardService.DashboardService.ApplyFilterServerMode(RelationalEngine
engine, String ReportName, Boolean Drilled, Boolean& useDefaultProperties,
Boolean isParamsColumn, SchemaInfo paramsSchema) in
f:\Back_To_Svn\source\js\dashboardsamples\wcf\Common\DataProcessor.cs:line
1030
at DashboardService.DashboardService.ApplyFilter(RelationalEngine
engine, String ReportName, Boolean Drilled, Boolean& useDefaultProperties,
Boolean isParamsColumn, SchemaInfo paramsSchema) in
f:\Back_To_Svn\source\js\dashboardsamples\wcf\Common\DataProcessor.cs:line
1047
at DashboardService.DashboardService.GetProcessedControlData(List`1
elements, RelationalEngine dataEngine, DashboardItem control,
RelationalReport currentReport) in
f:\Back_To_Svn\source\js\dashboardsamples\wcf\Common\DataProcessor.cs:line
205
at DashboardService.DashboardService.GetGridControlData(DashboardItem
controlObj, List`1& columnList, List`1& gridSchemaInfos, Dictionary`2&
barData, Dictionary`2& formattedColumns, List`1& colourSaturationColumns)
in
f:\Back_To_Svn\source\js\dashboardsamples\wcf\Controls\DashboardGrid.cs:line
115
at DashboardService.DashboardService.GetGridData(DashboardItem
controlObj, Boolean isLoadGrid) in
f:\Back_To_Svn\source\js\dashboardsamples\wcf\Controls\DashboardGrid.cs:line
47
at DashboardService.DashboardService.ControlConfigHelper(DashboardItem
control, Boolean IsLoad, DataFetcherGrid fn) in
f:\Back_To_Svn\source\js\dashboardsamples\wcf\DashboardService.svc.cs:line
1269
Regards,
Ravi
On Tue, Aug 11, 2015 at 11:53 PM, Josh Rosen <ro...@gmail.com> wrote:
> Can you share a query or stack trace? More information would make this
> question easier to answer.
>
> On Tue, Aug 11, 2015 at 8:50 PM, Ravisankar Mani <rr...@gmail.com>
> wrote:
>
>> Hi all,
>>
>> We got an exception like
>> “org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call
>> to dataType on unresolved object” when using some where condition queries.
>> I am using 1.4.0 version spark. Is this exception resolved in latest spark?
>>
>>
>> Regards,
>> Ravi
>>
>
>
Re: Exception in spark
Posted by Josh Rosen <ro...@gmail.com>.
Can you share a query or stack trace? More information would make this
question easier to answer.
On Tue, Aug 11, 2015 at 8:50 PM, Ravisankar Mani <rr...@gmail.com> wrote:
> Hi all,
>
> We got an exception like
> “org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call
> to dataType on unresolved object” when using some where condition queries.
> I am using 1.4.0 version spark. Is this exception resolved in latest spark?
>
>
> Regards,
> Ravi
>