[GitHub] [arrow] paleolimbot commented on pull request #14295: ARROW-17915: [C++] Error when using Substrait ProjectRel

[GitBox <gi...@apache.org>]

paleolimbot commented on PR #14295:
URL: https://github.com/apache/arrow/pull/14295#issuecomment-1265821810

   Thanks!
   
   I now get a different issue (also probably related to the Substrait that I'm generating!)
   
   ``` r
   library(arrow, warn.conflicts = FALSE)
   #> Some features are not enabled in this build of Arrow. Run `arrow_info()` for more information.
   
   plan_as_json <- '{
     "extensionUris": [
       {
         "extensionUriAnchor": 1,
         "uri": "https://github.com/apache/arrow/blob/master/format/substrait/extension_types.yaml"
       }
     ],
     "relations": [
       {
         "rel": {
           "project": {
             "common": {
               "emit": {"outputMapping": [2]
               }
             },
             "input": {
               "read": {
                 "baseSchema": {
                   "names": ["int"],
                   "struct": {
                     "types": [{"i32": {"nullability": "NULLABILITY_NULLABLE"}}]
                   }
                 },
                 "localFiles": {
                   "items": [
                     {
                       "uriFile": "file:///var/folders/gt/l87wjg8s7312zs9s7c1fgs900000gn/T//Rtmph5wiTQ/file1260f24ace0d2",
                       "parquet": {
   
                       }
                     }
                   ]
                 }
               }
             },
             "expressions": [
               {"selection": {"directReference": {"structField": {"field": 0}}}}
             ]
           }
         }
       }
     ]
   }'
   
   temp_parquet <- tempfile()
   write_parquet(data.frame(int = 1:5), temp_parquet)
   plan_as_json <- gsub("THIS_IS_THE_TEMP_FILE", temp_parquet, plan_as_json)
   arrow:::do_exec_plan_substrait(plan_as_json)
   #> Error: Invalid: No match for FieldRef.FieldPath(2) in FieldPath(0): int32
   #> FieldPath(0): int32
   #> /Users/deweydunnington/Desktop/rscratch/arrow/cpp/src/arrow/type.h:1796  CheckNonEmpty(matches, root)
   #> /Users/deweydunnington/Desktop/rscratch/arrow/cpp/src/arrow/compute/exec/expression.cc:437  ref->FindOne(in)
   #> /Users/deweydunnington/Desktop/rscratch/arrow/cpp/src/arrow/compute/exec/project_node.cc:68  expr.Bind(*inputs[0]->output_schema(), plan->exec_context())
   #> /Users/deweydunnington/Desktop/rscratch/arrow/cpp/src/arrow/compute/exec/exec_plan.cc:535  MakeExecNode(this->factory_name, plan, std::move(inputs), *this->options, registry)
   #> /Users/deweydunnington/Desktop/rscratch/arrow/cpp/src/arrow/compute/exec/exec_plan.cc:530  std::get<Declaration>(input).AddToPlan(plan, registry)
   ```
   
   <sup>Created on 2022-10-03 by the [reprex package](https://reprex.tidyverse.org) (v2.0.1)</sup>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org