[I] Export the first five operators as Python, and serve the script [texera]

["kz930 (via GitHub)" <gi...@apache.org>]

kz930 opened a new issue, #8501:
URL: https://github.com/apache/texera/issues/8501

   ### Feature Summary
   
   The trait and the translator are in place, but nothing implements the trait, so the script a plan exports is a file of commented placeholders. Five operators are enough to make it produce something that runs, and between them they cover every shape the translator has to handle: Distinct, Filter, Limit and Projection each read a single input, and Union reads a variadic port, which is the case the numbered placeholders cannot state.
   
   The endpoint the editor calls belongs with them, because what it is worth testing on is a script that runs rather than one made of placeholders.
   
   ### Proposed Solution or Design
   
   Each of the five implements `generateStandaloneCode`, returning the pandas that does what its executor does. Union names the whole list of upstreams rather than a fixed count, since a variadic port can be drawn any number of links.
   
   A generator writes column names into the source it emits, so the shared builder gains `pyStringLiteral`: writing the quotes by hand lets any quote, backslash or newline in a name close the literal early and change the program.
   
   The endpoint takes a plan, compiles it first so a scan source can read the schema off the file it points at, hands the translator the output schemas that gives, and returns the script. A failed compile is logged and translation goes on without the schemas, so a workflow whose file is not chosen yet still exports.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Export the first five operators as Python, and serve the script [texera]

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

github-actions[bot] commented on issue #8501:
URL: https://github.com/apache/texera/issues/8501#issuecomment-5629061562

   <!-- texera:template-compliance -->
   👋 Thanks for opening this issue, @kz930!
   
   It looks like the issue description doesn't quite follow our template yet:
   
   - This issue doesn't appear to use one of our templates (Bug, Feature, or Task). Please open it using a template so the required details are captured.
   
   Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
   
   You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Export the first five operators as Python, and serve the script [texera]

["aglinxinyuan (via GitHub)" <gi...@apache.org>]

aglinxinyuan closed issue #8501: Export the first five operators as Python, and serve the script
URL: https://github.com/apache/texera/issues/8501


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org