You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "tanishqgandhi1908 (via GitHub)" <gi...@apache.org> on 2026/05/16 18:00:10 UTC
[PR] [Hackathon] feat: add image-native workflows [texera]
tanishqgandhi1908 opened a new pull request, #5107:
URL: https://github.com/apache/texera/pull/5107
### What changes were proposed in this PR?
This hackathon submission focuses on making image workflows feel first-class inside Texera.
**Motivation**
Texera already works well for tabular data, but image-heavy workflows are harder to inspect and explain. A user may have a folder of images, want to build a workflow over them, and then inspect visual outputs, yet the experience often collapses back into raw binary values or table-only results.
The goal of this idea is to make visual data feel natural in a no-code workflow canvas.
| User task | Before | After |
| --- | --- | --- |
| Start from an image dataset | No first-class path to treat a folder of images as structured input | Load an image folder and get one structured row per image |
| Inspect image data | Image bytes appear as opaque binary values | Result tables render actual image thumbnails |
| Understand a visual result | The user sees the final visual output but not the path behind it | Clicking a visual result can open a `Visual Journey` side panel that explains the upstream flow |
**Main changes**
1. Support image folders as structured workflow input, with image bytes plus detected format and dimensions.
2. Serialize recognized image binaries as image data URLs so the frontend can render them directly.
3. Render image thumbnails in result tables instead of raw binary text.
4. Add a reusable `Visual Journey` side panel for richer visual explanations of how an output was produced.
5. Allow visualizer interactions, including iframe-origin clicks, to open the side panel reliably.
**Why this matters**
This makes Texera more useful for modern multimodal workflows such as image classification, visual QA, medical-image review, and report dashboards where the user needs to see both the data and the reasoning path through the workflow.
This submission highlights the image-workflow slice of the broader implementation also discussed in #5094.
### Any related issues, documentation, discussions?
- Related to hackathon discussion #5059.
- Related implementation discussion: #5094.
### How was this PR tested?
```bash
JAVA_HOME=$(/usr/libexec/java_home -v 17) sbt "testOnly org.apache.texera.amber.operator.source.scan.smart.CSVDialectSnifferSpec org.apache.texera.amber.operator.source.scan.smart.FormatDetectorSpec org.apache.texera.amber.operator.source.scan.smart.SmartFileSourceOpDescSpec org.apache.texera.amber.operator.source.scan.smart.SmartFileSourceOpExecSpec org.apache.texera.amber.operator.fileSplit.FileSplitOpDescSpec org.apache.texera.amber.operator.fileSplit.FileSplitOpExecSpec org.apache.texera.amber.operator.source.scan.file.FileScanSourceOpDescSpec org.apache.texera.web.service.ExecutionResultServiceSpec"
PATH="/Users/tanishqgandhi/.nvm/versions/node/v24.15.0/bin:$PATH" yarn ng test --watch=false --include='src/app/workspace/service/visual-trace/visual-trace.utils.spec.ts' --include='src/app/workspace/component/visual-trace-panel/visual-trace-panel.component.spec.ts' --include='src/app/workspace/component/result-panel/result-table-frame/result-table-cell.utils.spec.ts'
```
Manual verification:
1. Loaded a folder-backed image dataset and confirmed it produced structured rows with image metadata.
2. Confirmed result cells render visible image thumbnails instead of raw binary text.
3. Opened an HTML visualizer, clicked a winner card, and confirmed the `Visual Journey` panel opens from visualizer interactions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Hackathon] feat: add image-native workflows [texera]
Posted by "Yicong-Huang (via GitHub)" <gi...@apache.org>.
Yicong-Huang commented on PR #5107:
URL: https://github.com/apache/texera/pull/5107#issuecomment-4526156466
Thank you for participating in the hackathon. We really enjoyed your idea and appreciate the contribution.
We are now archiving hackathon submissions by closing the submission PRs. However, we strongly encourage you to continue developing your idea and explore the possibility of merging it into the main branch.
To move forward, please:
1. Open an issue describing your idea, and link this PR as a reference.
2. Discuss the design and implementation plan with us in the issue.
3. Open smaller, focused PRs so they can go through proper review.
Thanks again for your participation and contribution!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Hackathon] feat: add image-native workflows [texera]
Posted by "Yicong-Huang (via GitHub)" <gi...@apache.org>.
Yicong-Huang closed pull request #5107: [Hackathon] feat: add image-native workflows
URL: https://github.com/apache/texera/pull/5107
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org