You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@texera.apache.org by "bobbai00 (via GitHub)" <gi...@apache.org> on 2025/11/08 01:40:03 UTC

[I] Large language model agent as copilots for workflow construction [texera]

bobbai00 opened a new issue, #4034:
URL: https://github.com/apache/texera/issues/4034

### Feature Summary

Texera has over 130 operators. For users who are not familiar data science and workflow, it is hard for them to get started on using Texera.

Large language models are becoming widely-used in many applications as copilots to help users clarify system functionalities and finish certain tasks.

Therefore, it would be great if Texera can incorporate LLMs as workflow copilots, helping users understand workflow functionalities and construct workflows.

### Proposed Solution or Design

### System Architecture
At high level, here is the system architecture with LLM copilot:

Three major components should be made:

### 1. Frontend: Agent Panel
A panel where users can CRUD agents, and interact with agent through chat interface.

### 2. Backend: LLM Proxy Service
A new micro service where
- API keys of different LLM providers are managed
- Request and response are handled and monitored

[litellm](https://docs.litellm.ai/#when-to-use-litellm-proxy-server-llm-gateway) is a very good out-of-box option for such functionalities.

### 3. Backend: Access control
Access control logic to authentic LLM-related traffic. Adding the logic to the existing `AccessControlService` should be good enough.

### Impact / Priority

(P1)High – significantly improves user experience

### Affected Area

Workflow UI

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Introduce a LLM Agent that helps users construct workflows [texera]

Posted by "bobbai00 (via GitHub)" <gi...@apache.org>.

bobbai00 commented on issue #4034:
URL: https://github.com/apache/texera/issues/4034#issuecomment-4358078711

   Finished!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Introduce a LLM Agent that helps users construct workflows [texera]

Posted by "chenlica (via GitHub)" <gi...@apache.org>.

chenlica commented on issue #4034:
URL: https://github.com/apache/texera/issues/4034#issuecomment-4358090985

   Congratulations, Agent Bob!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Introduce a LLM Agent that helps users construct workflows [texera]

Posted by "bobbai00 (via GitHub)" <gi...@apache.org>.

bobbai00 closed issue #4034: Introduce a LLM Agent that helps users construct workflows
URL: https://github.com/apache/texera/issues/4034


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] LLM Agent for Workflow Construction [texera]

Posted by "bobbai00 (via GitHub)" <gi...@apache.org>.

bobbai00 commented on issue #4034:
URL: https://github.com/apache/texera/issues/4034#issuecomment-4315792517

   #4020 adds a pure-frontend implementation of a LLM agent and it can only read workflows, do things like explaining existing workflows and operator definitions.
   
   #4417 replaces the pure-frontend agent with a micro service architecture. And the agent can do write operations like adding operators, and execute operators.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org