[PR] feat(llm): support asynchronous streaming generation in rag block by using async_generator and asyncio.wait. [incubator-hugegraph-ai]

["vichayturen (via GitHub)" <gi...@apache.org>]

vichayturen opened a new pull request, #190:
URL: https://github.com/apache/incubator-hugegraph-ai/pull/190

   In order to achieve asynchronization, we compromised by changing `gremlin_generate_operator` to a synchronous generation mode. This can be changed back to an asynchronous mode after achieving full asynchronization in the subsequent agentization process.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org

Re: [PR] feat(llm): support asynchronous streaming generation in rag block by using async_generator and asyncio.wait. [incubator-hugegraph-ai]

["imbajin (via GitHub)" <gi...@apache.org>]

imbajin merged PR #190:
URL: https://github.com/apache/incubator-hugegraph-ai/pull/190


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org