You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/07/16 07:49:26 UTC

[GitHub] [incubator-pinot] deepakcse2k5 opened a new issue #7168: I am not able to manage offline flows ( from realtime to offline)

deepakcse2k5 opened a new issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168


   Hi ,
   
   I have started Quickstart batch with minions :- bin/quick-start-batch-with-minion.sh
   
   followed instruction from here:- https://docs.pinot.apache.org/operators/operating-pinot/pinot-managed-offline-flows
   
   created realtime table - "tableName": "transcript_realtime",
     "tableType": "REALTIME". 
   
   crated realtime table :- 
   <img width="791" alt="transcript-table-realtime" src="https://user-images.githubusercontent.com/8656387/125911634-2999f345-0d4f-449e-b47d-0abf5d56dea0.png">
   
   
   create corresponding offline table :- 
   
   <img width="616" alt="transcript-table-offline" src="https://user-images.githubusercontent.com/8656387/125911484-97a5cb16-0146-4d2c-b8e5-03561f6c77e2.png">
   
   
   segment is generated for real time after pushing data via Kafka .
   
   But I am not able to store data into offline table.
   
   please let me know what is missing in the config file . 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] mayankshriv edited a comment on issue #7168: I am not able to manage offline flows ( from realtime to offline)

Posted by GitBox <gi...@apache.org>.
mayankshriv edited a comment on issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168#issuecomment-882905587


   @deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the `RealtimeToOfflineSegmentsTask`. Unclear from your description if you configured this task to run?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] mayankshriv edited a comment on issue #7168: I am not able to manage offline flows ( from realtime to offline)

Posted by GitBox <gi...@apache.org>.
mayankshriv edited a comment on issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168#issuecomment-882905587


   @deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the `RealtimeToOfflineSegmentsTask`. Unclear from your description if you configured this task to run?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] mayankshriv edited a comment on issue #7168: I am not able to manage offline flows ( from realtime to offline)

Posted by GitBox <gi...@apache.org>.
mayankshriv edited a comment on issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168#issuecomment-882905587


   @deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the `RealtimeToOfflineSegmentsTask`. Unclear from your description if you configured this task to run?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] mayankshriv commented on issue #7168: I am not able to manage offline flows ( from realtime to offline)

Posted by GitBox <gi...@apache.org>.
mayankshriv commented on issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168#issuecomment-882905587


   @deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the `RealtimeToOfflineSegmentsTask`. Unclear from your description if you did that?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] mayankshriv commented on issue #7168: I am not able to manage offline flows ( from realtime to offline)

Posted by GitBox <gi...@apache.org>.
mayankshriv commented on issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168#issuecomment-882905587


   @deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the `RealtimeToOfflineSegmentsTask`. Unclear from your description if you did that?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] mayankshriv commented on issue #7168: I am not able to manage offline flows ( from realtime to offline)

Posted by GitBox <gi...@apache.org>.
mayankshriv commented on issue #7168:
URL: https://github.com/apache/incubator-pinot/issues/7168#issuecomment-882905587


   @deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the `RealtimeToOfflineSegmentsTask`. Unclear from your description if you did that?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org