You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "soumitra-st (via GitHub)" <gi...@apache.org> on 2024/01/08 17:50:14 UTC

[I] FD_AWARE_INSTANCE_PARTITION_SELECTOR fails when pool tag does not start with 0 [pinot]

soumitra-st opened a new issue, #12239:
URL: https://github.com/apache/pinot/issues/12239

   I have a cluster with 6 servers and they are tagged into pools as:
   
   
   ```
   Server Server_100.69.142.24_7505
   {
     "DefaultTenant_OFFLINE": "2",
     "DefaultTenant_REALTIME": "2"
   }
   Server Server_100.69.142.24_7504
   {
     "DefaultTenant_OFFLINE": "2",
     "DefaultTenant_REALTIME": "2"
   }
   Server Server_100.69.142.24_7503
   {
     "DefaultTenant_OFFLINE": "1",
     "DefaultTenant_REALTIME": "1"
   }
   Server Server_100.69.142.24_7502
   {
     "DefaultTenant_OFFLINE": "1",
     "DefaultTenant_REALTIME": "1"
   }
   Server Server_100.69.142.24_7501
   {
     "DefaultTenant_OFFLINE": "3",
     "DefaultTenant_REALTIME": "3"
   }
   Server Server_100.69.142.24_7500
   {
     "DefaultTenant_OFFLINE": "3",
     "DefaultTenant_REALTIME": "3"
   }
   
   ```
   
   Can't create a table using "partitionSelector": "FD_AWARE_INSTANCE_PARTITION_SELECTOR":
   
   ```
   % curl http://localhost:9000/tables -H 'accept: application/json' -H 'Content-Type: application/json' -d @transcript-table-offline.json.az
   {"code":500,"error":"Index 3 out of bounds for length 3"}
   ```
   
   Table config used:
   ```
   {
     "tableName": "transcript",
     "segmentsConfig" : {
       "timeColumnName": "timestamp",
       "timeType": "MILLISECONDS",
       "replication" : "3",
       "schemaName" : "transcript"
     },
     "tableIndexConfig" : {
       "invertedIndexColumns" : [],
       "loadMode"  : "MMAP"
     },
     "tenants" : {
       "broker":"DefaultTenant",
       "server":"DefaultTenant"
     },
     "tableType":"OFFLINE",
     "metadata": {},
     "instanceAssignmentConfigMap": {
       "OFFLINE": {
         "partitionSelector": "FD_AWARE_INSTANCE_PARTITION_SELECTOR",
         "tagPoolConfig": {
           "tag": "DefaultTenant_OFFLINE",
           "poolBased": true,
           "numPools": 3
         },
         "replicaGroupPartitionConfig": {
           "replicaGroupBased": true,
           "numReplicaGroups": 3
         }
       }
     }
   }
   ```
   
   Table creation succeeds with "partitionSelector": "INSTANCE_REPLICA_GROUP_PARTITION_SELECTOR" as:
   ```
   % curl http://localhost:9000/tables -H 'accept: application/json' -H 'Content-Type: application/json' -d @transcript-table-offline.json.az
   {"unrecognizedProperties":{},"status":"Table transcript_OFFLINE successfully added"}
   ```
   
   cc: @jasperjiaguo @mayankshriv 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] FD_AWARE_INSTANCE_PARTITION_SELECTOR fails when pool tag does not start with 0 [pinot]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12239:
URL: https://github.com/apache/pinot/issues/12239#issuecomment-5274342618

   This issue has been automatically marked as stale because it has not had any activity in the last 150 days. It will be closed in 30 days if no further activity occurs. If this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] FD_AWARE_INSTANCE_PARTITION_SELECTOR fails when pool tag does not start with 0 [pinot]

Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang closed issue #12239: FD_AWARE_INSTANCE_PARTITION_SELECTOR fails when pool tag does not start with 0
URL: https://github.com/apache/pinot/issues/12239


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] FD_AWARE_INSTANCE_PARTITION_SELECTOR fails when pool tag does not start with 0 [pinot]

Posted by "Vamsi-klu (via GitHub)" <gi...@apache.org>.
Vamsi-klu commented on issue #12239:
URL: https://github.com/apache/pinot/issues/12239#issuecomment-5304514961

   Opened https://github.com/apache/pinot/pull/19266 to fix the non-zero-based pool tag crash.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org