You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Ewen Cheslack-Postava (JIRA)" <ji...@apache.org> on 2015/09/01 23:56:45 UTC
[jira] [Commented] (KAFKA-1763) validate_index_log in system tests
runs remotely but uses local paths
[ https://issues.apache.org/jira/browse/KAFKA-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726275#comment-14726275 ]
Ewen Cheslack-Postava commented on KAFKA-1763:
----------------------------------------------
This is for the old system tests. I think there are at least a couple of others bugs that were specifically for old system tests that are going to be replaced anyway. Anybody mind if I just close those? We haven't fully replaced & deleted the old ones yet, so I don't want to clean these up prematurely.
> validate_index_log in system tests runs remotely but uses local paths
> ---------------------------------------------------------------------
>
> Key: KAFKA-1763
> URL: https://issues.apache.org/jira/browse/KAFKA-1763
> Project: Kafka
> Issue Type: Bug
> Components: system tests
> Affects Versions: 0.8.1.1
> Reporter: Ewen Cheslack-Postava
> Assignee: Ewen Cheslack-Postava
> Attachments: KAFKA-1763.patch
>
>
> validate_index_log is the only validation step in the system tests that needs to execute a Kafka binary and it's currently doing so remotely, like the rest of the test binaries. However, this is probably incorrect since it looks like logs are synced back to the driver host and in other cases are operated on locally. It looks like validate_index_log mixes up local/remote paths, causing an exception in DumpLogSegments:
> {quote}
> 2014-11-10 12:09:57,665 - DEBUG - executing command [ssh vagrant@worker1 -o 'HostName 127.0.0.1' -o 'Port 2222' -o 'UserKnownHostsFile /dev/null' -o 'StrictHostKeyChecking no' -o 'PasswordAuthentication no' -o 'IdentityFile /Users/ewencp/.vagrant.d/insecure_private_key' -o 'IdentitiesOnly yes' -o 'LogLevel FATAL' '/opt/kafka/bin/kafka-run-class.sh kafka.tools.DumpLogSegments --file /Users/ewencp/kafka.git/system_test/replication_testsuite/testcase_0008/logs/broker-3/kafka_server_3_logs/test_1-2/00000000000000001294.index --verify-index-only 2>&1'] (system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - Dumping /Users/ewencp/kafka.git/system_test/replication_testsuite/testcase_0008/logs/broker-3/kafka_server_3_logs/test_1-2/00000000000000001294.index (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - Exception in thread "main" java.io.FileNotFoundException: /Users/ewencp/kafka.git/system_test/replication_testsuite/testcase_0008/logs/broker-3/kafka_server_3_logs/test_1-2/00000000000000001294.log (No such file or directory) (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - at java.io.FileInputStream.open(Native Method) (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - at java.io.FileInputStream.<init>(FileInputStream.java:146) (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - at kafka.utils.Utils$.openChannel(Utils.scala:162) (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - at kafka.log.FileMessageSet.<init>(FileMessageSet.scala:74) (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - at kafka.tools.DumpLogSegments$.kafka$tools$DumpLogSegments$$dumpIndex(DumpLogSegments.scala:108) (kafka_system_test_utils)
> 2014-11-10 12:09:58,673 - DEBUG - at kafka.tools.DumpLogSegments$$anonfun$main$1.apply(DumpLogSegments.scala:80) (kafka_system_test_utils)
> 2014-11-10 12:09:58,674 - DEBUG - at kafka.tools.DumpLogSegments$$anonfun$main$1.apply(DumpLogSegments.scala:73) (kafka_system_test_utils)
> 2014-11-10 12:09:58,674 - DEBUG - at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) (kafka_system_test_utils)
> 2014-11-10 12:09:58,674 - DEBUG - at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:105) (kafka_system_test_utils)
> 2014-11-10 12:09:58,674 - DEBUG - at kafka.tools.DumpLogSegments$.main(DumpLogSegments.scala:73) (kafka_system_test_utils)
> 2014-11-10 12:09:58,674 - DEBUG - at kafka.tools.DumpLogSegments.main(DumpLogSegments.scala) (kafka_system_test_utils)
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)