You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Sebastian <ss...@googlemail.com> on 2015/03/03 14:08:22 UTC
Strange output paths in Flink 0.8.1
Hi I'm getting strange output paths for this piece of code:
computeDistribution(
"/home/ssc/Desktop/trackthetrackers/sampleSeg.tsv",
"/home/ssc/Entwicklung/datasets/hyperlink2012/pld-index",
"/home/ssc/Desktop/trackthetrackers/out/trackerDistribution/")
def computeDistribution(trackingGraphFile: String,
domainIndexFile: String, outputPath: String) = {
...
topTrackerDomains.writeAsCsv(outputPath, fieldDelimiter = "\t",
writeMode = WriteMode.OVERWRITE)
}
For some reasons, the last directory name is repeated twice in the final
output:
/home/ssc/Desktop/trackthetrackers/out/trackerDistribution/trackerDistribution/
How does this come?
Best,
Sebastian
Re: Strange output paths in Flink 0.8.1
Posted by Sebastian <ss...@googlemail.com>.
Thank you!
On 03.03.2015 23:09, Fabian Hueske wrote:
> A quick workaround is to remove the last '/' from the output path.
>
> I created https://issues.apache.org/jira/browse/FLINK-1640 and will
> provide a fix tomorrow.
>
> 2015-03-03 21:59 GMT+01:00 Fabian Hueske <fhueske@gmail.com
> <ma...@gmail.com>>:
>
> I reproduced the bug and will look into that.
>
> Cheers, Fabian
>
> 2015-03-03 14:08 GMT+01:00 Sebastian <ssc.open@googlemail.com
> <ma...@googlemail.com>>:
>
> Hi I'm getting strange output paths for this piece of code:
>
> computeDistribution(
> "/home/ssc/Desktop/__trackthetrackers/sampleSeg.__tsv",
> "/home/ssc/Entwicklung/__datasets/hyperlink2012/pld-__index",
>
> "/home/ssc/Desktop/__trackthetrackers/out/__trackerDistribution/")
>
> def computeDistribution(__trackingGraphFile: String,
> domainIndexFile: String, outputPath: String) = {
>
> ...
>
> topTrackerDomains.writeAsCsv(__outputPath, fieldDelimiter = "\t",
> writeMode = WriteMode.OVERWRITE)
>
> }
>
> For some reasons, the last directory name is repeated twice in
> the final output:
>
> /home/ssc/Desktop/__trackthetrackers/out/__trackerDistribution/__trackerDistribution/
>
> How does this come?
>
> Best,
> Sebastian
>
>
>
Re: Strange output paths in Flink 0.8.1
Posted by Fabian Hueske <fh...@gmail.com>.
A quick workaround is to remove the last '/' from the output path.
I created https://issues.apache.org/jira/browse/FLINK-1640 and will provide
a fix tomorrow.
2015-03-03 21:59 GMT+01:00 Fabian Hueske <fh...@gmail.com>:
> I reproduced the bug and will look into that.
>
> Cheers, Fabian
>
> 2015-03-03 14:08 GMT+01:00 Sebastian <ss...@googlemail.com>:
>
>> Hi I'm getting strange output paths for this piece of code:
>>
>> computeDistribution(
>> "/home/ssc/Desktop/trackthetrackers/sampleSeg.tsv",
>> "/home/ssc/Entwicklung/datasets/hyperlink2012/pld-index",
>> "/home/ssc/Desktop/trackthetrackers/out/trackerDistribution/")
>>
>> def computeDistribution(trackingGraphFile: String,
>> domainIndexFile: String, outputPath: String) = {
>>
>> ...
>>
>> topTrackerDomains.writeAsCsv(outputPath, fieldDelimiter = "\t",
>> writeMode = WriteMode.OVERWRITE)
>>
>> }
>>
>> For some reasons, the last directory name is repeated twice in the final
>> output:
>>
>> /home/ssc/Desktop/trackthetrackers/out/trackerDistribution/
>> trackerDistribution/
>>
>> How does this come?
>>
>> Best,
>> Sebastian
>>
>
>
Re: Strange output paths in Flink 0.8.1
Posted by Fabian Hueske <fh...@gmail.com>.
I reproduced the bug and will look into that.
Cheers, Fabian
2015-03-03 14:08 GMT+01:00 Sebastian <ss...@googlemail.com>:
> Hi I'm getting strange output paths for this piece of code:
>
> computeDistribution(
> "/home/ssc/Desktop/trackthetrackers/sampleSeg.tsv",
> "/home/ssc/Entwicklung/datasets/hyperlink2012/pld-index",
> "/home/ssc/Desktop/trackthetrackers/out/trackerDistribution/")
>
> def computeDistribution(trackingGraphFile: String,
> domainIndexFile: String, outputPath: String) = {
>
> ...
>
> topTrackerDomains.writeAsCsv(outputPath, fieldDelimiter = "\t",
> writeMode = WriteMode.OVERWRITE)
>
> }
>
> For some reasons, the last directory name is repeated twice in the final
> output:
>
> /home/ssc/Desktop/trackthetrackers/out/trackerDistribution/
> trackerDistribution/
>
> How does this come?
>
> Best,
> Sebastian
>