You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cordova.apache.org by nikhilkh <gi...@git.apache.org> on 2016/04/13 01:47:09 UTC
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
GitHub user nikhilkh opened a pull request:
https://github.com/apache/cordova-medic/pull/87
Add medic command to download BuildBot CI logs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MSOpenTech/cordova-medic downloadLog
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/cordova-medic/pull/87.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #87
----
commit 8fb541ddd61aeb2232d5a83e4863fdd8264796d8
Author: Nikhil Khandelwal <ni...@microsoft.com>
Date: 2016-04-12T23:45:39Z
Add medic command to download BuildBot CI logs
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by dblotsky <gi...@git.apache.org>.
Github user dblotsky commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r59607150
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
+ //https://ci.apache.org/json/builders/cordova-ios/builds/_all
+ var buildInfoFile = path.join(outputDir, builder + ".json");
+ var buildInfoUrl = util.format("%s/json/builders/%s/builds/_all", SERVER, builder);
+ return download(buildInfoUrl, buildInfoFile).then(function() {
+ var buildInfo = JSON.parse(fs.readFileSync(buildInfoFile));
+ var promises = [];
+ for(var buildNumber in buildInfo) {
+ var steps = buildInfo[buildNumber].steps.filter(
+ function(step) {
+ return STEPS.indexOf(step.name) !== -1 && step.logs && step.logs.length > 0;
+ });
+ steps.forEach(function(step) {
--- End diff --
This anonymous function and the one above are done in different styles. Please format them to be consistent with the others in the file.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by dblotsky <gi...@git.apache.org>.
Github user dblotsky commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r59607181
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
+ //https://ci.apache.org/json/builders/cordova-ios/builds/_all
+ var buildInfoFile = path.join(outputDir, builder + ".json");
+ var buildInfoUrl = util.format("%s/json/builders/%s/builds/_all", SERVER, builder);
+ return download(buildInfoUrl, buildInfoFile).then(function() {
+ var buildInfo = JSON.parse(fs.readFileSync(buildInfoFile));
+ var promises = [];
+ for(var buildNumber in buildInfo) {
+ var steps = buildInfo[buildNumber].steps.filter(
+ function(step) {
+ return STEPS.indexOf(step.name) !== -1 && step.logs && step.logs.length > 0;
+ });
+ steps.forEach(function(step) {
+ var filename = util.format("%s_%s_%s_stdio.log", builder, buildNumber, step.name);
+ if(step.logs[0].length !== 2) {
+ throw "Unexpected build info schema";
--- End diff --
Please throw an `Error` here.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r60274167
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
--- End diff --
It can be - but I prefer map :)
---
In reply to: [59606984](https://github.com/apache/cordova-medic/pull/87#discussion_r59606984) [](ancestors = 59606984)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh commented on the pull request:
https://github.com/apache/cordova-medic/pull/87#issuecomment-212503004
This was merged with cfe4e828fb392709ee97f4da1df46264e6d0faa7
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by dblotsky <gi...@git.apache.org>.
Github user dblotsky commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r59606984
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
--- End diff --
Can this be done in a `for`-loop instead of `map`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r60274259
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
+ //https://ci.apache.org/json/builders/cordova-ios/builds/_all
+ var buildInfoFile = path.join(outputDir, builder + ".json");
+ var buildInfoUrl = util.format("%s/json/builders/%s/builds/_all", SERVER, builder);
+ return download(buildInfoUrl, buildInfoFile).then(function() {
+ var buildInfo = JSON.parse(fs.readFileSync(buildInfoFile));
+ var promises = [];
+ for(var buildNumber in buildInfo) {
+ var steps = buildInfo[buildNumber].steps.filter(
+ function(step) {
+ return STEPS.indexOf(step.name) !== -1 && step.logs && step.logs.length > 0;
+ });
+ steps.forEach(function(step) {
+ var filename = util.format("%s_%s_%s_stdio.log", builder, buildNumber, step.name);
+ if(step.logs[0].length !== 2) {
+ throw "Unexpected build info schema";
--- End diff --
Fixed!
---
In reply to: [59607181](https://github.com/apache/cordova-medic/pull/87#discussion_r59607181) [](ancestors = 59607181)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r60276684
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
+ //https://ci.apache.org/json/builders/cordova-ios/builds/_all
+ var buildInfoFile = path.join(outputDir, builder + ".json");
+ var buildInfoUrl = util.format("%s/json/builders/%s/builds/_all", SERVER, builder);
+ return download(buildInfoUrl, buildInfoFile).then(function() {
+ var buildInfo = JSON.parse(fs.readFileSync(buildInfoFile));
+ var promises = [];
+ for(var buildNumber in buildInfo) {
+ var steps = buildInfo[buildNumber].steps.filter(
+ function(step) {
+ return STEPS.indexOf(step.name) !== -1 && step.logs && step.logs.length > 0;
+ });
+ steps.forEach(function(step) {
+ var filename = util.format("%s_%s_%s_stdio.log", builder, buildNumber, step.name);
+ if(step.logs[0].length !== 2) {
+ throw "Unexpected build info schema";
+ }
+ counter++;
+ promises.push(download(step.logs[0][1] + "/text", path.join(outputDir, filename)));
+ });
+ }
+ return q.all(promises);
+ });
+ });
+
+ q.all(builderPromises).done(function() {
+ console.log("Downloaded " + counter + " logs to " + outputDir);
+ }, function(error) {
+ console.log("Error: " + error);
+ });
+}
+
+function download(url, filename){
+ var defer = q.defer();
+ https.get(url, function(res) {
+ res.setEncoding('utf-8');
+ if (res.statusCode == 200) {
+ var file = fs.createWriteStream(filename);
+ res.pipe(file);
+ file.on('finish', function() {
+ console.log(url + " -> " + filename);
+ file.end();
+ defer.resolve();
+ });
+ } else {
+ defer.reject(url + " Status code: " + res.statusCode);
+ }
+ }).on('error', function(error) {
+ defer.reject(url + " Error: " + error);
+ });
+ return defer.promise;
+}
--- End diff --
Done!
---
In reply to: [59606560](https://github.com/apache/cordova-medic/pull/87#discussion_r59606560) [](ancestors = 59606560)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r60274095
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
--- End diff --
Removed!
---
In reply to: [59606834](https://github.com/apache/cordova-medic/pull/87#discussion_r59606834) [](ancestors = 59606834)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by dblotsky <gi...@git.apache.org>.
Github user dblotsky commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r59606560
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
+ //https://ci.apache.org/json/builders/cordova-ios/builds/_all
+ var buildInfoFile = path.join(outputDir, builder + ".json");
+ var buildInfoUrl = util.format("%s/json/builders/%s/builds/_all", SERVER, builder);
+ return download(buildInfoUrl, buildInfoFile).then(function() {
+ var buildInfo = JSON.parse(fs.readFileSync(buildInfoFile));
+ var promises = [];
+ for(var buildNumber in buildInfo) {
+ var steps = buildInfo[buildNumber].steps.filter(
+ function(step) {
+ return STEPS.indexOf(step.name) !== -1 && step.logs && step.logs.length > 0;
+ });
+ steps.forEach(function(step) {
+ var filename = util.format("%s_%s_%s_stdio.log", builder, buildNumber, step.name);
+ if(step.logs[0].length !== 2) {
+ throw "Unexpected build info schema";
+ }
+ counter++;
+ promises.push(download(step.logs[0][1] + "/text", path.join(outputDir, filename)));
+ });
+ }
+ return q.all(promises);
+ });
+ });
+
+ q.all(builderPromises).done(function() {
+ console.log("Downloaded " + counter + " logs to " + outputDir);
+ }, function(error) {
+ console.log("Error: " + error);
+ });
+}
+
+function download(url, filename){
+ var defer = q.defer();
+ https.get(url, function(res) {
+ res.setEncoding('utf-8');
+ if (res.statusCode == 200) {
+ var file = fs.createWriteStream(filename);
+ res.pipe(file);
+ file.on('finish', function() {
+ console.log(url + " -> " + filename);
+ file.end();
+ defer.resolve();
+ });
+ } else {
+ defer.reject(url + " Status code: " + res.statusCode);
+ }
+ }).on('error', function(error) {
+ defer.reject(url + " Error: " + error);
+ });
+ return defer.promise;
+}
--- End diff --
Please comment and space out this code.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh closed the pull request at:
https://github.com/apache/cordova-medic/pull/87
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by nikhilkh <gi...@git.apache.org>.
Github user nikhilkh commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r60274232
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
+var STEPS = ["running-tests", "gathering-logs", "getting-test-results"];
+
+function downloadLogs(outputDir) {
+ var counter = 0;
+ var builderPromises = BUILDERS.map(function(builder) {
+ //https://ci.apache.org/json/builders/cordova-ios/builds/_all
+ var buildInfoFile = path.join(outputDir, builder + ".json");
+ var buildInfoUrl = util.format("%s/json/builders/%s/builds/_all", SERVER, builder);
+ return download(buildInfoUrl, buildInfoFile).then(function() {
+ var buildInfo = JSON.parse(fs.readFileSync(buildInfoFile));
+ var promises = [];
+ for(var buildNumber in buildInfo) {
+ var steps = buildInfo[buildNumber].steps.filter(
+ function(step) {
+ return STEPS.indexOf(step.name) !== -1 && step.logs && step.logs.length > 0;
+ });
+ steps.forEach(function(step) {
--- End diff --
Fixed!
---
In reply to: [59607150](https://github.com/apache/cordova-medic/pull/87#discussion_r59607150) [](ancestors = 59607150)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
[GitHub] cordova-medic pull request: Add medic command to download BuildBot...
Posted by dblotsky <gi...@git.apache.org>.
Github user dblotsky commented on a diff in the pull request:
https://github.com/apache/cordova-medic/pull/87#discussion_r59606834
--- Diff: medic/medic-downloadlogs.js ---
@@ -0,0 +1,80 @@
+var path = require('path'),
+ fs = require('fs'),
+ https = require('https'),
+ optimist = require('optimist');
+ q = require('Q'),
+ mkdirp = require('mkdirp')
+ util = require('util');
+
+var SERVER = "https://ci.apache.org";
+var BUILDERS = ["cordova-windows-store8.1", "cordova-ios", "cordova-windows-phone8.1", "cordova-android-osx","cordova-android-win"];
+//var BUILDERS = ["cordova-windows-store8.1"];
--- End diff --
If this content is unnecessary, please remove it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org