You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by GitBox <gi...@apache.org> on 2022/04/07 09:37:39 UTC
[GitHub] [incubator-wayang] regaleo605 opened a new issue, #138: Error in Spark Operator Test
regaleo605 opened a new issue, #138:
URL: https://github.com/apache/incubator-wayang/issues/138
I tried running this [class](https://github.com/apache/incubator-wayang/blob/main/wayang-platforms/wayang-spark/code/test/java/org/apache/wayang/spark/operators/SparkCartesianOperatorTest.java) in my Intellij. However I got the following error;
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
22/04/07 11:31:38 WARN Utils: Your hostname, xxx resolves to a loopback address: 127.0.1.1; using 10.163.38.1 instead (on interface wlo1)
22/04/07 11:31:38 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
java.lang.ExceptionInInitializerError
I think it is a local machine problem in my side. If so, do we need to also add documentation for people trying to use Spark?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] regaleo605 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
regaleo605 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1091440364
Sorry,
So I just need to open the terminal of the project and just type EXPORT SPARK_LOCAL_IP=MY_IP in the command line?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] 2pk03 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
2pk03 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1091441682
Yes, in a terminal or via export variables in your IDE. That should to the trick :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] berttty commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
berttty commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1094652481
@regaleo605
Did you solve it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] regaleo605 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
regaleo605 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1094698111
More or less, so if you don't install Spark then you can't use the command export SPARK_LOCAL_IP in the terminal.
I assume that is also the case with sqlite and maybe other wayang platform?
Thank you in advance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] 2pk03 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
2pk03 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1091436282
Yeah, that comes with 127.0.0.1 machine name resolver (normally localhost resolves to 127.0.0.1). Please set the local IP of your spark instance with:
EXPORT SPARK_LOCAL_IP=YOUR_IP
Yes, would be great to add this into our FAQ :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] 2pk03 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
2pk03 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1094701062
Yes, you need to have access to the platforms to use Wayang. Wayang is a sublayer above the processing frameworks you want to use: wayang.apache.org/documentation
https://github.com/databloom-ai/BDE is a full prebuilt dev environment, comes also as docker container.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] regaleo605 closed issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
regaleo605 closed issue #138: Error in Spark Operator Test
URL: https://github.com/apache/incubator-wayang/issues/138
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] regaleo605 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
regaleo605 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1091465457
Lastly, do you need to install Apache Spark to be able to access SPARK_HOME and have the Spark.env configuration?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] regaleo605 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
regaleo605 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1094704288
No wonder, then issues solved. Thank you for the clarification. It was helpful
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-wayang] 2pk03 commented on issue #138: Error in Spark Operator Test
Posted by GitBox <gi...@apache.org>.
2pk03 commented on issue #138:
URL: https://github.com/apache/incubator-wayang/issues/138#issuecomment-1092858152
Yes, I wrote a small blog post about:
https://mapredit.blogspot.com/2021/09/compile-apache-wayang-on-mac-m1.html
For OSX it's easy with brew
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org