[jira] [Created] (ZEPPELIN-1620) livy.spark interpreter formatting breaks for scala with new line

["alex zeltov (JIRA)" <ji...@apache.org>]

alex zeltov created ZEPPELIN-1620:
-------------------------------------

             Summary: livy.spark interpreter formatting breaks for scala with new line
                 Key: ZEPPELIN-1620
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1620
             Project: Zeppelin
          Issue Type: Bug
          Components: livy-interpreter
    Affects Versions: 0.6.0
         Environment: HDP 2.5
Apache Zeppelin

Version 0.6.0.2.5.0.0-1245 
            Reporter: alex zeltov


When using %livy.spark

if you have new line and comments in multi-line statement it breaks. Same code using regular spark statement works correct.

Error that you get:
<console>:1: error: illegal start of definition
           .format("com.databricks.spark.csv")

Example:
%livy.spark

val df = sqlContext.read
    .format("com.databricks.spark.csv")
    .option("header", "true")       // Use first line of all files as header
    .option("inferSchema", "true")  // Automatically infer data types
    .load("/tmp/airflightsdelays/") // Read all flights
    
df.printSchema

If i consolidate the code it works fine:
%livy.spark

val df = sqlContext.read.format("com.databricks.spark.csv").option("header", "true").option("inferSchema", "true").load("/tmp/airflightsdelays/") // Read all flights





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)