[jira] [Created] (SPARK-12927) Dataframe doesn't display the current status on Aerospike.

["Sasi (JIRA)" <ji...@apache.org>]

Sasi created SPARK-12927:
----------------------------

             Summary: Dataframe doesn't display the current status on Aerospike.
                 Key: SPARK-12927
                 URL: https://issues.apache.org/jira/browse/SPARK-12927
             Project: Spark
          Issue Type: Bug
    Affects Versions: 1.5.1
            Reporter: Sasi


Hi,
I'm facing with issue on my environment when my dataframe doesn't display the real status of my Aerospike bin.
I have the following code:
{code}
 SparkContextFunctions sparkContextFunctions = new SparkContextFunctions(spark_context); 
            String aeroSpikeAddress = host+port;
            String query = "select * from bin";
            dataFrame = sparkContextFunctions.aeroSInput(aeroSpikeAddress, query, sqlCtx, 6);
            dataFrame .registerTempTable("testTbl");
            dataFrame .persist(StorageLevel.MEMORY_ONLY());
{code}

After create the tmpTbl I do the following:
{code}
subscribersDataFrame.where(whereClause).collect();
{code}

At the first time I get the same values of the Aerospike bin, but if I add or delete row I don't get the same status.
If I drop the table and create it again then I get the right status.

Thanks.
Sasi



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org