You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@apex.apache.org by th...@apache.org on 2016/08/31 01:09:56 UTC
apex-malhar git commit: APEXMALHAR-2142 #comment Fix content in test
resource file
Repository: apex-malhar
Updated Branches:
refs/heads/master 79ece3d8b -> 75c7e59bd
APEXMALHAR-2142 #comment Fix content in test resource file
Project: http://git-wip-us.apache.org/repos/asf/apex-malhar/repo
Commit: http://git-wip-us.apache.org/repos/asf/apex-malhar/commit/75c7e59b
Tree: http://git-wip-us.apache.org/repos/asf/apex-malhar/tree/75c7e59b
Diff: http://git-wip-us.apache.org/repos/asf/apex-malhar/diff/75c7e59b
Branch: refs/heads/master
Commit: 75c7e59bd8a83244a578bf1123393756dfb8ac98
Parents: 79ece3d
Author: Siyuan Hua <hs...@apache.org>
Authored: Tue Aug 30 17:13:35 2016 -0700
Committer: Siyuan Hua <hs...@apache.org>
Committed: Tue Aug 30 17:13:35 2016 -0700
----------------------------------------------------------------------
.../sample/complete/AutoCompleteTest.java | 11 +-
.../src/test/resources/sampletweets.txt | 251 ++++---------------
stream/src/test/resources/sampletweets.txt | 207 ---------------
3 files changed, 47 insertions(+), 422 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/apex-malhar/blob/75c7e59b/demos/highlevelapi/src/test/java/org/apache/apex/malhar/stream/sample/complete/AutoCompleteTest.java
----------------------------------------------------------------------
diff --git a/demos/highlevelapi/src/test/java/org/apache/apex/malhar/stream/sample/complete/AutoCompleteTest.java b/demos/highlevelapi/src/test/java/org/apache/apex/malhar/stream/sample/complete/AutoCompleteTest.java
index 26bb13e..97c5ad4 100644
--- a/demos/highlevelapi/src/test/java/org/apache/apex/malhar/stream/sample/complete/AutoCompleteTest.java
+++ b/demos/highlevelapi/src/test/java/org/apache/apex/malhar/stream/sample/complete/AutoCompleteTest.java
@@ -53,14 +53,9 @@ public class AutoCompleteTest
lc.run(200000);
- Assert.assertTrue(AutoComplete.Collector.getResult().containsKey("chi"));
- Assert.assertTrue(AutoComplete.Collector.getResult().containsKey("china"));
- Assert.assertEquals(2, AutoComplete.Collector.getResult().get("china").get(0).getCount());
- Assert.assertEquals("China", AutoComplete.Collector.getResult().get("china").get(0).getValue());
- Assert.assertEquals(2, AutoComplete.Collector.getResult().get("d").size());
- Assert.assertEquals(3, AutoComplete.Collector.getResult().get("f").size());
- Assert.assertTrue(AutoComplete.Collector.getResult().get("f").get(0).getCount() >= AutoComplete.Collector.getResult().get("f").get(1).getCount());
- Assert.assertTrue(AutoComplete.Collector.getResult().get("f").get(1).getCount() >= AutoComplete.Collector.getResult().get("f").get(2).getCount());
+ Assert.assertTrue(AutoComplete.Collector.getResult().containsKey("had"));
+ Assert.assertTrue(AutoComplete.Collector.getResult().containsKey("hadoop"));
+ Assert.assertEquals(2, AutoComplete.Collector.getResult().get("mapreduce").get(0).getCount());
}
}
http://git-wip-us.apache.org/repos/asf/apex-malhar/blob/75c7e59b/demos/highlevelapi/src/test/resources/sampletweets.txt
----------------------------------------------------------------------
diff --git a/demos/highlevelapi/src/test/resources/sampletweets.txt b/demos/highlevelapi/src/test/resources/sampletweets.txt
index 475fada..c113130 100644
--- a/demos/highlevelapi/src/test/resources/sampletweets.txt
+++ b/demos/highlevelapi/src/test/resources/sampletweets.txt
@@ -1,207 +1,44 @@
-Tweet content
-"Apple has $233 billion in cash. It could buy all
-
-\u2014@NFL teams
-\u2014@NBA teams
-\u2014@MLB teams
-\u2014@NHL teams
-
-...and still have $80 billion left. $AAPL"
-Read $MRNJ #NEWS, $HEMP & $GRCU r above .01, that's where we r goin\U0001f680 $SPY $MSFT $SBUX $SFOR $VRX $AAPL $TSLA $GOOG $FB $EURUSD $USDJPY $MLCG
-$RXSF is leadin their sector accordin 2 @EdisonMediaCen $AAPL $SPY $TSLA $FB $EURUSD $ALK $IBB $EW $AMZN $GBPUSD $GM https://t.co/LYY2mHn755
-Philstockworld Top Trade Review $AAPL $MSFT #Dividends $USO $HOV $TWTR -- https://t.co/JArXsIm7CI https://t.co/kRR9ezhm9E
-Philstockworld Top Trade Review: $AAPL $ABX $BA $CAKE $CMG $DIS $IBM $GILD $LL $UNG $SPY -- https://t.co/EX5SYjdwBC https://t.co/7FBZwVZ63v
-"Monday\u2019s Oil Mess: Rent-A-Rebel Jacks up Prices into the Holiday $USO $AAPL
-#Earnings -- https://t.co/cGHB3WDKA8 https://t.co/JFZIBcom1n"
-Meaningless Monday Market Movement! $AAPL $SQQQ #oil #Brexit https://t.co/j4Iqg7E1HN
-"S&P Futures Back over 2,050, for Now
-$SPY $AAPL $SQQQ #China #Debt #Hedging -- https://t.co/2dOc5T89S3 https://t.co/TDPVdNRNQF"
-"\U0001f4a5TURN YOUR $500 INTO $5,000+\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE\u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $AAPL $GSAT $MGT
-https://t.co/lwAGjfmIP3"
-Trendless Tuesday - Watch Yesterday\u2019s Fake Gains Disappear $AAPL #China $FXI #Earnings -- https://t.co/GpgGqoOlFn https://t.co/FRuixv5aZF
-"\U0001f4a5TURN YOUR $500 INTO $5,000+\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE\u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $AAPL $UVXY $JDST
-https://t.co/lwAGjfmIP3"
-"Apple has $233 billion in cash. It could buy:
-
-Uber
-Tesla
-Twitter
-Airbnb
-Netflix
-Yahoo
-
-...and still have $18 billion left. $AAPL"
-Option Opportunity Portfolio May Review \u2013 Up 19.3% In 30 Days! $ABX $FCX $USO $AAPL $DIS - https://t.co/rp3kMsRZ3E https://t.co/TKkc15pKcR
-Waiting for the Fed \u2013 Apple Gives Us Huge Wins: $AAPL $SQQQ #GDP #Nikkei #Futures #Oil -- https://t.co/Al3pkf350V https://t.co/LktIRF4F2b
-Tempting Tuesday - S&P 2,100 is Still the Line to Watch Ahead of the Fed $AAPL $QQQ -- https://t.co/t1eDfKHJnk https://t.co/BAW3RAe7SC
-Our $SQQQ Hedge is Up 314% and Our Futures Are Up $4,850, You're Welcome! $AAPL -- https://t.co/eUQ2kCkCOY https://t.co/Yk98oyqMZl
-"TURN YOUR \U0001f4b2500 INTO \U0001f4b25,000$\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE \u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $TWTR $AAPL $LNKD
-https://t.co/euJFNQX1g4"
-"TURN YOUR \U0001f4b2500 INTO \U0001f4b25,000$\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE \u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $TALK $PPPI $AAPL https://t.co/oSn11kxftM"
-Bears today. We getting paid! $AAPL $TWTR $BWLD $NFLX https://t.co/CCi0S3skJJ
-"Apple has $233 billion in cash. It could buy all
-
-\u2014@NFL teams
-\u2014@NBA teams
-\u2014@MLB teams
-\u2014@NHL teams
-
-...and still have $80 billion left. $AAPL"
-Are you in Sync with the market? https://t.co/ZtHHCrSAf8 #stocks #finance #investing #trading $AAPL $LNKD $NFLX $GOOGL $FB
-The Last Time These Insiders Purchased This Stock It Sky Rocketed 1000%+ https://t.co/bmNAHBoQBD $DIA $QQQ $SPY $GOOG $AAPL $BAC $TWTR $FB
-"This Hacker Made Amazon\u2019s Alexa, Google Now, and Siri Command One Another
-https://t.co/YXP3yqmf4H $AAPL $AMZN $GOOG https://t.co/NG7r6qgfRt"
-"Over the last 3 years, the top 14 automakers upped their combined R&D spend by $192 million.
-
-$AAPL upped R&D spend by $5 billion.
-
-- MS"
-Volatility can be your friend. https://t.co/aHz2r8HHD2 #stocks #trading #investing #financials #learntodaytrade $FB $AAPL $LNKD $NFLX
-"PERCENTAGE of Apple's Revenues:
-FY 2006:
-iPod 40%
-Mac 38%
-Services 10%
-Others 12%
-
-FY 2015:
-iPhone 66%
-Mac 11%
-iPad 10%
-Others 13%
-
-$AAPL"
-Apple recovered $40 million worth of gold from recycled iPhones, iPads & Macs in 2015. https://t.co/XPBWlM6cBs $AAPL https://t.co/P0LMSRw7Ot
-"Apple's iPhone sales sink for 1st time ever last quarter
-https://t.co/TAKjUwl4Yc @DavidGoldmanCNN @cnntech $AAPL https://t.co/OrDp4BDpsD"
-$BAC is down 5% since our article was posted on Friday https://t.co/al8AgaSsiI $DIA $QQQ $SPY $AAPL $GOOG $FB $TWTR $STUDY $NFLX $LNKD $IBM
-Ben Franklin: The First Proponent Of Dividend Growth Investing? https://t.co/dx7FE2G9AH $AAPL $ACN $AL $BEN $CSV $HON $IJR $JNJ $JWN $PEGI
-$5,000 Friday the 13th - Yesterday's Futures Trades Pay Off Nicely $USO $SPY $AAPL -- https://t.co/3RUEjAq1bO https://t.co/2L7cdebTlT
-I DON'T SEE ANY BUBBLE RIGHT NOW , I SWEAR ! $SPX $SPY $DIA $DJI $AAPL $VIX $TVIX $C $BAC $GM $GE $FB #STOCKMARKET https://t.co/E5954RIpC7
-Terrible $AAPL quarter, finally. On the way to becoming $NOK. Tech is mean reverting, today's leaders are almost always tomorrow's laggards.
-The iPhone 7S could look radically different from the iPhones of today https://t.co/eQxUMAZ4eM $AAPL https://t.co/HIH3QqKpIC
-"No Bull: The Evidence
-https://t.co/Md2SNpjdwd
-$SPX $MSFT $GOOGL $AAPL $NFLX $AMZN $FB $DIS $V $BAC $GS $WMT $SBUX https://t.co/1oISHNX4cJ"
-The iPhone 7S could look radically different from the iPhones of today https://t.co/KgeVSjmcGe $AAPL https://t.co/7hFtg37oJu
-There was a 3rd Apple founder, Ronald Wayne, who sold his 10% stake for $800 in 1976. Today his share would've been worth $65 Billion. $AAPL
-Twitter Stock Set to Breakout Soon https://t.co/u4V6ChhpOW $TWTR $DIA $QQQ $SPY $AAPL $GLD $GDX $NUGT $DUST $BAC $GOOG $FB $STUDY $NFLX $IBM
-Alibaba Stock Price Breaks The 50 Day Moving Average https://t.co/ABOVWI6j2G $BABA $AAPL $YHOO $COST $UWTI $CSC $MON https://t.co/VlWGDxrQXh
-I still can\u2019t shake the feeling that $AAPL is slowly taking themselves private. https://t.co/XIAMvppDWh https://t.co/kdMGCGbMaJ
-$SPX ROADMAP 2016 #STOCKMARKET $INTC $F $SPY $AAPL $AMZN $C $VIX $FB $TWTR $GOOGL $UVXY $FAZ $FEZ $MSFT $GS $BAC $AA https://t.co/owuQ9awcDw
-"Want to know why $GOOG is so impressive and why $AAPL is so fucked? Read this years founders' letter from $GOOG:
-
-https://t.co/LiBjGZwyKw"
-"GET READY. Here are the companies reporting earnings next week: https://t.co/NXptPkQX70
-
-$AAPL $FB $TWTR $CMG $GILD https://t.co/tcIoCZdOZi"
-$SPX THIS TIME IT'S DIFFERENT! $SPY $DIA $SDOW $S $FAZ $FEZ $AAPL $MSFT $BAC $C $JPM $GS $SIRI $AMZN $F $VIX $TVIX https://t.co/pkYVgNKv3P
-$SPX ROADMAP 2016 #STOCKS $TVIX $VXX $VALE $AAPL $AKS $FCX $MSFT $AA $MU $VIX $SPX $SPY #TRADING $PCLN $SIRI $ MCD https://t.co/6UH5He38h1
-The iPhone 6S is the first iPhone ever to sell fewer models than its predecessor https://t.co/s8iQOvPQeR $AAPL https://t.co/QmQROtQ9vY
-11/ For example, buy an Echo and see your behavior change. The future is happening, and $AAPL seems, to me, asleep.
-$RLYP $SPY $KORS $WDAY $MSFT $AAPL $QLIK $TIVO $NXPI $CPXX $AVGO $ZOES $LE $TICC $SLB $FCEL $VRA $MLNX $ASNA $ICPT https://t.co/LXMpz4rFG0
-#STOCKMARKET GRAVITY LESSONS: what goes up must come down $SPX $SPY $DIA $QQQ $TVIX $VIX $AAPL $C $FB $PCLN $BAC $F https://t.co/8HQHBEgSj5
-Should Icahn's exit or Buffett's entry affect your $AAPL judgment? The Big Name Effect. https://t.co/9Z2ok61MUh https://t.co/udAQLfdJFe
-Apple revenue drops 13 percent, ending 13 years of growth. Greater China was especially weak, down 26 percent. $AAPL https://t.co/q4ovXUenBU
-It was a $18 billion day for Apple. https://t.co/iRbGeoTmCJ $AAPL
-"Apple has $233 billion in cash. It could buy:
-
-Uber
-Tesla
-Twitter
-Airbnb
-Netflix
-Yahoo
-
-...and still have $18 billion left. $AAPL"
-#3 TOP 2111.05 #STOCKS #STOCKMARKET #TRADING $SPX $SPY $VIX $TVIX $AAPL $SIRI $C $BAC $JPM $AMZN $MSFT $FB $TWTR $F https://t.co/gSqmN0fVON
-Google #IO16: Android's failure to innovate hands a Apple free run at WWDC $GOOG $AAPL https://t.co/FTs9M8JD5g https://t.co/20uou1gUkW
-$SPX 2134.72..2116.48...2111.05 HOUSTON WE HAVE A PROBLEM ! #STOCKMARKET $VIX $SPY $DIA $AAPL $C $BAC $FB $VXX $MSFT https://t.co/du3QfPUM4Q
-top #earnings $FB $AAPL $AMZN $TWTR $CMG $F $GILD $LNKD $FCX $CELG $SWKS $JBLU $T $NXPI $BA https://t.co/lObOE0uRjZ https://t.co/94F6GJc3hE
-The iPhone 6S is the first iPhone ever to sell fewer models than its predecessor https://t.co/ZVeQ9a4Yrh $AAPL https://t.co/2Ntpbxwlyo
-You do not want to miss this incredibly candid look into $AAPL w/ @tim_cook! Tune into @MadMoneyOnCNBC on @CNBC now! https://t.co/budv4qfvju
-Foxconn axes 60,000 jobs in one Chinese factory as robots take over: https://t.co/BnFdjGCmLf $AAPL https://t.co/WhRHer8jdN
-Warren Buffett's Berkshire Hathaway reports 9.8M share stake in $AAPL https://t.co/nXmvK6PV7M https://t.co/MAcMz0iTg6
-Apple is about to report its worst quarter in 13 years on Tuesday https://t.co/NJ3hwunHCx $AAPL https://t.co/YLTmnpqNjI
-Everyone who wants an iPhone has one. $AAPL is now a consumer staple stock and will trade on replacement / shareholder yield.
-Financial Armageddon\u2019 is imminent, the next major crash will happen in 2016 $VXX $VIX $TVIX $SPX $SPY $AAPL $MSFT $BAC $C $FB $DJI $DIA $F
-"Apple is NO longer the largest US stock by market cap. Google is: https://t.co/i81Y83jQJC
-
-$GOOGL $AAPL https://t.co/cRCKRYBICS"
-Exclusive: Apple hires former Tesla VP Chris Porritt for \u2018special [car] project\u2019 https://t.co/7knsloxvJW $TSLA $AAPL https://t.co/X8cYztExoP
-$SPX on the top of downtrend Channel Be careful! #STOCKMARKET $SPY $AAPL $AMZN $TSLA $FB $QQQ $DIA $NFLX $PCLN $C $F https://t.co/UKZCyLYuBq
-UPDATE: Apple CEO Cook says in conference call that smartphone marker is 'currently not growing' $AAPL https://t.co/WeECmrdv1j
-In February Charlie Munger was asked why Berkshire owns $GM. The $AAPL stake isn't anymore complicated than this: https://t.co/Rwkb30OEgq
-Talking to @SquawkStreet about $AAPL & more at @NYSE ! https://t.co/m05b68VLMp
-iPhone sales sour #Apple's earning: https://t.co/962fj9SWsc $AAPL https://t.co/nz9FRK6sNK
-People aren\u2019t upgrading smartphones as quickly and that is bad for Apple https://t.co/EOEJPfNR8Z \U0001f513 $AAPL
-"$NXPI $JBLU $FCX $AAPL $CMG
-$TWTR $EBAY $BWLD $PNRA $CRUS
-$FB $FSLR $UPS $CELG $AMZN
-$LNKD $BIDU $SWKS $GILD $HELE https://t.co/rQUmhHgYn0"
-People mad that Icahn sold $AAPL without giving them the head\u2019s up - How much in commissions did you pay him this year?
-Cool stat: $AAPL's $46 billion loss in market cap overnight is greater than the market cap of 391 S&P 500 companies https://t.co/1ms1YZzTbP
-Apple. You've come a long way... https://t.co/WGvk8K8MYv $AAPL https://t.co/3Wo0hAwRAc
-"Someone is building the Internet's biggest list of stock market cliches and it's amazing: https://t.co/mIV169cF36
-
-$SPY $AAPL $EURUSD"
-JUST IN: Apple delays earnings release by one day, to April 26th after the bell. \u2022 $AAPL
-Apple's market value is down nearly three Twitters $AAPL $TWTR
-Trump warns of a tech bubble: https://t.co/6Ks1yTa4Zc $AAPL $FB $AMZN He's 100% right about this. https://t.co/dJgTLk5JOB
-Apple could sell its billionth iPhone in just a few months' time https://t.co/g6VYDFIE3d $AAPL https://t.co/jzucmxDYXe
-$SPX KEEP BLOWING #STOCKMARKET #BUBBLE #STOCKS $MSFT $GS $AAPL $SPY $DIA $DJI $C $SIRI $PCLN $BAC $JPM $VIX $TVIX https://t.co/GPFBb0uCLF
-Will Apple $AAPL fall from tree? 12-mo descending triangle. I've no interest to short it, but it will be wild ride https://t.co/AnjsIKmIHI
-Tim Cook shouldn't be doing TV w/out a new product. Looks desperate. Not a consumer-facing guy. $AAPL https://t.co/Z4UFSimTLg
-When will Apple will sell its billionth iPhone? It may be sooner than you think: https://t.co/5IaF018N1p $AAPL https://t.co/cCIgtKqWHA
-#Stockmarket downtrend continues next week $spx $spy $vix $tvix $dji $aapl $jpm $bac $c $msft $pcln $wmt $ba https://t.co/1TTlgnKnZc
-$AAPL https://t.co/AFANPYHnoq
-40 years ago this month, Apple co-founder Ronald Wayne sold his 10% stake in $AAPL for $800. Current value: $61 billion.
-Warren Buffett's Berkshire Hathaway reports 9.8M share stake in $AAPL https://t.co/rXWwuyIooI https://t.co/TztgKCcWWy
-Apple's iBooks and iTunes Movies in China have been shut down after less than 7 months https://t.co/ZuGXZqSHma $AAPL https://t.co/1OHGC9YiUf
-Possible buy on $AAPL as it drops onto it's 9 DEMA support #1Broker #Bitcoin #Blockchain https://t.co/WWssD01joh https://t.co/jOKJyG9EaJ
-"Apple is down 7% after earnings.
-
-That's about $40 BILLION in market cap gone in 30 minutes. Poof.
-
-$AAPL: https://t.co/ggfmPjJjkW"
-B4 CRASH 2008 - Paulson's speech:" OUR FINANCIAL SYSTEM IS STRONG" $VXX $VIX $TVIX $UVXY $SPX $SPY $AAPL $MSFT $BAC $C $FB $DJI $DIA $F
-$ONCI is ready to RUN this week! #stockmarket #pennystocks #parabolic $CDNL $MGT $GOOGL $AAPL $TSLA $TWTR $ONCI https://t.co/wwqf0RNOix
-Apple could sell its billionth iPhone in just a few months' time https://t.co/u2qFZ440dH $AAPL https://t.co/8cAchiZ0vC
-The iPhone might radically change in 2017 $AAPL https://t.co/IXLdCfEdus https://t.co/GpdMvFZPjE
-"The growth of smartphones. On one graph.
-
-A great share via: https://t.co/2hAJlarjSM
-
-$AAPL $GOOGL $MSFT https://t.co/BAwQRvYzou"
-"$AAPL finished last quarter with $232 billion in cash, meanwhile Kanye running up debts making records for Tidal.
-
-Bro."
-Which is bullish for $AAPL if you know anything about $GS https://t.co/WWssD01joh https://t.co/CQk8iKMI7w
-"The tech stocks with the MOST revenue
-
-1. $AAPL
-2. $AMZN
-3. $MSFT
-
-Visual by @OphirGottlieb: https://t.co/GpZ5ct2z5r https://t.co/H6sNKdtBHd"
-
+Last week, I published a blog announcing that Apex was accepted as an Apache incubator project.
+This week, I\u2019ll give you a little more detail on what Apache Apex is, and why it\u2019s important.
+
+Apache #Hadoop has been around for over a decade. It has become the de-facto big data platform,
+allowing enterprises to transform their business operations by turning big data into something useful, meaningful,
+and revenue-generating. #Hadoop promised the enablement of big data without incurring the costs you would normally think such powerful
+processing systems would demand. This tremendous promise of transforming business operations continues to fuel high growth in the industry.
+
+It all got started when Hadoop engineers at Yahoo! asked, \u201cHow can we build an efficient search indexing capability?\u201d
+The ensuing iterations and some inspiration resulted in the #MapReduce programming model. Although powerful, MapReduce wasn\u2019t perfect.
+
+Mastering MapReduce required a steep learning curve. Migrating applications to MapReduce required an almost complete rewrite.
+Equally worrisome was the fact that MapReduce had batch processing paradigm and \u201ccompute going to data\u201d at its core,
+thus posing a deterrent to Hadoop realizing its true potential.
+
+Expectedly enough, #MapReduce was an impediment that did little to bolster productization of big data.
+Not to be deterred, there were faster substitutes for MapReduce. Just like Hadoop, these models required deeper expertise, were tough to operate and difficult to master.
+As such, #Hadoop disrupted the way big data needs were handled, but remained largely under-productized.
+
+A decade after Hadoop was started, only a small percentage of big data projects are in production.
+Data is growing rapidly and the ability to harness big data has become a decisive competitive advantage.
+MapReduce impedes this demand (actually more of a scramble) to transform into a data-driven business.
+
+In hindsight, it is clear that in the early days, the subsequent success of Hadoop was not anticipated.
+If they had anticipated Hadoop\u2019s success, the question would have been, \u201cWhat can we do with massively distributed resources?\u201d
+The answer to this question, which came about soon after, was YARN (Hadoop 2.0), the next generation Hadoop.
+For the first time, #YARN brought the capability of exploring how distributed resources handling big data could perform \u201ca lot of things\u201d,
+thus going beyond the early MapReduce paradigm, and in a way beyond batch or even compute-going-to-data paradigms.
+YARN presented the capability to allow big data to not just become big in size, but broader in use cases. With its enabling capability as a Hadoop facilitator,
+YARN has pushed Hadoop towards realizing its true potential. The Hadoop predicament is similar to what
+cellphones would have been without the more popular features such as messaging and internet connectivity.
+
+
+In their early years, cellphones upset the landline market, but did not foster an immediate market furor till
+it transformed into the new-age \u201csmartphone\u201d with impressive features.
+YARN is most certainly the enabling factor for big data dreaming bigger and wider, and with it, Hadoop 2.0 is now a true de-facto distributed operating system.
+
+What\u2019s needed is bleeding edge YARN-based platforms capable of radically realizing Hadoop\u2019s potential
+
+Now is the right time to not only productize big data, but to see how setting it in motion can ensure realization of greater business goals.
+A Herculean task, this demands platforms that are easy to deploy, require nothing beyond everyday IT expertise, can effortlessly integrate with an existing IT infrastructure while ensuring ease of migration.
+The new-age Hadoop platforms need to be designed with an approach to reduce time-to-market by shortening the application lifecycle, from building to launching, thus quickening the realization of revenue for businesses.
+They will also have to reduce time for developers to develop, devOps to operationalize, and finally reduce time to insight for business.
+Platforms such as these will need to learn, adapt, and change to meet the burgeoning needs of the big data world.
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/apex-malhar/blob/75c7e59b/stream/src/test/resources/sampletweets.txt
----------------------------------------------------------------------
diff --git a/stream/src/test/resources/sampletweets.txt b/stream/src/test/resources/sampletweets.txt
deleted file mode 100644
index 379d424..0000000
--- a/stream/src/test/resources/sampletweets.txt
+++ /dev/null
@@ -1,207 +0,0 @@
-Tweet content
-"Apple has $233 billion in cash. It could buy all
-
-\u2014@NFL teams
-\u2014@NBA teams
-\u2014@MLB teams
-\u2014@NHL teams
-
-...and still have $80 billion left. $AAPL"
-Read $MRNJ #NEWS, $HEMP & $GRCU r above .01, that's where we r goin\U0001f680 $SPY $MSFT $SBUX $SFOR $VRX $AAPL $TSLA $GOOG $FB $EURUSD $USDJPY $MLCG
-$RXSF is leadin their sector accordin 2 @EdisonMediaCen $AAPL $SPY $TSLA $FB $EURUSD $ALK $IBB $EW $AMZN $GBPUSD $GM https://t.co/LYY2mHn755
-Philstockworld Top Trade Review $AAPL $MSFT #Dividends $USO $HOV $TWTR -- https://t.co/JArXsIm7CI https://t.co/kRR9ezhm9E
-Philstockworld Top Trade Review: $AAPL $ABX $BA $CAKE $CMG $DIS $IBM $GILD $LL $UNG $SPY -- https://t.co/EX5SYjdwBC https://t.co/7FBZwVZ63v
-"Monday\u2019s Oil Mess: Rent-A-Rebel Jacks up Prices into the Holiday $USO $AAPL
-#Earnings -- https://t.co/cGHB3WDKA8 https://t.co/JFZIBcom1n"
-Meaningless Monday Market Movement! $AAPL $SQQQ #oil #Brexit https://t.co/j4Iqg7E1HN
-"S&P Futures Back over 2,050, for Now
-$SPY $AAPL $SQQQ #China #Debt #Hedging -- https://t.co/2dOc5T89S3 https://t.co/TDPVdNRNQF"
-"\U0001f4a5TURN YOUR $500 INTO $5,000+\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE\u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $AAPL $GSAT $MGT
-https://t.co/lwAGjfmIP3"
-Trendless Tuesday - Watch Yesterday\u2019s Fake Gains Disappear $AAPL #China $FXI #Earnings -- https://t.co/GpgGqoOlFn https://t.co/FRuixv5aZF
-"\U0001f4a5TURN YOUR $500 INTO $5,000+\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE\u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $AAPL $UVXY $JDST
-https://t.co/lwAGjfmIP3"
-"Apple has $233 billion in cash. It could buy:
-
-Uber
-Tesla
-Twitter
-Airbnb
-Netflix
-Yahoo
-
-...and still have $18 billion left. $AAPL"
-Option Opportunity Portfolio May Review \u2013 Up 19.3% In 30 Days! $ABX $FCX $USO $AAPL $DIS - https://t.co/rp3kMsRZ3E https://t.co/TKkc15pKcR
-Waiting for the Fed \u2013 Apple Gives Us Huge Wins: $AAPL $SQQQ #GDP #Nikkei #Futures #Oil -- https://t.co/Al3pkf350V https://t.co/LktIRF4F2b
-Tempting Tuesday - S&P 2,100 is Still the Line to Watch Ahead of the Fed $AAPL $QQQ -- https://t.co/t1eDfKHJnk https://t.co/BAW3RAe7SC
-Our $SQQQ Hedge is Up 314% and Our Futures Are Up $4,850, You're Welcome! $AAPL -- https://t.co/eUQ2kCkCOY https://t.co/Yk98oyqMZl
-"TURN YOUR \U0001f4b2500 INTO \U0001f4b25,000$\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE \u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $TWTR $AAPL $LNKD
-https://t.co/euJFNQX1g4"
-"TURN YOUR \U0001f4b2500 INTO \U0001f4b25,000$\U0001f4a5
-
-JOIN #TEAMBILLIONAIRE \u2935
-\U0001f4e7 pennystockhotline@gmail.com
-
-#PENNYSTOCKS $TALK $PPPI $AAPL https://t.co/oSn11kxftM"
-Bears today. We getting paid! $AAPL $TWTR $BWLD $NFLX https://t.co/CCi0S3skJJ
-"Apple has $233 billion in cash. It could buy all
-
-\u2014@NFL teams
-\u2014@NBA teams
-\u2014@MLB teams
-\u2014@NHL teams
-
-...and still have $80 billion left. $AAPL"
-Are you in Sync with the market? https://t.co/ZtHHCrSAf8 #stocks #finance #investing #trading $AAPL $LNKD $NFLX $GOOGL $FB
-The Last Time These Insiders Purchased This Stock It Sky Rocketed 1000%+ https://t.co/bmNAHBoQBD $DIA $QQQ $SPY $GOOG $AAPL $BAC $TWTR $FB
-"This Hacker Made Amazon\u2019s Alexa, Google Now, and Siri Command One Another
-https://t.co/YXP3yqmf4H $AAPL $AMZN $GOOG https://t.co/NG7r6qgfRt"
-"Over the last 3 years, the top 14 automakers upped their combined R&D spend by $192 million.
-
-$AAPL upped R&D spend by $5 billion.
-
-- MS"
-Volatility can be your friend. https://t.co/aHz2r8HHD2 #stocks #trading #investing #financials #learntodaytrade $FB $AAPL $LNKD $NFLX
-"PERCENTAGE of Apple's Revenues:
-FY 2006:
-iPod 40%
-Mac 38%
-Services 10%
-Others 12%
-
-FY 2015:
-iPhone 66%
-Mac 11%
-iPad 10%
-Others 13%
-
-$AAPL"
-Apple recovered $40 million worth of gold from recycled iPhones, iPads & Macs in 2015. https://t.co/XPBWlM6cBs $AAPL https://t.co/P0LMSRw7Ot
-"Apple's iPhone sales sink for 1st time ever last quarter
-https://t.co/TAKjUwl4Yc @DavidGoldmanCNN @cnntech $AAPL https://t.co/OrDp4BDpsD"
-$BAC is down 5% since our article was posted on Friday https://t.co/al8AgaSsiI $DIA $QQQ $SPY $AAPL $GOOG $FB $TWTR $STUDY $NFLX $LNKD $IBM
-Ben Franklin: The First Proponent Of Dividend Growth Investing? https://t.co/dx7FE2G9AH $AAPL $ACN $AL $BEN $CSV $HON $IJR $JNJ $JWN $PEGI
-$5,000 Friday the 13th - Yesterday's Futures Trades Pay Off Nicely $USO $SPY $AAPL -- https://t.co/3RUEjAq1bO https://t.co/2L7cdebTlT
-I DON'T SEE ANY BUBBLE RIGHT NOW , I SWEAR ! $SPX $SPY $DIA $DJI $AAPL $VIX $TVIX $C $BAC $GM $GE $FB #STOCKMARKET https://t.co/E5954RIpC7
-Terrible $AAPL quarter, finally. On the way to becoming $NOK. Tech is mean reverting, today's leaders are almost always tomorrow's laggards.
-The iPhone 7S could look radically different from the iPhones of today https://t.co/eQxUMAZ4eM $AAPL https://t.co/HIH3QqKpIC
-"No Bull: The Evidence
-https://t.co/Md2SNpjdwd
-$SPX $MSFT $GOOGL $AAPL $NFLX $AMZN $FB $DIS $V $BAC $GS $WMT $SBUX https://t.co/1oISHNX4cJ"
-The iPhone 7S could look radically different from the iPhones of today https://t.co/KgeVSjmcGe $AAPL https://t.co/7hFtg37oJu
-There was a 3rd Apple founder, Ronald Wayne, who sold his 10% stake for $800 in 1976. Today his share would've been worth $65 Billion. $AAPL
-Twitter Stock Set to Breakout Soon https://t.co/u4V6ChhpOW $TWTR $DIA $QQQ $SPY $AAPL $GLD $GDX $NUGT $DUST $BAC $GOOG $FB $STUDY $NFLX $IBM
-Alibaba Stock Price Breaks The 50 Day Moving Average https://t.co/ABOVWI6j2G $BABA $AAPL $YHOO $COST $UWTI $CSC $MON https://t.co/VlWGDxrQXh
-I still can\u2019t shake the feeling that $AAPL is slowly taking themselves private. https://t.co/XIAMvppDWh https://t.co/kdMGCGbMaJ
-$SPX ROADMAP 2016 #STOCKMARKET $INTC $F $SPY $AAPL $AMZN $C $VIX $FB $TWTR $GOOGL $UVXY $FAZ $FEZ $MSFT $GS $BAC $AA https://t.co/owuQ9awcDw
-"Want to know why $GOOG is so impressive and why $AAPL is so fucked? Read this years founders' letter from $GOOG:
-
-https://t.co/LiBjGZwyKw"
-"GET READY. Here are the companies reporting earnings next week: https://t.co/NXptPkQX70
-
-$AAPL $FB $TWTR $CMG $GILD https://t.co/tcIoCZdOZi"
-$SPX THIS TIME IT'S DIFFERENT! $SPY $DIA $SDOW $S $FAZ $FEZ $AAPL $MSFT $BAC $C $JPM $GS $SIRI $AMZN $F $VIX $TVIX https://t.co/pkYVgNKv3P
-$SPX ROADMAP 2016 #STOCKS $TVIX $VXX $VALE $AAPL $AKS $FCX $MSFT $AA $MU $VIX $SPX $SPY #TRADING $PCLN $SIRI $ MCD https://t.co/6UH5He38h1
-The iPhone 6S is the first iPhone ever to sell fewer models than its predecessor https://t.co/s8iQOvPQeR $AAPL https://t.co/QmQROtQ9vY
-11/ For example, buy an Echo and see your behavior change. The future is happening, and $AAPL seems, to me, asleep.
-$RLYP $SPY $KORS $WDAY $MSFT $AAPL $QLIK $TIVO $NXPI $CPXX $AVGO $ZOES $LE $TICC $SLB $FCEL $VRA $MLNX $ASNA $ICPT https://t.co/LXMpz4rFG0
-#STOCKMARKET GRAVITY LESSONS: what goes up must come down $SPX $SPY $DIA $QQQ $TVIX $VIX $AAPL $C $FB $PCLN $BAC $F https://t.co/8HQHBEgSj5
-Should Icahn's exit or Buffett's entry affect your $AAPL judgment? The Big Name Effect. https://t.co/9Z2ok61MUh https://t.co/udAQLfdJFe
-Apple revenue drops 13 percent, ending 13 years of growth. Greater China was especially weak, down 26 percent. $AAPL https://t.co/q4ovXUenBU
-It was a $18 billion day for Apple. https://t.co/iRbGeoTmCJ $AAPL
-"Apple has $233 billion in cash. It could buy:
-
-Uber
-Tesla
-Twitter
-Airbnb
-Netflix
-Yahoo
-
-...and still have $18 billion left. $AAPL"
-#3 TOP 2111.05 #STOCKS #STOCKMARKET #TRADING $SPX $SPY $VIX $TVIX $AAPL $SIRI $C $BAC $JPM $AMZN $MSFT $FB $TWTR $F https://t.co/gSqmN0fVON
-Google #IO16: Android's failure to innovate hands a Apple free run at WWDC $GOOG $AAPL https://t.co/FTs9M8JD5g https://t.co/20uou1gUkW
-$SPX 2134.72..2116.48...2111.05 HOUSTON WE HAVE A PROBLEM ! #STOCKMARKET $VIX $SPY $DIA $AAPL $C $BAC $FB $VXX $MSFT https://t.co/du3QfPUM4Q
-top #earnings $FB $AAPL $AMZN $TWTR $CMG $F $GILD $LNKD $FCX $CELG $SWKS $JBLU $T $NXPI $BA https://t.co/lObOE0uRjZ https://t.co/94F6GJc3hE
-The iPhone 6S is the first iPhone ever to sell fewer models than its predecessor https://t.co/ZVeQ9a4Yrh $AAPL https://t.co/2Ntpbxwlyo
-You do not want to miss this incredibly candid look into $AAPL w/ @tim_cook! Tune into @MadMoneyOnCNBC on @CNBC now! https://t.co/budv4qfvju
-Foxconn axes 60,000 jobs in one Chinese factory as robots take over: https://t.co/BnFdjGCmLf $AAPL https://t.co/WhRHer8jdN
-Warren Buffett's Berkshire Hathaway reports 9.8M share stake in $AAPL https://t.co/nXmvK6PV7M https://t.co/MAcMz0iTg6
-Apple is about to report its worst quarter in 13 years on Tuesday https://t.co/NJ3hwunHCx $AAPL https://t.co/YLTmnpqNjI
-Everyone who wants an iPhone has one. $AAPL is now a consumer staple stock and will trade on replacement / shareholder yield.
-Financial Armageddon\u2019 is imminent, the next major crash will happen in 2016 $VXX $VIX $TVIX $SPX $SPY $AAPL $MSFT $BAC $C $FB $DJI $DIA $F
-"Apple is NO longer the largest US stock by market cap. Google is: https://t.co/i81Y83jQJC
-
-$GOOGL $AAPL https://t.co/cRCKRYBICS"
-Exclusive: Apple hires former Tesla VP Chris Porritt for \u2018special [car] project\u2019 https://t.co/7knsloxvJW $TSLA $AAPL https://t.co/X8cYztExoP
-$SPX on the top of downtrend Channel Be careful! #STOCKMARKET $SPY $AAPL $AMZN $TSLA $FB $QQQ $DIA $NFLX $PCLN $C $F https://t.co/UKZCyLYuBq
-UPDATE: Apple CEO Cook says in conference call that smartphone marker is 'currently not growing' $AAPL https://t.co/WeECmrdv1j
-In February Charlie Munger was asked why Berkshire owns $GM. The $AAPL stake isn't anymore complicated than this: https://t.co/Rwkb30OEgq
-Talking to @SquawkStreet about $AAPL & more at @NYSE ! https://t.co/m05b68VLMp
-iPhone sales sour #Apple's earning: https://t.co/962fj9SWsc $AAPL https://t.co/nz9FRK6sNK
-People aren\u2019t upgrading smartphones as quickly and that is bad for Apple https://t.co/EOEJPfNR8Z \U0001f513 $AAPL
-"$NXPI $JBLU $FCX $AAPL $CMG
-$TWTR $EBAY $BWLD $PNRA $CRUS
-$FB $FSLR $UPS $CELG $AMZN
-$LNKD $BIDU $SWKS $GILD $HELE https://t.co/rQUmhHgYn0"
-People mad that Icahn sold $AAPL without giving them the head\u2019s up - How much in commissions did you pay him this year?
-Cool stat: $AAPL's $46 billion loss in market cap overnight is greater than the market cap of 391 S&P 500 companies https://t.co/1ms1YZzTbP
-Apple. You've come a long way... https://t.co/WGvk8K8MYv $AAPL https://t.co/3Wo0hAwRAc
-"Someone is building the Internet's biggest list of stock market cliches and it's amazing: https://t.co/mIV169cF36
-
-$SPY $AAPL $EURUSD"
-JUST IN: Apple delays earnings release by one day, to April 26th after the bell. \u2022 $AAPL
-Apple's market value is down nearly three Twitters $AAPL $TWTR
-Trump warns of a tech bubble: https://t.co/6Ks1yTa4Zc $AAPL $FB $AMZN He's 100% right about this. https://t.co/dJgTLk5JOB
-Apple could sell its billionth iPhone in just a few months' time https://t.co/g6VYDFIE3d $AAPL https://t.co/jzucmxDYXe
-$SPX KEEP BLOWING #STOCKMARKET #BUBBLE #STOCKS $MSFT $GS $AAPL $SPY $DIA $DJI $C $SIRI $PCLN $BAC $JPM $VIX $TVIX https://t.co/GPFBb0uCLF
-Will Apple $AAPL fall from tree? 12-mo descending triangle. I've no interest to short it, but it will be wild ride https://t.co/AnjsIKmIHI
-Tim Cook shouldn't be doing TV w/out a new product. Looks desperate. Not a consumer-facing guy. $AAPL https://t.co/Z4UFSimTLg
-When will Apple will sell its billionth iPhone? It may be sooner than you think: https://t.co/5IaF018N1p $AAPL https://t.co/cCIgtKqWHA
-#Stockmarket downtrend continues next week $spx $spy $vix $tvix $dji $aapl $jpm $bac $c $msft $pcln $wmt $ba https://t.co/1TTlgnKnZc
-$AAPL https://t.co/AFANPYHnoq
-40 years ago this month, Apple co-founder Ronald Wayne sold his 10% stake in $AAPL for $800. Current value: $61 billion.
-Warren Buffett's Berkshire Hathaway reports 9.8M share stake in $AAPL https://t.co/rXWwuyIooI https://t.co/TztgKCcWWy
-Apple's iBooks and iTunes Movies in China have been shut down after less than 7 months https://t.co/ZuGXZqSHma $AAPL https://t.co/1OHGC9YiUf
-Possible buy on $AAPL as it drops onto it's 9 DEMA support #1Broker #Bitcoin #Blockchain https://t.co/WWssD01joh https://t.co/jOKJyG9EaJ
-"Apple is down 7% after earnings.
-
-That's about $40 BILLION in market cap gone in 30 minutes. Poof.
-
-$AAPL: https://t.co/ggfmPjJjkW"
-B4 CRASH 2008 - Paulson's speech:" OUR FINANCIAL SYSTEM IS STRONG" $VXX $VIX $TVIX $UVXY $SPX $SPY $AAPL $MSFT $BAC $C $FB $DJI $DIA $F
-$ONCI is ready to RUN this week! #stockmarket #pennystocks #parabolic $CDNL $MGT $GOOGL $AAPL $TSLA $TWTR $ONCI https://t.co/wwqf0RNOix
-Apple could sell its billionth iPhone in just a few months' time https://t.co/u2qFZ440dH $AAPL https://t.co/8cAchiZ0vC
-The iPhone might radically change in 2017 $AAPL https://t.co/IXLdCfEdus https://t.co/GpdMvFZPjE
-"The growth of smartphones. On one graph.
-
-A great share via: https://t.co/2hAJlarjSM
-
-$AAPL $GOOGL $MSFT https://t.co/BAwQRvYzou"
-"$AAPL finished last quarter with $232 billion in cash, meanwhile Kanye running up debts making records for Tidal.
-
-Bro."
-Which is bullish for $AAPL if you know anything about $GS https://t.co/WWssD01joh https://t.co/CQk8iKMI7w
-"The tech stocks with the MOST revenue
-
-1. $AAPL
-2. $AMZN
-3. $MSFT
-
-Visual by @OphirGottlieb: https://t.co/GpZ5ct2z5r https://t.co/H6sNKdtBHd"
-