You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@joshua.apache.org by le...@apache.org on 2016/05/26 05:11:38 UTC
[33/53] [abbrv] [partial] incubator-joshua git commit: Pulled
JOSHUA-252 changes and Resolved Merge Conflicts
http://git-wip-us.apache.org/repos/asf/incubator-joshua/blob/ef91969a/src/test/resources/bn-en/hiero/output.gold.bleu
----------------------------------------------------------------------
diff --git a/src/test/resources/bn-en/hiero/output.gold.bleu b/src/test/resources/bn-en/hiero/output.gold.bleu
new file mode 100644
index 0000000..596e317
--- /dev/null
+++ b/src/test/resources/bn-en/hiero/output.gold.bleu
@@ -0,0 +1,14 @@
+Processing 100 sentences...
+Evaluating set of 1'th candidate translations from output...
+BLEU_precision(1) = 1032 / 1474 = 0.7001
+BLEU_precision(2) = 478 / 1374 = 0.3479
+BLEU_precision(3) = 248 / 1280 = 0.1938
+BLEU_precision(4) = 141 / 1190 = 0.1185
+BLEU_precision = 0.2735
+
+Length of candidate corpus = 1474
+Effective length of reference corpus = 1446
+BLEU_BP = 1.0000
+
+ => BLEU = 0.2735
+
http://git-wip-us.apache.org/repos/asf/incubator-joshua/blob/ef91969a/src/test/resources/bn-en/hiero/output.scores.berkeleylm.gold
----------------------------------------------------------------------
diff --git a/src/test/resources/bn-en/hiero/output.scores.berkeleylm.gold b/src/test/resources/bn-en/hiero/output.scores.berkeleylm.gold
new file mode 100644
index 0000000..fc8eeb5
--- /dev/null
+++ b/src/test/resources/bn-en/hiero/output.scores.berkeleylm.gold
@@ -0,0 +1,100 @@
+ rabindranath was born in a \u09aa\u09bf\u09b0\u09be\u09b2\u09c0 \u09ac\u09cd\u09b0\u09be\u09b9\u09cd\u09ae\u09a3 in the family ||| -226.302
+ recently with united states with the relationship between improved . ||| -21.022
+ mathematics so science language . ||| -10.471
+ from this it it can be understood that this \u09ae\u09c7\u099f\u09cd\u09b0\u09bf\u0995\u099f\u09bf will be \u098f\u09ab\u0986\u09b0\u09a1\u09ac\u09cd\u09b2\u09bf\u0989 \u09ae\u09c7\u099f\u09cd\u09b0\u09bf\u0995 . ||| -322.621
+ the same with the earthcentered \u09b8\u09be\u09ae\u09a8\u09cd\u09a4\u09a4\u09a8\u09cd\u09a4\u09cd\u09b0\u09c7\u09b0 \u09aa\u09a4\u09a8\u09c7\u09b0 indication match from this novel . ||| -236.836
+ \u09a8\u09bf\u09b0\u09cd\u09ac\u099a\u09a8\u09c7 mujib and his party \u09a8\u09bf\u09b0\u0999\u09cd\u0995\u09c1\u09b7 majority in the . ||| -217.895
+ \u09b9\u09bf\u099f\u09b2\u09be\u09b0\u0993 \u09ac\u09be\u09ad\u09be\u09b0\u09bf\u09af\u09bc\u09be\u09b0 \u09ae\u09bf\u0989\u09a8\u09bf\u0996 \u09b6\u09b9\u09b0\u09c7\u0987 his work with to that . ||| -432.357
+ other than task \u0993\u098f\u09b8-\u099f\u09cd\u09af\u09be\u09a8 and also some linux \u09aa\u09cd\u09b0\u09a4\u09bf\u09a8\u09bf\u09a7\u09bf\u09a4\u09cd\u09ac\u0995\u09be\u09b0\u09c0 character there are but these are very is not . ||| -246.114
+ it social situation in \u09b8\u09bf\u09a6\u09cd\u09a7\u09be\u09a8\u09cd\u09a4\u0997\u09cd\u09b0\u09b9\u09a8\u0995\u09be\u09b0\u09c0 his oppositions with \u0995\u09cd\u09b0\u09c0\u09a1\u09bc\u09be\u0995\u09cd\u09b7\u09c7\u09a4\u09cd\u09b0\u09c7 decision making the rule of the vagina . ||| -255.565
+ \u09ac\u09c3\u09b7\u09cd\u099f\u09bf\u09aa\u09be\u09a4\u0983 annual \u09e8\u09eb\u09ea\u09e6 \u09ae\u09bf\u09b2\u09bf meters ||| -321.077
+ on the year 2004 \u09ae\u09cd\u09af\u09be\u09b8\u09be\u099a\u09c1\u09b8\u09c7\u099f\u09b8 \u0985\u0999\u09cd\u0997\u09b0\u09be\u099c\u09cd\u09af\u09c7\u09b0 \u09ac\u09b8\u09cd\u099f\u09a8 in the city in \u09a1\u09c7\u09ae\u09cb\u0995\u09cd\u09b0\u09cd\u09af\u09be\u099f the national he was the main speech -lrb- keynote speech -rrb- on the . ||| -664.033
+ power distribution of population on east pakistan where to west pakistan " one unit theory " is a \u0985\u09ad\u09bf\u09a8\u09ac started with the where the whole of west pakistan was considered as a province . ||| -186.010
+ the \u09aa\u09b0\u09bf\u09ae\u09be\u09aa\u09a8 theory ||| -110.415
+ external links of ||| -4.318
+ tata communicationer " foreign sanchar nigam limited building it is the telecommunication system is one of the main providers ||| -48.733
+ he that year \u09ea\u0987 \u09a8\u09ad\u09c7\u09ae\u09cd\u09ac\u09b0\u09c7\u09b0 national assembly in election won all and was elected as the 44th president of the united states . ||| -241.090
+ many indian \u09aa\u09cd\u09b0\u099c\u09be\u09a4\u09bf fighting \u099c\u09be\u09a4 \u099f\u09c7\u0995\u09cd\u09b8\u09be from upper stage ||| -332.122
+ britain writers written drama novels and stories recently scripts in \u0986\u09a6\u09c3\u09a4 . ||| -140.670
+ on may 1919 , it was published in saogat magazine . ||| -19.086
+ 2005 , \u0989\u0987\u09ae\u09c7\u09a8\u09b8 tennis association tour \u099f\u09be\u09af\u09bc\u09be\u09b0-\u09a5\u09cd\u09b0\u09bf \u099f\u09c1\u09b0\u09cd\u09a8\u09be\u09ae\u09c7\u09a8\u09cd\u099f \u09b8\u09be\u09a8\u09ab\u09bf\u09b8\u09cd\u099f open netaji indoor stadium was arranged . ||| -452.293
+ to prevent this several measures are taken . ||| -12.088
+ on 5th february , \u09e7\u09ef\u09ec\u09ec \u09b2\u09be\u09b9\u09cb\u09b0\u09c7 of \u09a6\u09b2\u09b8\u09ae\u09c2\u09b9\u09c7\u09b0 a national was held in . ||| -334.940
+ bangladesh \u0985\u09b0\u09cd\u0997\u09be\u09a8\u09be\u0987\u099c\u09c7\u09b6\u09a8 of the islamic \u0995\u09a8\u09ab\u09be\u09b0\u09c7\u09a8\u09cd\u09b8 and islamic \u09a1\u09c7\u09ad\u09c7\u09b2\u09aa\u09ae\u09c7\u09a3\u09cd\u099f bank secured its place in in the . ||| -341.281
+ subject category : encyclopedia ||| 1.726
+ russia france and israel is the main \u0985\u09b8\u09cd\u09a4\u09cd\u09b0\u09b8\u09b0\u09ac\u09b0\u09be\u09b9\u0995\u09be\u09b0\u09c0 country and defense sub country . ||| -132.240
+ this is our known as an imaginary unit of mathematics formed with the help of which are set of real numbers from \u09b8\u09c7\u099f\u09c7 par with the complex number . ||| -143.878
+ <address> ||| -13.673
+ september ||| 1.148
+ from this theory though big \u09ac\u09bf\u09b8\u09cd\u09ab\u09cb\u09b0\u09a3\u09cb\u09b0 against can not be but it can be support . ||| -133.987
+ agricultural in production france is the most important country ; it is mainly \u0996\u09be\u09a6\u09cd\u09af\u09b6\u09b8\u09cd\u09af wine cheese and other \u0995\u09c3\u09b7\u09bf\u09a6\u09cd\u09b0\u09ac\u09cd\u09af europe and export the in the whole world . ||| -252.851
+ their in mathematics \u09aa\u09be\u099f\u09c0\u0997\u09a3\u09bf\u09a4\u09c7\u09b0 person was . ||| -115.913
+ deshgulo are : france call , make noise china belgium switzerland germany denmark sweden austria chekoslovakia argentina italy norway \u09b9\u09be\u0999\u09cd\u0997\u09c7\u09b0\u09c0 yugoslavia bulgaria romania \u0997\u09cd\u09b0\u09c0\u09b8 egypt singapore indonesia \u09a5\u09be\u0987\u09b2\u09cd\u09af\u09be\u09a8\u09cd\u09a1 japan burma \u09b9\u09b2\u09cd\u09af\u09be\u09a8\u09cd\u09a1 soviet russia iran iraq and sri lanka . ||| -548.678
+ this \u09ac\u09cd\u09af\u09be\u09b8\u09bf\u09b2\u09bf\u0995\u09be\u09b0 places now bank of england is situated . ||| -117.393
+ on the north of the country is the \u09ac\u09bf\u09b8\u09cd\u0995\u09be\u0987 sub-sea on the south \u099c\u09bf\u09ac\u09cd\u09b0\u09be\u09b2\u09cd\u099f\u09be\u09b0 strait \u09aa\u09cd\u09b0\u09a3\u09be\u09b2\u09c0\u09b0 in the south \u09ae\u09b0\u0995\u09cd\u0995\u09cb on the west and the atlantic ocean . ||| -445.620
+ apart from this situation it can be understood that a \u09ae\u09c1\u09b9\u09c2\u09b0\u09cd\u09a4\u09c7 within \u0985\u0995\u09cd\u09b7\u09ae\u09a4\u09be after taking the decision of the united nations . ||| -248.040
+ \u0995\u09be\u09b0\u09cd\u09b2 there is work through it is controlled by . ||| -125.132
+ the subject matters sometimes puran -lrb- from sometimes in the middle age love story sometimes again from today 's social and political \u0998\u099f\u09a8\u09be\u09ac\u09b2\u09bf taken from . ||| -157.897
+ three measure based on the age of the universe is found that is almost \u09e7\u09e9.\u09ed � \u09e6.\u09e8 billion years . ||| -344.330
+ there are \u0995\u09be\u099b\u09c7\u0987 east russia which \u0993\u0996\u099f\u09b8\u09cd\u0995 sea and japan sea on the other can be is situated . ||| -235.028
+ in kolkata is located at the national library of india the leading public \u09b2\u09be\u0987\u09ac\u09cd\u09b0\u09c7\u09b0\u09bf . ||| -119.076
+ \u099b\u09a4\u09cd\u09b0\u09be\u0995\u09ac\u09bf\u09a6\u09cd\u09af\u09be ||| -103.288
+ \u09b0\u09be\u09b7\u09cd\u099f\u09cd\u09b0\u09b8\u0999\u09cd\u0998\u09c7\u09b0 general secretary \u09ac\u09be\u09a8 ki moon ||| -218.172
+ \u09ae\u09bf\u09a8\u09bf\u0995\u09cd\u09b8\u09c7\u09b0 of india was smells \u099f\u09be\u09a8\u09c7\u09a8\u09ac\u09ae a famous operating system design \u09aa\u09cd\u09b0\u09b6\u09bf\u0995\u09cd\u09b7\u0995 . ||| -337.188
+ the \u099f\u09be\u0987\u09ae\u09cd the 's of \u0987\u09a8\u09cd\u09a1\u09bf\u09af\u09bc\u09be-\u09a4\u09c7 written in the " it is absurd to compare it with any other indian cinema ... pather panchali is pure cinema " -lrb- " it other by the indian films with compared to unreal ... pather panchali are pure film " -rrb- . ||| -1714.540
+ after that , 1953 in the month of may nazrul and \u09aa\u09cd\u09b0\u09ae\u09c0\u09b2\u09be \u09a6\u09c7\u09ac\u09c0\u0995\u09c7 \u099a\u09bf\u0995\u09bf\u09ce\u09b8\u09be\u09b0 for london sent to . ||| -336.768
+ the southern and the east there is \u09ac\u09bf\u09b8\u09cd\u09a4\u09c0\u09b0\u09cd\u09a3 land , west and in the north there are \u09b0\u09c1\u0995\u09cd\u09b7 mountain and mountain . ||| -242.245
+ \u099f\u09cd\u09b0\u09c7\u09a1\u09ae\u09be\u09b0\u09cd\u0995 ||| -103.288
+ \u09b2\u09b0\u09cd\u09a1 \u0993\u09af\u09bc\u09c7\u09b2\u09c7\u09b8\u09b2\u09bf\u09b0 -lrb- \u0997\u09ad\u09b0\u09cd\u09a8\u09b0-\u099c\u09c7\u09a8\u09be\u09b0\u09c7\u09b2 \u09e7\u09ed\u09ef\u09ed-\u09e7\u09ee\u09e6\u09eb -rrb- during his city are the ghotechilo ||| -443.070
+ many important and real extremely necessary to solve problems complex number ||| -26.515
+ the big bang is a famous result in the state of the universe so and recent situation from the separate . ||| -45.363
+ windows \u09ae\u09bf\u09b2\u09bf\u09a8\u09bf\u09af\u09bc\u09be\u09ae ||| -104.858
+ however , rabindranath more than one \u09b6\u09c8\u09b2\u09c0 \u0986\u09af\u09bc\u09a4\u09cd\u09a4\u09cd\u09ac was . ||| -219.540
+ labour economics ||| -0.994
+ britain at some point of time the was the main and his economic power in the world . ||| -20.224
+ the military rule movement against pakistan and \u0997\u09cb\u09b7\u09cd\u09a0\u09c0\u0997\u09a4 was against protest and independence movement of the bengalis , \u09a7\u09be\u09ac\u09bf\u09a4 to for he widely praised . ||| -266.155
+ here is mentioned that were internet and other name of world wide web word to be but actually \u09b6\u09ac\u09cd\u09a6\u09a6\u09cd\u09ac\u09af\u09bc different subject to the . ||| -171.397
+ . the related z polar co-ordinate two are r = . ||| -31.445
+ november ||| 1.122
+ 1972 \u0996\u09cd\u09b0\u09c0\u09b8\u09cd\u099f\u09be\u09ac\u09cd\u09a6\u09c7 then \u0986\u09b0\u09aa\u09be\u09a8\u09c7\u099f\u09c7 first \u0987\u09b2\u09c7\u0995\u09cd\u099f\u09cd\u09b0\u09a8\u09bf\u0995 mail to to . ||| -337.642
+ \u099c\u09c0\u09ac science that \u09b6\u09be\u0996\u09be\u09af\u09bc fungi and the practical about the subject to he was \u099b\u09a4\u09cd\u09b0\u09be\u0995\u09ac\u09bf\u09a6\u09cd\u09af\u09be -lrb- mycology -rrb- ||| -453.504
+ water river from \u0989\u09a0\u09be\u09a8\u09cb was some a \u09a6\u09bf\u09af\u09bc\u09c7- \u09a6\u09a1\u09bc\u09bf and \u09ac\u09be\u09b2\u099f\u09bf\u09b0 through water used by animal world a system . ||| -467.773
+ among these there are tribal dance lokuj dance classical dance etc . ||| -25.170
+ the oldest literature at first \u09ae\u09cc\u0996\u09bf\u0995\u09ad\u09be\u09ac\u09c7 and later written form is the . ||| -128.172
+ in 1989 , the \u0997\u09a3\u09b6\u09a4\u09cd\u09b0\u09c1 in this film his conducted \u09a4\u09c1\u09b2\u09a8\u09be\u09ae\u09c2\u09b2\u0995\u09ad\u09be\u09ac\u09c7 \u09a6\u09c1\u09b0\u09cd\u09ac\u09b2 and this \u09a6\u09c0\u09b0\u09cd\u0998\u09a6\u09bf\u09a8\u09c7\u09b0 \u0985\u09b8\u09c1\u09b8\u09cd\u09a5\u09a4\u09be\u09b6\u09c7\u09b7\u09c7 came back , after \u09aa\u09c1\u09a8\u09b0\u09cd\u09aa\u09cd\u09b0\u099a\u09c7\u09b7\u09cd\u099f\u09be of satyajit 's films , a is considered as . ||| -681.400
+ the \u09ac\u09b2\u09ac\u09bf\u09a6\u09cd\u09af\u09be ||| -108.280
+ other \u09b8\u09cd\u09ac\u09a4\u09cd\u09a4\u09cd\u09ac-\u09b8\u0982\u09b0\u0995\u09cd\u09b7\u09bf\u09a4 operating system like windows and mac os to linux in different different . ||| -126.793
+ asia \u099f\u09be\u0987\u09ae\u09b8\u09c7\u09b0 \u09ad\u09be\u09b7\u09cd\u09af according to , ||| -215.125
+ open source or open source -lrb- open source -rrb- the money is computer software the source code or the \u09b8\u09be\u0982\u0995\u09c7\u09a4\u09bf\u0995 language open way \u09ac\u09bf\u09a4\u09b0\u09a3 to . ||| -461.854
+ bangladesh \u0985\u09a8\u09b2\u09be\u0987\u09a8\u09c7 dhaka ||| -107.382
+ the first world war germany \u09b9\u09c7\u09b0\u09c7 can be seen . ||| -109.139
+ but this subject is to understand for even research to going on . ||| -32.160
+ \u09b8\u09c1\u09aa\u09be\u09b0\u098f\u0987\u099a ||| -103.288
+ he was military forces for \u0986\u09a8\u09ab\u09bf\u099f was declared . ||| -118.584
+ bhutto \u098f\u09cd\u09af\u09be\u09b8\u09c7\u09ae\u09cd\u09ac\u09b2\u09bf \u09ac\u09af\u09bc\u0995\u099f to 2.5 with announced that the yahya khan mujib was to form the government to \u099c\u09be\u09a8\u09be\u09b2\u09c7 he that government by \u09a8\u09c7\u09ac\u09c7\u09a8 not . ||| -478.493
+ and computer words money \u0997\u09a3\u09a8\u09be\u0995\u09be\u09b0\u09c0 machine . ||| -217.956
+ on 4th july \u09e7\u09ed\u09ed\u09ec this constituents of a independence notice \u099c\u09be\u09b0\u09bf the . ||| -236.748
+ germany -lrb- in german : deutschland \u09a1\u09af\u09bc\u099a\u09cd the \u09b2\u09be\u09a8\u09cd\u099f\u09cd of pronounced [ d\u0254\u028ft\u0283lant through ] -rrb- is a country of europe . ||| -446.865
+ the main religion \u0996\u09cd\u09b0\u09bf\u09b8\u09cd\u099f\u09a7\u09b0\u09cd\u09ae from russia . ||| -110.479
+ but \u0997\u09b2\u09a6\u09c7\u09b0 education \u09b0\u09cb\u09ae\u09be\u09a8\u09c0\u0995\u09b0\u09a3\u09c7\u09b0 \u0997\u09a4\u09bf was slow down . ||| -321.499
+ subject category : gnu foundation ||| -4.645
+ economic policy and revenue \u09a8\u09c0\u09a4\u09bf\u0995\u09c7\u0993 it study the . ||| -124.215
+ among these there are : may be \u09a4\u09cb\u09ae\u09be\u09b0 get seen \u0993\u09b0\u09c7 this any \u09b8\u09cd\u09a8\u09c7\u09b9-\u09b8\u09c1\u09b0\u09a7\u09c1\u09a8\u09c0 . ||| -335.374
+ on 23rd april 1992 satyajit died . ||| -13.054
+ at this time nazrul 's medical \u09b0\u09bf\u09aa\u09cb\u09b0\u09cd\u099f stay famous \u099a\u09bf\u0995\u09bf\u09ce\u09b8\u0995\u09a6\u09c7\u09b0 to send to . ||| -232.362
+ other than acted at different times rani \u09ae\u09c1\u0996\u09be\u09b0\u09cd\u099c\u09c0 different \u09a6\u09be\u09a4\u09ac\u09cd\u09af are connected with \u09a5\u09c7\u0995\u09c7\u099b\u09c7\u09a8 . ||| -338.434
+ bengali literature and culture a special contribution on \u09b8\u09cd\u09ac\u09c0\u0995\u09c3\u09a4\u09bf\u09b8\u09cd\u09ac\u09b0\u09c1\u09aa year on 9th december , dhaka university he was honorary \u09a1\u09bf.\u09b2\u09bf\u099f \u0989\u09aa\u09be\u09a7\u09bf\u09a4\u09c7 awarded with the . ||| -358.420
+ in kolkata durga puja tourism \u0986\u0995\u09b0\u09cd\u09b7\u09a3\u0993 of the city is also a reason ||| -131.010
+ but many people of east germany started living in economically reach and democratic west germany , east germany government built a wall in berlin in 1961 and reinforced its boundaries . ||| -38.023
+ the first one is the film \u09a8\u09bf\u09b0\u09cd\u09ac\u09be\u0995 first seven \u09ae\u09bf\u09a8\u09bf\u099f which \u099a\u09be\u09b0\u09c1\u09b0 \u098f\u0995\u0998\u09c7\u09af\u09bc\u09c7\u09ae\u09bf life shown level and the second one is " the \u09a6\u09cb\u09b2\u09a8\u09be\u09b0 scene " where \u099a\u09be\u09b0\u09c1 \u0985\u09ae\u09b2\u09c7\u09b0 for his love \u09ae\u09c1\u0996\u09cb\u09ae\u09c1\u0996\u09bf in . ||| -900.700
+ a group of 18th century the \u099a\u09bf\u09a8\u09cd\u09a4\u09be\u09ac\u09bf\u09a6 and writer income and production \u099a\u0995\u09cd\u09b0\u09be\u0995\u09be\u09b0 current through economic thoughts development it . ||| -251.701
+ the arousal activities before penetrating male organ into vagina is called foreplay . ||| -16.182
+ it is mainly \u09b6\u09c2\u0995\u09b0\u09c7\u09b0 in in was which can \u09b6\u09c2\u0995\u09b0\u0995\u09c7 \u0987\u09a8\u09ab\u09cd\u09b2\u09c1\u09af\u09bc\u09c7\u099e\u09cd\u099c\u09be\u09a4\u09c7 affected by british . ||| -341.900
+ these \u098f\u0995\u098f the mycelium formed the . ||| -217.337
+ russia at present a democratic country . ||| -6.462
+ penis ||| -3.566
+ this state is called orgasm . ||| -3.009
+ history different period here established the royal more than one empire . ||| -34.107
+ micro economics ||| -0.625
+ the user to operating system the visible form of the computer interface . ||| -29.010
+ \u09ac\u09bf\u09b8\u09cd\u09a4\u09be\u09b0\u09bf\u09a4\u0983 , 1971 temporary bangladesh government ||| -110.935