You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafu.apache.org by ey...@apache.org on 2019/05/19 07:16:02 UTC
[datafu] branch spark-tmp updated (a410e1c -> 519be50)
This is an automated email from the ASF dual-hosted git repository.
eyal pushed a change to branch spark-tmp
in repository https://gitbox.apache.org/repos/asf/datafu.git.
from a410e1c rename example_tests
add 857cf16 DATAFU-129 - New macro - Dedup
add 8bccf5b Update changes.md
add c4b5cc8 Bump version to 1.5.0
add f7ec4c7 Update exclusions when building source release
add e81ea86 DATAFU-130 Add three-way left outer join macro
add 0d08427 Merge branch 'DATAFU-130'
add 183e434 Website update for 1.5.0 release
add 3e52d11 Blog post - a look at PayPal's contributions to DataFu
new 519be50 Merge master back into spark-tmp
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 4 +-
changes.md | 16 ++
.../evaluation/ExtremalTupleByNthField.java | 306 +++++++++++++++++++++
.../src/main/resources/datafu/count_macros.pig | 11 +
.../Median.java => resources/datafu/dedup.pig} | 30 +-
.../src/main/resources/datafu/diff_macros.pig | 8 +
.../datafu/left_outer_join.pig} | 20 +-
.../src/main/resources/datafu/sample_by_keys.pig | 13 +-
.../src/test/java/datafu/test/pig/PigTests.java | 2 +-
.../java/datafu/test/pig/macros/MacroTests.java | 42 ++-
.../test/java/datafu/test/pig/util/DedupTests.java | 91 ++++++
gradle/release.gradle | 4 +-
site/config.rb | 2 -
...n => 2019-01-07-datafu-1-5-0-released.markdown} | 20 +-
...ook-at-paypals-contributions-to-datafu.markdown | 242 ++++++++++++++++
.../docs/datafu/getting-started.html.markdown.erb | 2 +-
site/source/docs/datafu/guide.html.markdown.erb | 2 +-
.../datafu/guide/bag-operations.html.markdown.erb | 2 +-
.../docs/datafu/guide/hashing.html.markdown.erb | 2 +-
.../datafu/guide/link-analysis.html.markdown.erb | 2 +-
.../guide/more-tips-and-tricks.html.markdown.erb | 2 +-
.../docs/datafu/guide/sampling.html.markdown.erb | 2 +-
.../docs/datafu/guide/sessions.html.markdown.erb | 2 +-
.../datafu/guide/set-operations.html.markdown.erb | 2 +-
.../docs/datafu/guide/statistics.html.markdown.erb | 2 +-
site/source/docs/download.html.markdown.erb | 9 +-
site/source/layouts/_docs_nav.erb | 4 +-
site/source/layouts/_footer.erb | 2 +-
site/source/stylesheets/all.less | 8 +
29 files changed, 796 insertions(+), 58 deletions(-)
create mode 100644 datafu-pig/src/main/java/datafu/org/apache/pig/piggybank/evaluation/ExtremalTupleByNthField.java
copy datafu-pig/src/main/{java/datafu/pig/stats/Median.java => resources/datafu/dedup.pig} (56%)
copy datafu-pig/src/main/{java/datafu/pig/sampling/package-info.java => resources/datafu/left_outer_join.pig} (51%)
create mode 100644 datafu-pig/src/test/java/datafu/test/pig/util/DedupTests.java
copy site/source/blog/{2017-03-10-datafu-1-3-2-released.markdown => 2019-01-07-datafu-1-5-0-released.markdown} (74%)
create mode 100644 site/source/blog/2019-01-29-a-look-at-paypals-contributions-to-datafu.markdown
[datafu] 01/01: Merge master back into spark-tmp
Posted by ey...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
eyal pushed a commit to branch spark-tmp
in repository https://gitbox.apache.org/repos/asf/datafu.git
commit 519be50c7ea4d7299ec0fbd3e212424ddc7ed862
Merge: a410e1c 3e52d11
Author: Eyal Allweil <ey...@apache.org>
AuthorDate: Sun May 19 10:14:27 2019 +0300
Merge master back into spark-tmp
.gitignore | 4 +-
changes.md | 16 ++
.../evaluation/ExtremalTupleByNthField.java | 306 +++++++++++++++++++++
.../src/main/resources/datafu/count_macros.pig | 11 +
.../datafu/{count_macros.pig => dedup.pig} | 24 +-
.../src/main/resources/datafu/diff_macros.pig | 8 +
.../{count_macros.pig => left_outer_join.pig} | 28 +-
.../src/main/resources/datafu/sample_by_keys.pig | 13 +-
.../src/test/java/datafu/test/pig/PigTests.java | 2 +-
.../java/datafu/test/pig/macros/MacroTests.java | 42 ++-
.../test/java/datafu/test/pig/util/DedupTests.java | 91 ++++++
gradle/release.gradle | 4 +-
site/config.rb | 2 -
.../blog/2019-01-07-datafu-1-5-0-released.markdown | 45 +++
...ook-at-paypals-contributions-to-datafu.markdown | 242 ++++++++++++++++
.../docs/datafu/getting-started.html.markdown.erb | 2 +-
site/source/docs/datafu/guide.html.markdown.erb | 2 +-
.../datafu/guide/bag-operations.html.markdown.erb | 2 +-
.../docs/datafu/guide/hashing.html.markdown.erb | 2 +-
.../datafu/guide/link-analysis.html.markdown.erb | 2 +-
.../guide/more-tips-and-tricks.html.markdown.erb | 2 +-
.../docs/datafu/guide/sampling.html.markdown.erb | 2 +-
.../docs/datafu/guide/sessions.html.markdown.erb | 2 +-
.../datafu/guide/set-operations.html.markdown.erb | 2 +-
.../docs/datafu/guide/statistics.html.markdown.erb | 2 +-
site/source/docs/download.html.markdown.erb | 9 +-
site/source/layouts/_docs_nav.erb | 4 +-
site/source/layouts/_footer.erb | 2 +-
site/source/stylesheets/all.less | 8 +
29 files changed, 830 insertions(+), 51 deletions(-)
diff --cc .gitignore
index 60d11ee,e219be2..28aa89b
--- a/.gitignore
+++ b/.gitignore
@@@ -32,12 -32,4 +32,12 @@@ datafu-pig/quer
gradle/wrapper/gradle-wrapper.jar
gradle/wrapper/gradle-wrapper.properties
gradlew*
-.java-version
++.java-version
+datafu-spark/out
+datafu-spark/derby.log
+datafu-spark/spark-warehouse
+datafu-spark/metastore_db
+datafu-spark/bin
+datafu-spark/test-output
+datafu-spark/data
- datafu-spark/.apt_generated/
-
++datafu-spark/.apt_generated/