You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by we...@apache.org on 2018/03/22 13:01:57 UTC
[1/2] arrow-site git commit: Update site for 0.9.0
Repository: arrow-site
Updated Branches:
refs/heads/asf-site d37db9ddf -> 74ed94774
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/release/0.9.0.html
----------------------------------------------------------------------
diff --git a/release/0.9.0.html b/release/0.9.0.html
new file mode 100644
index 0000000..83f715d
--- /dev/null
+++ b/release/0.9.0.html
@@ -0,0 +1,444 @@
+<!DOCTYPE html>
+<html lang="en-US">
+ <head>
+ <meta charset="UTF-8">
+ <title>Apache Arrow Homepage</title>
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <meta name="generator" content="Jekyll v3.4.3">
+ <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
+ <link rel="icon" type="image/x-icon" href="/favicon.ico">
+
+ <link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
+
+ <link href="/css/main.css" rel="stylesheet">
+ <link href="/css/syntax.css" rel="stylesheet">
+ <script src="https://code.jquery.com/jquery-3.2.1.min.js"
+ integrity="sha256-hwg4gsxgFZhOsEEamdOYGBf13FyQuiTwlAQgxVSNgt4="
+ crossorigin="anonymous"></script>
+ <script src="/assets/javascripts/bootstrap.min.js"></script>
+
+ <!-- Global Site Tag (gtag.js) - Google Analytics -->
+<script async src="https://www.googletagmanager.com/gtag/js?id=UA-107500873-1"></script>
+<script>
+ window.dataLayer = window.dataLayer || [];
+ function gtag(){dataLayer.push(arguments)};
+ gtag('js', new Date());
+
+ gtag('config', 'UA-107500873-1');
+</script>
+
+
+ </head>
+
+
+<body class="wrap">
+ <div class="container">
+ <nav class="navbar navbar-default">
+ <div class="container-fluid">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#arrow-navbar">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/">Apache Arrow™ </a>
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="arrow-navbar">
+ <ul class="nav navbar-nav">
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Project Links<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/install/">Install</a></li>
+ <li><a href="/blog/">Blog</a></li>
+ <li><a href="/release/">Releases</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW">Issue Tracker</a></li>
+ <li><a href="https://github.com/apache/arrow">Source Code</a></li>
+ <li><a href="http://mail-archives.apache.org/mod_mbox/arrow-dev/">Mailing List</a></li>
+ <li><a href="https://apachearrowslackin.herokuapp.com">Slack Channel</a></li>
+ <li><a href="/committers/">Committers</a></li>
+ <li><a href="/powered_by/">Powered By</a></li>
+ </ul>
+ </li>
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Specification<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/docs/memory_layout.html">Memory Layout</a></li>
+ <li><a href="/docs/metadata.html">Metadata</a></li>
+ <li><a href="/docs/ipc.html">Messaging / IPC</a></li>
+ </ul>
+ </li>
+
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Documentation<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/docs/python">Python</a></li>
+ <li><a href="/docs/cpp">C++ API</a></li>
+ <li><a href="/docs/java">Java API</a></li>
+ <li><a href="/docs/c_glib">C GLib API</a></li>
+ <li><a href="/docs/js">Javascript API</a></li>
+ </ul>
+ </li>
+ <!-- <li><a href="/blog">Blog</a></li> -->
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">ASF Links<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="http://www.apache.org/">ASF Website</a></li>
+ <li><a href="http://www.apache.org/licenses/">License</a></li>
+ <li><a href="http://www.apache.org/foundation/sponsorship.html">Donate</a></li>
+ <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+ <li><a href="http://www.apache.org/security/">Security</a></li>
+ </ul>
+ </li>
+ </ul>
+ <a href="http://www.apache.org/">
+ <img style="float:right;" src="/img/asf_logo.svg" width="120px"/>
+ </a>
+ </div><!-- /.navbar-collapse -->
+ </div>
+ </nav>
+
+
+ <!--
+
+-->
+
+<h1 id="apache-arrow-090-21-march-2018">Apache Arrow 0.9.0 (21 March 2018)</h1>
+
+<p>This is a major release.</p>
+
+<h2 id="download">Download</h2>
+
+<ul>
+ <li><a href="https://www.apache.org/dyn/closer.cgi/arrow/arrow-0.9.0/"><strong>Source Artifacts</strong></a></li>
+ <li><a href="https://github.com/apache/arrow/releases/tag/apache-arrow-0.9.0">Git tag</a></li>
+</ul>
+
+<h2 id="contributors">Contributors</h2>
+
+<div class="language-shell highlighter-rouge"><pre class="highlight"><code><span class="gp">$ </span>git shortlog -sn apache-arrow-0.8.0..apache-arrow-0.9.0
+ 52 Wes McKinney
+ 52 Antoine Pitrou
+ 25 Uwe L. Korn
+ 14 Paul Taylor
+ 13 Kouhei Sutou
+ 13 Phillip Cloud
+ 9 Robert Nishihara
+ 9 Korn, Uwe
+ 9 Jim Crist
+ 8 Brian Hulette
+ 7 Philipp Moritz
+ 6 Panchen Xue
+ 6 yosuke shiro
+ 5 Mitar
+ 5 Bryan Cutler
+ 4 siddharth
+ 3 Adam Seibert
+ 3 Licht-T
+ 3 moriyoshi
+ 2 rvernica
+ 2 Sidd
+ 2 Albert Shieh
+ 1 Marco Neumann
+ 1 Max Risuhin
+ 1 Jin Hai
+ 1 Jeffrey Heer
+ 1 Jacques Nadeau
+ 1 Ehsan Totoni
+ 1 Dimitri Vorona
+ 1 Chris Bartak
+ 1 Simbarashe Nyatsanga
+ 1 Cheng Lian
+ 1 Viktor Gal
+ 1 Andy Grove
+ 1 William Paul
+ 1 devin-petersohn
+</code></pre>
+</div>
+
+<h1 id="changelog">Changelog</h1>
+
+<h2 id="new-features-and-improvements">New Features and Improvements</h2>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1021">ARROW-1021</a> - [Python] Add documentation about using pyarrow from other Cython and C++ projects</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1035">ARROW-1035</a> - [Python] Add ASV benchmarks for streaming columnar deserialization</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1394">ARROW-1394</a> - [Plasma] Add optional extension for allocating memory on GPUs</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1463">ARROW-1463</a> - [JAVA] Restructure ValueVector hierarchy to minimize compile-time generated code</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1579">ARROW-1579</a> - [Java] Add dockerized test setup to validate Spark integration</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1580">ARROW-1580</a> - [Python] Instructions for setting up nightly builds on Linux</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1623">ARROW-1623</a> - [C++] Add convenience method to construct Buffer from a string that owns its memory</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1632">ARROW-1632</a> - [Python] Permit categorical conversions in Table.to_pandas on a per-column basis</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1643">ARROW-1643</a> - [Python] Accept hdfs:// prefixes in parquet.read_table and attempt to connect to HDFS</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1705">ARROW-1705</a> - [Python] Create StructArray from sequence of dicts given a known data type</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1706">ARROW-1706</a> - [Python] StructArray.from_arrays should handle sequences that are coercible to arrays</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1712">ARROW-1712</a> - [C++] Add method to BinaryBuilder to reserve space for value data</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1757">ARROW-1757</a> - [C++] Add DictionaryArray::FromArrays alternate ctor that can check or sanitized “untrusted” indices</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1815">ARROW-1815</a> - [Java] Rename MapVector to StructVector</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1832">ARROW-1832</a> - [JS] Implement JSON reader for integration tests</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1835">ARROW-1835</a> - [C++] Create Arrow schema from std::tuple types</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1861">ARROW-1861</a> - [Python] Fix up ASV setup, add developer instructions for writing new benchmarks and running benchmark suite locally</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1872">ARROW-1872</a> - [Website] Populate hard-coded fields for current release from a YAML file</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1920">ARROW-1920</a> - Add support for reading ORC files</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1926">ARROW-1926</a> - [GLib] Add garrow_timestamp_data_type_get_unit()</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1927">ARROW-1927</a> - [Plasma] Implement delete function</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1929">ARROW-1929</a> - [C++] Move various Arrow testing utility code from Parquet to Arrow codebase</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1930">ARROW-1930</a> - [C++] Implement Slice for ChunkedArray and Column</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1931">ARROW-1931</a> - [C++] w4996 warning due to std::tr1 failing builds on Visual Studio 2017</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1937">ARROW-1937</a> - [Python] Add documentation for different forms of constructing nested arrays from Python data structures</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1942">ARROW-1942</a> - [C++] Hash table specializations for small integers</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1947">ARROW-1947</a> - [Plasma] Change Client Create and Get to use Buffers</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1951">ARROW-1951</a> - Add memcopy_threads to serialization context</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1962">ARROW-1962</a> - [Java] Add reset() to ValueVector interface</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1965">ARROW-1965</a> - [GLib] Add garrow_array_builder_get_value_data_type() and garrow_array_builder_get_value_type()</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1969">ARROW-1969</a> - [C++] Do not build ORC adapter by default</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1970">ARROW-1970</a> - [GLib] Add garrow_chunked_array_get_value_data_type() and garrow_chunked_array_get_value_type()</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1977">ARROW-1977</a> - [C++] Update windows dev docs</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1978">ARROW-1978</a> - [Website] Add more visible link to “Powered By” page to front page, simplify Powered By</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2004">ARROW-2004</a> - [C++] Add shrink_to_fit option in BufferBuilder::Resize</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2007">ARROW-2007</a> - [Python] Sequence converter for float32 not implemented</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2011">ARROW-2011</a> - Allow setting the pickler to use in pyarrow serialization.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2012">ARROW-2012</a> - [GLib] Support “make distclean”</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2018">ARROW-2018</a> - [C++] Build instruction on macOS and Homebrew is incomplete</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2019">ARROW-2019</a> - Control the memory allocated for inner vector in LIST</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2024">ARROW-2024</a> - [Python] Remove global SerializationContext variables</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2028">ARROW-2028</a> - [Python] extra_cmake_args needs to be passed through shlex.split</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2031">ARROW-2031</a> - HadoopFileSystem isn’t pickleable</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2035">ARROW-2035</a> - [C++] Update vendored cpplint.py to a Py3-compatible one</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2036">ARROW-2036</a> - NativeFile should support standard IOBase methods</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2042">ARROW-2042</a> - [Plasma] Revert API change of plasma::Create to output a MutableBuffer</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2043">ARROW-2043</a> - [C++] Change description from OS X to macOS</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2046">ARROW-2046</a> - [Python] Add support for PEP519 - pathlib and similar objects</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2048">ARROW-2048</a> - [Python/C++] Upate Thrift pin to 0.11</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2050">ARROW-2050</a> - Support <code class="highlighter-rouge">setup.py pytest</code> to automatically fetch the test dependencies</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2052">ARROW-2052</a> - Unify OwnedRef and ScopedRef</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2054">ARROW-2054</a> - Compilation warnings</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2064">ARROW-2064</a> - [GLib] Add common build problems link to the install section</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2065">ARROW-2065</a> - Fix bug in SerializationContext.clone().</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2068">ARROW-2068</a> - [Python] Expose Array’s buffers to Python users</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2069">ARROW-2069</a> - [Python] Document that Plasma is not (yet) supported on Windows</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2071">ARROW-2071</a> - [Python] Reduce runtime of builds in Travis CI</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2073">ARROW-2073</a> - [Python] Create StructArray from sequence of tuples given a known data type</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2076">ARROW-2076</a> - [Python] Display slowest test durations</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2083">ARROW-2083</a> - Support skipping builds</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2084">ARROW-2084</a> - [C++] Support newer Brotli static library names</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2086">ARROW-2086</a> - [Python] Shrink size of arrow_manylinux1_x86_64_base docker image</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2087">ARROW-2087</a> - [Python] Binaries of 3rdparty are not stripped in manylinux1 base image</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2088">ARROW-2088</a> - [GLib] Add GArrowNumericArray</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2089">ARROW-2089</a> - [GLib] Rename to GARROW_TYPE_BOOLEAN for consistency</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2090">ARROW-2090</a> - [Python] Add context manager methods to ParquetWriter</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2093">ARROW-2093</a> - [Python] Possibly do not test pytorch serialization in Travis CI</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2094">ARROW-2094</a> - [Python] Use toolchain libraries and PROTOBUF_HOME for protocol buffers</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2095">ARROW-2095</a> - [C++] Suppress ORC EP build logging by default</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2096">ARROW-2096</a> - [C++] Turn off Boost_DEBUG to trim build output</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2099">ARROW-2099</a> - [Python] Support DictionaryArray::FromArrays in Python bindings</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2107">ARROW-2107</a> - [GLib] Follow arrow::gpu::CudaIpcMemHandle API change</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2108">ARROW-2108</a> - [Python] Update instructions for ASV</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2110">ARROW-2110</a> - [Python] Only require pytest-runner on test commands</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2111">ARROW-2111</a> - [C++] Linting could be faster</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2114">ARROW-2114</a> - [Python] Pull latest docker manylinux1 image</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2117">ARROW-2117</a> - [C++] Pin clang to version 5.0</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2118">ARROW-2118</a> - [Python] Improve error message when calling parquet.read_table on an empty file</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2120">ARROW-2120</a> - Add possibility to use empty _MSVC_STATIC_LIB_SUFFIX for Thirdparties</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2121">ARROW-2121</a> - [Python] Consider special casing object arrays in pandas serializers.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2123">ARROW-2123</a> - [JS] Upgrade to TS 2.7.1</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2132">ARROW-2132</a> - [Doc] Add links / mentions of Plasma store to main README</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2134">ARROW-2134</a> - [CI] Make Travis commit inspection more robust</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2137">ARROW-2137</a> - [Python] Don’t print paths that are ignored when reading Parquet files</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2138">ARROW-2138</a> - [C++] Have FatalLog abort instead of exiting</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2142">ARROW-2142</a> - [Python] Conversion from Numpy struct array unimplemented</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2143">ARROW-2143</a> - [Python] Provide a manylinux1 wheel for cp27m</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2146">ARROW-2146</a> - [GLib] Implement Slice for ChunkedArray</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2149">ARROW-2149</a> - [Python] reorganize test_convert_pandas.py</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2154">ARROW-2154</a> - [Python] <strong>eq</strong> unimplemented on Buffer</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2155">ARROW-2155</a> - [Python] pa.frombuffer(bytearray) returns immutable Buffer</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2156">ARROW-2156</a> - [CI] Isolate Sphinx dependencies</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2163">ARROW-2163</a> - Install apt dependencies separate from built-in Travis commands, retry on flakiness</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2166">ARROW-2166</a> - [GLib] Implement Slice for Column</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2168">ARROW-2168</a> - [C++] Build toolchain builds with jemalloc</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2169">ARROW-2169</a> - [C++] MSVC is complaining about uncaptured variables</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2174">ARROW-2174</a> - [JS] Export format and schema enums</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2176">ARROW-2176</a> - [C++] Extend DictionaryBuilder to support delta dictionaries</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2177">ARROW-2177</a> - [C++] Remove support for specifying negative scale values in DecimalType</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2180">ARROW-2180</a> - [C++] Remove APIs deprecated in 0.8.0 release</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2181">ARROW-2181</a> - [Python] Add concat_tables to API reference, add documentation on use</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2184">ARROW-2184</a> - [C++] Add static constructor for FileOutputStream returning shared_ptr to base OutputStream</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2185">ARROW-2185</a> - Remove CI directives from squashed commit messages</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2190">ARROW-2190</a> - [GLib] Add add/remove field functions for RecordBatch.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2191">ARROW-2191</a> - [C++] Only use specific version of jemalloc</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2197">ARROW-2197</a> - Document “undefined symbol” issue and workaround</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2198">ARROW-2198</a> - [Python] Docstring for parquet.read_table is misleading or incorrect</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2199">ARROW-2199</a> - [JAVA] Follow up fixes for ARROW-2019. Ensure density driven capacity is never less than 1 and propagate density throughout the vector tree</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2203">ARROW-2203</a> - [C++] StderrStream class</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2204">ARROW-2204</a> - [C++] Build fails with TLS error on parquet-cpp clone</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2205">ARROW-2205</a> - [Python] Option for integer object nulls</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2206">ARROW-2206</a> - [JS] Add Perspective as a community project</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2218">ARROW-2218</a> - [Python] PythonFile should infer mode when not given</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2231">ARROW-2231</a> - [CI] Use clcache on AppVeyor</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2238">ARROW-2238</a> - [C++] Detect clcache in cmake configuration</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2239">ARROW-2239</a> - [C++] Update build docs for Windows</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2250">ARROW-2250</a> - plasma_store process should cleanup on INT and TERM signals</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2252">ARROW-2252</a> - [Python] Create buffer from address, size and base</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2253">ARROW-2253</a> - [Python] Support <strong>eq</strong> on scalar values</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2261">ARROW-2261</a> - [GLib] Can’t share the same memory in GArrowBuffer safely</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2262">ARROW-2262</a> - [Python] Support slicing on pyarrow.ChunkedArray</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2279">ARROW-2279</a> - [Python] Better error message if lib cannot be found</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2282">ARROW-2282</a> - [Python] Create StringArray from buffers</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2283">ARROW-2283</a> - [C++] Support Arrow C++ installed in /usr detection by pkg-config</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2289">ARROW-2289</a> - [GLib] Add Numeric, Integer and FloatingPoint data types</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2291">ARROW-2291</a> - [C++] README missing instructions for libboost-regex-dev</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2292">ARROW-2292</a> - [Python] More consistent / intuitive name for pyarrow.frombuffer</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2309">ARROW-2309</a> - [C++] Use std::make_unsigned</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-232">ARROW-232</a> - C++/Parquet: Support writing chunked arrays as part of a table</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2321">ARROW-2321</a> - [C++] Release verification script fails with if CMAKE_INSTALL_LIBDIR is not $ARROW_HOME/lib</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-633">ARROW-633</a> - [Java] Add support for FixedSizeBinary type</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-634">ARROW-634</a> - Add integration tests for FixedSizeBinary</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-764">ARROW-764</a> - [C++] Improve performance of CopyBitmap, add benchmarks</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-969">ARROW-969</a> - [C++/Python] Add add/remove field functions for RecordBatch</li>
+</ul>
+
+<h2 id="bug-fixes">Bug Fixes</h2>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1345">ARROW-1345</a> - [Python] Conversion from nested NumPy arrays fails on integers other than int64, float32</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1589">ARROW-1589</a> - [C++] Fuzzing for certain input formats</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1646">ARROW-1646</a> - [Python] pyarrow.array cannot handle NumPy scalar types</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1856">ARROW-1856</a> - [Python] Auto-detect Parquet ABI version when using PARQUET_HOME</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1909">ARROW-1909</a> - [C++] Bug: Build fails on windows with “-DARROW_BUILD_BENCHMARKS=ON”</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1912">ARROW-1912</a> - [Website] Add org affiliations to committers.html</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1919">ARROW-1919</a> - Plasma hanging if object id is not 20 bytes</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1924">ARROW-1924</a> - [Python] Bring back pickle=True option for serialization</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1933">ARROW-1933</a> - [GLib] Build failure with –with-arrow-cpp-build-dir and GPU enabled Arrow C++</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1940">ARROW-1940</a> - [Python] Extra metadata gets added after multiple conversions between pd.DataFrame and pa.Table</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1941">ARROW-1941</a> - Table <–> DataFrame roundtrip failing</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1943">ARROW-1943</a> - Handle setInitialCapacity() for deeply nested lists of lists</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1944">ARROW-1944</a> - FindArrow has wrong ARROW_STATIC_LIB</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1945">ARROW-1945</a> - [C++] Fix doxygen documentation of array.h</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1946">ARROW-1946</a> - Add APIs to decimal vector for writing big endian data</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1948">ARROW-1948</a> - [Java] ListVector does not handle ipc with all non-null values with none set</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1950">ARROW-1950</a> - [Python] pandas_type in pandas metadata incorrect for List types</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1953">ARROW-1953</a> - [JS] JavaScript builds broken on master</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1958">ARROW-1958</a> - [Python] Error in pandas conversion for datetimetz row index</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1961">ARROW-1961</a> - [Python] Writing Parquet file with flavor=’spark’ loses pandas schema metadata</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1966">ARROW-1966</a> - [C++] Support JAVA_HOME paths in HDFS libjvm loading that include the jre directory</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1971">ARROW-1971</a> - [Python] Add pandas serialization to the default</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1972">ARROW-1972</a> - Deserialization of buffer objects (and pandas dataframes) segfaults on different processes.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1973">ARROW-1973</a> - [Python] Memory leak when converting Arrow tables with array columns to Pandas dataframes.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1976">ARROW-1976</a> - [Python] Handling unicode pandas columns on parquet.read_table</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1979">ARROW-1979</a> - [JS] JS builds handing in es2015:umd tests</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1980">ARROW-1980</a> - [Python] Race condition in <code class="highlighter-rouge">write_to_dataset</code></li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1982">ARROW-1982</a> - [Python] Return parquet statistics min/max as values instead of strings</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1991">ARROW-1991</a> - [GLib] Docker-based documentation build is broken</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1992">ARROW-1992</a> - [Python] to_pandas crashes when using strings_to_categoricals on empty string cols on 0.8.0</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1997">ARROW-1997</a> - [Python] to_pandas with strings_to_categorical fails</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1998">ARROW-1998</a> - [Python] Table.from_pandas crashes when data frame is empty</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-1999">ARROW-1999</a> - [Python] from_numpy_dtype returns wrong types</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2000">ARROW-2000</a> - Deduplicate file descriptors when plasma store replies to get request.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2002">ARROW-2002</a> - use pyarrow download file will raise queue.Full exceptions sometimes</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2003">ARROW-2003</a> - [Python] Do not use deprecated kwarg in pandas.core.internals.make_block</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2005">ARROW-2005</a> - [Python] pyflakes warnings on Cython files not failing build</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2008">ARROW-2008</a> - [Python] Type inference for int32 NumPy arrays (expecting list<int32>) returns int64 and then conversion fails</int32></li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2010">ARROW-2010</a> - [C++] Compiler warnings with CHECKIN warning level in ORC adapter</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2017">ARROW-2017</a> - Array initialization with large (>2**31-1) uint64 values fails</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2023">ARROW-2023</a> - [C++] Test opening IPC stream reader or file reader on an empty InputStream</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2025">ARROW-2025</a> - [Python/C++] HDFS Client disconnect closes all open clients</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2029">ARROW-2029</a> - [Python] Program crash on <code class="highlighter-rouge">HdfsFile.tell</code> if file is closed</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2032">ARROW-2032</a> - [C++] ORC ep installs on each call to ninja build (even if no work to do)</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2033">ARROW-2033</a> - pa.array() doesn’t work with iterators</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2039">ARROW-2039</a> - [Python] pyarrow.Buffer().to_pybytes() segfaults</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2040">ARROW-2040</a> - [Python] Deserialized Numpy array must keep ref to underlying tensor</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2047">ARROW-2047</a> - [Python] test_serialization.py uses a python executable in PATH rather than that used for a test run</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2049">ARROW-2049</a> - ARROW-2049: [Python] Use python -m cython to run Cython, instead of CYTHON_EXECUTABLE</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2062">ARROW-2062</a> - [C++] Stalled builds in test_serialization.py in Travis CI</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2070">ARROW-2070</a> - [Python] chdir logic in setup.py buggy</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2072">ARROW-2072</a> - [Python] decimal128.byte_width crashes</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2080">ARROW-2080</a> - [Python] Update documentation after ARROW-2024</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2085">ARROW-2085</a> - HadoopFileSystem.isdir and .isfile should return False if the path doesn’t exist</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2106">ARROW-2106</a> - [Python] pyarrow.array can’t take a pandas Series of python datetime objects.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2109">ARROW-2109</a> - [C++] Boost 1.66 compilation fails on Windows on linkage stage</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2124">ARROW-2124</a> - [Python] ArrowInvalid raised if the first item of a nested list of numpy arrays is empty</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2128">ARROW-2128</a> - [Python] Cannot serialize array of empty lists</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2129">ARROW-2129</a> - [Python] Segmentation fault on conversion of empty array to Pandas</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2131">ARROW-2131</a> - [Python] Serialization test fails on Windows when library has been built in place / not installed</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2133">ARROW-2133</a> - [Python] Segmentation fault on conversion of empty nested arrays to Pandas</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2135">ARROW-2135</a> - [Python] NaN values silently casted to int64 when passing explicit schema for conversion in Table.from_pandas</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2145">ARROW-2145</a> - [Python] Decimal conversion not working for NaN values</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2150">ARROW-2150</a> - [Python] array equality defaults to identity</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2151">ARROW-2151</a> - [Python] Error when converting from list of uint64 arrays</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2153">ARROW-2153</a> - [C++/Python] Decimal conversion not working for exponential notation</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2157">ARROW-2157</a> - [Python] Decimal arrays cannot be constructed from Python lists</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2160">ARROW-2160</a> - [C++/Python] Fix decimal precision inference</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2161">ARROW-2161</a> - [Python] Skip test_cython_api if ARROW_HOME isn’t defined</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2162">ARROW-2162</a> - [Python/C++] Decimal Values with too-high precision are multiplied by 100</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2167">ARROW-2167</a> - [C++] Building Orc extensions fails with the default BUILD_WARNING_LEVEL=Production</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2170">ARROW-2170</a> - [Python] construct_metadata fails on reading files where no index was preserved</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2171">ARROW-2171</a> - [Python] OwnedRef is fragile</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2172">ARROW-2172</a> - [Python] Incorrect conversion from Numpy array when stride % itemsize != 0</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2173">ARROW-2173</a> - [Python] NumPyBuffer destructor should hold the GIL</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2175">ARROW-2175</a> - [Python] arrow_ep build is triggering during parquet-cpp build in Travis CI</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2178">ARROW-2178</a> - [JS] Fix JS html FileReader example</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2179">ARROW-2179</a> - [C++] arrow/util/io-util.h missing from libarrow-dev</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2192">ARROW-2192</a> - Commits to master should run all builds in CI matrix</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2209">ARROW-2209</a> - [Python] Partition columns are not correctly loaded in schema of ParquetDataset</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2210">ARROW-2210</a> - [C++] TestBuffer_ResizeOOM has a memory leak with jemalloc</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2212">ARROW-2212</a> - [C++/Python] Build Protobuf in base manylinux 1 docker image</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2223">ARROW-2223</a> - [JS] installing umd release throws an error</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2227">ARROW-2227</a> - [Python] Table.from_pandas does not create chunked_arrays.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2230">ARROW-2230</a> - [Python] JS version number is sometimes picked up</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2232">ARROW-2232</a> - [Python] pyarrow.Tensor constructor segfaults</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2234">ARROW-2234</a> - [JS] Read timestamp low bits as Uint32s</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2240">ARROW-2240</a> - [Python] Array initialization with leading numpy nan fails with exception</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2244">ARROW-2244</a> - [C++] Slicing NullArray should not cause the null count on the internal data to be unknown</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2245">ARROW-2245</a> - [Python] Revert static linkage of parquet-cpp in manylinux1 wheel</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2246">ARROW-2246</a> - [Python] Use namespaced boost in manylinux1 package</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2251">ARROW-2251</a> - [GLib] Destroying GArrowBuffer while GArrowTensor that uses the buffer causes a crash</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2254">ARROW-2254</a> - [Python] Local in-place dev versions picking up JS tags</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2258">ARROW-2258</a> - [C++] Appveyor builds failing on master</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2263">ARROW-2263</a> - [Python] test_cython.py fails if pyarrow is not in import path (e.g. with inplace builds)</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2265">ARROW-2265</a> - [Python] Serializing subclasses of np.ndarray returns a np.ndarray.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2268">ARROW-2268</a> - Remove MD5 checksums from release process</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2269">ARROW-2269</a> - [Python] Cannot build bdist_wheel for Python</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2270">ARROW-2270</a> - [Python] ForeignBuffer doesn’t tie Python object lifetime to C++ buffer lifetime</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2272">ARROW-2272</a> - [Python] test_plasma spams /tmp</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2275">ARROW-2275</a> - [C++] Buffer::mutable_data_ member uninitialized</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2280">ARROW-2280</a> - [Python] pyarrow.Array.buffers should also include the offsets</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2284">ARROW-2284</a> - [Python] test_plasma error on plasma_store error</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2288">ARROW-2288</a> - [Python] slicing logic defective</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2297">ARROW-2297</a> - [JS] babel-jest is not listed as a dev dependency</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2304">ARROW-2304</a> - [C++] MultipleClients test in io-hdfs-test fails on trunk</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2306">ARROW-2306</a> - [Python] HDFS test failures</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2307">ARROW-2307</a> - [Python] Unable to read arrow stream containing 0 record batches</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2311">ARROW-2311</a> - [Python] Struct array slicing defective</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2312">ARROW-2312</a> - [JS] verify-release-candidate-sh must be updated to include JS in integration tests</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2313">ARROW-2313</a> - [GLib] Release builds must define NDEBUG</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2316">ARROW-2316</a> - [C++] Revert Buffer::mutable_data member to always inline</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2318">ARROW-2318</a> - [C++] TestPlasmaStore.MultipleClientTest is flaky (hangs) in release builds</li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW-2320">ARROW-2320</a> - [C++] Vendored Boost build does not build regex library</li>
+</ul>
+
+
+
+ <hr/>
+<footer class="footer">
+ <p>Apache Arrow, Arrow, Apache, the Apache feather logo, and the Apache Arrow project logo are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+ <p>© 2017 Apache Software Foundation</p>
+</footer>
+
+ </div>
+</body>
+</html>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/release/index.html
----------------------------------------------------------------------
diff --git a/release/index.html b/release/index.html
index 42d0402..d2f7e28 100644
--- a/release/index.html
+++ b/release/index.html
@@ -123,6 +123,7 @@
<p>Navigate to the release page for downloads and the changelog.</p>
<ul>
+ <li><a href="/release/0.9.0.html">0.9.0 (21 March 2018)</a></li>
<li><a href="/release/0.8.0.html">0.8.0 (18 December 2017)</a></li>
<li><a href="/release/0.7.1.html">0.7.1 (1 October 2017)</a></li>
<li><a href="/release/0.7.0.html">0.7.0 (17 September 2017)</a></li>
[2/2] arrow-site git commit: Update site for 0.9.0
Posted by we...@apache.org.
Update site for 0.9.0
Project: http://git-wip-us.apache.org/repos/asf/arrow-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/arrow-site/commit/74ed9477
Tree: http://git-wip-us.apache.org/repos/asf/arrow-site/tree/74ed9477
Diff: http://git-wip-us.apache.org/repos/asf/arrow-site/diff/74ed9477
Branch: refs/heads/asf-site
Commit: 74ed94774f7aea92755cf9f0be6f0b1402018fc7
Parents: d37db9d
Author: Wes McKinney <we...@twosigma.com>
Authored: Thu Mar 22 09:01:44 2018 -0400
Committer: Wes McKinney <we...@twosigma.com>
Committed: Thu Mar 22 09:01:44 2018 -0400
----------------------------------------------------------------------
blog/2017/12/18/0.8.0-release/index.html | 2 +-
.../12/19/java-vector-improvements/index.html | 1 +
blog/2018/03/22/0.9.0-release/index.html | 222 ++++++++++
blog/2018/03/22/go-code-donation/index.html | 199 +++++++++
blog/index.html | 183 +++++++-
docs/ipc.html | 47 +-
docs/memory_layout.html | 11 +-
docs/metadata.html | 3 +-
feed.xml | 237 +++++-----
img/native_go_implementation.png | Bin 0 -> 56186 bytes
index.html | 2 +-
install/index.html | 22 +-
powered_by/index.html | 1 +
release/0.9.0.html | 444 +++++++++++++++++++
release/index.html | 1 +
15 files changed, 1190 insertions(+), 185 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/blog/2017/12/18/0.8.0-release/index.html
----------------------------------------------------------------------
diff --git a/blog/2017/12/18/0.8.0-release/index.html b/blog/2017/12/18/0.8.0-release/index.html
index 2ca46fc..7ab1ec8 100644
--- a/blog/2017/12/18/0.8.0-release/index.html
+++ b/blog/2017/12/18/0.8.0-release/index.html
@@ -143,7 +143,7 @@
-->
<p>The Apache Arrow team is pleased to announce the 0.8.0 release. It is the
-product of 10 weeks of development andincludes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.0"><strong>286 resolved JIRAs</strong></a> with
+product of 10 weeks of development and includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.0"><strong>286 resolved JIRAs</strong></a> with
many new features and bug fixes to the various language implementations. This
is the largest release since 0.3.0 earlier this year.</p>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/blog/2017/12/19/java-vector-improvements/index.html
----------------------------------------------------------------------
diff --git a/blog/2017/12/19/java-vector-improvements/index.html b/blog/2017/12/19/java-vector-improvements/index.html
index 93ccfbd..2c54256 100644
--- a/blog/2017/12/19/java-vector-improvements/index.html
+++ b/blog/2017/12/19/java-vector-improvements/index.html
@@ -89,6 +89,7 @@
<li><a href="/docs/cpp">C++ API</a></li>
<li><a href="/docs/java">Java API</a></li>
<li><a href="/docs/c_glib">C GLib API</a></li>
+ <li><a href="/docs/js">Javascript API</a></li>
</ul>
</li>
<!-- <li><a href="/blog">Blog</a></li> -->
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/blog/2018/03/22/0.9.0-release/index.html
----------------------------------------------------------------------
diff --git a/blog/2018/03/22/0.9.0-release/index.html b/blog/2018/03/22/0.9.0-release/index.html
new file mode 100644
index 0000000..b9f7815
--- /dev/null
+++ b/blog/2018/03/22/0.9.0-release/index.html
@@ -0,0 +1,222 @@
+<!DOCTYPE html>
+<html lang="en-US">
+ <head>
+ <meta charset="UTF-8">
+ <title>Apache Arrow Homepage</title>
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <meta name="generator" content="Jekyll v3.4.3">
+ <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
+ <link rel="icon" type="image/x-icon" href="/favicon.ico">
+
+ <link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
+
+ <link href="/css/main.css" rel="stylesheet">
+ <link href="/css/syntax.css" rel="stylesheet">
+ <script src="https://code.jquery.com/jquery-3.2.1.min.js"
+ integrity="sha256-hwg4gsxgFZhOsEEamdOYGBf13FyQuiTwlAQgxVSNgt4="
+ crossorigin="anonymous"></script>
+ <script src="/assets/javascripts/bootstrap.min.js"></script>
+
+ <!-- Global Site Tag (gtag.js) - Google Analytics -->
+<script async src="https://www.googletagmanager.com/gtag/js?id=UA-107500873-1"></script>
+<script>
+ window.dataLayer = window.dataLayer || [];
+ function gtag(){dataLayer.push(arguments)};
+ gtag('js', new Date());
+
+ gtag('config', 'UA-107500873-1');
+</script>
+
+
+ </head>
+
+
+
+<body class="wrap">
+ <div class="container">
+ <nav class="navbar navbar-default">
+ <div class="container-fluid">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#arrow-navbar">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/">Apache Arrow™ </a>
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="arrow-navbar">
+ <ul class="nav navbar-nav">
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Project Links<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/install/">Install</a></li>
+ <li><a href="/blog/">Blog</a></li>
+ <li><a href="/release/">Releases</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW">Issue Tracker</a></li>
+ <li><a href="https://github.com/apache/arrow">Source Code</a></li>
+ <li><a href="http://mail-archives.apache.org/mod_mbox/arrow-dev/">Mailing List</a></li>
+ <li><a href="https://apachearrowslackin.herokuapp.com">Slack Channel</a></li>
+ <li><a href="/committers/">Committers</a></li>
+ <li><a href="/powered_by/">Powered By</a></li>
+ </ul>
+ </li>
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Specification<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/docs/memory_layout.html">Memory Layout</a></li>
+ <li><a href="/docs/metadata.html">Metadata</a></li>
+ <li><a href="/docs/ipc.html">Messaging / IPC</a></li>
+ </ul>
+ </li>
+
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Documentation<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/docs/python">Python</a></li>
+ <li><a href="/docs/cpp">C++ API</a></li>
+ <li><a href="/docs/java">Java API</a></li>
+ <li><a href="/docs/c_glib">C GLib API</a></li>
+ <li><a href="/docs/js">Javascript API</a></li>
+ </ul>
+ </li>
+ <!-- <li><a href="/blog">Blog</a></li> -->
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">ASF Links<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="http://www.apache.org/">ASF Website</a></li>
+ <li><a href="http://www.apache.org/licenses/">License</a></li>
+ <li><a href="http://www.apache.org/foundation/sponsorship.html">Donate</a></li>
+ <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+ <li><a href="http://www.apache.org/security/">Security</a></li>
+ </ul>
+ </li>
+ </ul>
+ <a href="http://www.apache.org/">
+ <img style="float:right;" src="/img/asf_logo.svg" width="120px"/>
+ </a>
+ </div><!-- /.navbar-collapse -->
+ </div>
+ </nav>
+
+
+ <h2>
+ Apache Arrow 0.9.0 Release
+ <a href="/blog/2018/03/22/0.9.0-release/" class="permalink" title="Permalink">∞</a>
+ </h2>
+
+
+
+ <div class="panel">
+ <div class="panel-body">
+ <div>
+ <span class="label label-default">Published</span>
+ <span class="published">
+ <i class="fa fa-calendar"></i>
+ 22 Mar 2018
+ </span>
+ </div>
+ <div>
+ <span class="label label-default">By</span>
+ <a href="http://wesmckinney.com"><i class="fa fa-user"></i> Wes McKinney (wesm)</a>
+ </div>
+ </div>
+ </div>
+
+ <!--
+
+-->
+
+<p>The Apache Arrow team is pleased to announce the 0.9.0 release. It is the
+product of over 3 months of development and includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.9.0"><strong>260 resolved
+JIRAs</strong></a>.</p>
+
+<p>While we made some of backwards-incompatible columnar binary format changes in
+last December’s 0.8.0 release, the 0.9.0 release is backwards-compatible with
+0.8.0. We will be working toward a 1.0.0 release this year, which will mark
+longer-term binary stability for the Arrow columnar format and metadata.</p>
+
+<p>See the <a href="https://arrow.apache.org/install">Install Page</a> to learn how to get the libraries for your
+platform. The <a href="https://arrow.apache.org/release/0.8.0.html">complete changelog</a> is also available.</p>
+
+<p>We discuss some highlights from the release and other project news in this
+post. This release has been overall focused more on bug fixes, compatibility,
+and stability compared with previous releases which have pushed more on new and
+expanded features.</p>
+
+<h2 id="new-arrow-committers-and-pmc-members">New Arrow committers and PMC members</h2>
+
+<p>Since the last release, we have added 2 new Arrow committers: <a href="https://github.com/theneuralbit">Brian
+Hulette</a> and <a href="https://github.com/robertnishihara">Robert Nishihara</a>. Additionally, <a href="https://github.com/cpcloud">Phillip Cloud</a> and
+<a href="https://github.com/pcmoritz">Philipp Moritz</a> have been promoted from committer to PMC
+member. Congratulations and thank you for your contributions!</p>
+
+<h2 id="plasma-object-store-improvements">Plasma Object Store Improvements</h2>
+
+<p>The Plasma Object Store now supports managing interprocess shared memory on
+CUDA-enabled GPUs. We are excited to see more GPU-related functionality develop
+in Apache Arrow, as this has become a key computing environment for scalable
+machine learning.</p>
+
+<h2 id="python-improvements">Python Improvements</h2>
+
+<p><a href="https://github.com/pitrou">Antoine Pitrou</a> has joined the Python development efforts and helped
+significantly this release with interoperability with built-in CPython data
+structures and NumPy structured data types.</p>
+
+<ul>
+ <li>New experimental support for reading Apache ORC files</li>
+ <li><code class="highlighter-rouge">pyarrow.array</code> now accepts lists of tuples or Python dicts for creating
+Arrow struct type arrays.</li>
+ <li>NumPy structured dtypes (which are row/record-oriented) can be directly
+converted to Arrow struct (column-oriented) arrays</li>
+ <li>Python 3.6 <code class="highlighter-rouge">pathlib</code> objects for file paths are now accepted in many file
+APIs, including for Parquet files</li>
+ <li>Arrow integer arrays with nulls can now be converted to NumPy object arrays
+with <code class="highlighter-rouge">None</code> values</li>
+ <li>New <code class="highlighter-rouge">pyarrow.foreign_buffer</code> API for interacting with memory blocks located
+at particular memory addresses</li>
+</ul>
+
+<h2 id="java-improvements">Java Improvements</h2>
+
+<p>Java now fully supports the <code class="highlighter-rouge">FixedSizeBinary</code> data type.</p>
+
+<h2 id="javascript-improvements">JavaScript Improvements</h2>
+
+<p>The JavaScript library has been significantly refactored and expanded. We are
+making separate Apache releases (most recently <code class="highlighter-rouge">JS-0.3.1</code>) for JavaScript,
+which are being <a href="https://www.npmjs.com/package/apache-arrow">published to NPM</a>.</p>
+
+<h2 id="upcoming-roadmap">Upcoming Roadmap</h2>
+
+<p>In the coming months, we will be working to move Apache Arrow closer to a 1.0.0
+release. We will also be discussing plans to develop native Arrow-based
+computational libraries within the project.</p>
+
+
+
+ <hr/>
+<footer class="footer">
+ <p>Apache Arrow, Arrow, Apache, the Apache feather logo, and the Apache Arrow project logo are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+ <p>© 2017 Apache Software Foundation</p>
+</footer>
+
+ </div>
+</body>
+</html>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/blog/2018/03/22/go-code-donation/index.html
----------------------------------------------------------------------
diff --git a/blog/2018/03/22/go-code-donation/index.html b/blog/2018/03/22/go-code-donation/index.html
new file mode 100644
index 0000000..c20af9c
--- /dev/null
+++ b/blog/2018/03/22/go-code-donation/index.html
@@ -0,0 +1,199 @@
+<!DOCTYPE html>
+<html lang="en-US">
+ <head>
+ <meta charset="UTF-8">
+ <title>Apache Arrow Homepage</title>
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <meta name="generator" content="Jekyll v3.4.3">
+ <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
+ <link rel="icon" type="image/x-icon" href="/favicon.ico">
+
+ <link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
+
+ <link href="/css/main.css" rel="stylesheet">
+ <link href="/css/syntax.css" rel="stylesheet">
+ <script src="https://code.jquery.com/jquery-3.2.1.min.js"
+ integrity="sha256-hwg4gsxgFZhOsEEamdOYGBf13FyQuiTwlAQgxVSNgt4="
+ crossorigin="anonymous"></script>
+ <script src="/assets/javascripts/bootstrap.min.js"></script>
+
+ <!-- Global Site Tag (gtag.js) - Google Analytics -->
+<script async src="https://www.googletagmanager.com/gtag/js?id=UA-107500873-1"></script>
+<script>
+ window.dataLayer = window.dataLayer || [];
+ function gtag(){dataLayer.push(arguments)};
+ gtag('js', new Date());
+
+ gtag('config', 'UA-107500873-1');
+</script>
+
+
+ </head>
+
+
+
+<body class="wrap">
+ <div class="container">
+ <nav class="navbar navbar-default">
+ <div class="container-fluid">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#arrow-navbar">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/">Apache Arrow™ </a>
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="arrow-navbar">
+ <ul class="nav navbar-nav">
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Project Links<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/install/">Install</a></li>
+ <li><a href="/blog/">Blog</a></li>
+ <li><a href="/release/">Releases</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/ARROW">Issue Tracker</a></li>
+ <li><a href="https://github.com/apache/arrow">Source Code</a></li>
+ <li><a href="http://mail-archives.apache.org/mod_mbox/arrow-dev/">Mailing List</a></li>
+ <li><a href="https://apachearrowslackin.herokuapp.com">Slack Channel</a></li>
+ <li><a href="/committers/">Committers</a></li>
+ <li><a href="/powered_by/">Powered By</a></li>
+ </ul>
+ </li>
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Specification<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/docs/memory_layout.html">Memory Layout</a></li>
+ <li><a href="/docs/metadata.html">Metadata</a></li>
+ <li><a href="/docs/ipc.html">Messaging / IPC</a></li>
+ </ul>
+ </li>
+
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">Documentation<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="/docs/python">Python</a></li>
+ <li><a href="/docs/cpp">C++ API</a></li>
+ <li><a href="/docs/java">Java API</a></li>
+ <li><a href="/docs/c_glib">C GLib API</a></li>
+ <li><a href="/docs/js">Javascript API</a></li>
+ </ul>
+ </li>
+ <!-- <li><a href="/blog">Blog</a></li> -->
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"
+ role="button" aria-haspopup="true"
+ aria-expanded="false">ASF Links<span class="caret"></span>
+ </a>
+ <ul class="dropdown-menu">
+ <li><a href="http://www.apache.org/">ASF Website</a></li>
+ <li><a href="http://www.apache.org/licenses/">License</a></li>
+ <li><a href="http://www.apache.org/foundation/sponsorship.html">Donate</a></li>
+ <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+ <li><a href="http://www.apache.org/security/">Security</a></li>
+ </ul>
+ </li>
+ </ul>
+ <a href="http://www.apache.org/">
+ <img style="float:right;" src="/img/asf_logo.svg" width="120px"/>
+ </a>
+ </div><!-- /.navbar-collapse -->
+ </div>
+ </nav>
+
+
+ <h2>
+ A Native Go Library for Apache Arrow
+ <a href="/blog/2018/03/22/go-code-donation/" class="permalink" title="Permalink">∞</a>
+ </h2>
+
+
+
+ <div class="panel">
+ <div class="panel-body">
+ <div>
+ <span class="label label-default">Published</span>
+ <span class="published">
+ <i class="fa fa-calendar"></i>
+ 22 Mar 2018
+ </span>
+ </div>
+ <div>
+ <span class="label label-default">By</span>
+ <a href="http://github.com/pmc"><i class="fa fa-user"></i> The Apache Arrow PMC (pmc)</a>
+ </div>
+ </div>
+ </div>
+
+ <!--
+
+-->
+
+<p>Since launching in early 2016, Apache Arrow has been growing fast. We have made
+nine major releases through the efforts of over 120 distinct contributors. The
+project’s scope has also expanded. We began by focusing on the development of
+the standardized in-memory columnar data format, which now serves as a pillar
+of the project. Since then, we have been growing into a more general
+cross-language platform for in-memory data analysis through new additions to
+the project like the <a href="http://arrow.apache.org/blog/2017/08/16/0.6.0-release/">Plasma shared memory object store</a>. A primary goal of
+the project is to enable data system developers to process and move data fast.</p>
+
+<p>So far, we officially have developed native Arrow implementations in C++, Java,
+and JavaScript. We have created binding layers for the C++ libraries in C
+(using the GLib libraries) and Python. We have also seen efforts to develop
+interfaces to the Arrow C++ libraries in Go, Lua, Ruby, and Rust. While binding
+layers serve many purposes, there can be benefits to native implementations,
+and so we’ve been keen to see future work on native implementations in growing
+systems languages like Go and Rust.</p>
+
+<p>This past October, engineers <a href="https://github.com/stuartcarnie">Stuart Carnie</a>, <a href="https://github.com/nathanielc">Nathaniel Cook</a>, and
+<a href="https://github.com/goller">Chris Goller</a>, employees of <a href="https://influxdata.com">InfluxData</a>, began developing a native [Go
+language implementation of the <a href="https://github.com/influxdata/arrow">Apache Arrow</a> in-memory columnar format for
+use in Go-based database systems like InfluxDB. We are excited to announce that
+InfluxData has donated this native Go implementation to the Apache Arrow
+project, where it will continue to be developed. This work features low-level
+integration with the Go runtime and native support for SIMD instruction
+sets. We are looking forward to working more closely with the Go community on
+solving in-memory analytics and data interoperability problems.</p>
+
+<div align="center">
+<img src="/img/native_go_implementation.png" alt="Apache Arrow implementations and bindings" width="60%" class="img-responsive" />
+</div>
+
+<p>One of the mantras in <a href="https://www.apache.org">The Apache Software Foundation</a> is “Community over
+Code”. By building an open and collaborative development community across many
+programming language ecosystems, we will be able to development better and
+longer-lived solutions to the systems problems faced by data developers.</p>
+
+<p>We are excited for what the future holds for the Apache Arrow project. Adding
+first-class support for a popular systems programming language like Go is an
+important step along the way. We welcome others from the Go community to get
+involved in the project. We also welcome others who wish to explore building
+Arrow support for other programming languages not yet represented. Learn more
+at <a href="https://arrow.apache.org">https://arrow.apache.org</a> and join the mailing list
+<a href="https://lists.apache.org/list.html?dev@arrow.apache.org">dev@arrow.apache.org</a>.</p>
+
+
+
+ <hr/>
+<footer class="footer">
+ <p>Apache Arrow, Arrow, Apache, the Apache feather logo, and the Apache Arrow project logo are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+ <p>© 2017 Apache Software Foundation</p>
+</footer>
+
+ </div>
+</body>
+</html>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/blog/index.html
----------------------------------------------------------------------
diff --git a/blog/index.html b/blog/index.html
index c70cc40..ac80a96 100644
--- a/blog/index.html
+++ b/blog/index.html
@@ -124,6 +124,185 @@
<div class="container">
<h2>
+ A Native Go Library for Apache Arrow
+ <a href="/blog/2018/03/22/go-code-donation/" class="permalink" title="Permalink">∞</a>
+ </h2>
+
+
+
+ <div class="panel">
+ <div class="panel-body">
+ <div>
+ <span class="label label-default">Published</span>
+ <span class="published">
+ <i class="fa fa-calendar"></i>
+ 22 Mar 2018
+ </span>
+ </div>
+ <div>
+ <span class="label label-default">By</span>
+ <a href="http://github.com/pmc"><i class="fa fa-user"></i> The Apache Arrow PMC (pmc)</a>
+ </div>
+ </div>
+ </div>
+ <!--
+
+-->
+
+<p>Since launching in early 2016, Apache Arrow has been growing fast. We have made
+nine major releases through the efforts of over 120 distinct contributors. The
+project’s scope has also expanded. We began by focusing on the development of
+the standardized in-memory columnar data format, which now serves as a pillar
+of the project. Since then, we have been growing into a more general
+cross-language platform for in-memory data analysis through new additions to
+the project like the <a href="http://arrow.apache.org/blog/2017/08/16/0.6.0-release/">Plasma shared memory object store</a>. A primary goal of
+the project is to enable data system developers to process and move data fast.</p>
+
+<p>So far, we officially have developed native Arrow implementations in C++, Java,
+and JavaScript. We have created binding layers for the C++ libraries in C
+(using the GLib libraries) and Python. We have also seen efforts to develop
+interfaces to the Arrow C++ libraries in Go, Lua, Ruby, and Rust. While binding
+layers serve many purposes, there can be benefits to native implementations,
+and so we’ve been keen to see future work on native implementations in growing
+systems languages like Go and Rust.</p>
+
+<p>This past October, engineers <a href="https://github.com/stuartcarnie">Stuart Carnie</a>, <a href="https://github.com/nathanielc">Nathaniel Cook</a>, and
+<a href="https://github.com/goller">Chris Goller</a>, employees of <a href="https://influxdata.com">InfluxData</a>, began developing a native [Go
+language implementation of the <a href="https://github.com/influxdata/arrow">Apache Arrow</a> in-memory columnar format for
+use in Go-based database systems like InfluxDB. We are excited to announce that
+InfluxData has donated this native Go implementation to the Apache Arrow
+project, where it will continue to be developed. This work features low-level
+integration with the Go runtime and native support for SIMD instruction
+sets. We are looking forward to working more closely with the Go community on
+solving in-memory analytics and data interoperability problems.</p>
+
+<div align="center">
+<img src="/img/native_go_implementation.png" alt="Apache Arrow implementations and bindings" width="60%" class="img-responsive" />
+</div>
+
+<p>One of the mantras in <a href="https://www.apache.org">The Apache Software Foundation</a> is “Community over
+Code”. By building an open and collaborative development community across many
+programming language ecosystems, we will be able to development better and
+longer-lived solutions to the systems problems faced by data developers.</p>
+
+<p>We are excited for what the future holds for the Apache Arrow project. Adding
+first-class support for a popular systems programming language like Go is an
+important step along the way. We welcome others from the Go community to get
+involved in the project. We also welcome others who wish to explore building
+Arrow support for other programming languages not yet represented. Learn more
+at <a href="https://arrow.apache.org">https://arrow.apache.org</a> and join the mailing list
+<a href="https://lists.apache.org/list.html?dev@arrow.apache.org">dev@arrow.apache.org</a>.</p>
+
+
+ </div>
+
+
+
+
+
+ <div class="container">
+ <h2>
+ Apache Arrow 0.9.0 Release
+ <a href="/blog/2018/03/22/0.9.0-release/" class="permalink" title="Permalink">∞</a>
+ </h2>
+
+
+
+ <div class="panel">
+ <div class="panel-body">
+ <div>
+ <span class="label label-default">Published</span>
+ <span class="published">
+ <i class="fa fa-calendar"></i>
+ 22 Mar 2018
+ </span>
+ </div>
+ <div>
+ <span class="label label-default">By</span>
+ <a href="http://wesmckinney.com"><i class="fa fa-user"></i> Wes McKinney (wesm)</a>
+ </div>
+ </div>
+ </div>
+ <!--
+
+-->
+
+<p>The Apache Arrow team is pleased to announce the 0.9.0 release. It is the
+product of over 3 months of development and includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.9.0"><strong>260 resolved
+JIRAs</strong></a>.</p>
+
+<p>While we made some of backwards-incompatible columnar binary format changes in
+last December’s 0.8.0 release, the 0.9.0 release is backwards-compatible with
+0.8.0. We will be working toward a 1.0.0 release this year, which will mark
+longer-term binary stability for the Arrow columnar format and metadata.</p>
+
+<p>See the <a href="https://arrow.apache.org/install">Install Page</a> to learn how to get the libraries for your
+platform. The <a href="https://arrow.apache.org/release/0.8.0.html">complete changelog</a> is also available.</p>
+
+<p>We discuss some highlights from the release and other project news in this
+post. This release has been overall focused more on bug fixes, compatibility,
+and stability compared with previous releases which have pushed more on new and
+expanded features.</p>
+
+<h2 id="new-arrow-committers-and-pmc-members">New Arrow committers and PMC members</h2>
+
+<p>Since the last release, we have added 2 new Arrow committers: <a href="https://github.com/theneuralbit">Brian
+Hulette</a> and <a href="https://github.com/robertnishihara">Robert Nishihara</a>. Additionally, <a href="https://github.com/cpcloud">Phillip Cloud</a> and
+<a href="https://github.com/pcmoritz">Philipp Moritz</a> have been promoted from committer to PMC
+member. Congratulations and thank you for your contributions!</p>
+
+<h2 id="plasma-object-store-improvements">Plasma Object Store Improvements</h2>
+
+<p>The Plasma Object Store now supports managing interprocess shared memory on
+CUDA-enabled GPUs. We are excited to see more GPU-related functionality develop
+in Apache Arrow, as this has become a key computing environment for scalable
+machine learning.</p>
+
+<h2 id="python-improvements">Python Improvements</h2>
+
+<p><a href="https://github.com/pitrou">Antoine Pitrou</a> has joined the Python development efforts and helped
+significantly this release with interoperability with built-in CPython data
+structures and NumPy structured data types.</p>
+
+<ul>
+ <li>New experimental support for reading Apache ORC files</li>
+ <li><code class="highlighter-rouge">pyarrow.array</code> now accepts lists of tuples or Python dicts for creating
+Arrow struct type arrays.</li>
+ <li>NumPy structured dtypes (which are row/record-oriented) can be directly
+converted to Arrow struct (column-oriented) arrays</li>
+ <li>Python 3.6 <code class="highlighter-rouge">pathlib</code> objects for file paths are now accepted in many file
+APIs, including for Parquet files</li>
+ <li>Arrow integer arrays with nulls can now be converted to NumPy object arrays
+with <code class="highlighter-rouge">None</code> values</li>
+ <li>New <code class="highlighter-rouge">pyarrow.foreign_buffer</code> API for interacting with memory blocks located
+at particular memory addresses</li>
+</ul>
+
+<h2 id="java-improvements">Java Improvements</h2>
+
+<p>Java now fully supports the <code class="highlighter-rouge">FixedSizeBinary</code> data type.</p>
+
+<h2 id="javascript-improvements">JavaScript Improvements</h2>
+
+<p>The JavaScript library has been significantly refactored and expanded. We are
+making separate Apache releases (most recently <code class="highlighter-rouge">JS-0.3.1</code>) for JavaScript,
+which are being <a href="https://www.npmjs.com/package/apache-arrow">published to NPM</a>.</p>
+
+<h2 id="upcoming-roadmap">Upcoming Roadmap</h2>
+
+<p>In the coming months, we will be working to move Apache Arrow closer to a 1.0.0
+release. We will also be discussing plans to develop native Arrow-based
+computational libraries within the project.</p>
+
+
+ </div>
+
+
+
+
+
+ <div class="container">
+ <h2>
Apache Arrow 0.8.0 Release
<a href="/blog/2017/12/18/0.8.0-release/" class="permalink" title="Permalink">∞</a>
</h2>
@@ -150,7 +329,7 @@
-->
<p>The Apache Arrow team is pleased to announce the 0.8.0 release. It is the
-product of 10 weeks of development andincludes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.0"><strong>286 resolved JIRAs</strong></a> with
+product of 10 weeks of development and includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.0"><strong>286 resolved JIRAs</strong></a> with
many new features and bug fixes to the various language implementations. This
is the largest release since 0.3.0 earlier this year.</p>
@@ -310,7 +489,7 @@ implementations and bindings to more languages.</p>
<div class="container">
<h2>
Improvements to Java Vector API in Apache Arrow 0.8.0
- <a href="/blog/2017/12/18/java-vector-improvements/" class="permalink" title="Permalink">∞</a>
+ <a href="/blog/2017/12/19/java-vector-improvements/" class="permalink" title="Permalink">∞</a>
</h2>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/docs/ipc.html
----------------------------------------------------------------------
diff --git a/docs/ipc.html b/docs/ipc.html
index 5022c80..a825908 100644
--- a/docs/ipc.html
+++ b/docs/ipc.html
@@ -146,7 +146,7 @@
<ul>
<li>A length prefix indicating the metadata size</li>
- <li>The message metadata as a <a href="https://github.com/google/flatbuffers">Flatbuffer</a></li>
+ <li>The message metadata as a <a href="https://github.com/google]/flatbuffers">Flatbuffer</a></li>
<li>Padding bytes to an 8-byte boundary</li>
<li>The message body, which must be a multiple of 8 bytes</li>
</ul>
@@ -191,9 +191,7 @@ flatbuffer union), and the size of the message body:</p>
of encapsulated messages, each of which follows the format above. The schema
comes first in the stream, and it is the same for all of the record batches
that follow. If any fields in the schema are dictionary-encoded, one or more
-<code class="highlighter-rouge">DictionaryBatch</code> messages will be included. <code class="highlighter-rouge">DictionaryBatch</code> and
-<code class="highlighter-rouge">RecordBatch</code> messages may be interleaved, but before any dictionary key is used
-in a <code class="highlighter-rouge">RecordBatch</code> it should be defined in a <code class="highlighter-rouge">DictionaryBatch</code>.</p>
+<code class="highlighter-rouge">DictionaryBatch</code> messages will follow the schema.</p>
<div class="highlighter-rouge"><pre class="highlight"><code><SCHEMA>
<DICTIONARY 0>
@@ -201,10 +199,6 @@ in a <code class="highlighter-rouge">RecordBatch</code> it should be defined in
<DICTIONARY k - 1>
<RECORD BATCH 0>
...
-<DICTIONARY x DELTA>
-...
-<DICTIONARY y DELTA>
-...
<RECORD BATCH n - 1>
<EOS [optional]: int32>
</code></pre>
@@ -239,10 +233,6 @@ footer.</p>
</code></pre>
</div>
-<p>In the file format, there is no requirement that dictionary keys should be
-defined in a <code class="highlighter-rouge">DictionaryBatch</code> before they are used in a <code class="highlighter-rouge">RecordBatch</code>, as long
-as the keys are defined somewhere in the file.</p>
-
<h3 id="recordbatch-body-structure">RecordBatch body structure</h3>
<p>The <code class="highlighter-rouge">RecordBatch</code> metadata contains a depth-first (pre-order) flattened set of
@@ -316,7 +306,6 @@ the dictionaries can be properly interpreted.</p>
<div class="highlighter-rouge"><pre class="highlight"><code>table DictionaryBatch {
id: long;
data: RecordBatch;
- isDelta: boolean = false;
}
</code></pre>
</div>
@@ -326,38 +315,6 @@ in the schema, so that dictionaries can even be used for multiple fields. See
the <a href="https://github.com/apache/arrow/blob/master/format/Layout.md">Physical Layout</a> document for more about the semantics of
dictionary-encoded data.</p>
-<p>The dictionary <code class="highlighter-rouge">isDelta</code> flag allows dictionary batches to be modified
-mid-stream. A dictionary batch with <code class="highlighter-rouge">isDelta</code> set indicates that its vector
-should be concatenated with those of any previous batches with the same <code class="highlighter-rouge">id</code>. A
-stream which encodes one column, the list of strings
-<code class="highlighter-rouge">["A", "B", "C", "B", "D", "C", "E", "A"]</code>, with a delta dictionary batch could
-take the form:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code><SCHEMA>
-<DICTIONARY 0>
-(0) "A"
-(1) "B"
-(2) "C"
-
-<RECORD BATCH 0>
-0
-1
-2
-1
-
-<DICTIONARY 0 DELTA>
-(3) "D"
-(4) "E"
-
-<RECORD BATCH 1>
-3
-2
-4
-0
-EOS
-</code></pre>
-</div>
-
<h3 id="tensor-multi-dimensional-array-message-format">Tensor (Multi-dimensional Array) Message Format</h3>
<p>The <code class="highlighter-rouge">Tensor</code> message types provides a way to write a multidimensional array of
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/docs/memory_layout.html
----------------------------------------------------------------------
diff --git a/docs/memory_layout.html b/docs/memory_layout.html
index ff8f9e8..10fc82c 100644
--- a/docs/memory_layout.html
+++ b/docs/memory_layout.html
@@ -162,8 +162,9 @@ from <code class="highlighter-rouge">List<V></code> iff U and V are differ
or a fully-specified nested type. When we say slot we mean a relative type
value, not necessarily any physical storage region.</li>
<li>Logical type: A data type that is implemented using some relative (physical)
-type. For example, Decimal values are stored as 16 bytes in a fixed byte
-size array. Similarly, strings can be stored as <code class="highlighter-rouge">List<1-byte></code>.</li>
+type. For example, a Decimal value stored in 16 bytes could be stored in a
+primitive array with slot size 16 bytes. Similarly, strings can be stored as
+<code class="highlighter-rouge">List<1-byte></code>.</li>
<li>Parent and child arrays: names to express relationships between physical
value arrays in a nested type structure. For example, a <code class="highlighter-rouge">List<T></code>-type parent
array has a T-type array as its child (see more on lists below).</li>
@@ -752,9 +753,9 @@ the the types array indicates that a slot contains a different type at the index
<h2 id="dictionary-encoding">Dictionary encoding</h2>
<p>When a field is dictionary encoded, the values are represented by an array of Int32 representing the index of the value in the dictionary.
-The Dictionary is received as one or more DictionaryBatches with the id referenced by a dictionary attribute defined in the metadata (<a href="https://github.com/apache/arrow/blob/master/format/Message.fbs">Message.fbs</a>) in the Field table.
-The dictionary has the same layout as the type of the field would dictate. Each entry in the dictionary can be accessed by its index in the DictionaryBatches.
-When a Schema references a Dictionary id, it must send at least one DictionaryBatch for this id.</p>
+The Dictionary is received as a DictionaryBatch whose id is referenced by a dictionary attribute defined in the metadata (<a href="https://github.com/apache/arrow/blob/master/format/Message.fbs">Message.fbs</a>) in the Field table.
+The dictionary has the same layout as the type of the field would dictate. Each entry in the dictionary can be accessed by its index in the DictionaryBatch.
+When a Schema references a Dictionary id, it must send a DictionaryBatch for this id before any RecordBatch.</p>
<p>As an example, you could have the following data:</p>
<div class="highlighter-rouge"><pre class="highlight"><code>type: List<String>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/docs/metadata.html
----------------------------------------------------------------------
diff --git a/docs/metadata.html b/docs/metadata.html
index 858f0c0..df36202 100644
--- a/docs/metadata.html
+++ b/docs/metadata.html
@@ -531,8 +531,7 @@ logical type, which have no children) and 3 buffers:</p>
<h3 id="decimal">Decimal</h3>
-<p>Decimals are represented as a 2’s complement 128-bit (16 byte) signed integer
-in little-endian byte order.</p>
+<p>TBD</p>
<h3 id="timestamp">Timestamp</h3>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/feed.xml
----------------------------------------------------------------------
diff --git a/feed.xml b/feed.xml
index 27952f7..d4d6c6f 100644
--- a/feed.xml
+++ b/feed.xml
@@ -1,9 +1,124 @@
-<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" ><generator uri="https://jekyllrb.com/" version="3.4.3">Jekyll</generator><link href="/feed.xml" rel="self" type="application/atom+xml" /><link href="/" rel="alternate" type="text/html" /><updated>2018-02-23T11:25:04-05:00</updated><id>/</id><entry><title type="html">Apache Arrow 0.8.0 Release</title><link href="/blog/2017/12/18/0.8.0-release/" rel="alternate" type="text/html" title="Apache Arrow 0.8.0 Release" /><published>2017-12-18T23:01:00-05:00</published><updated>2017-12-18T23:01:00-05:00</updated><id>/blog/2017/12/18/0.8.0-release</id><content type="html" xml:base="/blog/2017/12/18/0.8.0-release/"><!--
+<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" ><generator uri="https://jekyllrb.com/" version="3.4.3">Jekyll</generator><link href="/feed.xml" rel="self" type="application/atom+xml" /><link href="/" rel="alternate" type="text/html" /><updated>2018-03-22T09:01:09-04:00</updated><id>/</id><entry><title type="html">A Native Go Library for Apache Arrow</title><link href="/blog/2018/03/22/go-code-donation/" rel="alternate" type="text/html" title="A Native Go Library for Apache Arrow" /><published>2018-03-22T00:00:00-04:00</published><updated>2018-03-22T00:00:00-04:00</updated><id>/blog/2018/03/22/go-code-donation</id><content type="html" xml:base="/blog/2018/03/22/go-code-donation/"><!--
+
+-->
+
+<p>Since launching in early 2016, Apache Arrow has been growing fast. We have made
+nine major releases through the efforts of over 120 distinct contributors. The
+project’s scope has also expanded. We began by focusing on the development of
+the standardized in-memory columnar data format, which now serves as a pillar
+of the project. Since then, we have been growing into a more general
+cross-language platform for in-memory data analysis through new additions to
+the project like the <a href="http://arrow.apache.org/blog/2017/08/16/0.6.0-release/">Plasma shared memory object store</a>. A primary goal of
+the project is to enable data system developers to process and move data fast.</p>
+
+<p>So far, we officially have developed native Arrow implementations in C++, Java,
+and JavaScript. We have created binding layers for the C++ libraries in C
+(using the GLib libraries) and Python. We have also seen efforts to develop
+interfaces to the Arrow C++ libraries in Go, Lua, Ruby, and Rust. While binding
+layers serve many purposes, there can be benefits to native implementations,
+and so we’ve been keen to see future work on native implementations in growing
+systems languages like Go and Rust.</p>
+
+<p>This past October, engineers <a href="https://github.com/stuartcarnie">Stuart Carnie</a>, <a href="https://github.com/nathanielc">Nathaniel Cook</a>, and
+<a href="https://github.com/goller">Chris Goller</a>, employees of <a href="https://influxdata.com">InfluxData</a>, began developing a native [Go
+language implementation of the <a href="https://github.com/influxdata/arrow">Apache Arrow</a> in-memory columnar format for
+use in Go-based database systems like InfluxDB. We are excited to announce that
+InfluxData has donated this native Go implementation to the Apache Arrow
+project, where it will continue to be developed. This work features low-level
+integration with the Go runtime and native support for SIMD instruction
+sets. We are looking forward to working more closely with the Go community on
+solving in-memory analytics and data interoperability problems.</p>
+
+<div align="center">
+<img src="/img/native_go_implementation.png" alt="Apache Arrow implementations and bindings" width="60%" class="img-responsive" />
+</div>
+
+<p>One of the mantras in <a href="https://www.apache.org">The Apache Software Foundation</a> is “Community over
+Code”. By building an open and collaborative development community across many
+programming language ecosystems, we will be able to development better and
+longer-lived solutions to the systems problems faced by data developers.</p>
+
+<p>We are excited for what the future holds for the Apache Arrow project. Adding
+first-class support for a popular systems programming language like Go is an
+important step along the way. We welcome others from the Go community to get
+involved in the project. We also welcome others who wish to explore building
+Arrow support for other programming languages not yet represented. Learn more
+at <a href="https://arrow.apache.org">https://arrow.apache.org</a> and join the mailing list
+<a href="https://lists.apache.org/list.html?dev@arrow.apache.org">dev@arrow.apache.org</a>.</p></content><author><name>pmc</name></author></entry><entry><title type="html">Apache Arrow 0.9.0 Release</title><link href="/blog/2018/03/22/0.9.0-release/" rel="alternate" type="text/html" title="Apache Arrow 0.9.0 Release" /><published>2018-03-22T00:00:00-04:00</published><updated>2018-03-22T00:00:00-04:00</updated><id>/blog/2018/03/22/0.9.0-release</id><content type="html" xml:base="/blog/2018/03/22/0.9.0-release/"><!--
+
+-->
+
+<p>The Apache Arrow team is pleased to announce the 0.9.0 release. It is the
+product of over 3 months of development and includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.9.0"><strong>260 resolved
+JIRAs</strong></a>.</p>
+
+<p>While we made some of backwards-incompatible columnar binary format changes in
+last December’s 0.8.0 release, the 0.9.0 release is backwards-compatible with
+0.8.0. We will be working toward a 1.0.0 release this year, which will mark
+longer-term binary stability for the Arrow columnar format and metadata.</p>
+
+<p>See the <a href="https://arrow.apache.org/install">Install Page</a> to learn how to get the libraries for your
+platform. The <a href="https://arrow.apache.org/release/0.8.0.html">complete changelog</a> is also available.</p>
+
+<p>We discuss some highlights from the release and other project news in this
+post. This release has been overall focused more on bug fixes, compatibility,
+and stability compared with previous releases which have pushed more on new and
+expanded features.</p>
+
+<h2 id="new-arrow-committers-and-pmc-members">New Arrow committers and PMC members</h2>
+
+<p>Since the last release, we have added 2 new Arrow committers: <a href="https://github.com/theneuralbit">Brian
+Hulette</a> and <a href="https://github.com/robertnishihara">Robert Nishihara</a>. Additionally, <a href="https://github.com/cpcloud">Phillip Cloud</a> and
+<a href="https://github.com/pcmoritz">Philipp Moritz</a> have been promoted from committer to PMC
+member. Congratulations and thank you for your contributions!</p>
+
+<h2 id="plasma-object-store-improvements">Plasma Object Store Improvements</h2>
+
+<p>The Plasma Object Store now supports managing interprocess shared memory on
+CUDA-enabled GPUs. We are excited to see more GPU-related functionality develop
+in Apache Arrow, as this has become a key computing environment for scalable
+machine learning.</p>
+
+<h2 id="python-improvements">Python Improvements</h2>
+
+<p><a href="https://github.com/pitrou">Antoine Pitrou</a> has joined the Python development efforts and helped
+significantly this release with interoperability with built-in CPython data
+structures and NumPy structured data types.</p>
+
+<ul>
+ <li>New experimental support for reading Apache ORC files</li>
+ <li><code class="highlighter-rouge">pyarrow.array</code> now accepts lists of tuples or Python dicts for creating
+Arrow struct type arrays.</li>
+ <li>NumPy structured dtypes (which are row/record-oriented) can be directly
+converted to Arrow struct (column-oriented) arrays</li>
+ <li>Python 3.6 <code class="highlighter-rouge">pathlib</code> objects for file paths are now accepted in many file
+APIs, including for Parquet files</li>
+ <li>Arrow integer arrays with nulls can now be converted to NumPy object arrays
+with <code class="highlighter-rouge">None</code> values</li>
+ <li>New <code class="highlighter-rouge">pyarrow.foreign_buffer</code> API for interacting with memory blocks located
+at particular memory addresses</li>
+</ul>
+
+<h2 id="java-improvements">Java Improvements</h2>
+
+<p>Java now fully supports the <code class="highlighter-rouge">FixedSizeBinary</code> data type.</p>
+
+<h2 id="javascript-improvements">JavaScript Improvements</h2>
+
+<p>The JavaScript library has been significantly refactored and expanded. We are
+making separate Apache releases (most recently <code class="highlighter-rouge">JS-0.3.1</code>) for JavaScript,
+which are being <a href="https://www.npmjs.com/package/apache-arrow">published to NPM</a>.</p>
+
+<h2 id="upcoming-roadmap">Upcoming Roadmap</h2>
+
+<p>In the coming months, we will be working to move Apache Arrow closer to a 1.0.0
+release. We will also be discussing plans to develop native Arrow-based
+computational libraries within the project.</p></content><author><name>wesm</name></author></entry><entry><title type="html">Apache Arrow 0.8.0 Release</title><link href="/blog/2017/12/18/0.8.0-release/" rel="alternate" type="text/html" title="Apache Arrow 0.8.0 Release" /><published>2017-12-18T23:01:00-05:00</published><updated>2017-12-18T23:01:00-05:00</updated><id>/blog/2017/12/18/0.8.0-release</id><content type="html" xml:base="/blog/2017/12/18/0.8.0-release/"><!--
-->
<p>The Apache Arrow team is pleased to announce the 0.8.0 release. It is the
-product of 10 weeks of development andincludes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.0"><strong>286 resolved JIRAs</strong></a> with
+product of 10 weeks of development and includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.0"><strong>286 resolved JIRAs</strong></a> with
many new features and bug fixes to the various language implementations. This
is the largest release since 0.3.0 earlier this year.</p>
@@ -151,7 +266,7 @@ working to improve and expand the libraries in support of downstream use cases.&
<p>We continue to look for more JavaScript, Julia, R, Rust, and other programming
language developers to join the project and expand the available
-implementations and bindings to more languages.</p></content><author><name>wesm</name></author></entry><entry><title type="html">Improvements to Java Vector API in Apache Arrow 0.8.0</title><link href="/blog/2017/12/18/java-vector-improvements/" rel="alternate" type="text/html" title="Improvements to Java Vector API in Apache Arrow 0.8.0" /><published>2017-12-18T19:00:00-05:00</published><updated>2017-12-18T19:00:00-05:00</updated><id>/blog/2017/12/18/java-vector-improvements</id><content type="html" xml:base="/blog/2017/12/18/java-vector-improvements/"><!--
+implementations and bindings to more languages.</p></content><author><name>wesm</name></author></entry><entry><title type="html">Improvements to Java Vector API in Apache Arrow 0.8.0</title><link href="/blog/2017/12/19/java-vector-improvements/" rel="alternate" type="text/html" title="Improvements to Java Vector API in Apache Arrow 0.8.0" /><published>2017-12-18T19:00:00-05:00</published><updated>2017-12-18T19:00:00-05:00</updated><id>/blog/2017/12/19/java-vector-improvements</id><content type="html" xml:base="/blog/2017/12/19/java-vector-improvements/"><!--
-->
@@ -1073,118 +1188,4 @@ systems to improve their processing performance and interoperability with other
systems.</p>
<p>We are discussing the roadmap to a future 1.0.0 release on the <a href="http://mail-archives.apache.org/mod_mbox/arrow-dev/">developer
-mailing list</a>. Please join the discussion there.</p></content><author><name>wesm</name></author></entry><entry><title type="html">Connecting Relational Databases to the Apache Arrow World with turbodbc</title><link href="/blog/2017/06/16/turbodbc-arrow/" rel="alternate" type="text/html" title="Connecting Relational Databases to the Apache Arrow World with turbodbc" /><published>2017-06-16T04:00:00-04:00</published><updated>2017-06-16T04:00:00-04:00</updated><id>/blog/2017/06/16/turbodbc-arrow</id><content type="html" xml:base="/blog/2017/06/16/turbodbc-arrow/"><!--
-
--->
-
-<p><em><a href="https://github.com/mathmagique">Michael König</a> is the lead developer of the <a href="https://github.com/blue-yonder/turbodbc">turbodbc project</a></em></p>
-
-<p>The <a href="https://arrow.apache.org/">Apache Arrow</a> project set out to become the universal data layer for
-column-oriented data processing systems without incurring serialization costs
-or compromising on performance on a more general level. While relational
-databases still lag behind in Apache Arrow adoption, the Python database module
-<a href="https://github.com/blue-yonder/turbodbc">turbodbc</a> brings Apache Arrow support to these databases using a much
-older, more specialized data exchange layer: <a href="https://en.wikipedia.org/wiki/Open_Database_Connectivity">ODBC</a>.</p>
-
-<p>ODBC is a database interface that offers developers the option to transfer data
-either in row-wise or column-wise fashion. Previous Python ODBC modules typically
-use the row-wise approach, and often trade repeated database roundtrips for simplified
-buffer handling. This makes them less suited for data-intensive applications,
-particularly when interfacing with modern columnar analytical databases.</p>
-
-<p>In contrast, turbodbc was designed to leverage columnar data processing from day
-one. Naturally, this implies using the columnar portion of the ODBC API. Equally
-important, however, is to find new ways of providing columnar data to Python users
-that exceed the capabilities of the row-wise API mandated by Python’s <a href="https://www.python.org/dev/peps/pep-0249/">PEP 249</a>.
-Turbodbc has adopted Apache Arrow for this very task with the recently released
-version 2.0.0:</p>
-
-<div class="language-python highlighter-rouge"><pre class="highlight"><code><span class="o">&gt;&gt;&gt;</span> <span class="kn">from</span> <span class="nn">turbodbc</span> <span class="kn">import</span> <span class="n">connect</span>
-<span class="o">&gt;&gt;&gt;</span> <span class="n">connection</span> <span class="o">=</span> <span class="n">connect</span><span class="p">(</span><span class="n">dsn</span><span class="o">=</span><span class="s">"My columnar database"</span><span class="p">)</span>
-<span class="o">&gt;&gt;&gt;</span> <span class="n">cursor</span> <span class="o">=</span> <span class="n">connection</span><span class="o">.</span><span class="n">cursor</span><span class="p">()</span>
-<span class="o">&gt;&gt;&gt;</span> <span class="n">cursor</span><span class="o">.</span><span class="n">execute</span><span class="p">(</span><span class="s">"SELECT some_integers, some_strings FROM my_table"</span><span class="p">)</span>
-<span class="o">&gt;&gt;&gt;</span> <span class="n">cursor</span><span class="o">.</span><span class="n">fetchallarrow</span><span class="p">()</span>
-<span class="n">pyarrow</span><span class="o">.</span><span class="n">Table</span>
-<span class="n">some_integers</span><span class="p">:</span> <span class="n">int64</span>
-<span class="n">some_strings</span><span class="p">:</span> <span class="n">string</span>
-</code></pre>
-</div>
-
-<p>With this new addition, the data flow for a result set of a typical SELECT query
-is like this:</p>
-<ul>
- <li>The database prepares the result set and exposes it to the ODBC driver using
-either row-wise or column-wise storage.</li>
- <li>Turbodbc has the ODBC driver write chunks of the result set into columnar buffers.</li>
- <li>These buffers are exposed to turbodbc’s Apache Arrow frontend. This frontend
-will create an Arrow table and fill in the buffered values.</li>
- <li>The previous steps are repeated until the entire result set is retrieved.</li>
-</ul>
-
-<p><img src="/img/turbodbc_arrow.png" alt="Data flow from relational databases to Python with turbodbc and the Apache Arrow frontend" class="img-responsive" width="75%" /></p>
-
-<p>In practice, it is possible to achieve the following ideal situation: A 64-bit integer
-column is stored as one contiguous block of memory in a columnar database. A huge chunk
-of 64-bit integers is transferred over the network and the ODBC driver directly writes
-it to a turbodbc buffer of 64-bit integers. The Arrow frontend accumulates these values
-by copying the entire 64-bit buffer into a free portion of an Arrow table’s 64-bit
-integer column.</p>
-
-<p>Moving data from the database to an Arrow table and, thus, providing it to the Python
-user can be as simple as copying memory blocks around, megabytes equivalent to hundred
-thousands of rows at a time. The absence of serialization and conversion logic renders
-the process extremely efficient.</p>
-
-<p>Once the data is stored in an Arrow table, Python users can continue to do some
-actual work. They can convert it into a <a href="https://arrow.apache.org/docs/python/pandas.html">Pandas DataFrame</a> for data analysis
-(using a quick <code class="highlighter-rouge">table.to_pandas()</code>), pass it on to other data processing
-systems such as <a href="http://spark.apache.org/">Apache Spark</a> or <a href="http://impala.apache.org/">Apache Impala (incubating)</a>, or store
-it in the <a href="http://parquet.apache.org/">Apache Parquet</a> file format. This way, non-Python systems are
-efficiently connected with relational databases.</p>
-
-<p>In the future, turbodbc’s Arrow support will be extended to use more
-sophisticated features such as <a href="https://arrow.apache.org/docs/memory_layout.html#dictionary-encoding">dictionary-encoded</a> string fields. We also
-plan to pick smaller than 64-bit <a href="https://arrow.apache.org/docs/metadata.html#integers">data types</a> where possible. Last but not
-least, Arrow support will be extended to cover the reverse direction of data
-flow, so that Python users can quickly insert Arrow tables into relational
-databases.</p>
-
-<p>If you would like to learn more about turbodbc, check out the <a href="https://github.com/blue-yonder/turbodbc">GitHub project</a> and the
-<a href="http://turbodbc.readthedocs.io/">project documentation</a>. If you want to learn more about how turbodbc implements the
-nitty-gritty details, check out parts <a href="https://tech.blue-yonder.com/making-of-turbodbc-part-1-wrestling-with-the-side-effects-of-a-c-api/">one</a> and <a href="https://tech.blue-yonder.com/making-of-turbodbc-part-2-c-to-python/">two</a> of the
-<a href="https://tech.blue-yonder.com/making-of-turbodbc-part-1-wrestling-with-the-side-effects-of-a-c-api/">“Making of turbodbc”</a> series at <a href="https://tech.blue-yonder.com/">Blue Yonder’s technology blog</a>.</p></content><author><name>MathMagique</name></author></entry><entry><title type="html">Apache Arrow 0.4.1 Release</title><link href="/blog/2017/06/14/0.4.1-release/" rel="alternate" type="text/html" title="Apache Arrow 0.4.1 Release" /><published>2017-06-14T10:00:00-04:00</published><updated>2017-06-14T10:00:00-04:00</updated><id>/blog/2017/06/14/0.4.1-release</id><content type="html" xml:base="/blog/2017/06/14/0.4.1-release/"><!--
-
--->
-
-<p>The Apache Arrow team is pleased to announce the 0.4.1 release of the
-project. This is a bug fix release that addresses a regression with Decimal
-types in the Java implementation introduced in 0.4.0 (see
-<a href="https://issues.apache.org/jira/browse/ARROW-1091">ARROW-1091</a>). There were a total of <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.4.1">31 resolved JIRAs</a>.</p>
-
-<p>See the <a href="http://arrow.apache.org/install">Install Page</a> to learn how to get the libraries for your platform.</p>
-
-<h3 id="python-wheel-installers-for-windows">Python Wheel Installers for Windows</h3>
-
-<p>Max Risuhin contributed fixes to enable binary wheel installers to be generated
-for Python 3.5 and 3.6. Thus, 0.4.1 is the first Arrow release for which
-PyArrow including bundled <a href="http://parquet.apache.org">Apache Parquet</a> support that can be installed
-with either conda or pip across the 3 major platforms: Linux, macOS, and
-Windows. Use one of:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>pip install pyarrow
-conda install pyarrow -c conda-forge
-</code></pre>
-</div>
-
-<h3 id="turbodbc-200-with-apache-arrow-support">Turbodbc 2.0.0 with Apache Arrow Support</h3>
-
-<p><a href="http://turbodbc.readthedocs.io/">Turbodbc</a>, a fast C++ ODBC interface with Python bindings, released
-version 2.0.0 including reading SQL result sets as Arrow record batches. The
-team used the PyArrow C++ API introduced in version 0.4.0 to construct
-<code class="highlighter-rouge">pyarrow.Table</code> objects inside the <code class="highlighter-rouge">turbodbc</code> library. Learn more in their
-<a href="http://turbodbc.readthedocs.io/en/latest/pages/advanced_usage.html#apache-arrow-support">documentation</a> and install with one of:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>pip install turbodbc
-conda install turbodbc -c conda-forge
-</code></pre>
-</div></content><author><name>wesm</name></author></entry></feed>
\ No newline at end of file
+mailing list</a>. Please join the discussion there.</p></content><author><name>wesm</name></author></entry></feed>
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/img/native_go_implementation.png
----------------------------------------------------------------------
diff --git a/img/native_go_implementation.png b/img/native_go_implementation.png
new file mode 100644
index 0000000..39f0952
Binary files /dev/null and b/img/native_go_implementation.png differ
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/index.html
----------------------------------------------------------------------
diff --git a/index.html b/index.html
index 6c726c5..a4b137f 100644
--- a/index.html
+++ b/index.html
@@ -120,7 +120,7 @@
<p class="lead">A cross-language development platform for in-memory data</p>
<p>
<a class="btn btn-lg btn-success" style="white-space: normal;" href="mailto:dev-subscribe@arrow.apache.org" role="button">Join Mailing List</a>
- <a class="btn btn-lg btn-primary" style="white-space: normal;" href="/install/" role="button">Install (0.8.0 Release - 18 December 2017)</a>
+ <a class="btn btn-lg btn-primary" style="white-space: normal;" href="/install/" role="button">Install (0.9.0 Release - 21 March 2018)</a>
</p>
</div>
<div class="row">
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/install/index.html
----------------------------------------------------------------------
diff --git a/install/index.html b/install/index.html
index 27f848c..28f678c 100644
--- a/install/index.html
+++ b/install/index.html
@@ -118,24 +118,24 @@
-->
-<h2 id="current-version-080">Current Version: 0.8.0</h2>
+<h2 id="current-version-090">Current Version: 0.9.0</h2>
-<h3 id="released-18-december-2017">Released: 18 December 2017</h3>
+<h3 id="released-21-march-2018">Released: 21 March 2018</h3>
-<p>See the <a href="http://arrow.apache.org/release/0.8.0.html">release notes</a> for more about what’s new.</p>
+<p>See the <a href="http://arrow.apache.org/release/0.9.0.html">release notes</a> for more about what’s new.</p>
<h3 id="source-release">Source release</h3>
<ul>
- <li><strong>Source Release</strong>: <a href="https://www.apache.org/dyn/closer.cgi/arrow/arrow-0.8.0/apache-arrow-0.8.0.tar.gz">apache-arrow-0.8.0.tar.gz</a></li>
- <li><strong>Verification</strong>: <a href="https://www.apache.org/dist/arrow/arrow-0.8.0/apache-arrow-0.8.0.tar.gz.sha512">sha512</a>, <a href="https://www.apache.org/dist/arrow/arrow-0.8.0/apache-arrow-0.8.0.tar.gz.asc">asc</a> (<a href="https://www.apache.org/dyn/closer.cgi#verify">verification instructions</a>)</li>
- <li><a href="https://github.com/apache/arrow/releases/tag/apache-arrow-0.8.0">Git tag 1d689e5</a></li>
+ <li><strong>Source Release</strong>: <a href="https://www.apache.org/dyn/closer.cgi/arrow/arrow-0.9.0/apache-arrow-0.9.0.tar.gz">apache-arrow-0.9.0.tar.gz</a></li>
+ <li><strong>Verification</strong>: <a href="https://www.apache.org/dist/arrow/arrow-0.9.0/apache-arrow-0.9.0.tar.gz.sha512">sha512</a>, <a href="https://www.apache.org/dist/arrow/arrow-0.9.0/apache-arrow-0.9.0.tar.gz.asc">asc</a> (<a href="https://www.apache.org/dyn/closer.cgi#verify">verification instructions</a>)</li>
+ <li><a href="https://github.com/apache/arrow/releases/tag/apache-arrow-0.9.0">Git tag c695a5d</a></li>
<li><a href="http://www.apache.org/dist/arrow/KEYS">PGP keys for release signatures</a></li>
</ul>
<h3 id="java-packages">Java Packages</h3>
-<p><a href="http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.arrow%22%20AND%20v%3A%220.8.0%22">Java Artifacts on Maven Central</a></p>
+<p><a href="http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.arrow%22%20AND%20v%3A%220.9.0%22">Java Artifacts on Maven Central</a></p>
<h2 id="binary-installers-for-c-c-python">Binary Installers for C, C++, Python</h2>
@@ -153,8 +153,8 @@ platforms:</p>
<p>Install them with:</p>
-<div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install arrow-cpp<span class="o">=</span>0.8.<span class="k">*</span> -c conda-forge
-conda install <span class="nv">pyarrow</span><span class="o">=</span>0.8.<span class="k">*</span> -c conda-forge
+<div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install arrow-cpp<span class="o">=</span>0.9.<span class="k">*</span> -c conda-forge
+conda install <span class="nv">pyarrow</span><span class="o">=</span>0.9.<span class="k">*</span> -c conda-forge
</code></pre>
</div>
@@ -162,11 +162,11 @@ conda install <span class="nv">pyarrow</span><span class="o">=</span>0.8.<span c
<p>We have provided binary wheels on PyPI for Linux, macOS, and Windows:</p>
-<div class="language-shell highlighter-rouge"><pre class="highlight"><code>pip install <span class="nv">pyarrow</span><span class="o">==</span>0.8.<span class="k">*</span>
+<div class="language-shell highlighter-rouge"><pre class="highlight"><code>pip install <span class="nv">pyarrow</span><span class="o">==</span>0.9.<span class="k">*</span>
</code></pre>
</div>
-<p>We recommend pinning <code class="highlighter-rouge">0.8.*</code> in <code class="highlighter-rouge">requirements.txt</code> to install the latest patch
+<p>We recommend pinning <code class="highlighter-rouge">0.9.*</code> in <code class="highlighter-rouge">requirements.txt</code> to install the latest patch
release.</p>
<p>These include the Apache Arrow and Apache Parquet C++ binary libraries bundled
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/74ed9477/powered_by/index.html
----------------------------------------------------------------------
diff --git a/powered_by/index.html b/powered_by/index.html
index 0fb59f2..2b2b111 100644
--- a/powered_by/index.html
+++ b/powered_by/index.html
@@ -193,6 +193,7 @@ handles. This work is part of the <a href="https://gpuopenanalytics.com/">GPU Op
<li><strong><a href="https://pandas.pydata.org">pandas</a>:</strong> data analysis toolkit for Python programmers. pandas
supports reading and writing Parquet files using pyarrow. Several pandas
core developers are also contributors to Apache Arrow.</li>
+ <li><strong><a href="https://github.com/jpmorganchase/perspective">Perspective</a>:</strong> Perspective is a streaming data visualization engine in JavaScript for building real-time & user-configurable analytics entirely in the browser.</li>
<li><strong><a href="https://quiltdata.com/">Quilt Data</a>:</strong> Quilt is a data package manager, designed to make
managing data as easy as managing code. It supports Parquet format via
pyarrow for data access.</li>