You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/08/04 18:26:00 UTC
[jira] [Resolved] (ARROW-1328) [Python] pyarrow.Table.from_pandas
option timestamps_to_ms changes column values
[ https://issues.apache.org/jira/browse/ARROW-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney resolved ARROW-1328.
---------------------------------
Resolution: Fixed
Issue resolved by pull request 941
[https://github.com/apache/arrow/pull/941]
> [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column values
> --------------------------------------------------------------------------------
>
> Key: ARROW-1328
> URL: https://issues.apache.org/jira/browse/ARROW-1328
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 0.5.0
> Environment: MacOS 10.12.6
> python 2.7.12
> pyarrow==0.5.0
> pandas==0.20.3
> numpy==1.13.1
> python-dateutil==2.6.1
> Reporter: Florian Jetter
> Assignee: Wes McKinney
> Fix For: 0.6.0
>
>
> The {{pyarrow.Table.from_pandas}} option {{timestamps_to_ms}} changes the value of the datetime column
> {code:none}
> >>> import pyarrow as pa
> >>> import pandas as pd
> >>> from datetime import datetime
> >>>
> >>> df = pd.DataFrame({'datetime': [datetime(2017, 1, 1)]})
> >>> dtype = df['datetime'].dtype
> >>> pa_type = pa.from_numpy_dtype(dtype)
> >>> schema = pa.schema([pa.field('datetime', pa_type)])
> >>> table = pa.Table.from_pandas(df=df, schema=schema, timestamps_to_ms=True)
> >>> table.to_pandas()
> datetime
> 0 1970-01-01 00:24:43.228800
> >>> dtype
> dtype('<M8[ns]')
> >>> pa_type
> TimestampType(timestamp[ns])
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)