ARROW-43: Python: format array values to in repr for interactive computing #21

wesm · 2016-03-08T06:24:38Z

No description provided.

wesm · 2016-03-08T06:25:34Z

In [1]: from pandas.util.testing import rands

In [2]: import arrow

In [3]: arr = arrow.from_pylist([rands(10) for i in range(100)])

In [4]: arr
Out[4]: 
<arrow.array.StringArray object at 0x7fa18c162458>
[
  'EnlVTCtpvf',
  'sRblWEmOn3',
  'O2eDmvLCHe',
  'tsyM8vvmFr',
  'E45bXGo7I6',
  'IsuSa0kKFd',
  'lzCdv1Q3Jk',
  '9hlTjpXhDX',
  'zafUvF40tW',
  'QyA4RYrMqF',
  ...
  '7UJOYaZKe0',
  'psRrt3whyc',
  'k4EXJ8tKQg',
  'vocEm3M385',
  'yJdinYjNix',
  '2wCr2LJObu',
  'kiAPdSzBKC',
  'JKK9RWiKuF',
  'gt7Z1YWLS7',
  'BD3SrPMW4O'
]

In [5]: arr = arrow.from_pylist([[[['foo', 'bar'], ['qux'], None, []]]])

In [6]: arr
Out[6]: 
<arrow.array.ListArray object at 0x7fa18c167868>
[
  [[['foo',
     'bar'],
    ['qux'],
    NA,
    []]]
]

Author: Kashif Rasul <kashif.rasul@gmail.com> Author: Kashif Rasul <kashif.rasul@zalando.de> Closes apache#21 from kashif/PARQUET-449 and squashes the following commits: 5ebcba6 [Kashif Rasul] get rid of make clean to fix linux compile issue 15294f4 [Kashif Rasul] updated thrift version to 0.9.3 0fb3846 [Kashif Rasul] updated to latest parquet.thrift

Author: Kashif Rasul <kashif.rasul@gmail.com> Author: Kashif Rasul <kashif.rasul@zalando.de> Closes apache#21 from kashif/PARQUET-449 and squashes the following commits: 5ebcba6 [Kashif Rasul] get rid of make clean to fix linux compile issue 15294f4 [Kashif Rasul] updated thrift version to 0.9.3 0fb3846 [Kashif Rasul] updated to latest parquet.thrift Change-Id: I729638504d6228998a06db514e71287587f40499

This PR enables tests for `ARROW_COMPUTE`, `ARROW_DATASET`, `ARROW_FILESYSTEM`, `ARROW_HDFS`, `ARROW_ORC`, and `ARROW_IPC` (default on). #7131 enabled a minimal set of tests as a starting point. I confirmed that these tests pass locally with the current master. In the current TravisCI environment, we cannot see this result due to a lot of error messages in `arrow-utility-test`. ``` $ git log | head -1 commit ed5f534 % ctest ... Start 1: arrow-array-test 1/51 Test #1: arrow-array-test ..................... Passed 4.62 sec Start 2: arrow-buffer-test 2/51 Test #2: arrow-buffer-test .................... Passed 0.14 sec Start 3: arrow-extension-type-test 3/51 Test #3: arrow-extension-type-test ............ Passed 0.12 sec Start 4: arrow-misc-test 4/51 Test #4: arrow-misc-test ...................... Passed 0.14 sec Start 5: arrow-public-api-test 5/51 Test #5: arrow-public-api-test ................ Passed 0.12 sec Start 6: arrow-scalar-test 6/51 Test #6: arrow-scalar-test .................... Passed 0.13 sec Start 7: arrow-type-test 7/51 Test #7: arrow-type-test ...................... Passed 0.14 sec Start 8: arrow-table-test 8/51 Test #8: arrow-table-test ..................... Passed 0.13 sec Start 9: arrow-tensor-test 9/51 Test #9: arrow-tensor-test .................... Passed 0.13 sec Start 10: arrow-sparse-tensor-test 10/51 Test #10: arrow-sparse-tensor-test ............. Passed 0.16 sec Start 11: arrow-stl-test 11/51 Test #11: arrow-stl-test ....................... Passed 0.12 sec Start 12: arrow-concatenate-test 12/51 Test #12: arrow-concatenate-test ............... Passed 0.53 sec Start 13: arrow-diff-test 13/51 Test #13: arrow-diff-test ...................... Passed 1.45 sec Start 14: arrow-c-bridge-test 14/51 Test #14: arrow-c-bridge-test .................. Passed 0.18 sec Start 15: arrow-io-buffered-test 15/51 Test #15: arrow-io-buffered-test ............... Passed 0.20 sec Start 16: arrow-io-compressed-test 16/51 Test #16: arrow-io-compressed-test ............. Passed 3.48 sec Start 17: arrow-io-file-test 17/51 Test #17: arrow-io-file-test ................... Passed 0.74 sec Start 18: arrow-io-hdfs-test 18/51 Test #18: arrow-io-hdfs-test ................... Passed 0.12 sec Start 19: arrow-io-memory-test 19/51 Test #19: arrow-io-memory-test ................. Passed 2.77 sec Start 20: arrow-utility-test 20/51 Test #20: arrow-utility-test ...................***Failed 5.65 sec Start 21: arrow-threading-utility-test 21/51 Test #21: arrow-threading-utility-test ......... Passed 1.34 sec Start 22: arrow-compute-compute-test 22/51 Test #22: arrow-compute-compute-test ........... Passed 0.13 sec Start 23: arrow-compute-boolean-test 23/51 Test #23: arrow-compute-boolean-test ........... Passed 0.15 sec Start 24: arrow-compute-cast-test 24/51 Test #24: arrow-compute-cast-test .............. Passed 0.22 sec Start 25: arrow-compute-hash-test 25/51 Test #25: arrow-compute-hash-test .............. Passed 2.61 sec Start 26: arrow-compute-isin-test 26/51 Test #26: arrow-compute-isin-test .............. Passed 0.81 sec Start 27: arrow-compute-match-test 27/51 Test #27: arrow-compute-match-test ............. Passed 0.40 sec Start 28: arrow-compute-sort-to-indices-test 28/51 Test #28: arrow-compute-sort-to-indices-test ... Passed 3.33 sec Start 29: arrow-compute-nth-to-indices-test 29/51 Test #29: arrow-compute-nth-to-indices-test .... Passed 1.51 sec Start 30: arrow-compute-util-internal-test 30/51 Test #30: arrow-compute-util-internal-test ..... Passed 0.13 sec Start 31: arrow-compute-add-test 31/51 Test #31: arrow-compute-add-test ............... Passed 0.12 sec Start 32: arrow-compute-aggregate-test 32/51 Test #32: arrow-compute-aggregate-test ......... Passed 14.70 sec Start 33: arrow-compute-compare-test 33/51 Test #33: arrow-compute-compare-test ........... Passed 7.96 sec Start 34: arrow-compute-take-test 34/51 Test #34: arrow-compute-take-test .............. Passed 4.80 sec Start 35: arrow-compute-filter-test 35/51 Test #35: arrow-compute-filter-test ............ Passed 8.23 sec Start 36: arrow-dataset-dataset-test 36/51 Test #36: arrow-dataset-dataset-test ........... Passed 0.25 sec Start 37: arrow-dataset-discovery-test 37/51 Test #37: arrow-dataset-discovery-test ......... Passed 0.13 sec Start 38: arrow-dataset-file-ipc-test 38/51 Test #38: arrow-dataset-file-ipc-test .......... Passed 0.21 sec Start 39: arrow-dataset-file-test 39/51 Test #39: arrow-dataset-file-test .............. Passed 0.12 sec Start 40: arrow-dataset-filter-test 40/51 Test #40: arrow-dataset-filter-test ............ Passed 0.16 sec Start 41: arrow-dataset-partition-test 41/51 Test #41: arrow-dataset-partition-test ......... Passed 0.13 sec Start 42: arrow-dataset-scanner-test 42/51 Test #42: arrow-dataset-scanner-test ........... Passed 0.20 sec Start 43: arrow-filesystem-test 43/51 Test #43: arrow-filesystem-test ................ Passed 1.62 sec Start 44: arrow-hdfs-test 44/51 Test #44: arrow-hdfs-test ...................... Passed 0.13 sec Start 45: arrow-feather-test 45/51 Test #45: arrow-feather-test ................... Passed 0.91 sec Start 46: arrow-ipc-read-write-test 46/51 Test #46: arrow-ipc-read-write-test ............ Passed 5.77 sec Start 47: arrow-ipc-json-simple-test 47/51 Test #47: arrow-ipc-json-simple-test ........... Passed 0.16 sec Start 48: arrow-ipc-json-test 48/51 Test #48: arrow-ipc-json-test .................. Passed 0.27 sec Start 49: arrow-json-integration-test 49/51 Test #49: arrow-json-integration-test .......... Passed 0.13 sec Start 50: arrow-json-test 50/51 Test #50: arrow-json-test ...................... Passed 0.26 sec Start 51: arrow-orc-adapter-test 51/51 Test #51: arrow-orc-adapter-test ............... Passed 1.92 sec 98% tests passed, 1 tests failed out of 51 Label Time Summary: arrow-tests = 27.38 sec (27 tests) arrow_compute = 45.11 sec (14 tests) arrow_dataset = 1.21 sec (7 tests) arrow_ipc = 6.20 sec (3 tests) unittest = 79.91 sec (51 tests) Total Test time (real) = 79.99 sec The following tests FAILED: 20 - arrow-utility-test (Failed) Errors while running CTest ``` Closes #7142 from kiszk/ARROW-8754 Authored-by: Kazuaki Ishizaki <ishizaki@jp.ibm.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>

wesm force-pushed the ARROW-43 branch from 6777d11 to e4fc57e Compare March 8, 2016 06:40

Basic array formatter, not tweaking too much for now

dee6ba2

wesm force-pushed the ARROW-43 branch from e4fc57e to dee6ba2 Compare March 8, 2016 16:08

asfgit closed this in 45cd9fd Mar 8, 2016

wesm deleted the ARROW-43 branch March 12, 2016 05:19

guyuqi mentioned this pull request Nov 22, 2018

ARROW-3849: [C++] Leverage Armv8 crc32 extension instructions to accelerate the hash computation for Arm64 #3010

Closed

brills mentioned this pull request Jun 4, 2019

importing pyarrow and Tensorflow crashes #4472

Closed

brills mentioned this pull request Jul 15, 2019

ARROW-5894: [Gandiva][C++] Added a linker script for libgandiva.so to restrict libstdc++ symbols. #4883

Closed

helloqingbing mentioned this pull request Jun 8, 2022

[Urgent]parquet-cpp write a row done without column type exception ,but cause a segfault #13339

Closed

asfimport mentioned this pull request Sep 20, 2019

[C++][Gandiva] Re-enable Gandiva JNI tests and fix Travis CI failure #22877

Closed

jorisvandenbossche mentioned this pull request Oct 6, 2023

GH-38068: [C++][CI] Fixing Parquet unittest arrow_reader_writer_test.cc compile #38069

Merged

icexelloss mentioned this pull request Jun 3, 2024

[C++] Thread deadlock in ObjectOutputStream #41862

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ARROW-43: Python: format array values to in repr for interactive computing #21

ARROW-43: Python: format array values to in repr for interactive computing #21

wesm commented Mar 8, 2016

wesm commented Mar 8, 2016

ARROW-43: Python: format array values to in __repr__ for interactive computing #21

ARROW-43: Python: format array values to in __repr__ for interactive computing #21

Conversation

wesm commented Mar 8, 2016

wesm commented Mar 8, 2016

ARROW-43: Python: format array values to in repr for interactive computing #21

ARROW-43: Python: format array values to in repr for interactive computing #21