Build modules: pyspark-pandas-slow

Créé Le diff n'expire jamais
32 suppressions
115 lignes
33 ajouts
116 lignes
Before
After
https://github.com/apache/spark/runs/2959035642
https://github.com/Yikun/spark/runs/2968286041

[success] Total time: 157 s (02:37), completed Jul 2, 2021 1:51:12 AM


========================================================================
========================================================================
Running Spark unit tests
Running Spark unit tests
========================================================================
========================================================================


========================================================================
========================================================================
Running PySpark tests
Running PySpark tests
========================================================================
========================================================================
'PYARROW_IGNORE_TIMEZONE' environment variable was not set. It is required to set this environment variable to '1' in both driver and executor sides if you use pyarrow>=2.0.0. pandas-on-Spark will set it for you but it does not work if there is a Spark context already launched.
Running PySpark tests. Output is in /__w/spark/spark/python/unit-tests.log
Running PySpark tests. Output is in /__w/spark/spark/python/unit-tests.log
Will test against the following Python executables: ['python3.6', 'python3.9', 'pypy3']
Will test against the following Python executables: ['python3.6', 'python3.9', 'pypy3']
Will test the following Python modules: ['pyspark-pandas-slow']
Will test the following Python modules: ['pyspark-pandas-slow']
python3.6 python_implementation is CPython
python3.6 python_implementation is CPython
python3.6 version is: Python 3.6.13
python3.6 version is: Python 3.6.13
python3.9 python_implementation is CPython
python3.9 python_implementation is CPython
python3.9 version is: Python 3.9.5
python3.9 version is: Python 3.9.5
pypy3 python_implementation is PyPy
pypy3 python_implementation is PyPy
pypy3 version is: Python 3.7.10 (7.3.5+dfsg-1~ppa1~ubuntu20.04, May 23 2021, 14:57:07)
pypy3 version is: Python 3.7.10 (7.3.5+dfsg-1~ppa1~ubuntu20.04, May 23 2021, 14:57:07)
[PyPy 7.3.5 with GCC 9.3.0]
[PyPy 7.3.5 with GCC 9.3.0]
Starting test(python3.6): pyspark.pandas.tests.indexes.test_base
Starting test(python3.6): pyspark.pandas.tests.indexes.test_base
Starting test(python3.6): pyspark.pandas.tests.indexes.test_datetime
Starting test(python3.6): pyspark.pandas.tests.indexes.test_datetime
Finished test(python3.6): pyspark.pandas.tests.indexes.test_datetime (239s)
Finished test(python3.6): pyspark.pandas.tests.indexes.test_datetime (225s)
Starting test(python3.6): pyspark.pandas.tests.test_dataframe
Starting test(python3.6): pyspark.pandas.tests.test_dataframe
Finished test(python3.6): pyspark.pandas.tests.indexes.test_base (267s)
Finished test(python3.6): pyspark.pandas.tests.indexes.test_base (257s)
Starting test(python3.6): pyspark.pandas.tests.test_groupby
Starting test(python3.6): pyspark.pandas.tests.test_groupby
Finished test(python3.6): pyspark.pandas.tests.test_dataframe (387s) ... 3 tests were skipped
Finished test(python3.6): pyspark.pandas.tests.test_dataframe (376s) ... 3 tests were skipped
Starting test(python3.6): pyspark.pandas.tests.test_indexing
Starting test(python3.6): pyspark.pandas.tests.test_indexing
Finished test(python3.6): pyspark.pandas.tests.test_indexing (164s) ... 5 tests were skipped
Finished test(python3.6): pyspark.pandas.tests.test_groupby (518s)
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames
Finished test(python3.6): pyspark.pandas.tests.test_groupby (524s)
Finished test(python3.6): pyspark.pandas.tests.test_indexing (174s) ... 5 tests were skipped
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby (194s)
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby (191s)
Starting test(python3.6): pyspark.pandas.tests.test_series
Starting test(python3.6): pyspark.pandas.tests.test_series
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames (383s) ... 2 tests were skipped
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames (373s) ... 2 tests were skipped
Starting test(python3.6): pyspark.pandas.tests.test_stats
Starting test(python3.6): pyspark.pandas.tests.test_stats
Finished test(python3.6): pyspark.pandas.tests.test_series (275s) ... 2 tests were skipped
Finished test(python3.6): pyspark.pandas.tests.test_series (268s) ... 1 tests were skipped
Starting test(python3.9): pyspark.pandas.tests.indexes.test_base
Starting test(python3.9): pyspark.pandas.tests.indexes.test_base
Finished test(python3.6): pyspark.pandas.tests.test_stats (93s)
Finished test(python3.6): pyspark.pandas.tests.test_stats (91s)
Starting test(python3.9): pyspark.pandas.tests.indexes.test_datetime
Starting test(python3.9): pyspark.pandas.tests.indexes.test_datetime
Finished test(python3.9): pyspark.pandas.tests.indexes.test_datetime (240s)
Finished test(python3.9): pyspark.pandas.tests.indexes.test_datetime (250s)
Starting test(python3.9): pyspark.pandas.tests.test_dataframe
Starting test(python3.9): pyspark.pandas.tests.test_dataframe
Finished test(python3.9): pyspark.pandas.tests.indexes.test_base (266s)
Finished test(python3.9): pyspark.pandas.tests.indexes.test_base (270s)
Starting test(python3.9): pyspark.pandas.tests.test_groupby
Starting test(python3.9): pyspark.pandas.tests.test_groupby
Finished test(python3.9): pyspark.pandas.tests.test_dataframe (355s) ... 1 tests were skipped
Finished test(python3.9): pyspark.pandas.tests.test_dataframe (364s) ... 1 tests were skipped
Starting test(python3.9): pyspark.pandas.tests.test_indexing
Starting test(python3.9): pyspark.pandas.tests.test_indexing
Finished test(python3.9): pyspark.pandas.tests.test_indexing (159s) ... 5 tests were skipped
Finished test(python3.9): pyspark.pandas.tests.test_groupby (491s)
Starting test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames
Starting test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames
Finished test(python3.9): pyspark.pandas.tests.test_groupby (498s)
Finished test(python3.9): pyspark.pandas.tests.test_indexing (156s) ... 5 tests were skipped
Starting test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames_groupby
Starting test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames_groupby
Finished test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames_groupby (203s)
Finished test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames_groupby (182s)
Starting test(python3.9): pyspark.pandas.tests.test_series
Starting test(python3.9): pyspark.pandas.tests.test_series
Finished test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames (404s)
Finished test(python3.9): pyspark.pandas.tests.test_ops_on_diff_frames (383s)
Starting test(python3.9): pyspark.pandas.tests.test_stats
Starting test(python3.9): pyspark.pandas.tests.test_stats
Finished test(python3.9): pyspark.pandas.tests.test_series (267s) ... 1 tests were skipped
Finished test(python3.9): pyspark.pandas.tests.test_series (264s) ... 1 tests were skipped
Starting test(python3.6): pyspark.pandas.frame
Starting test(python3.6): pyspark.pandas.frame
Finished test(python3.9): pyspark.pandas.tests.test_stats (102s)
Finished test(python3.9): pyspark.pandas.tests.test_stats (101s)
Starting test(python3.6): pyspark.pandas.generic
Starting test(python3.6): pyspark.pandas.generic
Finished test(python3.6): pyspark.pandas.generic (107s)
Finished test(python3.6): pyspark.pandas.generic (109s)
Starting test(python3.6): pyspark.pandas.series
Starting test(python3.6): pyspark.pandas.series
Finished test(python3.6): pyspark.pandas.series (150s)
Finished test(python3.6): pyspark.pandas.series (151s)
Starting test(python3.9): pyspark.pandas.frame
Starting test(python3.9): pyspark.pandas.frame
Finished test(python3.6): pyspark.pandas.frame (373s)
Finished test(python3.6): pyspark.pandas.frame (374s)
Starting test(python3.9): pyspark.pandas.generic
Starting test(python3.9): pyspark.pandas.generic
Finished test(python3.9): pyspark.pandas.generic (102s)
Finished test(python3.9): pyspark.pandas.generic (98s)
Starting test(python3.9): pyspark.pandas.series
Starting test(python3.9): pyspark.pandas.series
Finished test(python3.9): pyspark.pandas.series (145s)
Finished test(python3.9): pyspark.pandas.series (138s)
Finished test(python3.9): pyspark.pandas.frame (344s)
Finished test(python3.9): pyspark.pandas.frame (338s)
Tests passed in 3132 seconds
Tests passed in 3083 seconds


Skipped tests in pyspark.pandas.tests.test_dataframe with python3.6:
Skipped tests in pyspark.pandas.tests.test_dataframe with python3.6:
test_astype_extension_float_dtypes (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)
test_astype_extension_float_dtypes (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)
test_extension_float_dtypes (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)
test_extension_float_dtypes (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)
test_to_markdown (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)
test_to_markdown (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)


Skipped tests in pyspark.pandas.tests.test_indexing with python3.6:
Skipped tests in pyspark.pandas.tests.test_indexing with python3.6:
test_getitem_period_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_getitem_period_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_getitem_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_getitem_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc2d_duplicated_columns (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc2d_duplicated_columns (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_datetime_no_freq (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_datetime_no_freq (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)


Skipped tests in pyspark.pandas.tests.test_ops_on_diff_frames with python3.6:
Skipped tests in pyspark.pandas.tests.test_ops_on_diff_frames with python3.6:
test_arithmetic_chain_extension_float_dtypes (pyspark.pandas.tests.test_ops_on_diff_frames.OpsOnDiffFramesEnabledTest) ... SKIP (0.000s)
test_arithmetic_chain_extension_float_dtypes (pyspark.pandas.tests.test_ops_on_diff_frames.OpsOnDiffFramesEnabledTest) ... SKIP (0.000s)
test_arithmetic_extension_float_dtypes (pyspark.pandas.tests.test_ops_on_diff_frames.OpsOnDiffFramesEnabledTest) ... SKIP (0.000s)
test_arithmetic_extension_float_dtypes (pyspark.pandas.tests.test_ops_on_diff_frames.OpsOnDiffFramesEnabledTest) ... SKIP (0.000s)


Skipped tests in pyspark.pandas.tests.test_series with python3.6:
Skipped tests in pyspark.pandas.tests.test_series with python3.6:
test_extension_float_dtypes (pyspark.pandas.tests.test_series.SeriesTest) ... SKIP (0.000s)
test_to_markdown (pyspark.pandas.tests.test_series.SeriesTest) ... SKIP (0.000s)
test_to_markdown (pyspark.pandas.tests.test_series.SeriesTest) ... SKIP (0.000s)


Skipped tests in pyspark.pandas.tests.test_dataframe with python3.9:
Skipped tests in pyspark.pandas.tests.test_dataframe with python3.9:
test_to_markdown (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)
test_to_markdown (pyspark.pandas.tests.test_dataframe.DataFrameTest) ... SKIP (0.000s)


Skipped tests in pyspark.pandas.tests.test_indexing with python3.9:
Skipped tests in pyspark.pandas.tests.test_indexing with python3.9:
test_getitem_period_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_getitem_period_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_getitem_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_getitem_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc2d_duplicated_columns (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc2d_duplicated_columns (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_datetime_no_freq (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_datetime_no_freq (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)
test_loc_timestamp_str (pyspark.pandas.tests.test_indexing.IndexingTest) ... SKIP (0.000s)


Skipped tests in pyspark.pandas.tests.test_series with python3.9:
Skipped tests in pyspark.pandas.tests.test_series with python3.9:
test_to_markdown (pyspark.pandas.tests.test_series.SeriesTest) ... SKIP (0.000s)
test_to_markdown (pyspark.pandas.tests.test_series.SeriesTest) ... SKIP (0.000s)


========================================================================
========================================================================
Running PySpark packaging tests
Running PySpark packaging tests
========================================================================
========================================================================
Constructing virtual env for testing
Constructing virtual env for testing
Using conda virtual environments
Using conda virtual environments
Testing pip installation with python 3.6
Testing pip installation with python 3.6
Using /tmp/tmp.mwfAxdmDS8 for virtualenv
Using /tmp/tmp.2jQ3LTvgpf for virtualenv
Collecting package metadata (current_repodata.json): ...working... done
Collecting package metadata (current_repodata.json): ...working... done
Solving environment: ...working... failed with repodata from current_repodata.json, will retry with next repodata source.
Solving environment: ...working... failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): ...working... done
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... done
Solving environment: ...working... done