refactor: make to_pandas() call to_arrow() and use local dtypes in DataFrame construction

[tswast]

Towards internal issue 280662868
🦕

[tswast]

Looks like some real test failures. Investigating.

=========================== short test summary info ============================
FAILED tests/system/small/test_dataframe.py::test_iloc_slice[0-0-None] - Asse...
FAILED tests/system/small/test_dataframe.py::test_dataframe_pct_change[2] - A...
FAILED tests/system/small/test_dataframe.py::test_iloc_slice[5-4-None] - Asse...
FAILED tests/system/small/test_numpy.py::test_df_ufuncs[log] - AssertionError...
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[sin] - AssertionE...
FAILED tests/system/small/test_numpy.py::test_df_ufuncs[log10] - AssertionErr...
FAILED tests/system/small/test_numpy.py::test_df_ufuncs[sqrt] - AssertionErro...
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[cos] - AssertionE...
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[tan] - AssertionE...
FAILED tests/system/small/test_numpy.py::test_series_binary_ufuncs[add] - Ass...
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[arcsin] - Asserti...
FAILED tests/system/small/test_numpy.py::test_series_binary_ufuncs[subtract]
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[arccos] - Asserti...
FAILED tests/system/small/test_numpy.py::test_series_binary_ufuncs[multiply]
FAILED tests/system/small/test_numpy.py::test_series_binary_ufuncs[divide] - ...
FAILED tests/system/small/test_series.py::test_mods[mod-float64_col-float64_col]
FAILED tests/system/small/test_numpy.py::test_series_binary_ufuncs[power] - A...
FAILED tests/system/small/test_series.py::test_divmods_series[divmod-float64_col-float64_col]
FAILED tests/system/small/test_series.py::test_mods[rmod-int64_col-float64_col]
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[arccosh] - Assert...
FAILED tests/system/small/test_series.py::test_mods[rmod-int64_too-float64_col]
FAILED tests/system/small/test_series.py::test_divmods_series[rdivmod-int64_col-float64_col]
FAILED tests/system/small/test_numpy.py::test_df_binary_ufuncs[power] - Asser...
FAILED tests/system/small/test_series.py::test_mods[rmod-float64_col-int64_col]
FAILED tests/system/small/test_series.py::test_mods[mod-int64_col-float64_col]
FAILED tests/system/small/test_series.py::test_mods[rmod-float64_col-int64_too]
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[arctanh] - Assert...
FAILED tests/system/small/test_series.py::test_divmods_series[rdivmod-float64_col-int64_col]
FAILED tests/system/small/test_series.py::test_mods[rmod-float64_col-float64_col]
FAILED tests/system/small/test_series.py::test_divmods_series[rdivmod-float64_col-float64_col]
FAILED tests/system/small/test_series.py::test_mods[mod-int64_too-float64_col]
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[log] - AssertionE...
FAILED tests/system/small/test_series.py::test_mods[mod-float64_col-int64_col]
FAILED tests/system/small/test_series.py::test_mods[mod-float64_col-int64_too]
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[log10] - Assertio...
FAILED tests/system/small/test_series.py::test_divmods_series[divmod-int64_col-float64_col]
FAILED tests/system/small/test_series.py::test_divmods_scalars[divmod--1000-float64_col]
FAILED tests/system/small/test_numpy.py::test_series_ufuncs[sqrt] - Assertion...
FAILED tests/system/small/test_series.py::test_series_iloc[5-4-None] - Assert...
FAILED tests/system/small/test_series.py::test_divmods_series[divmod-float64_col-int64_col]
FAILED tests/system/small/test_series.py::test_string_astype_float - Assertio...
FAILED tests/system/small/test_series.py::test_divmods_scalars[divmod-678-float64_col]
FAILED tests/system/small/test_series.py::test_divmods_scalars[rdivmod--1000-float64_col]
FAILED tests/system/small/test_series.py::test_divmods_scalars[rdivmod-678-float64_col]
44 failed, 1374 passed, 87 skipped, 5 xfailed, 7744 warnings in 4655.38s (1:17:35)

Edit: Fixed in c2f9d72 and 7ccb61d on latest python + pandas + pyarrow, but still failing on Python 3.9 with our minimum versions.

[gcf-merge-on-green]

Merge-on-green attempted to merge your PR for 6 hours, but it was not mergeable because either one of your required status checks failed, one of your required reviews was not approved, or there is a do not merge label. Learn more about your required status checks here: https://help.github.com/en/github/administering-a-repository/enabling-required-status-checks. You can remove and reapply the label to re-run the bot.