Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate issues with Build statistics pipeline #2211

Closed
JacobDomagala opened this issue Nov 7, 2023 · 1 comment
Closed

Investigate issues with Build statistics pipeline #2211

JacobDomagala opened this issue Nov 7, 2023 · 1 comment
Assignees

Comments

@JacobDomagala
Copy link
Contributor

Current output:

AttributeError: 'DataFrame' object has no attribute 'append'. Did you mean: '_append'?
Test files /github/workspace/build/vt/tests/test_make_runnable_micro_time.csv /github/workspace/build/vt/tests/test_make_runnable_micro_mem.csv for test: test_make_runnable_micro
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
Test files /github/workspace/build/vt/tests/test_ping_pong_am_time.csv /github/workspace/build/vt/tests/test_ping_pong_am_mem.csv for test: test_ping_pong_am
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
Test files /github/workspace/build/vt/tests/test_reduce_time.csv /github/workspace/build/vt/tests/test_reduce_mem.csv for test: test_reduce
/generate_perf_graph.py:67: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  current["run_num"] = [new_run_num for node in range(num_nodes)]
/generate_perf_graph.py:68: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  current["date"] = [new_date for node in range(num_nodes)]
/generate_perf_graph.py:69: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  current["commit"] = [commit_id for node in range(num_nodes)]
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 70, in prepare_data
    current = total_df.append(current)
  File "/usr/local/lib/python3.10/dist-packages/pandas/core/generic.py", line 6204, in __getattr__
Memory: [            name  node       mem
101  test_reduce     0  20460330
102  test_reduce     0  20460330
103  test_reduce     0  20460330
104  test_reduce     0  20460330
105  test_reduce     0  20460330
..           ...   ...       ...
197  test_reduce     0  20486545
198  test_reduce     0  20486545
199  test_reduce     0  20486545
200  test_reduce     0  20486545
201  test_reduce     0  20486545

[101 rows x 3 columns],             name  node       mem
0    test_reduce     1  20152312
1    test_reduce     1  20152312
2    test_reduce     1  20152312
3    test_reduce     1  20152312
4    test_reduce     1  20152312
..           ...   ...       ...
96   test_reduce     1  20171973
97   test_reduce     1  20178527
98   test_reduce     1  20178527
99   test_reduce     1  20178527
100  test_reduce     1  20178527

[101 rows x 3 columns]]
    return object.__getattribute__(self, name)
AttributeError: 'DataFrame' object has no attribute 'append'. Did you mean: '_append'?
Test files /github/workspace/build/vt/tests/test_collection_local_send_preallocate_time.csv /github/workspace/build/vt/tests/test_collection_local_send_preallocate_mem.csv for test: test_collection_local_send_preallocate
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
Test files /github/workspace/build/vt/tests/test_collection_local_send_time.csv /github/workspace/build/vt/tests/test_collection_local_send_mem.csv for test: test_collection_local_send
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
/tmp/ci-XJBFHmL3Gl
Traceback (most recent call last):
  File "/generate_wiki_pages.py", line 430, in <module>
    generate_graph(EXP_TEMPLATE_INST_DIR, templates_total_times_in)
  File "/generate_wiki_pages.py", line 180, in generate_graph
    ax_1.grid(b=True, color="grey", linestyle="-.", linewidth=0.5, alpha=0.8)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axes/_base.py", line 3196, in grid
    self.xaxis.grid(visible, which=which, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axis.py", line 1697, in grid
    self.set_tick_params(which='major', **gridkw)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axis.py", line 958, in set_tick_params
    kwtrans = self._translate_tick_params(kwargs)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axis.py", line 1102, in _translate_tick_params
    raise ValueError(
ValueError: keyword grid_b is not recognized; valid keywords are ['size', 'width', 'color', 'tickdir', 'pad', 'labelsize', 'labelcolor', 'labelfontfamily', 'zorder', 'gridOn', 'tick1On', 'tick2On', 'label1On', 'label2On', 'length', 'direction', 'left', 'bottom', 'right', 'top', 'labelleft', 'labelbottom', 'labelright', 'labeltop', 'labelrotation', 'grid_agg_filter', 'grid_alpha', 'grid_animated', 'grid_antialiased', 'grid_clip_box', 'grid_clip_on', 'grid_clip_path', 'grid_color', 'grid_dash_capstyle', 'grid_dash_joinstyle', 'grid_dashes', 'grid_data', 'grid_drawstyle', 'grid_figure', 'grid_fillstyle', 'grid_gapcolor', 'grid_gid', 'grid_in_layout', 'grid_label', 'grid_linestyle', 'grid_linewidth', 'grid_marker', 'grid_markeredgecolor', 'grid_markeredgewidth', 'grid_markerfacecolor', 'grid_markerfacecoloralt', 'grid_markersize', 'grid_markevery', 'grid_mouseover', 'grid_path_effects', 'grid_picker', 'grid_pickradius', 'grid_rasterized', 'grid_sketch_params', 'grid_snap', 'grid_solid_capstyle', 'grid_solid_joinstyle', 'grid_transform', 'grid_url', 'grid_visible', 'grid_xdata', 'grid_ydata', 'grid_zorder', 'grid_aa', 'grid_c', 'grid_ds', 'grid_ls', 'grid_lw', 'grid_mec', 'grid_mew', 'grid_mfc', 'grid_mfcalt', 'grid_ms']
@JacobDomagala
Copy link
Contributor Author

With DARMA-tasking/build-stats#25 merged, the issue is resolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant