[PRE REVIEW]: Generating Visualizations Conversationally using LLMs

[editorialbot]

Submitting author: @buddyroo30 (Andrew Smith)
Repository: https://github.com/buddyroo30/canvasxpress_gen
Branch with paper.md (empty if default branch): JOSS-submission
Version: V1.0.1
Editor: @crvernon
Reviewers: @ahmadawais, @RahulSundar
Managing EiC: Chris Vernon

Status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47"><img src="https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47/status.svg)](https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47)

Author instructions

Thanks for submitting your paper to JOSS @buddyroo30. Currently, there isn't a JOSS editor assigned to your paper.

@buddyroo30 if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). You can search the list of people that have already agreed to review and may be suitable for this submission.

Editor instructions

The JOSS submission bot @editorialbot is here to help you find and assign reviewers and start the main review. To find out what @editorialbot can do for you type:

@editorialbot commands

[editorialbot]

Hello human, I'm @editorialbot, a robot that can help you with some common editorial tasks.

For a list of things I can do to help you, just type:

@editorialbot commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@editorialbot generate pdf

[editorialbot]

Software report:

github.com/AlDanial/cloc v 1.90  T=2.53 s (15.8 files/s, 12681.3 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
JSON                             5              0              0          28157
Python                          17            465            203           2019
HTML                             1             38              0            265
CSS                              3             30              3            226
TeX                              1             18              0            197
Markdown                         5             52              0            136
make                             2             27              0             83
Perl                             3             16             26             68
Dockerfile                       2              4              0             22
YAML                             1              1              4             19
-------------------------------------------------------------------------------
SUM:                            40            651            236          31192
-------------------------------------------------------------------------------

Commit count by author:

    76	EC2 Default User
    32	Andrew K Smith
    10	Andrew Smith

[editorialbot]

Paper file info:

📄 Wordcount for paper.md is 1896

✅ The paper includes a Statement of need section

[editorialbot]

License info:

🔴 Failed to discover a valid open source license

[editorialbot]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.48550/arXiv.2402.03216 is OK
- 10.1145/3397271.3401075 is OK
- 10.48550/arXiv.2407.21783 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Showing Examples
- No DOI given, and none found for title: CanvasXpress: A JavaScript Library for Data Analyt...
- No DOI given, and none found for title: Better language models and their implications
- No DOI given, and none found for title: Retrieval-Augmented Generation for Large Language ...
- No DOI given, and none found for title: Long-context LLMs Struggle with Long In-context Le...
- No DOI given, and none found for title: milvus-io/pymilvus
- No DOI given, and none found for title: A Quick Intro to Leave-One-Out Cross-Validation (L...
- No DOI given, and none found for title: Hello GPT-4o \textbar OpenAI
- No DOI given, and none found for title: Meet Claude
- No DOI given, and none found for title: Large Enough
- No DOI given, and none found for title: Google AI Gemini API \textbar Google AI Studio \te...
- No DOI given, and none found for title: Phi-3 Open Models - Small Language Models \textbar...
- No DOI given, and none found for title: Introducing DBRX: A New State-of-the-Art Open LLM
- No DOI given, and none found for title: GPT-4
- No DOI given, and none found for title: OpenAI vs Open-Source Multilingual Embedding Model...
- No DOI given, and none found for title: CanvasXpress: AI using LLM

❌ MISSING DOIs

- None

❌ INVALID DOIs

- None

[editorialbot]

👉📄 Download article proof 📄 View article proof on GitHub 📄 👈

[editorialbot]

Five most similar historical JOSS papers:

AstronomicAL: an interactive dashboard for visualisation, integration and classification of data with Active Learning
Submitting author: @grant-m-s
Handling editor: @crvernon (Active)
Reviewers: @crhea93, @rmorgan10
Similarity score: 0.6453

SAMBA: A Trainable Segmentation Web-App with Smart Labelling
Submitting author: @rmdocherty
Handling editor: @Kevin-Mattheus-Moerman (Active)
Reviewers: @pchlap, @jingpengw
Similarity score: 0.6318

TLViz: Visualising and analysing tensor decomposition models with Python
Submitting author: @marieroald
Handling editor: @faroit (Active)
Reviewers: @sara-02, @yiitozer
Similarity score: 0.6280

TX$^2$: Transformer eXplainability and eXploration
Submitting author: @WarmCyan
Handling editor: @fabian-s (Active)
Reviewers: @assenmacher-mat, @deniederhut
Similarity score: 0.6272

Jury: A Comprehensive Evaluation Toolkit
Submitting author: @devrimcavusoglu
Handling editor: @crvernon (Active)
Reviewers: @evamaxfield, @KennethEnevoldsen
Similarity score: 0.6241

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

[crvernon]

👋 @buddyroo30 - while I am finding you an editor, please reduce the word count of your paper to around 1000 words. Also, please add an open source license to your repository (see https://opensource.org/licenses).

[crvernon]

@editorialbot invite @logological as editor

👋 @logological are you able to take this on one as editor? Thanks!

[editorialbot]

Invitation to edit this submission sent!

[logological]

@crvernon This submission presents a problem similar to the one we had with PYLIWC (#7119) in that it is targeted at users of a proprietary tool, CanvasXpress. (Note that CanvasXpress falsely claims to be open source; it is actually distributed under a licence that covers only uses that are "personal and educational" and places heavy-handed restrictions on redistribution.) I am concerned about our ability to find reviewers who can (legally) use CanvasXpress to test the software. Before PYLIWC was rejected (for unrelated reasons), I tried and failed to find reviewers who held a licence to the proprietary software it depended on.

In any case, even if it's not strictly outside JOSS's scope, I'm not particularly comfortable editing a submission on a free/open-source tool whose only purpose is to facilitate the use of proprietary software.

What are your thoughts?

[crvernon]

@editorialbot query scope

Thank you for raising this issue @logological. I am going to place this on in review with our larger editorial board as well. So let's hold off on finding reviewers.

@buddyroo30 - please feel free to provide any comment here to address the above.

[editorialbot]

Submission flagged for editorial review.

[buddyroo30]

Hi, Thank you for the feedback on our submission. I went ahead and added an open source license as requested and I will work to reduce the word count. As for the issue around the license for CanvasXpress itself, let me discuss that with my co-author and get back to you soon.  Best,Andrew Smith Yahoo Mail: Search, Organize, Conquer On Thu, Oct 24, 2024 at 4:39 PM, Chris ***@***.***> wrote: @editorialbot query scope Thank you for raising this issue @logological. I am going to place this on in review with our larger editorial board as well. So let's hold off on finding reviewers. @buddyroo30 - please feel free to provide any comment here to address the above. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[buddyroo30]

Hi, So I discussed the license issue around CanvasXpress itself with my collaborator and he feels its current license is reasonable and does not want to change it. First, practically, the vast majority of users of CanvasXpress are academic or not for profit users, so they would be able to freely use CanvasXpress (and the associated AI enhancements we discuss in our paper) without limitation. Second, the license for CanvasXpress itself is essentially what most of the other large visualization packages use (e.g. Plotly) so CanvasXpress's license is not anything out of the ordinary. Please let us know your thoughts and if you think you could proceed with the review of the paper. thanks,Andrew Smith On Friday, October 25, 2024 at 09:57:54 AM EDT, Andrew Smith ***@***.***> wrote: Hi, Thank you for the feedback on our submission. I went ahead and added an open source license as requested and I will work to reduce the word count. As for the issue around the license for CanvasXpress itself, let me discuss that with my co-author and get back to you soon.  Best,Andrew Smith Yahoo Mail: Search, Organize, Conquer On Thu, Oct 24, 2024 at 4:39 PM, Chris ***@***.***> wrote: @editorialbot query scope Thank you for raising this issue @logological. I am going to place this on in review with our larger editorial board as well. So let's hold off on finding reviewers. @buddyroo30 - please feel free to provide any comment here to address the above. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[crvernon]

@editorialbot assign me as editor

@buddyroo30 - I will see if we can find you reviewers who have free access to this platform. If not, then we will have to reject. But let's give it a shot. I'll take this one on.

[editorialbot]

Assigned! @crvernon is now the editor

[crvernon]

👋 @RahulSundar - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress

[crvernon]

👋 @luisaforozco - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress

[crvernon]

👋 @ahmadawais - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress

[ahmadawais]

@crvernon I can try to help alongside @saqibameen our lead MLE founding engineer.

[crvernon]

@editorialbot add @ahmadawais as reviewer

[editorialbot]

@ahmadawais added to the reviewers list!

[crvernon]

👋 @saqibameen - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

[luisaforozco]

@crvernon thanks for the invitation. This field is outside of my expertise and I do not have access to CanvasXpress, so I will have to pass on reviewing this one.

[RahulSundar]

👋 @RahulSundar - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress

Hi @crvernon ! Yes, I would like to review this work.

[crvernon]

@editorialbot add @RahulSundar as reviewer

[editorialbot]

@RahulSundar added to the reviewers list!

[crvernon]

@editorialbot start review

👋 - Alright @buddyroo30, @ahmadawais, and @RahulSundar - I am going to close this Pre-Review and kick off the full review which you should receive a notification for. Thanks!

[editorialbot]

OK, I've started the review over in #7529.