[PRE REVIEW]: AMLTK: A Modular AutoML Toolkit in Python

[editorialbot]

Submitting author: @eddiebergman (Edward Bergman)
Repository: https://github.com/automl/amltk
Branch with paper.md (empty if default branch): joss-paper
Version: v1.3.4
Editor: @JBorrow
Reviewers: @gomezzz, @woznicak, @hirzel
Managing EiC: Arfon Smith

Status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/63a52e26b9e3bb3cfb7e028df69d6fe5"><img src="https://joss.theoj.org/papers/63a52e26b9e3bb3cfb7e028df69d6fe5/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/63a52e26b9e3bb3cfb7e028df69d6fe5/status.svg)](https://joss.theoj.org/papers/63a52e26b9e3bb3cfb7e028df69d6fe5)

Author instructions

Thanks for submitting your paper to JOSS @eddiebergman. Currently, there isn't a JOSS editor assigned to your paper.

@eddiebergman if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). You can search the list of people that have already agreed to review and may be suitable for this submission.

Editor instructions

The JOSS submission bot @editorialbot is here to help you find and assign reviewers and start the main review. To find out what @editorialbot can do for you type:

@editorialbot commands

[editorialbot]

Hello human, I'm @editorialbot, a robot that can help you with some common editorial tasks.

For a list of things I can do to help you, just type:

@editorialbot commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@editorialbot generate pdf

[editorialbot]

Software report:

github.com/AlDanial/cloc v 1.88  T=0.21 s (819.7 files/s, 144138.9 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
Python                         110           4948           6589          12376
Markdown                        34            955              0           2762
SVG                             11              6             10            967
YAML                             8             31             13            527
HTML                             5             48              0            268
TOML                             1             30             14            266
TeX                              1             17              0            133
CSS                              1             17              6             87
-------------------------------------------------------------------------------
SUM:                           171           6052           6632          17386
-------------------------------------------------------------------------------


gitinspector failed to run statistical information for the repository

[editorialbot]

Wordcount for paper.md is 1189

[editorialbot]

⚠️ An error happened when generating the pdf. Problem with affiliations for Matthias Feurer, perhaps the affiliations index need quoting?.

[editorialbot]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

OK DOIs

- None

MISSING DOIs

- 10.1109/tpami.2021.3067763 may be a valid DOI for title: Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL
- 10.21105/joss.01132 may be a valid DOI for title: GAMA: Genetic Automated Machine Learning Assistant
- 10.1007/s10994-022-06200-0 may be a valid DOI for title: Naive automated machine learning
- 10.1145/2908812.2908918 may be a valid DOI for title: Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science
- 10.1371/journal.pdig.0000276 may be a valid DOI for title: AutoPrognosis 2.0: Democratizing Diagnostic and Prognostic Modeling in Healthcare with Automated Machine Learning

INVALID DOIs

- None

[arfon]

@eddiebergman - thanks for your submission to JOSS. We're currently managing a large backlog of submissions and the editor most appropriate for your area is already rather busy.

For now, we will need to waitlist this paper and process it as the queue reduces. Thanks for your patience!

[eddiebergman]

@arfon No worries, we're looking forward to a review whenever the reviewer has availability :)

[eddiebergman]

@editorialbot generate pdf

[editorialbot]

👉📄 Download article proof 📄 View article proof on GitHub 📄 👈

[editorialbot]

Five most similar historical JOSS papers:

GAMA: Genetic Automated Machine learning Assistant
Submitting author: @PGijsbers
Handling editor: @arokem (Retired)
Reviewers: @jsgalan
Similarity score: 0.8675

PyAutoFit: A Classy Probabilistic Programming Language for Model Composition and Fitting
Submitting author: @Jammy2211
Handling editor: @dfm (Active)
Reviewers: @arm61, @karllark
Similarity score: 0.8230

ADaPT-ML: A Data Programming Template for Machine Learning
Submitting author: @nulberry
Handling editor: @jmschrei (Active)
Reviewers: @aaronpeikert, @wincowgerDEV
Similarity score: 0.8186

AutoFunc: A Python package for automating and verifying functional modeling
Submitting author: @AlexMikes
Handling editor: @gkthiruvathukal (Active)
Reviewers: @cmccomb, @e-dub, @srmnitc
Similarity score: 0.8185

AutoClassWrapper: a Python wrapper for AutoClass C classification
Submitting author: @pierrepo
Handling editor: @trallard (Retired)
Reviewers: @rpetit3, @lowandrew
Similarity score: 0.8171

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

[arfon]

@editorialbot invite @JBorrow as editor

👋 @JBorrow – would you be willing to edit this submission for JOSS?

[editorialbot]

Invitation to edit this submission sent!

[JBorrow]

Happy to edit this submission!

[JBorrow]

@editorialbot assign me as editor

[editorialbot]

Assigned! @JBorrow is now the editor

[JBorrow]

@eddiebergman I will be the handling editor for this submission; the next step in the process is for us to reach out to potential reviewers. If you have anyone in mind who would be appropriate, please do let me know! The guide for reviewers is available at: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html.

[JBorrow]

Hi @Jammy2211, would you be willing to review this submission to JOSS?

[eddiebergman]

Hi @JBorrow, there are a few names we could recommend. How best to forward these to you or shall I put their names here in the issue.

Further:

• Do we need to provide github handles?
• Do we need to provide emails?

[Jammy2211]

@JBorrow I've got two MNRAS reviews on the go (one I accepted yesterday before your invite) so I'll need to pass this time, thanks!

[JBorrow]

@eddiebergman if you could please write their GitHub handles here but without mentioning them, I would appreciate it (i.e. JBorrow, not @JBorrow).

[JBorrow]

Hi @eddiebergman, just a quick reminder that I'm waiting for the list of potential reviewers that you have as suggestions.

[eddiebergman]

Hi @JBorrow, thank you very much for the reminder!

• Martin Hirzel hirzel - One of the main contributors to IMB Lale AutoML Tool and second author of the paper.
• Felix Mohr fmohr - Author of ML-Plan.
• Anna Kozak kozaka93 - Automated machine learning and responsible machine learning
• Katarzyna Woźnica woznicak - PhD student in Machine Learning and AutoML

To the best of our knowledge, none of these proposed reviewers have a COI with any of the authors. Please let me know if you need more names!

[JBorrow]

Thank you for providing these! I will start asking some people if they are available for reviews.

[JBorrow]

Hi @GarrettMerz, I found your handle using the JOSS review volunteer application. Would you be interested in reviewing this package for JOSS? Our review guidelines are available here: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html should you want to take a look before agreeing to review.

[JBorrow]

Hi @hirzel, you were suggested as a potential reviewer for this paper and repository by one of the authors. Would you be interested in reviewing this package for the Journal of Open Source Software? We are a diamond open access journal focused on sharing and improving software. Our review guidelines are available here: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html should you want to take a look before agreeing to review.

[JBorrow]

Hi @woznicak, you were suggested as a potential reviewer for this paper and repository by one of the authors. Would you be interested in reviewing this package for the Journal of Open Source Software? We are a diamond open access journal focused on sharing and improving software. Our review guidelines are available here: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html should you want to take a look before agreeing to review.

[JBorrow]

Hi @gomezzz, I found your handle using the JOSS review volunteer application. Would you be interested in reviewing this package for JOSS? Our review guidelines are available here: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html should you want to take a look before agreeing to review.

[hirzel]

Sorry for the delayed reply ... your reviewing process seems to be very different from that for typical academic papers, so I want to scrutinize the guidelines before committing to this.

[JBorrow]

No worries @hirzel. Thank you for considering! Please do let me know if you have any questions about the review process or the journal more generally.

[gomezzz]

Hi @JBorrow ,
Sure I'd be happy to review.

[woznicak]

Hello @JBorrow ,
I'd also be happy to review.

[hirzel]

Hi @JBorrow yes I would be happy to review this paper.

[JBorrow]

Fantastic, thank you all so much! I will now assign you all as reviewers, and we will move to a different GitHub issue where the review will take place in the open. Please, if you have any further questions, do not hesitate to ask me.

[JBorrow]

@editorialbot add @gomezzz as reviewer

[editorialbot]

@gomezzz added to the reviewers list!

[JBorrow]

@editorialbot add @woznicak as reviewer

[editorialbot]

@woznicak added to the reviewers list!

[JBorrow]

@editorialbot add @hirzel as reviewer

[editorialbot]

@hirzel added to the reviewers list!

[JBorrow]

@editorialbot start review

[editorialbot]

OK, I've started the review over in #6367.