Skip to content
This repository has been archived by the owner on Feb 3, 2021. It is now read-only.

Feature: Add extra spark-submit options #695

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Commits on Feb 13, 2019

  1. Feature: Add extra spark-submit options

    The following `spark-submit` options are really useful for tweaking the
    spark configuration/environment on a per-app/job basis:
    
    - `--packages`
    - `--exclude-packages`
    - `--repositories`
    - `--conf`
    - `--properties-file`
    
    The changes to the code that enable them are simply additional arguments
    to the existing API/CLI and just pass them straight through to the spark
    submit command generator. To make things consistent with the `spark-submit`
    CLI, the corresponding arguments in AZTK maintain the same names.
    jamesclarke committed Feb 13, 2019
    Configuration menu
    Copy the full SHA
    9eccec9 View commit details
    Browse the repository at this point in the history