Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added script to create LICENSES.md file. #966

Merged
merged 2 commits into from
Sep 7, 2021

Conversation

jorgecarleitao
Copy link
Member

Alternative to #920: goes through all dependencies and fetches the license and repo from cargo metadata.

Example of output:


This software is built and contains the following software:

(automatically generated via cargo-license)

adler 1.0.2

ahash 0.7.2

aho-corasick 0.7.15

alloc-no-stdlib 2.0.1

alloc-stdlib 0.2.1

arrayref 0.3.6

arrayvec 0.5.2

arrow 5.3.0

async-trait 0.1.50

atty 0.2.14

base64 0.13.0

bitflags 1.2.1

blake2b_simd 0.5.11

block-buffer 0.9.0

brotli 3.3.0

brotli-decompressor 2.3.1

bstr 0.2.15

byteorder 1.4.3

cfg-if 1.0.0

chrono 0.4.19

constant_time_eq 0.1.5

cpuid-bool 0.1.2

crc32fast 1.2.1

crossbeam-utils 0.8.4

csv 1.1.6

csv-core 0.1.10

datafusion 0.3.0

datafusion 4.0.0-SNAPSHOT

digest 0.9.0

dirs 1.0.5

encode_unicode 0.3.6

flatbuffers 2.0.0

flate2 1.0.20

futures 0.3.14

futures-channel 0.3.14

futures-core 0.3.14

futures-executor 0.3.14

futures-io 0.3.14

futures-macro 0.3.14

futures-sink 0.3.14

futures-task 0.3.14

futures-util 0.3.14

generic-array 0.14.4

getrandom 0.1.16

getrandom 0.2.2

hashbrown 0.9.1

hashbrown 0.11.2

hermit-abi 0.1.18

hex 0.4.3

indexmap 1.6.2

indoc 0.3.6

indoc-impl 0.3.6

instant 0.1.9

integer-encoding 1.1.7

itoa 0.4.7

lazy_static 1.4.0

lexical-core 0.7.6

libc 0.2.94

lock_api 0.4.3

log 0.4.14

lz4 1.23.2

lz4-sys 1.9.2

md-5 0.9.1

memchr 2.3.4

miniz_oxide 0.4.4

multiversion 0.6.1

multiversion-macros 0.6.1

num 0.4.0

num-bigint 0.4.0

num-complex 0.4.0

num-integer 0.1.44

num-iter 0.1.42

num-rational 0.4.0

num-traits 0.2.14

num_cpus 1.13.0

once_cell 1.7.2

opaque-debug 0.3.0

ordered-float 1.1.1

ordered-float 2.1.1

parking_lot 0.11.1

parking_lot_core 0.8.3

parquet 5.3.0

parquet-format 2.6.1

paste 0.1.18

paste 1.0.5

paste-impl 0.1.18

pin-project-lite 0.2.6

pin-utils 0.1.0

ppv-lite86 0.2.10

prettytable-rs 0.8.0

proc-macro-hack 0.5.19

proc-macro-nested 0.1.7

proc-macro2 1.0.26

pyo3 0.14.4

pyo3-build-config 0.14.4

pyo3-macros 0.14.4

pyo3-macros-backend 0.14.4

quote 1.0.9

rand 0.7.3

rand 0.8.3

rand_chacha 0.2.2

rand_chacha 0.3.0

rand_core 0.5.1

rand_core 0.6.2

rand_hc 0.2.0

rand_hc 0.3.0

redox_syscall 0.1.57

redox_syscall 0.2.7

redox_users 0.3.5

regex 1.4.6

regex-automata 0.1.9

regex-syntax 0.6.23

rust-argon2 0.8.3

ryu 1.0.5

scopeguard 1.1.0

serde 1.0.125

serde_derive 1.0.125

serde_json 1.0.64

sha2 0.9.3

slab 0.4.3

smallvec 1.6.1

snap 1.0.4

sqlparser 0.9.0

static_assertions 1.1.0

syn 1.0.71

term 0.5.2

thiserror 1.0.24

thiserror-impl 1.0.24

threadpool 1.8.1

thrift 0.13.0

  • source: None
  • license: Apache-2.0

time 0.1.43

tokio 1.5.0

tokio-macros 1.1.0

tokio-stream 0.1.5

typenum 1.13.0

unicode-segmentation 1.7.1

unicode-width 0.1.8

unicode-xid 0.2.1

unindent 0.1.7

wasi 0.9.0+wasi-snapshot-preview1

wasi 0.10.2+wasi-snapshot-preview1

winapi 0.3.9

winapi-i686-pc-windows-gnu 0.4.0

winapi-x86_64-pc-windows-gnu 0.4.0

zstd 0.9.0+zstd.1.5.0

zstd-safe 4.1.1+zstd.1.5.0

zstd-sys 1.6.1+zstd.1.5.0

@jorgecarleitao jorgecarleitao added the development-process Related to development process of DataFusion label Sep 3, 2021
@jorgecarleitao
Copy link
Member Author

jorgecarleitao commented Sep 3, 2021

I am not married to any of this code; it is just demonstrating how it can be done. The script was ran as

cd python && python ../dev/create_python_notice.py

but running from other places (ballista) would do the same thing.

Copy link
Member

@houqp houqp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jorgecarleitao ! I think it's a good idea to make it not specific to the python binding since we would need to do the same thing for future ballista binary releases :)

dev/create_python_notice.py Outdated Show resolved Hide resolved
dev/create_python_notice.py Outdated Show resolved Hide resolved
@houqp houqp added this to the 5.1.0 milestone Sep 3, 2021
@houqp
Copy link
Member

houqp commented Sep 3, 2021

should we also include the generated license file for the python binding in this PR?

@mmuru
Copy link
Contributor

mmuru commented Sep 3, 2021

Not sure whether there was a typo, just wanna called out here.

datafusion 0.3.0
source: https://github.com/apache/arrow
license: Apache-2.0

datafusion 4.0.0-SNAPSHOT
source: https://github.com/apache/arrow-datafusion
license: Apache-2.0

@houqp
Copy link
Member

houqp commented Sep 4, 2021

@mmuru the duplicate entry is caused by the fact that the python binding's Cargo.toml file also has the package name set to datafusion. I have changed it to datafusion-python in #967

@houqp
Copy link
Member

houqp commented Sep 6, 2021

@jorgecarleitao if you need any help finishing up this PR, let me know :)

@houqp
Copy link
Member

houqp commented Sep 6, 2021

@jorgecarleitao it looks like you deleted the script entirely in the latest commit :P

@jorgecarleitao
Copy link
Member Author

woops, wanted to rename it and forgot to add. done. 😵‍💫

@houqp houqp merged commit 7a445e5 into apache:master Sep 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
development-process Related to development process of DataFusion
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants