testing doc-builder

[mishig25]

testing huggingface/doc-builder#426

[github-actions]

Show benchmarks

PyArrow==8.0.0

Show updated benchmarks!

Benchmark: benchmark_array_xd.json

metric	read_batch_formatted_as_numpy after write_array2d	read_batch_formatted_as_numpy after write_flattened_sequence	read_batch_formatted_as_numpy after write_nested_sequence	read_batch_unformated after write_array2d	read_batch_unformated after write_flattened_sequence	read_batch_unformated after write_nested_sequence	read_col_formatted_as_numpy after write_array2d	read_col_formatted_as_numpy after write_flattened_sequence	read_col_formatted_as_numpy after write_nested_sequence	read_col_unformated after write_array2d	read_col_unformated after write_flattened_sequence	read_col_unformated after write_nested_sequence	read_formatted_as_numpy after write_array2d	read_formatted_as_numpy after write_flattened_sequence	read_formatted_as_numpy after write_nested_sequence	read_unformated after write_array2d	read_unformated after write_flattened_sequence	read_unformated after write_nested_sequence	write_array2d	write_flattened_sequence	write_nested_sequence
new / old (diff)	0.006424 / 0.011353 (-0.004929)	0.003960 / 0.011008 (-0.007048)	0.084022 / 0.038508 (0.045514)	0.070770 / 0.023109 (0.047661)	0.320525 / 0.275898 (0.044627)	0.354507 / 0.323480 (0.031027)	0.003939 / 0.007986 (-0.004047)	0.004161 / 0.004328 (-0.000168)	0.064754 / 0.004250 (0.060503)	0.053630 / 0.037052 (0.016578)	0.323948 / 0.258489 (0.065459)	0.376908 / 0.293841 (0.083067)	0.031063 / 0.128546 (-0.097483)	0.008470 / 0.075646 (-0.067177)	0.288110 / 0.419271 (-0.131161)	0.053062 / 0.043533 (0.009529)	0.328176 / 0.255139 (0.073037)	0.345203 / 0.283200 (0.062003)	0.024579 / 0.141683 (-0.117104)	1.471649 / 1.452155 (0.019495)	1.561458 / 1.492716 (0.068742)

Benchmark: benchmark_getitem_100B.json

metric	get_batch_of_1024_random_rows	get_batch_of_1024_rows	get_first_row	get_last_row
new / old (diff)	0.223591 / 0.018006 (0.205585)	0.450758 / 0.000490 (0.450269)	0.003751 / 0.000200 (0.003552)	0.000079 / 0.000054 (0.000025)

Benchmark: benchmark_indices_mapping.json

metric	select	shard	shuffle	sort	train_test_split
new / old (diff)	0.027859 / 0.037411 (-0.009552)	0.080607 / 0.014526 (0.066081)	0.093835 / 0.176557 (-0.082722)	0.150466 / 0.737135 (-0.586669)	0.094381 / 0.296338 (-0.201957)

Benchmark: benchmark_iterating.json

metric	read 5000	read 50000	read_batch 50000 10	read_batch 50000 100	read_batch 50000 1000	read_formatted numpy 5000	read_formatted pandas 5000	read_formatted tensorflow 5000	read_formatted torch 5000	read_formatted_batch numpy 5000 10	read_formatted_batch numpy 5000 1000	shuffled read 5000	shuffled read 50000	shuffled read_batch 50000 10	shuffled read_batch 50000 100	shuffled read_batch 50000 1000	shuffled read_formatted numpy 5000	shuffled read_formatted_batch numpy 5000 10	shuffled read_formatted_batch numpy 5000 1000
new / old (diff)	0.394011 / 0.215209 (0.178802)	3.918318 / 2.077655 (1.840664)	1.928684 / 1.504120 (0.424564)	1.765944 / 1.541195 (0.224749)	1.784716 / 1.468490 (0.316226)	0.487189 / 4.584777 (-4.097588)	3.537705 / 3.745712 (-0.208008)	3.312162 / 5.269862 (-1.957699)	2.024520 / 4.565676 (-2.541156)	0.057571 / 0.424275 (-0.366704)	0.007203 / 0.007607 (-0.000404)	0.467253 / 0.226044 (0.241208)	4.659934 / 2.268929 (2.391005)	2.377764 / 55.444624 (-53.066860)	2.021984 / 6.876477 (-4.854492)	2.197468 / 2.142072 (0.055395)	0.586415 / 4.805227 (-4.218812)	0.136636 / 6.500664 (-6.364028)	0.060885 / 0.075469 (-0.014584)

Benchmark: benchmark_map_filter.json

metric	filter	map fast-tokenizer batched	map identity	map identity batched	map no-op batched	map no-op batched numpy	map no-op batched pandas	map no-op batched pytorch	map no-op batched tensorflow
new / old (diff)	1.241879 / 1.841788 (-0.599908)	18.719327 / 8.074308 (10.645019)	14.408689 / 10.191392 (4.217297)	0.155778 / 0.680424 (-0.524646)	0.018475 / 0.534201 (-0.515726)	0.392316 / 0.579283 (-0.186967)	0.409803 / 0.434364 (-0.024561)	0.458701 / 0.540337 (-0.081637)	0.630561 / 1.386936 (-0.756375)

PyArrow==latest

Show updated benchmarks!

Benchmark: benchmark_array_xd.json

metric	read_batch_formatted_as_numpy after write_array2d	read_batch_formatted_as_numpy after write_flattened_sequence	read_batch_formatted_as_numpy after write_nested_sequence	read_batch_unformated after write_array2d	read_batch_unformated after write_flattened_sequence	read_batch_unformated after write_nested_sequence	read_col_formatted_as_numpy after write_array2d	read_col_formatted_as_numpy after write_flattened_sequence	read_col_formatted_as_numpy after write_nested_sequence	read_col_unformated after write_array2d	read_col_unformated after write_flattened_sequence	read_col_unformated after write_nested_sequence	read_formatted_as_numpy after write_array2d	read_formatted_as_numpy after write_flattened_sequence	read_formatted_as_numpy after write_nested_sequence	read_unformated after write_array2d	read_unformated after write_flattened_sequence	read_unformated after write_nested_sequence	write_array2d	write_flattened_sequence	write_nested_sequence
new / old (diff)	0.006541 / 0.011353 (-0.004812)	0.003915 / 0.011008 (-0.007094)	0.064292 / 0.038508 (0.025784)	0.069174 / 0.023109 (0.046065)	0.402048 / 0.275898 (0.126150)	0.423960 / 0.323480 (0.100480)	0.005355 / 0.007986 (-0.002631)	0.003295 / 0.004328 (-0.001033)	0.065212 / 0.004250 (0.060962)	0.054292 / 0.037052 (0.017240)	0.402930 / 0.258489 (0.144441)	0.441840 / 0.293841 (0.147999)	0.032732 / 0.128546 (-0.095814)	0.008565 / 0.075646 (-0.067081)	0.070705 / 0.419271 (-0.348567)	0.047908 / 0.043533 (0.004375)	0.401400 / 0.255139 (0.146261)	0.422682 / 0.283200 (0.139483)	0.022244 / 0.141683 (-0.119439)	1.532018 / 1.452155 (0.079864)	1.597955 / 1.492716 (0.105239)

Benchmark: benchmark_getitem_100B.json

metric	get_batch_of_1024_random_rows	get_batch_of_1024_rows	get_first_row	get_last_row
new / old (diff)	0.226277 / 0.018006 (0.208271)	0.475578 / 0.000490 (0.475088)	0.005456 / 0.000200 (0.005256)	0.000140 / 0.000054 (0.000085)

Benchmark: benchmark_indices_mapping.json

metric	select	shard	shuffle	sort	train_test_split
new / old (diff)	0.033111 / 0.037411 (-0.004300)	0.093138 / 0.014526 (0.078613)	0.104619 / 0.176557 (-0.071937)	0.157972 / 0.737135 (-0.579164)	0.105017 / 0.296338 (-0.191321)

Benchmark: benchmark_iterating.json

metric	read 5000	read 50000	read_batch 50000 10	read_batch 50000 100	read_batch 50000 1000	read_formatted numpy 5000	read_formatted pandas 5000	read_formatted tensorflow 5000	read_formatted torch 5000	read_formatted_batch numpy 5000 10	read_formatted_batch numpy 5000 1000	shuffled read 5000	shuffled read 50000	shuffled read_batch 50000 10	shuffled read_batch 50000 100	shuffled read_batch 50000 1000	shuffled read_formatted numpy 5000	shuffled read_formatted_batch numpy 5000 10	shuffled read_formatted_batch numpy 5000 1000
new / old (diff)	0.441771 / 0.215209 (0.226562)	4.396981 / 2.077655 (2.319326)	2.410745 / 1.504120 (0.906625)	2.258359 / 1.541195 (0.717164)	2.372628 / 1.468490 (0.904138)	0.491411 / 4.584777 (-4.093366)	3.650084 / 3.745712 (-0.095628)	3.279557 / 5.269862 (-1.990304)	2.011377 / 4.565676 (-2.554300)	0.058283 / 0.424275 (-0.365992)	0.007435 / 0.007607 (-0.000172)	0.507212 / 0.226044 (0.281167)	5.080104 / 2.268929 (2.811176)	2.822680 / 55.444624 (-52.621945)	2.507608 / 6.876477 (-4.368869)	2.719349 / 2.142072 (0.577277)	0.586157 / 4.805227 (-4.219071)	0.132851 / 6.500664 (-6.367813)	0.059944 / 0.075469 (-0.015525)

Benchmark: benchmark_map_filter.json

metric	filter	map fast-tokenizer batched	map identity	map identity batched	map no-op batched	map no-op batched numpy	map no-op batched pandas	map no-op batched pytorch	map no-op batched tensorflow
new / old (diff)	1.374801 / 1.841788 (-0.466987)	19.089359 / 8.074308 (11.015051)	14.525861 / 10.191392 (4.334469)	0.184758 / 0.680424 (-0.495666)	0.020206 / 0.534201 (-0.513995)	0.397309 / 0.579283 (-0.181975)	0.418120 / 0.434364 (-0.016244)	0.471817 / 0.540337 (-0.068520)	0.681691 / 1.386936 (-0.705245)

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.