Skip to content

Commit

Permalink
add correct reduce prune results
Browse files Browse the repository at this point in the history
  • Loading branch information
ravishankar committed Nov 7, 2024
1 parent fda9735 commit deb97d4
Show file tree
Hide file tree
Showing 10 changed files with 74 additions and 461 deletions.
0 prec40M/KK3/KK3_reduce_prune_r64_k25.txt → prec40M/KK3/KK_3_reduce_prune_r64_k25.txt
View file
File renamed without changes.
28 changes: 23 additions & 5 deletions prec40M/combined-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,26 @@ RobustPrune Calls 75.3M
Avg Deg 38.23
Count(Deg<2) 1.4M

ReducePrune
Time 3135
RobustPrune Calls 86.5M
Avg Deg 47.86
Count(Deg<2) 0
ReducePrune (Replace R by R/2)
Time 3128
RobustPrune Calls 84.5M
Avg Deg 39.61
Count(Deg<2) 1.01M

ReducePrune (KK=1.5)
Time 3300
RobustPrune Calls 91.4M
Avg Deg 42.32
Count(Deg<2) 1.01M

ReducePrune (KK=3)
Time 2971
RobustPrune Calls 77.4M
Avg Deg 35.71
Count(Deg<2) 1.01M

ReducePrune (KK=4)
Time 2878
RobustPrune Calls 74.1M
Avg Deg 33.63
Count(Deg<2) 1M
26 changes: 13 additions & 13 deletions prec40M/reduce_prune_r64_k10.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,24 +3,24 @@ Opened: /nvmessd1/fbv4/gt100_prec40M, size: 10612008, cache_size: 10612008
Reading truthset file /nvmessd1/fbv4/gt100_prec40M ...
Metadata: #pts = 13265, #dims = 100...
Using AVX2 distance computation DistanceL2Int8.
Resizing took: 1.38761s
From graph header, expected_file_size: 7909652996, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1936943634 out-edges, _start is set to 11890341
Resizing took: 1.384s
From graph header, expected_file_size: 6574276560, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1603099525 out-edges, _start is set to 11890341
Num frozen points:0 _nd: 40469609 _start: 11890341 size(_location_to_tag): 0 size(_tag_to_location):0 Max points: 40469609
Index loaded
Using 48 threads to search
Ls QPS Avg dist cmps Mean Latency (mus) 99.9 Latency Recall@10
=================================================================================
10 57129.92 1204.54 819.73 14634.45 41.20
20 37392.97 1833.13 1278.26 2940.53 56.09
30 27900.83 2373.15 1712.59 4080.74 64.17
40 21924.93 2866.50 2181.54 5309.65 69.04
50 18519.77 3337.17 2584.02 6646.01 72.45
60 16504.86 3798.02 2899.18 6829.28 75.12
70 14574.02 4246.18 3283.93 8203.08 77.14
80 12924.68 4684.36 3698.47 8927.50 78.72
90 12426.62 5116.59 3849.06 8457.81 80.09
100 11174.85 5546.08 4282.37 9669.37 81.26
10 57259.69 1217.59 816.61 2283.84 38.52
20 35838.59 1882.56 1332.56 3141.44 54.20
30 26485.23 2442.28 1805.06 4193.79 62.89
40 21651.51 2946.59 2207.85 5068.30 67.83
50 18286.58 3434.01 2615.86 6031.00 71.71
60 16051.96 3901.36 2980.95 6910.60 74.49
70 14293.84 4359.70 3347.74 7776.13 76.73
80 12634.82 4799.74 3784.73 9042.38 78.44
90 11402.55 5237.92 4195.62 10103.31 79.86
100 11023.19 5669.62 4343.09 9582.72 81.01
Done searching. Now saving results
Writing bin: /home/rakri/avarhade/Dump/tmp_10_idx_uint32.bin
bin: #pts = 13265, #dims = 10, size = 530608B
Expand Down
8 changes: 4 additions & 4 deletions prec40M/reduce_prune_r64_k100.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,15 +3,15 @@ Opened: /nvmessd1/fbv4/gt100_prec40M, size: 10612008, cache_size: 10612008
Reading truthset file /nvmessd1/fbv4/gt100_prec40M ...
Metadata: #pts = 13265, #dims = 100...
Using AVX2 distance computation DistanceL2Int8.
Resizing took: 1.38845s
From graph header, expected_file_size: 7909652996, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1936943634 out-edges, _start is set to 11890341
Resizing took: 1.35972s
From graph header, expected_file_size: 6574276560, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1603099525 out-edges, _start is set to 11890341
Num frozen points:0 _nd: 40469609 _start: 11890341 size(_location_to_tag): 0 size(_tag_to_location):0 Max points: 40469609
Index loaded
Using 48 threads to search
Ls QPS Avg dist cmps Mean Latency (mus) 99.9 Latency Recall@100
=================================================================================
100 11408.18 5546.08 4185.72 18975.11 64.99
100 11158.65 5669.62 4279.87 10969.40 64.79
Done searching. Now saving results
Writing bin: /home/rakri/avarhade/Dump/tmp_100_idx_uint32.bin
bin: #pts = 13265, #dims = 100, size = 5306008B
Expand Down
22 changes: 11 additions & 11 deletions prec40M/reduce_prune_r64_k25.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,22 +3,22 @@ Opened: /nvmessd1/fbv4/gt100_prec40M, size: 10612008, cache_size: 10612008
Reading truthset file /nvmessd1/fbv4/gt100_prec40M ...
Metadata: #pts = 13265, #dims = 100...
Using AVX2 distance computation DistanceL2Int8.
Resizing took: 1.39634s
From graph header, expected_file_size: 7909652996, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1936943634 out-edges, _start is set to 11890341
Resizing took: 1.36418s
From graph header, expected_file_size: 6574276560, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1603099525 out-edges, _start is set to 11890341
Num frozen points:0 _nd: 40469609 _start: 11890341 size(_location_to_tag): 0 size(_tag_to_location):0 Max points: 40469609
Index loaded
Using 48 threads to search
Ls QPS Avg dist cmps Mean Latency (mus) 99.9 Latency Recall@25
=================================================================================
30 28002.82 2373.15 1697.85 17598.59 57.89
40 22399.96 2866.50 2135.36 4870.94 62.97
50 19318.24 3337.17 2477.03 5706.82 66.68
60 16663.92 3798.02 2871.46 6821.64 69.58
70 14740.77 4246.18 3246.82 7335.50 71.87
80 13408.25 4684.36 3568.74 8180.93 73.70
90 12230.36 5116.59 3912.60 8687.35 75.28
100 11226.85 5546.08 4263.22 9351.45 76.62
30 27153.00 2442.28 1751.17 5961.27 56.83
40 22141.99 2946.59 2159.38 4624.89 62.00
50 18813.29 3434.01 2542.66 5649.89 66.06
60 15260.28 3901.36 3136.05 7624.12 69.06
70 14314.76 4359.70 3342.75 7943.99 71.50
80 13081.96 4799.74 3659.94 8403.90 73.39
90 11887.32 5237.92 4023.93 8958.55 74.99
100 10995.38 5669.62 4353.71 9682.32 76.32
Done searching. Now saving results
Writing bin: /home/rakri/avarhade/Dump/tmp_30_idx_uint32.bin
bin: #pts = 13265, #dims = 25, size = 1326508B
Expand Down
18 changes: 9 additions & 9 deletions prec40M/reduce_prune_r64_k50.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,20 +3,20 @@ Opened: /nvmessd1/fbv4/gt100_prec40M, size: 10612008, cache_size: 10612008
Reading truthset file /nvmessd1/fbv4/gt100_prec40M ...
Metadata: #pts = 13265, #dims = 100...
Using AVX2 distance computation DistanceL2Int8.
Resizing took: 1.40172s
From graph header, expected_file_size: 7909652996, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1936943634 out-edges, _start is set to 11890341
Resizing took: 1.36864s
From graph header, expected_file_size: 6574276560, _max_observed_degree: 64, _start: 11890341, file_frozen_pts: 0
Loading vamana graph /nvmessd1/fbv4/avarhade/prec40M_reduce_prune_memory_index_r64_l100.......done. Index has 40469609 nodes and 1603099525 out-edges, _start is set to 11890341
Num frozen points:0 _nd: 40469609 _start: 11890341 size(_location_to_tag): 0 size(_tag_to_location):0 Max points: 40469609
Index loaded
Using 48 threads to search
Ls QPS Avg dist cmps Mean Latency (mus) 99.9 Latency Recall@50
=================================================================================
50 19471.17 3337.17 2449.13 12609.75 60.75
60 16232.72 3798.02 2948.13 6944.80 63.80
70 13798.80 4246.18 3469.60 8691.44 66.27
80 13327.01 4684.36 3589.55 8605.34 68.29
90 12339.93 5116.59 3878.24 8992.86 70.01
100 11395.03 5546.08 4200.90 9102.71 71.49
50 19101.99 3434.01 2492.46 8637.26 60.19
60 16430.50 3901.36 2911.56 6669.41 63.31
70 14276.69 4359.70 3351.47 7844.38 65.93
80 12866.87 4799.74 3719.99 8665.40 67.98
90 11685.88 5237.92 4094.19 9507.47 69.75
100 10885.24 5669.62 4398.48 9970.58 71.21
Done searching. Now saving results
Writing bin: /home/rakri/avarhade/Dump/tmp_50_idx_uint32.bin
bin: #pts = 13265, #dims = 50, size = 2653008B
Expand Down
Loading

0 comments on commit deb97d4

Please sign in to comment.