Skip to content

Latest commit

 

History

History
31 lines (20 loc) · 1.07 KB

README.md

File metadata and controls

31 lines (20 loc) · 1.07 KB

Reservoir Sampling algorithm in Python

The Reservoir Sampling algorithm is a random sampling algorithm.

It is a family of randomized algorithms for randomly choosing a sample of K items from a list S containing N items, where N is either a very large or unknown number. Typically N is large enough that the list doesn't fit into main memory.

Usage

This module is using Reservoir Sampling to randomly choose exactly K (Sample Number) rows on input file.

Sampling result's row order is the same as input file.

using in python 2.7
$ python2 reservoir_sampling_py27.py input.txt output.txt 4
arguments: python [pyfile] [infile] [outfile] [K]

using in python 3.6
$ python3 reservoir_sampling_py36.py input.txt output.txt 4
arguments: python [pyfile] [infile] [outfile] [K]

Efficiency

Suppose number of lines on input file is N.

Time complexity: O(N).

Space complexity: O(K) (regardless of the size of per line in file).

If K >= N, output file would be same as input file.