[SPARK-8998][MLlib] Distribute PrefixSpan computation for large projected databases#7783

Closed

feynmanliang wants to merge 30 commits intoapache:masterfrom

feynmanliang:SPARK-8998-improve-distributed

Commits on Jul 7, 2015

Add new algorithm PrefixSpan and test file.
zhangjiajin
committed

Commits on Jul 9, 2015

Commits on Jul 10, 2015

Add new object LocalPrefixSpan, and do some optimization.
zhangjiajin
committed

Commits on Jul 11, 2015

Modified the code according to the review comments.
zhangjiajin
committed

Commits on Jul 14, 2015

Commits on Jul 16, 2015

Commits on Jul 18, 2015

remove minPatternsBeforeLocalProcessing, add maxSuffixesBeforeLocalProcessing.
zhangjiajin
committed

Commits on Jul 27, 2015

Modified codes according to comments.
zhangjiajin
committed

Commits on Jul 28, 2015

Fix splitPrefixSuffixPairs
Feynman Liang
committed
Add getters
Feynman Liang
committed
Inline code for readability
Feynman Liang
committed
Use lists for prefixes to reuse data
Feynman Liang
committed
Use Iterable[Array[_]] over Array[Array[_]] for database
Feynman Liang
committed
Readability improvements and comments
Feynman Liang
committed
Improve extend prefix readability
Feynman Liang
committed

Commits on Jul 29, 2015

Merge pull request #1 from feynmanliang/SPARK-8998-collectBeforeLocal
zhangjiajin
committed

Commits on Jul 30, 2015

Parallelize freqItemCounts
Feynman Liang
committed
Collect small patterns to local
Feynman Liang
committed