Reproducible-Bayesian-Tensor/Matrix-Machine-Learning-SOTA

Collection of state-of-the-art and reproducible Bayesian tensor/matrix machine learning works.

• This list is maintained by: Zhongtao Chen, Le Xu, Yangge Chen, Lei Cheng [Website], and Yik-Chung Wu [Website].

Bayesian Tensor Canonical Polyadic Decomposition (CPD)

• Flexible Sparsity-Aware Bayesian Tensor CPD using GH prior [Code] [PDF]

  • Reference: Lei Cheng, Zhongtao Chen, Qingjiang Shi, Yik-Chung Wu, and Sergios Theodoridis, "Towards Flexible Sparsity-Aware Modeling: Automatic Tensor Rank Learning using The Generalized Hyperbolic Prior," IEEE Trans. on Signal Processing, 2022.

• Bayesian Tensor Tucker Completion With a Flexible Core [Code] [PDF]

  • Reference: Xueke Tong, Lei Cheng, and Yik-Chung Wu, “Bayesian Tensor Tucker Completion With A Flexible Core,” IEEE Trans. on Signal Processing, 2023.

• Accelerated Bayesian Tensor CPD With Nonnegative Factors [Code]

  • Reference: Zhongtao Chen, Lei Cheng, and Yik-Chung Wu, "Accelerating Probabilistic Tensor Canonical Polyadic Decomposition With Nonnegative Factors: An Inexact BCD Approach," Signal Processing, 2023.

• Bayesian Tensor CPD with Nonnegative Factors [Code] [PDF]

  • Reference: Lei Cheng, Xueke Tong, Shuai Wang, Yik-Chung Wu, and H. Vincent Poor, "Learning Nonnegative Factors from Tensor Data: Probabilistic Modeling and Inference Algorithm," IEEE Trans. on Signal Processing, vol. 68, pp. 1792-1806, 2020.

• Bayesian Robust Streaming CPD and Completion [Code] [PDF]

  • Reference: Z. Zhang and C. Hawkins, "Variational Bayesian Inference for Robust Streaming Tensor Factorization and Completion," 2018 IEEE International Conference on Data Mining (ICDM), 2018, pp. 1446-1451

• Bayesian Tensor CPD with Orthogonal Factors [Code] [PDF]

  • Reference: Lei Cheng, Yik-Chung Wu, and H. Vincent Poor, "Probabilistic Tensor Canonical Polyadic Decomposition With Orthogonal Factors," IEEE Trans. on Signal Processing, Vol. 65, no. 3, pp. 663-676, 2017.

• Bayesian Robust Tesor CPD using Gaussian-Gamma Prior [Code] [PDF]

  • Reference: Q. Zhao, G. Zhou, L. Zhang, A. Cichocki and S. -I. Amari, "Bayesian Robust Tensor Factorization for Incomplete Multiway Data," IEEE Trans. on Neural Networks and Learning Systems, vol. 27, no. 4, pp. 736-748, 2016.

• Bayesian Tensor CPD using Gaussian-Gamma Prior [Code] [PDF]

  • Reference: Q. Zhao, L. Zhang and A. Cichocki, "Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 37, no. 9, pp. 1751-1763, 2015.

Bayesian Tensor Train Decomposition

• Bayesian Tensor Train Decomposition [Code] [PDF]

  • Reference: Le Xu, Lei Cheng, Ngai Wong, and Yik-Chung Wu, "Overfitting Avoidance in Tensor Train Factorization and Completion: Prior Analysis and Inference," 2021 IEEE International Conference on Data Mining (ICDM), 2021, pp. 1439-1444.

• Bayesian Tensor Train Decomposition Based Neural Network Compression [Code] [PDF]

  • Reference: C. Hawkins, X. Liu and Z.Zhang, "Towards compact neural networks via end-to-end training: a Bayesian tensor approach with automatic rank determination," SIAM Journal on Mathematics of Data Science, vol. 4, no. 1, pp. 46-71, Jan. 2022.

Bayesian Tensor Ring Decompositon

• Bayesian Tensor Ring Decompositon [Code] [PDF]
  • Reference: Z. Long, C. Zhu, J. Liu and Y. Liu, "Bayesian Low Rank Tensor Ring for Image Recovery," in IEEE Trans. on Image Processing, vol. 30, pp. 3568-3580, 2021.

Bayesian Tensor t-SVD

• Bayesian tensor t-SVD [Code] [PDF]
  • Reference: Y. Zhou and Y. -M. Cheung, "Bayesian Low-Tubal-Rank Robust Tensor Factorization with Multi-Rank Determination," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 43, no. 1, pp. 62-76, 2021.

Graph-Aided Bayesian Matrix Completion

• Bayesian Matrix Completion With Graphs [Code] [PDF]
  • Reference: Yangge Chen, Lei Cheng#, and Yik-Chung Wu, 'Bayesian Low-rank Matrix Completion with Dual-graph Embedding: Prior Analysis and Tuning-free Inference', arXiv preprint arXiv:2203.10044.