SSMF

Implementation of SSMF: Shifting Seasonal Matrix Factorization, Koki Kawabata, Siddharth Bhatia, Rui Liu, Mohit Wadhwa, Bryan Hooi. NeurIPS, 2021.

DEMO

• Please RUN python3 ssmf.py, which starts processing DISEASE dataset and produces the SSMF results into "out" directory.
• Also, please RUN python3 ssmf.py --max_regimes 1 to compare its performance with SMF, which does not assume regime shifts.

Input for SSMF

SSMF expects 3-dimensional numpy.ndarray, whose last dimension corresponds to time points. If you have multi-column dataframes, utils.list2tensor helps convert your data to 3-dimensional array.

Commnad line options

• --output_dir:
  Path of output directory (default: 'out')
• --periodicity:
  Length of periodicity (default: 52, for yearly patterns of weekly data)
• --n_components:
  Rank of matrix factorization (default: 10)
• --max_regimes:
  Maximum number of regimes (default: 50, set at 1 for SMF)
• --learning_rate:
  Size of gradient steps in each update (default: 0.2)
• --max_iter:
  Number of iterations to estimate new regimes (default: 1)
• --float_cost:
  Number of bits in MDL (default: 32)
• --update_freq:
  Interval of regime estimation (default: 1)

Installation

You will need to install following libraries,

• numpy: https://numpy.org
• pandas: https://github.com/pandas-dev/pandas
• tensorly: http://tensorly.org/stable/index.html
• sklearn: https://pykalman.github.io
• matplotlib: https://matplotlib.org
• tqdm: https://github.com/tqdm/tqdm

Datasets

• Please download at:
  https://s3.amazonaws.com/tripdata/index.html
• Please download at:
  https://www1.nyc.gov/site/tlc/about/tlc-trip-record-data.page
• Disease: data/project_tycho.csv.gz. The original data can be found at:
  https://www.tycho.pitt.edu/data/

Citation

If you use this code for your research, please consider citing our paper.

@inproceedings{kawabata2021ssmf,
    title={SSMF: Shifting Seasonal Matrix Factorization},
    author={Koki Kawabata, Siddharth Bhatia, Rui Liu, Mohit Wadhwa, Bryan Hooi},
    booktitle={NeurIPS},
    year={2021}