We released a linked dataset for research on knowledge-aware recommender systems: KB4Rec v1.0 [1]. It aims to associate items from recommender systems with entities from Freebase.
- Motivations
- Datasets
- DownLoad and Usage
- How to get Freebase subgraph with our linkage
- Licence
- References
- Related Papers
- DOI
- Additional Notes
Recently, more and more efforts have been made by both research and industry communities for structurizing world knowledge or domain facts in a variety of data domains. One of the most typical organization forms is knowledge base (KB), also called knowledge graph. KBs provide a general and unified way to organize and relate information entities, which have been shown to be useful in many applications. Specially, KBs have also been used in recommender systems, called knowledge-aware recommender systems.
To address the need for the linked dataset of RS and KBs, we present the first public linked KB dataset for recommender systems, named KB4Rec v1.0. This dataset is first used in《Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks》[2].
In our KB4Rec v1.0 dataset, we organized the linkage results by linked ID pairs, which consists of a RS item ID and a KB entity ID. All the IDs are inner values from the original datasets. Here, we present a sample snippet of our linkage results for MovieLens 20M, in which we pair a MovieLens item ID with a Freebase entity ID.
25991 m.09pglcq
25993 m.0cjwhb
25994 m.0k443
25995 m.0b7kj8
Once such a linkage has been accomplished, it is able to reuse existing large-scale KB data for RSs. For example, the movie of from MovieLens dataset has a corresponding entity entry in Freebase, and we are able to obtain its attribute information by reading out all its associated relation triples in KBs.
We consider three popular RS datasets for linkage, namely MovieLens 20M [5], LFM-1b [6] and Amazon book [7], which covers the three domains of movie, music and book respectively. For KB, we adopt the large-scale pubic KB Freebase [8]. For more details of our linkage, please refer to our dataset paper [1].
We present the statistics of the linked dataset in the following table:
Attention! the number of users of Amazon Book is 8,026,324, rather than 3,468,412 reported in journal paper. You can address it with this issue
By using the datasets, you must agree to be bound by the terms of the following license.
- Our linkage dataset is provided in Linkage folder of this repo.
- For easy usage, we provide the 1step subgraph extrated with following process. You can download it here.
With KB4Rec linkage and freebase dump, you can extract subgraph now. For the dump of freebase, you can download it from freebase (We use the latest version of this page).
The freebase subgraph is all triples related to current seed entity set. You can get freebase subgraph which
(1) At first, the seed entity set only contain entities in our linkage. All triples which contain at least one entity in our linkage are called 1step subgraph.
(2) With the 1step subgraph extracted, we update the seed entity set to all entities appeared in 1step subgraph. (We only keep entities under freebase domain)
(3) With new entity set, similar to (1), we can get 2step subgraph. This subgraph is of rich semantics and fit for research purposes.
This process is simple and reproducible.
By using the datasets, you must agree to be bound by the terms of the following license.
License agreement
This dataset is made freely available to academic and non-academic entities for non-commercial purposes such as academic research, teaching, scientific publications, or personal experimentation. Permission is granted to use the data given that you agree:
1. That the dataset comes “AS IS”, without express or implied warranty. Although every effort has been made to ensure accuracy, we do not accept any responsibility for errors or omissions.
2. That you include a reference to the KB4Rec v1.0 dataset in any work that makes use of the dataset. For research papers, cite our preferred publication as listed on our References; for other media cite our preferred publication as listed on our website or link to the dataset website.
3. That you do not distribute this dataset or modified versions. It is permissible to distribute derivative works in as far as they are abstract representations of this dataset (such as models trained on it or additional annotations that do not directly include any of our data) and do not allow to recover the dataset or something similar in character.
4. That you may not use the dataset or any derivative work for commercial purposes as, for example, licensing or selling the data, or using the data with a purpose to procure a commercial gain.
5. That all rights not expressly granted to you are reserved by us (Wayne Xin Zhao, School of Information, Renmin University of China).
If you use our linkage or subgraph, please kindly cite our papers.
You can cite this dataset as below.
@article{Zhao-DI-2019,
author = {Wayne Xin Zhao and
Gaole He and
Kunlin Yang and
Hong{-}Jian Dou and
Jin Huang and
Siqi Ouyang and
Ji{-}Rong Wen},
title = {KB4Rec: A Data Set for Linking Knowledge Bases with Recommender Systems},
journal = {Data Intelligence},
volume = {1},
number = {2},
pages = {121-136},
year = {2019},
doi = {10.1162/dint\_a\_00008},
URL = {https://doi.org/10.1162/dint_a_00008},
}
@inproceedings{huang-SIGIR-2018,
author = {Jin Huang and
Wayne Xin Zhao and
Hong{-}Jian Dou and
Ji{-}Rong Wen and
Edward Y. Chang},
title = {Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks}
booktitle = {The 41st International {ACM} {SIGIR} Conference on Research {\&}
Development in Information Retrieval, {SIGIR} 2018, Ann Arbor, MI,
USA, July 08-12, 2018}
pages = {505--514}
year = {2018},
url = {http://doi.acm.org/10.1145/3209978.3210017},
doi = {10.1145/3209978.3210017},
}
@inproceedings{Zhao-PAKDD-2019,
author = {Wayne Xin Zhao and
Hong{-}Jian Dou and
Yuanpei Zhao and
Daxiang Dong and
Ji{-}Rong Wen},
title = {Neural Network Based Popularity Prediction by Linking Online Content
with Knowledge Bases},
booktitle = {Advances in Knowledge Discovery and Data Mining - 23rd Pacific-Asia
Conference, {PAKDD} 2019, Macau, China, April 14-17, 2019, Proceedings,
Part {II}},
pages = {16--28},
year = {2019},
crossref = {DBLP:conf/pakdd/2019-2},
url = {https://doi.org/10.1007/978-3-030-16145-3\_2},
doi = {10.1007/978-3-030-16145-3\_2},
}
@inproceedings{He-WWW-2020,
title={Mining Implicit Entity Preference from User-Item Interaction Data for Knowledge Graph Completion via Adversarial Learning},
author={Gaole He, Junyi Li, Wayne Xin Zhao, Peiju Liuand Ji{-}Rong Wen},
booktitle={Proceedings of The Web Conference},
year={2020},
}
We also strongly recommend you to cite the original papers that share the copies of recommender system datasets [5,6,7] and knowledge bases [8]. You can find the related references in our paper.
[1] Wayne Xin Zhao, Gaole He, Hongjian Dou, Jin Huang, Siqi Ouyang and Ji-Rong Wen : KB4Rec: A Dataset for Linking Knowledge Bases with Recommender Systems. paper ScienceDB
[2] Jin Huang, Wayne Xin Zhao, Hong-Jian Dou, Ji-Rong Wen, Edward Y. Chang : Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks. SIGIR 2018: 505-514. paper code
[3] Wayne Xin Zhao, Hong{-}Jian Dou, Yuanpei Zhao, Daxiang Dong and Ji{-}Rong Wen : Neural Network Based Popularity Prediction by Linking Online Content with Knowledge Bases. PAKDD (2) 2019: 16-28. paper
[4] Gaole He, Junyi Li, Wayne Xin Zhao, Peiju Liuand Ji{-}Rong Wen : Mining Implicit Entity Preference from User-Item Interaction Data for Knowledge Graph Completion via Adversarial Learning. WWW 2020. paper code [5] F. Maxwell Harper, Joseph A. Konstan : The MovieLens Datasets: History and Context. TiiS 5(4): 19:1-19:19 (2016). [web](https://grouplens.org/datasets/movielens/) [6] Markus Schedl : The LFM-1b Dataset for Music Retrieval and Recommendation. ICMR 2016: 103-110. [web](http://www.cp.jku.at/datasets/LFM-1b/) [7] Ruining He, Julian McAuley : Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. WWW 2016: 507-517. [web](http://jmcauley.ucsd.edu/data/amazon/) [8] Google : 2016. Freebase Data Dumps. https://developers.google.com/freebase/data.
- The following people contributed to the the construction of the KB4Rec v1.0 dataset: Wayne Xin Zhao, Gaole He, Hongjian Dou, Jin Huang, Siqi Ouyang and Ji-Rong Wen. This project is lead by Wayne Xin Zhao, School of Information, Renmin University of China.
- If you have any questions or suggestions with this dataset, please kindly let us know. Our goal is to make the dataset reliable and useful for the community.
- For contact, send email to RUCKB4Rec@gmail.com, and cc Wayne Xin Zhao via batmanfly@gmail.com .
