Skip to content

multi-task learning combing regression and classification tasks with joint feature selection

License

Notifications You must be signed in to change notification settings

transbioZI/MTLComb

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MTLComb: multi-task learning combing regression and classification tasks with joint feature selection

Introduction

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed types of tasks into a unified MTL framework remains challenging, primarily due to variations in the magnitudes of losses associated with different tasks. This challenge, particularly evident in MTL applications with joint feature selection, often results in biased selections. To overcome this obstacle, we propose a provable loss weighting scheme that analytically determines the optimal weights for balancing regression and classification tasks. This scheme significantly mitigates the otherwise biased feature selection. Building upon this scheme, we introduce MTLComb, an MTL algorithm and software package encompassing optimization procedures, training protocols, and hyperparameter estimation procedures. MTLComb is designed for learning shared predictors among tasks of mixed types. To showcase the efficacy of MTLComb, we conduct tests on both simulated data and biomedical studies pertaining to sepsis and schizophrenia.

Installation

install.packages("devtools")
library("devtools")
install_github("transbioZI/MTLComb")

Tutorial and Manuscript

The Tutorial demonstrated all functions of MTLComb regarding to solver, training procedure, cross-validation and prediction procedure. The technical details and more use cases can be found in our manuscipt

Contact

Han Cao (hank9cao@gmail.com)

About

multi-task learning combing regression and classification tasks with joint feature selection

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages