Federated Multi Task Learning for Joint Diagnosis of Multiple Mental Disorders on MRI Scans

Objective: Deep learning (DL) techniques have been introduced to assist doctors in the interpretation of medical images by detecting image-derived phenotype abnormality. Yet the privacy-preserving policy of medical images disables the effective training of DL model using sufficiently large datasets. As a decentralized computing paradigm to address this issue, federated learning (FL) allows the training process to occur in individual institutions with local datasets, and then aggregates the resultant weights without risk of privacy leakage. Methods: We propose an effective federated multi-task learning (MTL) framework to jointly identify multiple related mental disorders based on functional magnetic resonance imaging data. A federated contrastive learning-based feature extractor is developed to extract high-level features across client models. To ease the optimization conflicts of updating shared parameters in MTL, we present a federated multi-gate mixture of expert classifier for the joint classification. The proposed framework also provides practical modules, including personalized model learning, privacy protection, and federated biomarker interpretation. Results: On real-world datasets, the proposed framework achieves robust diagnosis accuracies of 69.48 ± 1.6%, 71.44 ± 3.2%, and 83.29 ± 3.2% in autism spectrum disorder, attention deficit/hyperactivity disorder, and schizophrenia, respectively. Conclusion: The proposed framework can effectively ease the domain shift between clients via federated MTL. Significance: The current work provides insights into exploiting the advantageous knowledge shared in related mental disorders for improving the generalization capability of computer-aided detection approaches.