Research & Products · Biomedical AI

TrustSyn

Biologically informed drug-combination prediction with explicit reliability assessment.

TrustSyn is a research prototype exploring how machine learning can help prioritise anticancer drug combinations for experimental investigation. We combine drug-related representations and cell-line features with split-specific prediction models, evaluation, and model interpretability.

Research prototype, not a clinically validated product

Predictions are intended to support research prioritisation. They do not establish clinical benefit, patient outcomes, or biological synergy, and require further experimental validation.

The Research Question

How can we estimate anticancer drug-combination activity from experimental data, evaluate generalisation under different data-splitting conditions, and understand which model inputs drive predictions?

Data & Modelling Pipeline

The project uses NCI-ALMANAC experimental data and integrates chemical representations, drug-target information, and cell-line molecular features. The modelling workflow explores gradient-boosting methods, a directed message-passing neural network, and split-specific stacking strategies.

Experimental data

Quality-controlled drug-combination observations and cell-line data.

Feature engineering

Chemical fingerprints, target-related information, and molecular features.

Prediction models

CatBoost, XGBoost, D-MPNN, and selected stacked models.

Evaluation & interpretability

Held-out evaluation across different split settings and SHAP-based analysis.

Selected Evaluation Results

The following results are from the saved evaluations of the selected models. RMSE measures prediction error; R² describes variance explained relative to a baseline.

SplitModelRMSE ↓R² ↑
RandomRidge5.8880.294
Cold combinationXGBoost6.5680.129
Cold cell lineXGBoost6.7890.323
Cold drugStacked (CatBoost + D-MPNN)4.8580.351

Note: Cold-drug results come from a separate saved stacking evaluation. Results across different splits should not be compared as if they represent identical test distributions.

Interpretability & Reliability

SHAP analysis of the random-split meta-model shows that the D-MPNN prediction contributes substantially more to the model output than the other listed features. This describes model reliance, not a proven biological mechanism.

The project also explores uncertainty and prediction reliability artefacts. Their calibration and coverage require further verification before numerical reliability claims can be made.

Current Limitations

  • • Predictions concern experimental cell-line activity, not clinical treatment outcomes.
  • • Predicted activity alone does not establish drug synergy or therapeutic benefit.
  • • Further robustness checks, repeated evaluations, and external validation are needed.
  • • Wet-lab, in-vivo, and clinical validation have not been established by this prototype.

Engineering Roadmap

Beyond model development, we plan to explore the engineering work required to make the research workflow reproducible, inspectable, and deployable.

  • ☐ Strengthen evaluation and reliability validation
  • ☐ Build a versioned prediction API with input validation
  • ☐ Package the workflow using Docker
  • ☐ Explore cloud deployment and experiment tracking
  • ☐ Add monitoring for data and prediction drift
  • ☐ Develop a research-facing interface with explanations and warnings

These are proposed extensions, not claims of completed production deployment.

TrustSyn

A biomedical AI research project documented on Steth2Tech.

Research prototype for experimental prioritisation only.