Analyze
What goes in: A 2D axial CT slice and/or RNA-seq gene expression profile (18,514 genes, HGNC symbols). Upload whichever data you have — CT, RNA-seq, or both.
A multimodal deep learning model combining CT scan imaging and RNA-seq genomic data to help identify lung adenocarcinoma staging — supporting earlier clinical decision-making.
signal map
multimodal view
Lung cancer is the leading cause of cancer death globally. Detecting potential risk earlier can give healthcare professionals more opportunities to investigate concerning cases.
Lung adenocarcinoma (LUAD) accounts for ~40% of all lung cancer cases. Staging at diagnosis determines treatment and prognosis — yet accurate staging still requires invasive biopsy or extensive imaging workup.The model accepts CT, RNA-seq, or both — because in clinical practice not every patient has both. The system adapts to whatever data is available, and the ablation results show exactly when each modality matters.
RNA-seq alone captures molecular subtypes — KRAS/STK11 co-mutations and proliferation signatures directly correlate with late-stage disease.
When both modalities are available. Current linear fusion dilutes genomic signal — future cross-attention with 3D CT may unlock true synergy.
When no RNA-seq exists. CT is routine standard-of-care — better than nothing when genomic data isn't available.
What goes in: A 2D axial CT slice and/or RNA-seq gene expression profile (18,514 genes, HGNC symbols). Upload whichever data you have — CT, RNA-seq, or both.
What the model does: ResNet-18 (RadiologyNET) extracts a 512-dim CT embedding; ComBat + PCA compresses RNA-seq to 480 dims. Available modalities fuse through a linear head.
What comes out: A staging prediction (Stage I/II vs. III/IV) with Grad-CAM saliency and genomic attribution — with a clear indication of which modality drove the result.
The indicator surfaces uncertainty to make the next clinical conversation easier to start.
Upload a CT scan, RNA-seq file, or both — the actual trained model runs inference and returns a staging prediction with Grad-CAM saliency and genomic attribution.
A responsible staging tool should make the next question clearer — not make the decision for the person who owns it.
A transparent pipeline keeps every output legible — from raw patient data through model inference to a structured clinical signal.
"I think your approach of combining imaging and genetics for staging disease is very interesting, especially that you have been able to achieve a degree of accuracy in your cross validation. I approve this project and wish you all the best in your endeavors."
Building technology that helps healthcare professionals see potential staging risk sooner — and act with more information.