Electrical Engineering

My research areas include computational medical imaging, machine lerning, image and multidimensional signal processing, visualization and augmented reality. The focus is on understanding the physics of imaging and to leverage machine learning algorithms to characterize tissues using physics based models of energy-tissue interaction thus, laying foundations of in situ functional histology. In due course along with my students and collaborators, we have investigated behaviour of ultrasonic and optical imaging signals interacting with different types of tissues, both in normal and pathological or diseased states. These have led to development of patient comfort centric non-invasive solutions for in situ histology of atherosclerotic vascular plaques, breast lesion, skin, and retina of the eye. Currently, we are working on developing deep and transfer learning techniques for analyzing multimodal medical imaging signals, understanding surgical informatics and effective visualization of such processes through augmented reality for clinical translation of research findings on the bed to equip clinicians with technology to deliver patient-comfort centric care.

All Publications

Designing Deep Neural High-Density Compression Engines for Radiology Images Raj A., Sathish R. , Sarkar T. , Sethuraman R. , Sheet D. By Circuits, Systems, and Signal Processing 42 643-682 (2023)
Spatiotemporal Deep Networks for Detecting Abnormality in Videos Sharma M. K., Sheet D. , Biswas P. K. By Multimedia Tools and Applications 79 11237-11268 (2020)
Frame-level global context modeling for detection and localization of abnormality Sharma M. K., Kumar V. , Sheet D. , Biswas P. K. By Multimedia Tools and Applications 1-26 (2023)
Cholectriplet2021: A benchmark challenge for surgical action triplet recognition Nwoye C. I., Raviteja S. , Sathish R. , Balasubramanian V. , Sheet D. By Medical Image Analysis 86 102803--21 (2023)
I m GROOT: a multi head multi GRaph netwOrk recognizing surgical actiOn Triplets Raviteja S., Sathish R. , Agrawal R. , De U. , Chakrabarti P. P., Sheet D. By Thirteenth Indian Conference on Computer Vision, Graphics and Image Processing 1-9 (2022)
Verifiable and Energy Efficient Medical Image Analysis with Quantised Self-attentive Deep Neural Networks Sathish R., Khare S. R., Sheet D. By 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) W. Affordable AI and Healthcare for Resource Diverse Global Health (FAIR 2022) 178-189 (2022)
CHAOS challenge-combined (CT-MR) healthy abdominal organ segmentation Kavur A. E., Sheet D. By Medical Image Analysis 69 101950-101950 (2021)
Local instance and context dictionary-based detection and localization of abnormalities Sharma M. K., Sheet D. , Biswas P. K. By Machine Vision and Applications 32 1-21 (2021)
Detection of Breast Cancer From Whole Slide Histopathological Images Using Deep Multiple Instance CNN Das K., Conjeti S. , Chatterjee J. , Sheet D. By IEEE Access 8 213502-213511 (2020)
IDRiD: Diabetic Retinopathy Segmentation and Grading Challenge Porwal P., Sheet D. By Medical Image Analysis 59 101561-101561 (2020)

Completed Projects

Principal Investigator

Adani AI Research Fellowship Program Adani Enterprises Ltd.
AI-based CT Reconstruction for Low Dose, Low Resolution Scan Wipro GE Healthcare Pvt Ltd.

Alumni members

Ph. D. Students

Abhishek Kumar

Area of Research: Medical image analysis, video processing, explainable models.

Abir Chowdhury

Area of Research: Medical imaging, Deep learning, Neuroimaging, Neuro information science

Alik Pramanick

Area of Research: Surgical information and audio-video event analysis

Anupam Borthakur

Area of Research: Federated Learning under Differential Privacy for Medical Imaging

Apoorva Srivastava

Area of Research: Biomedical Signal Processing

Ashraf Haroon Rashid

Area of Research: Multilinear Tensor Algebra for Deep Learning and Medical Imaging

Asim Manna

Area of Research: Deep Learning, Medical Imaging, Visual Hashing

Chinmay Kumar Behera

Area of Research: Deep Learning, Machine Vision, Industrial Process Monitoring

Dipayan Dewan

Area of Research: Neuro information science, Music cognition, Emotion analytics

Laveena Kewlani

Area of Research: Deep Learning, Federated Learning, Distributed Optimization

Maddimsetti Srinivas

Area of Research: Computational medical imaging and image analysis

Rachana Sathish

Area of Research: Computer assisted intervention, machine learning, medical image computing

Raj Krishan Ghosh

Area of Research: Computational ultrasonic imaging and deep learning

Seban James

Area of Research: Robotics

Sista Raviteja

Area of Research: Surgical Video Analytics and Surgical Informatics

MS Students

Rakshith Sathish

Area of Research: Explainable Deep Learning

Book Chapter/Section
- Phase Identification and Workflow Modeling in Laparoscopy Surgeries Using Temporal Connectionism of Deep Visual Residual Abstractions Mishra K., Sathish R. , Sheet D. By Handbook of Deep Learning Applications 201-217 (2019)
- Deep Neural Architecture for Localization and Tracking of Surgical Tools in Cataract Surgery Banerjee N., Sathish R. , Sheet D. By Computer Aided Intervention and Diagnostics in Clinical and Medical Images 31-38 (2019)
- On the Fly Segmentation of Intravascular Ultrasound Images Powered by Learning of Backscattering Physics China D., Mitra P. , Sheet D. By Classification in BioApps 351-380 (2018)
- Domain Adapted Model for In Vivo Intravascular Ultrasound Tissue Characterization Conjeti S., Guha Roy A. , Sheet D. , Carlier S. G., Sayeda-mahmood T. , Navab N. , Katouzian A. By Computing and Visualization for Intravascular Imaging and Computer Assisted Stenting 157-181 (2017)
- Multimodality Breast Imaging: Diagnosis and Treatment Garud H, Sheet D, Chatterjee J, Mahadevappa M, Ray AK and Ghosh A By Computer Vision Theoretic Approach for Breast Cancer Diagnosis: Commonly Perceived Diagnostic Significance of Cytological Features and Feature Usability Analysis of an Existing Breast Cancer Database 361-382 (2013)
Journal
- Designing Deep Neural High-Density Compression Engines for Radiology Images Raj A., Sathish R. , Sarkar T. , Sethuraman R. , Sheet D. By Circuits, Systems, and Signal Processing 42 643-682 (2023)
- Frame-level global context modeling for detection and localization of abnormality Sharma M. K., Kumar V. , Sheet D. , Biswas P. K. By Multimedia Tools and Applications 1-26 (2023)
- Cholectriplet2021: A benchmark challenge for surgical action triplet recognition Nwoye C. I., Raviteja S. , Sathish R. , Balasubramanian V. , Sheet D. By Medical Image Analysis 86 102803--21 (2023)
- Cross-sectional visual comparison of remineralization efficacy of various agents on early smooth surface caries of primary teeth with swept source optical coherence tomography Thomas C. S., Sharma D. S., Sheet D. , Mukhopadhyay A. , Sharma S. By Journal of Oral Biology and Craniofacial Research 11 628-637 (2021)
- CHAOS challenge-combined (CT-MR) healthy abdominal organ segmentation Kavur A. E., Sheet D. By Medical Image Analysis 69 101950-101950 (2021)
- Local instance and context dictionary-based detection and localization of abnormalities Sharma M. K., Sheet D. , Biswas P. K. By Machine Vision and Applications 32 1-21 (2021)
- IDRiD: Diabetic Retinopathy Segmentation and Grading Challenge Porwal P., Sheet D. By Medical Image Analysis 59 101561-101561 (2020)
- Detection of Breast Cancer From Whole Slide Histopathological Images Using Deep Multiple Instance CNN Das K., Conjeti S. , Chatterjee J. , Sheet D. By IEEE Access 8 213502-213511 (2020)
- Spatiotemporal Deep Networks for Detecting Abnormality in Videos Sharma M. K., Sheet D. , Biswas P. K. By Multimedia Tools and Applications 79 11237-11268 (2020)
- Evaluation of Commonly Used Algorithms for Thyroid Ultrasound Images Segmentation and Improvement Using Machine Learning Approaches Poudel P., Illanes A. , Sheet D. , Friebe M. By Journal of Healthcare Engineering 2018 - (2018)
- Anatomical Structure Segmentation in Ultrasound Volumes using Cross Frame Belief Propagating Iterative Random Walks China D., Illanes A. , Poudel P. , Friebe M. , Mitra P. , Sheet D. By IEEE Journal of Biomedical and Health Informatics - (2018)
- Global Spectral and Local Molecular Connects for Optical Coherence Tomography Features to Classify Oral Lesions towards Unravelling Quantitative Imaging Biomarkers Banerjee S., Chatterjee S. , Anura A. , Chakrabarty J. , Pal M. , Ghosh B. , Paul R. R., Sheet D. , Chatterjee J. By RSC Advances 6 7511-7520 (2016)
- Lumen segmentation in intravascular optical coherence tomography using backscattering tracked and initialized random walks Guha Roy A., Conjeti S. , Carlier S. J., Dutta P. K., Kastrati A. , Laine A. F., Navab N. , Katouzian A. , Sheet D. By IEEE Journal of Biomedical and Health Informatics 20 606-614 (2016)
- Learning of speckle statistics for in vivo and noninvasive characterization of cutaneous wound regions using laser speckle contrast imaging Basak K., Dey G. , Mahadevappa M. , Mandal M. , Sheet D. , Dutta P. K. By Microvascular Research 107 6-16 (2016)
- Supervised domain adaptation of decision forests: Transfer of models trained in vitro for in vivo intravascular ultrasound tissue characterization Conjeti S., Katouzian A. , Guha Roy A. , Loic P. , Sheet D. , Carlier S. J., Laine A. F., Navab N. By Medical Image Analysis 32 1-17 (2016)
- Joint learning of ultrasonic backscattering statistical physics and signal confidence primal for characterizing atherosclerotic plaques using intravascular ultrasound Sheet D, Karamalis A, Eslami A, Noel PB, Chatterjee J, Ray AK, Laine AF, Carlier SG, Navab N, Katouzian A By Medical Image Analysis 18(1) 103-117 (2014)
- Hunting for necrosis in the shadows of intravascular ultrasound Sheet D, Karamalis A, Eslami A, Noel PB, Virmani R, Nakano M, Chatterjee J, Ray AK, Laine AF, Carlier SG, Navab N, Katouzian A By Computerized Medical Imaging and Graphics 38(2) 104-112 (2014)
- In situ histology of mice skin through transfer learning of tissue energy interaction in optical coherence tomography Sheet D, Chaudhary A, Karri SPK, Das D, Katouzian A, Banerjee P, Navab N, Chatterjee J, Ray AK By Journal of Biomedical Optics 18(9) 090503-1-3 (2013)
- Iterative self-organizing atherosclerotic tissue labeling in intravascular ultrasound images and comparison with virtual histology Katouzian A, Karamalis A, Sheet D, Konofagou E, Baseri B, Carlier SG, Eslami A, Koenig A, Navab N, Laine AF By IEEE Transactions on Biomedical Engineering 59(11) 3039- 3049 (2012)
- Brightness preserving dynamic fuzzy histogram equalization Sheet D, Garud H, Suveer A, Chatterjee J and Mahadevappa M By IEEE Transactions on Consumer Electronics 56(4) 2475-2480 (2010)
Patent
- Digital microscopy equipment with image acquisition, image analysis and network communication Garud H, Sheet D, Chatterjee J, Mahadevappa M, Ray AK By US Patent - (2011)
Educational Package
- Deep Learning for Visual Computing (DLVC) Sheet D. By - (2017)
- Medical Image Analysis (NPTEL Online Course) Sheet D. By - (2016)
Conferences
- I m GROOT: a multi head multi GRaph netwOrk recognizing surgical actiOn Triplets Raviteja S., Sathish R. , Agrawal R. , De U. , Chakrabarti P. P., Sheet D. By Thirteenth Indian Conference on Computer Vision, Graphics and Image Processing 1-9 (2022)
- Design of a System and Method for Optimal selection of Tumor Slice using Linear Ultrasound Imaging for Histopathology Kumar A., Sheet D. By Thirteenth Indian Conference on Computer Vision, Graphics and Image Processing 1-8 (2022)
- Learning to Generate Missing Pulse Sequence in MRI using Deep Convolution Neural Network Trained with Visual Turing Test Kumar V., Sharma M. K., Jehadeesan R. , Venkatraman B. , Suman G. , Patra A. , Goenka A. H., Sheet D. By 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 3419-3422 (2021)
- Adversarial Training of Deep Convolutional Neural Network for Multi-organ Segmentation from Multi-sequence MRI of the Abdomen Kumar V., Sharma M. K., Jehadeesan R. , Venkatraman B. , Sheet D. By 2021 International Conference on Intelligent Technologies (CONIT) 1-6 (2021)
- Thyroid Nodule Segmentation and Pathological Clustering in Ultrasound Images using a Fast Deep Convolutional Neural Network Goel V., Gomes Ataide E. J., Maheshwari H. , Ghosh R. , Kumar A. , Illanes A. , Schenke S. , Ghazzawi S. , Kreissl M. C., Friebe M. , Sheet D. By CARS 2021 Computer Assisted Radiology and Surgery Congress 1-6 (2021)
- Distill DSM: Computationally efficient method for segmentation of medical imaging volumes Maheshwari H., Goel V. , Sethuraman R. , Sheet D. By Medical Imaging with Deep Learning 1-11 (2021)
- Assessing Lobe-wise Burden of COVID-19 Infection in Computed Tomography of Lungs using Knowledge Fusion from Multiple Datasets Visvanathan M., Balasubramanian V. , Sathish R. , Balasubramaniam S. , Sheet D. By 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 3961-3964 (2021)
- A Systematic Search over Deep Convolutional Neural Network Architectures for Screening Chest Radiographs Mitra A., Chakravarty A. , Ghosh N. , Sarkar T. , Sethuraman R. , Sheet D. By 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society 1225-1228 (2020)
- A Two-Stage Multiple Instance Learning Framework for the Detection of Breast Cancer in Mammograms Chandra S. K., Chakravarty A. , Ghosh N. , Sarkar T. , Sethuraman R. , Sheet D. By 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society 1128-1131 (2020)
- Learning Decision Ensemble using a Graph Neural Network for Comorbidity Aware Chest Radiograph Screening Chakravarty A., Sarkar T. , Ghosh N. , Sethuraman R. , Sheet D. By 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society 1234-1237 (2020)
- Lung Segmentation and Nodule Detection in Computed Tomography Scan using a Convolutional Neural Network Trained Adversarially using Turing Test Loss Sathish R., Sathish R. , Sethuraman R. , Sheet D. By 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 1331-1334 (2020)
- Image Embedding for Detecting Irregularity Sharma M. K., Sheet D. , Biswas P. K. By 3rd International Conference on Computer Vision and Image Processing 243-255 (2019)
- Adversarially Trained Convolutional Neural Networks for Semantic Segmentation of Ischaemic Stroke Lesion using Multisequence Magnetic Resonance Imaging Sathish R., Rajan R. , Vupputuri A. , Ghosh N. , Sheet D. By 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 1010-1013 (2019)
- Adversarially Trained Convolutional Neural Networks for Semantic Segmentation of Ischaemic Stroke Lesion using Multisequence Magnetic Resonance Imaging Sathish R., Rajan R. , Vupputuri A. , Ghosh N. , Sheet D. By 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 1010-1013 (2019)
- Adversarially Trained Deep Neural Semantic Hashing Scheme for Subjective Search in Fashion Inventory Singh S., Dasgupta M. , Sheet D. By 2019 4th International Workshop on Fashion and KDD, 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining 1-4 (2019)
- Learning with Multitask Adversaries using Weakly Labelled Data for Semantic Segmentation in Retinal Images Saha O., Sathish R. , Sheet D. By Int. Conf. Medical Imaging with Deep Learning (MIDL) 414-426 (2019)
- Radiologist Validated Systemic Search over Deep Neural Networks for Screening Musculoskeletal Radiographs Chakravarty A., Sarkar T. , Ghosh N. , Sethuraman R. , Sheet D. By Medical Imaging meets NeurIPS Workshop at 33rd Annual Conference on Neural Information Processing Systems 1-4 (2019)
- Unit Impulse Response as an Explainer of Redundancy in a Deep Convolutional Neural Network Sathish R., Sheet D. By Explainable AI Workshop, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2019) 24-27 (2019)
- A Deep Convolutional Neural Network Based Classification Of Multi-Class Motor Imagery With Improved Generalization Kar A., Bera S. , Karri S. K., Ghosh S. , Mahadevappa M. , Sheet D. By 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 5085-5088 (2018)
- Jointly Learning Convolutional Representations to Compress Radiological Images and Classify Thoracic Diseases in the Compressed Domain Ranjan E., Paul S. , Kapoor S. , Kar A. , Sethuraman R. , Sheet D. By Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP) - (2018)
- Deep Neural Architecture for Localization and Tracking of Surgical Tools in Cataract Surgery Banerjee N., Sathish R. , Sheet D. By International Conference on Clinical and Medical Image Analysis (ICCMIA) 31-38 (2018)
- Fully Convolutional Model for Variable Bit Length and Lossy High Density Compression of Mammograms Kar A., Karri S. K., Ghosh N. , Sethuraman R. , Sheet D. By IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops 2591-2594 (2018)
- Immersive augmented reality system for assisting needle positioning during ultrasound guided intervention Kanithi P. K., Chatterjee J. , Sheet D. By 10th Indian Conference on Computer Vision, Graphics and Image Processing 65- (2016)
- Deep neural ensemble for retinal vessel segmentation in fundus images towards achieving label-free angiography Lahiri A., Guha Roy A. , Sheet D. , Biswas P. K. By 38th Annual Conference of the IEEE Engineering in Medicine and Biology Society 1340-1343 (2016)
- Abnormality Detecting Deep Belief Network Sharma M. K., Sheet D. , Biswas P. K. By International Conference on Advances in Information Communication Technology & Computing 11- (2016)
- A generalized framework for stain separation in digital pathology applications Ghosh B., Karri S. K., Sheet D. , Garud H. , Ghosh A. , Ray A. K., Chatterjee J. By IEEE Annual India Conference (INDICON) 1-4 (2016)
- Landscaping of Random Forests through Controlled Deforestation Das K., Guha Roy A. , Chatterjee J. , Sheet D. By 22nd National Conference on Communication 1-5 (2016)
- Limitations with measuring performance of techniques for abnormality localization in surveillance video and how to overcome them? Sharma M. K., Sarkar S. , Sheet D. , Biswas P. K. By 10th Indian Conference on Computer Vision, Graphics and Image Processing 1-8 (2016)
- Simulation of B-mode Optical Coherence Tomography from Histology Das K., Guha Roy A. , Ghosh B. , Chatterjee J. , Sheet D. By IEEE Int. Symp. on Biomedical Imaging (ISBI) - (2016)
- An unsupervised approach for overlapping cervical cell cytoplasm segmentation Kumar P., Happy S. L., Chatterjee S. , Sheet D. , Routray A. By IEEE EMBS Conference on Biomedical Engineering and Sciences 106-109 (2016)
- An unsupervised approach for overlapping cervical cell cytoplasm segmentation Pranav K., S. L. H. , Swarnadip C. , Sheet D. , Routray A. By IECBES 2016 - IEEE-EMBS Conference on Biomedical Engineering and Sciences 106-109 (2016)
Workshop
- Verifiable and Energy Efficient Medical Image Analysis with Quantised Self-attentive Deep Neural Networks Sathish R., Khare S. R., Sheet D. By 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) W. Affordable AI and Healthcare for Resource Diverse Global Health (FAIR 2022) 178-189 (2022)
- Multitask Learning of Temporal Connectionism in Convolutional Networks using a Joint Distribution Loss Function to Simultaneously Identify Tools and Phase in Surgical Videos Mandal S. S., Sathish R. , Sheet D. By Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP) - MedImage Workshop - (2018)
- Identification of Cervical Pathology in Colposcopy Images using Adversarially Trained Convolutional Neural Networks Nandy A., Sathish R. , Sheet D. By Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP) - MedImage Workshop - (2018)
- Learning Latent Temporal Connectionism of Deep Residual Visual Abstractions for Identifying Surgical Tools in Laparoscopy Procedures Mishra K., Sathish R. , Sheet D. By Deep Vision at The 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition 1-8 (2017)
- Tracking of Retinal Microsurgery Tools using Late Fusion of Responses from Convolutional Neural Network over Pyramidally Decomposed Frames Mishra K., Sathish R. , Sheet D. By MedImage at 10th Indian Conference on Computer Vision, Graphics and Image Processing - (2016)
- Segmentation of Lumen and External Elastic Laminae in Intravascular Ultrasound Images using Ultrasonic Backscattering Physics Initialized Multiscale Random Walks China D., Mitra P. , Sheet D. By MedImage at 10th Indian Conference on Computer Vision, Graphics and Image Processing - (2016)
- Methods and System for Segmented of Isolated Nuclei in Microscopic Images of Breast Fine Needle Aspiration Cytology Images Garud H., Karri S. K., Ghosh A. , Sheet D. , Chatterjee J. , Mahadevappa M. , Ray A. K. By MedImage at 10th Indian Conference on Computer Vision, Graphics and Image Processing - (2016)
Symposium
- Federated Learning for Site Aware Chest Radiograph Screening Chakravarty A., Kar A. , Sethuraman R. , Sheet D. By 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI) 1077-1081 (2021)
- Zero-Shot Adaptation to Simulate 3D Ultrasound Volume by Learning a Multilinear Separable 2D Convolutional Neural Network Mooga A., Sethuraman R. , Sheet D. By 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI) 1780-1783 (2020)
- SUMNet: Fully Convolutional Model for Fast Segmentation of Anatomical Structures in Ultrasound Volumes Nandamuri S., China D. , Mitra P. , Sheet D. By IEEE International Symposium on Biomedical Imaging (ISBI) - (2019)
- Learning a Deep Convolution Network with Turing Test Adversaries for Microscopy Image Super Resolution Tom F., Mudhra D. , Sharma H. , Rai Dastidar T. , Sheet D. By IEEE International Symposium on Biomedical Imaging (ISBI) - (2019)
- UltraCompression: Framework for High Density Compression of Ultrasound Volumes using Physics Modeling Deep Neural Networks China D., Tom F. , Nandamuri S. , Kar A. , Srinivasan M. , Mitra P. , Sheet D. By IEEE International Symposium on Biomedical Imaging (ISBI) - (2019)
- Classifying Histopathology Whole-Slides using Fusion of Decisions from Deep Convolutional Network on a Collection of Random Multi-views at Multi-magnifications Das K., Karri S. K., Guha Roy A. , Chatterjee J. , Sheet D. By International Symposium on Biomedical Imaging 1024-1027 (2017)
- Multiscale Distribution Preserving Autoencoders for Plaque Detection in Intravascular Optical Coherence Tomography Guha Roy A., Conjeti S. , Carlier S. G., Houissa K. , Koenig A. , Kastrati A. , Dutta P. K., Laine A. F., Navab N. , Katouzian A. , Sheet D. By International Symposium on Biomedical Imaging 1359-1362 (2016)