Microscopy Machine Vision Lab

Research

Deep learning is not easy. For example, applying deep learning on a specifcal microscopy image analysis problem is much more than collecting images, making annotations, and feeding the images with annotations into a neural network. On one hand, annotation is not easy and sometimes even impossible (e.g., accurately annotating the segmentation of a very complex shape in 3D is nearly impossible). On the other hand, there are many important questions to think about. How to evaluate the quality of your annotation? What if different people have different annotations? How can I annotate the minimal amount of data to achieve to desired accuracy? When I apply my model on new images, how do I know the results are correct? …

Solving real computational biomedical problems with AI is not straightforward. The quantitative tasks in many biomedical applications may not be easily formulated into common deep learning or computer vision problems (e.g., segmentation, classification, image reconstruction, etc.). Even a well-defined problem, we may face very different challenges in the specific biomedical context than the problem’s original general computer vision setting. For example, it would be easy for everyone to accuratly annotate the contour of a car in a 2D image, but it could be very difficult to annotate the boundary of a nucleus in a 3D confocal microscopy image. It is not only because 3D is hard, but also because you have to take the diffraction of light into account to avoid over-segmentation. Or, minor segmentation error of cars may not be a big deal, but minor segmentation error of nuclei (e.g., over-smoothed boundary of nuclei with complex shape when being squeezed) may yield very different biomedical findings. So, to develop a successful AI-based microscopy image analysis algorithm, it is very important to have good understanding of microscopy and the underlying biomedical application.

Tracking cells in 2D/3D microscopy images

2023

Zhenge Jia, Jianxu Chen, Xiaowei Xu, John Kheir, Jingtong Hu, Han Xiao, Sui Peng, Xiaobo Sharon Hu, Danny Chen, Yiyu Shi
Nature Machine Intelligence  ·  12 Jun 2023
Philippa Spangenberg, Nina Hagemann, Anthony Squire, Nils Förster, Sascha D. Krauß, Yachao Qi, Ayan Mohamud Yusuf, Jing Wang, Anika Grüneboom, Lennart Kowitz, Sebastian Korste, Matthias Totzeck, Zülal Cibir, Ali Ata Tuz, Vikramjeet Singh, Devon Siemes, Laura Struensee, Daniel R. Engel, Peter Ludewig, Luiza Martins Nascentes Melo, Iris Helfrich, Jianxu Chen, Matthias Gunzer, Dirk M. Hermann, Axel Mosig
Cell Reports Methods  ·  01 Mar 2023
Matthias Gunzer, Zülal Cibir, Jacqueline Hassel, Justin Sonneck, Lennart Kowitz, Jianxu Chen, Susmita Ghosh, Albert Sickmann, Alexander Beer, Andreas Kraus, Gabriel Hallekamp, Martin Rosenkranz, Pascal Raffelberg, Sven Olfen, Kamil Smilowski, Roman Burkard, Karsten Seidl, Anton Grabmaier, Reinhard Viga, Iris Helfrich, Anne-Kathrin Klebl, Bert Klebl, Jan Eickhoff
Research Square Platform LLC  ·  17 Feb 2023
Matheus P. Viana, Jianxu Chen, Theo A. Knijnenburg, Ritvik Vasan, Calysta Yan, Joy E. Arakaki, Matte Bailey, Ben Berry, Antoine Borensztejn, Eva M. Brown, Sara Carlson, Julie A. Cass, Basudev Chaudhuri, Kimberly R. Cordes Metzler, Mackenzie E. Coston, Zach J. Crabtree, Steve Davidson, Colette M. DeLizo, Shailja Dhaka, Stephanie Q. Dinh, Thao P. Do, Justin Domingus, Rory M. Donovan-Maiye, Alexandra J. Ferrante, Tyler J. Foster, Christopher L. Frick, Griffin Fujioka, Margaret A. Fuqua, Jamie L. Gehring, Kaytlyn A. Gerbin, Tanya Grancharova, Benjamin W. Gregor, Lisa J. Harrylock, Amanda Haupt, Melissa C. Hendershott, Caroline Hookway, Alan R. Horwitz, H. Christopher Hughes, Eric J. Isaac, Gregory R. Johnson, Brian Kim, Andrew N. Leonard, Winnie W. Leung, Jordan J. Lucas, Susan A. Ludmann, Blair M. Lyons, Haseeb Malik, Ryan McGregor, Gabe E. Medrash, Sean L. Meharry, Kevin Mitcham, Irina A. Mueller, Timothy L. Murphy-Stevens, Aditya Nath, Angelique M. Nelson, Sandra A. Oluoch, Luana Paleologu, T. Alexander Popiel, Megan M. Riel-Mehan, Brock Roberts, Lisa M. Schaefbauer, Magdalena Schwarzl, Jamie Sherman, Sylvain Slaton, M. Filip Sluzewski, Jacqueline E. Smith, Youngmee Sul, Madison J. Swain-Bowden, W. Joyce Tang, Derek J. Thirstrup, Daniel M. Toloudis, Andrew P. Tucker, Veronica Valencia, Winfried Wiegraebe, Thushara Wijeratna, Ruian Yang, Rebecca J. Zaunbrecher, Ramon Lorenzo D. Labitigan, Adrian L. Sanborn, Graham T. Johnson, Ruwanthi N. Gunawardane, Nathalie Gaudreault, Julie A. Theriot, Susanne M. Rafelski
Nature  ·  04 Jan 2023
Annika Reinke, Minu D. Tizabi, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Emre Kavur, Tim Rädsch, Carole H. Sudre, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Matthew Blaschko, Florian Buettner, M. Jorge Cardoso, Veronika Cheplygina, Jianxu Chen, Evangelia Christodoulou, Beth A. Cimini, Gary S. Collins, Keyvan Farahani, Luciana Ferrer, Adrian Galdran, Bram van Ginneken, Ben Glocker, Patrick Godau, Robert Haase, Daniel A. Hashimoto, Michael M. Hoffman, Merel Huisman, Fabian Isensee, Pierre Jannin, Charles E. Kahn, Dagmar Kainmueller, Bernhard Kainz, Alexandros Karargyris, Alan Karthikesalingam, Hannes Kenngott, Jens Kleesiek, Florian Kofler, Thijs Kooi, Annette Kopp-Schneider, Michal Kozubek, Anna Kreshuk, Tahsin Kurc, Bennett A. Landman, Geert Litjens, Amin Madani, Klaus Maier-Hein, Anne L. Martel, Peter Mattson, Erik Meijering, Bjoern Menze, Karel G. M. Moons, Henning Müller, Brennan Nichyporuk, Felix Nickel, Jens Petersen, Susanne M. Rafelski, Nasir Rajpoot, Mauricio Reyes, Michael A. Riegler, Nicola Rieke, Julio Saez-Rodriguez, Clara I. Sánchez, Shravya Shetty, Maarten van Smeden, Ronald M. Summers, Abdel A. Taha, Aleksei Tiulpin, Sotirios A. Tsaftaris, Ben Van Calster, Gaël Varoquaux, Manuel Wiesenfarth, Ziv R. Yaniv, Paul F. Jäger, Lena Maier-Hein
arXiv  ·  01 Jan 2023
Yu Zhou, Justin Sonneck, Sweta Banerjee, Stefanie Dörr, Anika Grüneboom, Kristina Lorenz, Jianxu Chen
arXiv  ·  01 Jan 2023
Jianning Li, Antonio Pepe, Christina Gsaxner, Gijs Luijten, Yuan Jin, Narmada Ambigapathy, Enrico Nasca, Naida Solak, Gian Marco Melito, Viet Duc Vu, Afaque R. Memon, Xiaojun Chen, Jan Stefan Kirschke, Ezequiel de la Rosa, Patrick Ferdinand Christ, Hongwei Bran Li, David G. Ellis, Michele R. Aizenberg, Sergios Gatidis, Thomas Küstner, Nadya Shusharina, Nicholas Heller, Vincent Andrearczyk, Adrien Depeursinge, Mathieu Hatt, Anjany Sekuboyina, Maximilian Löffler, Hans Liebl, Reuben Dorent, Tom Vercauteren, Jonathan Shapey, Aaron Kujawa, Stefan Cornelissen, Patrick Langenhuizen, Achraf Ben-Hamadou, Ahmed Rekik, Sergi Pujades, Edmond Boyer, Federico Bolelli, Costantino Grana, Luca Lumetti, Hamidreza Salehi, Jun Ma, Yao Zhang, Ramtin Gharleghi, Susann Beier, Arcot Sowmya, Eduardo A. Garza-Villarreal, Thania Balducci, Diego Angeles-Valdez, Roberto Souza, Leticia Rittner, Richard Frayne, Yuanfeng Ji, Soumick Chatterjee, Florian Dubost, Stefanie Schreiber, Hendrik Mattern, Oliver Speck, Daniel Haehn, Christoph John, Andreas Nürnberger, João Pedrosa, Carlos Ferreira, Guilherme Aresta, António Cunha, Aurélio Campilho, Yannick Suter, Jose Garcia, Alain Lalande, Emmanuel Audenaert, Claudia Krebs, Timo Van Leeuwen, Evie Vereecke, Rainer Röhrig, Frank Hölzle, Vahid Badeli, Kathrin Krieger, Matthias Gunzer, Jianxu Chen, Amin Dada, Miriam Balzer, Jana Fragemann, Frederic Jonske, Moritz Rempe, Stanislav Malorodov, Fin H. Bahnsen, Constantin Seibold, Alexander Jaus, Ana Sofia Santos, Mariana Lindo, André Ferreira, Victor Alves, Michael Kamp, Amr Abourayya, Felix Nensa, Fabian Hörst, Alexander Brehmer, Lukas Heine, Lars E. Podleska, Matthias A. Fink, Julius Keyl, Konstantinos Tserpes, Moon-Sung Kim, Shireen Elhabian, Hans Lamecker, Dženan Zukić, Beatriz Paniagua, Christian Wachinger, Martin Urschler, Luc Duong, Jakob Wasserthal, Peter F. Hoyer, Oliver Basu, Thomas Maal, Max J. H. Witjes, Ti-chiun Chang, Seyed-Ahmad Ahmadi, Ping Luo, Bjoern Menze, Mauricio Reyes, Christos Davatzikos, Behrus Puladi, Jens Kleesiek, Jan Egger
arXiv  ·  01 Jan 2023

2022

Ali A Tuz, Alexander Beer, Markus Gallert, Dimitris Ttoouli, Susmita Ghosh, Sai P Sata, Andreas Kraus, Franziska Zwirnlein, Viola Kaygusuz, Vivian Lakovic, Altea Qefalia, Medina Antler, Sebastian Korste, Britta Kaltwasser, Hossam Abdelrahman, Ayan Mohamud-Yusuf, Chen Wang, Lars Haeusler, Smiths Lueong, Martin Stenzel, Benedikt Frank, Martin Köhrmann, Jens Siveke, Matthias Totzeck, Daniel Hoffmann, Anika Grüneboom, Nina Hagemann, Anja Hasenberg, Albert Sickmann, Jianxu Chen, Dirk M Hermann, Matthias Gunzer, Vikramjeet Singh
Cold Spring Harbor Laboratory  ·  09 Nov 2022

2021

Kaytlyn A. Gerbin, Tanya Grancharova, Rory M. Donovan-Maiye, Melissa C. Hendershott, Helen G. Anderson, Jackson M. Brown, Jianxu Chen, Stephanie Q. Dinh, Jamie L. Gehring, Gregory R. Johnson, HyeonWoo Lee, Aditya Nath, Angelique M. Nelson, M. Filip Sluzewski, Matheus P. Viana, Calysta Yan, Rebecca J. Zaunbrecher, Kimberly R. Cordes Metzler, Nathalie Gaudreault, Theo A. Knijnenburg, Susanne M. Rafelski, Julie A. Theriot, Ruwanthi N. Gunawardane
Cell Systems  ·  01 Jun 2021

2020

Hongxiao Wang, Hao Zheng, Jianxu Chen, Lin Yang, Yizhe Zhang, Danny Z. Chen
IEEE BIBM Conference  ·  16 Dec 2020
Jianxu Chen, Liya Ding, Matheus P. Viana, HyeonWoo Lee, M. Filip Sluezwski, Benjamin Morris, Melissa C. Hendershott, Ruian Yang, Irina A. Mueller, Susanne M. Rafelski
bioRxiv  ·  13 Dec 2020
Peixian Liang, Jianxu Chen, Yizhe Zhang, Hongxiao Wang, Hao Zheng, Pengfei Gu, Danny Chen
IEEE CBMS Conference  ·  01 Jul 2020

2019

Chinedu S. Madukoma, Peixian Liang, Aleksandar Dimkovikj, Jianxu Chen, Shaun W. Lee, Danny Z. Chen, Joshua D. Shrout
Journal of Bacteriology  ·  01 Oct 2019
Hao Zheng, Lin Yang, Jianxu Chen, Jun Han, Yizhe Zhang, Peixian Liang, Zhuo Zhao, Chaoli Wang, Danny Z. Chen
AAAI Conference  ·  17 Jul 2019
Peixian Liang, Jianxu Chen, Hao Zheng, Lin Yang, Yizhe Zhang, Danny Z. Chen
IEEE ISBI Conference  ·  01 Apr 2019
Pavel A. Brodskiy, Qinfeng Wu, Dharsan K. Soundarrajan, Francisco J. Huizar, Jianxu Chen, Peixian Liang, Cody Narciso, Megan K. Levis, Ninfamaria Arredondo-Walsh, Danny Z. Chen, Jeremiah J. Zartman
Biophysical Journal  ·  01 Feb 2019

2018

Peixian Liang, Jianxu Chen, Pavel A. Brodskiy, Qinfeng Wu, Yejia Zhang, Yizhe Zhang, Lin Yang, Jeremiah J. Zartman, Danny Z. Chen
IEEE ISBI Conference  ·  01 Apr 2018

2017

O.V. Kim, R.I. Litvinov, J. Chen, D.Z. Chen, J.W. Weisel, M.S. Alber
Matrix Biology  ·  01 Jul 2017
Xiaoming Chen, Jianxu Chen, Danny Z. Chen, Xiaobo Sharon Hu
ACM Design Automation Conference  ·  18 Jun 2017
Yizhe Zhang, Lin Yang, Jianxu Chen, Maridel Fredericksen, David P. Hughes, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2017
Lin Yang, Yizhe Zhang, Jianxu Chen, Siyuan Zhang, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2017
Jianxu Chen, Sreya Banerjee, Abhinav Grama, Walter J. Scheirer, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2017

2016

Jianxu Chen, Mark S. Alber, Danny Z. Chen
IEEE Transactions on Medical Imaging  ·  01 Sep 2016
Dhagash Mehta, Jianxu Chen, Danny Z. Chen, Halim Kusumaatmaja, David J. Wales
Physical Review Letters  ·  06 Jul 2016
Jianxu Chen, Feng Shen, Danny Ziyi Chen, Patrick J. Flynn
IEEE Transactions on Information Forensics and Security  ·  01 Jul 2016
Jianxu Chen, Yiqing Cai, Chen Wei, Lin Yang, Mark S. Alber, Danny Z. Chen
IEEE ISBI Conference  ·  01 Apr 2016

2015

Jianxu Chen, Feng Shen, Danny Z. Chen, Patrick J. Flynn
IEEE International Conference on Identity, Security, and Behavior Analysis  ·  01 Mar 2015
Jianxu Chen, Shant Mahserejian, Mark Alber, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2015

2014

Jianxu Chen, Oleg V. Kim, Rustem I. Litvinov, John W. Weisel, Mark S. Alber, Danny Z. Chen
IEEE CBMS Conference  ·  01 May 2014
Jianxu Chen, Cameron W. Harvey, Mark S. Alber, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2014