Microscopy Machine Vision Lab

Research

Deep learning is not easy. For example, applying deep learning on a specifcal microscopy image analysis problem is much more than collecting images, making annotations, and feeding the images with annotations into a neural network. On one hand, annotation is not easy and sometimes even impossible (e.g., accurately annotating the segmentation of a very complex shape in 3D is nearly impossible). On the other hand, there are many important questions to think about. How to evaluate the quality of your annotation? What if different people have different annotations? How can I annotate the minimal amount of data to achieve to desired accuracy? When I apply my model on new images, how do I know the results are correct? …

Solving real computational biomedical problems with AI is not straightforward. The quantitative tasks in many biomedical applications may not be easily formulated into common deep learning or computer vision problems (e.g., segmentation, classification, image reconstruction, etc.). Even a well-defined problem, we may face very different challenges in the specific biomedical context than the problem’s original general computer vision setting. For example, it would be easy for everyone to accuratly annotate the contour of a car in a 2D image, but it could be very difficult to annotate the boundary of a nucleus in a 3D confocal microscopy image. It is not only because 3D is hard, but also because you have to take the diffraction of light into account to avoid over-segmentation. Or, minor segmentation error of cars may not be a big deal, but minor segmentation error of nuclei (e.g., over-smoothed boundary of nuclei with complex shape when being squeezed) may yield very different biomedical findings. So, to develop a successful AI-based microscopy image analysis algorithm, it is very important to have good understanding of microscopy and the underlying biomedical application.

Tracking cells in 2D/3D microscopy images

2024

Jan Egger, Christina Gsaxner, Gijs Luijten, Jianxu Chen, Xiaojun Chen, Jiang Bian, Jens Kleesiek, Behrus Puladi
JMIR Serious Games  ·  18 Sep 2024
Shanghang Zhang, Gaole Dai, Tiejun Huang, Jianxu Chen
Nature Methods  ·  01 Aug 2024
Julie C. Dixon, Christopher L. Frick, Chantelle L. Leveille, Philip Garrison, Peyton A. Lee, Saurabh S. Mogre, Benjamin Morris, Nivedita Nivedita, Ritvik Vasan, Jianxu Chen, Cameron L. Fraser, Clare R. Gamlin, Leigh K. Harris, Melissa C. Hendershott, Graham T. Johnson, Kyle N. Klein, Sandra A. Oluoch, Derek J. Thirstrup, M. Filip Sluzewski, Lyndsay Wilhelm, Ruian Yang, Daniel M. Toloudis, Matheus P. Viana, Julie A. Theriot, Susanne M. Rafelski
bioRxiv  ·  30 Jun 2024
Jiachen Yao, Nina Hagemann, Qiaojie Xiong, Jianxu Chen, Dirk M. Hermann, Chao Chen
2024 IEEE International Symposium on Biomedical Imaging (ISBI)  ·  27 May 2024
Ali A. Tuz, Susmita Ghosh, Laura Karsch, Dimitris Ttoouli, Sai P. Sata, Özgür Ulusoy, Andreas Kraus, Nils Hoerenbaum, Jan-Niklas Wolf, Sabrina Lohmann, Franziska Zwirnlein, Viola Kaygusuz, Vivian Lakovic, Hannah-Lea Tummes, Alexander Beer, Markus Gallert, Stephanie Thiebes, Altea Qefalia, Zülal Cibir, Medina Antler, Sebastian Korste, Elias Haj Yehia, Lars Michel, Tienush Rassaf, Britta Kaltwasser, Hossam Abdelrahman, Ayan Mohamud Yusuf, Chen Wang, Dongpei Yin, Lars Haeusler, Smiths Lueong, Mathis Richter, Daniel R. Engel, Martin Stenzel, Oliver Soehnlein, Benedikt Frank, Mialitiana Solo-Nomenjanahary, Benoît Ho-Tin-Noé, Jens T. Siveke, Matthias Totzeck, Daniel Hoffmann, Anika Grüneboom, Nina Hagemann, Anja Hasenberg, Jean-Philippe Desilles, Mikael Mazighi, Albert Sickmann, Jianxu Chen, Dirk M. Hermann, Matthias Gunzer, Vikramjeet Singh
Nature Cardiovascular Research  ·  23 Apr 2024
Nina Hagemann, Yachao Qi, Ayan Mohamud Yusuf, AnRan Li, Anthony Squire, Tobias Tertel, Bernd Giebel, Peter Ludewig, Philippa Spangenberg, Jianxu Chen, Axel Mosig, Matthias Gunzer, Dirk M. Hermann
Arteriosclerosis, Thrombosis, and Vascular Biology  ·  01 Apr 2024
Annika Reinke, Minu D. Tizabi, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Emre Kavur, Tim Rädsch, Carole H. Sudre, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Florian Buettner, M. Jorge Cardoso, Veronika Cheplygina, Jianxu Chen, Evangelia Christodoulou, Beth A. Cimini, Keyvan Farahani, Luciana Ferrer, Adrian Galdran, Bram van Ginneken, Ben Glocker, Patrick Godau, Daniel A. Hashimoto, Michael M. Hoffman, Merel Huisman, Fabian Isensee, Pierre Jannin, Charles E. Kahn, Dagmar Kainmueller, Bernhard Kainz, Alexandros Karargyris, Jens Kleesiek, Florian Kofler, Thijs Kooi, Annette Kopp-Schneider, Michal Kozubek, Anna Kreshuk, Tahsin Kurc, Bennett A. Landman, Geert Litjens, Amin Madani, Klaus Maier-Hein, Anne L. Martel, Erik Meijering, Bjoern Menze, Karel G. M. Moons, Henning Müller, Brennan Nichyporuk, Felix Nickel, Jens Petersen, Susanne M. Rafelski, Nasir Rajpoot, Mauricio Reyes, Michael A. Riegler, Nicola Rieke, Julio Saez-Rodriguez, Clara I. Sánchez, Shravya Shetty, Ronald M. Summers, Abdel A. Taha, Aleksei Tiulpin, Sotirios A. Tsaftaris, Ben Van Calster, Gaël Varoquaux, Ziv R. Yaniv, Paul F. Jäger, Lena Maier-Hein
Nature Methods  ·  01 Feb 2024
Yu Zhou, Jiajun Cao, Justin Sonneck, Sweta Banerjee, Stefanie Dörr, Anika Grüneboom, Kristina Lorenz, Shanghang Zhang, Jianxu Chen
Nature Methods  ·  24 Jan 2024
Gaole Dai, Cheng-Ching Tseng, Qingpo Wuwu, Rongyu Zhang, Shaokang Wang, Ming Lu, Tiejun Huang, Yu Zhou, Ali Ata Tuz, Matthias Gunzer, Jianxu Chen, Shanghang Zhang
arXiv  ·  01 Jan 2024
Zixuan Pan, Jun Xia, Zheyu Yan, Guoyue Xu, Yawen Wu, Zhenge Jia, Jianxu Chen, Yiyu Shi
arXiv  ·  01 Jan 2024

2023

Zülal Cibir, Jacqueline Hassel, Justin Sonneck, Lennart Kowitz, Alexander Beer, Andreas Kraus, Gabriel Hallekamp, Martin Rosenkranz, Pascal Raffelberg, Sven Olfen, Kamil Smilowski, Roman Burkard, Iris Helfrich, Ali Ata Tuz, Vikramjeet Singh, Susmita Ghosh, Albert Sickmann, Anne-Kathrin Klebl, Jan Eike Eickhoff, Bert Klebl, Karsten Seidl, Jianxu Chen, Anton Grabmaier, Reinhard Viga, Matthias Gunzer
Nature Communications  ·  11 Dec 2023
Justin Sonneck, Shuo Zhao, Jianxu Chen
2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)  ·  02 Oct 2023
Zhenge Jia, Jianxu Chen, Xiaowei Xu, John Kheir, Jingtong Hu, Han Xiao, Sui Peng, Xiaobo Sharon Hu, Danny Chen, Yiyu Shi
Nature Machine Intelligence  ·  12 Jun 2023
Philippa Spangenberg, Nina Hagemann, Anthony Squire, Nils Förster, Sascha D. Krauß, Yachao Qi, Ayan Mohamud Yusuf, Jing Wang, Anika Grüneboom, Lennart Kowitz, Sebastian Korste, Matthias Totzeck, Zülal Cibir, Ali Ata Tuz, Vikramjeet Singh, Devon Siemes, Laura Struensee, Daniel R. Engel, Peter Ludewig, Luiza Martins Nascentes Melo, Iris Helfrich, Jianxu Chen, Matthias Gunzer, Dirk M. Hermann, Axel Mosig
Cell Reports Methods  ·  01 Mar 2023
Matheus P. Viana, Jianxu Chen, Theo A. Knijnenburg, Ritvik Vasan, Calysta Yan, Joy E. Arakaki, Matte Bailey, Ben Berry, Antoine Borensztejn, Eva M. Brown, Sara Carlson, Julie A. Cass, Basudev Chaudhuri, Kimberly R. Cordes Metzler, Mackenzie E. Coston, Zach J. Crabtree, Steve Davidson, Colette M. DeLizo, Shailja Dhaka, Stephanie Q. Dinh, Thao P. Do, Justin Domingus, Rory M. Donovan-Maiye, Alexandra J. Ferrante, Tyler J. Foster, Christopher L. Frick, Griffin Fujioka, Margaret A. Fuqua, Jamie L. Gehring, Kaytlyn A. Gerbin, Tanya Grancharova, Benjamin W. Gregor, Lisa J. Harrylock, Amanda Haupt, Melissa C. Hendershott, Caroline Hookway, Alan R. Horwitz, H. Christopher Hughes, Eric J. Isaac, Gregory R. Johnson, Brian Kim, Andrew N. Leonard, Winnie W. Leung, Jordan J. Lucas, Susan A. Ludmann, Blair M. Lyons, Haseeb Malik, Ryan McGregor, Gabe E. Medrash, Sean L. Meharry, Kevin Mitcham, Irina A. Mueller, Timothy L. Murphy-Stevens, Aditya Nath, Angelique M. Nelson, Sandra A. Oluoch, Luana Paleologu, T. Alexander Popiel, Megan M. Riel-Mehan, Brock Roberts, Lisa M. Schaefbauer, Magdalena Schwarzl, Jamie Sherman, Sylvain Slaton, M. Filip Sluzewski, Jacqueline E. Smith, Youngmee Sul, Madison J. Swain-Bowden, W. Joyce Tang, Derek J. Thirstrup, Daniel M. Toloudis, Andrew P. Tucker, Veronica Valencia, Winfried Wiegraebe, Thushara Wijeratna, Ruian Yang, Rebecca J. Zaunbrecher, Ramon Lorenzo D. Labitigan, Adrian L. Sanborn, Graham T. Johnson, Ruwanthi N. Gunawardane, Nathalie Gaudreault, Julie A. Theriot, Susanne M. Rafelski
Nature  ·  04 Jan 2023
Jianning Li, Antonio Pepe, Christina Gsaxner, Gijs Luijten, Yuan Jin, Narmada Ambigapathy, Enrico Nasca, Naida Solak, Gian Marco Melito, Viet Duc Vu, Afaque R. Memon, Xiaojun Chen, Jan Stefan Kirschke, Ezequiel de la Rosa, Patrick Ferdinand Christ, Hongwei Bran Li, David G. Ellis, Michele R. Aizenberg, Sergios Gatidis, Thomas Küstner, Nadya Shusharina, Nicholas Heller, Vincent Andrearczyk, Adrien Depeursinge, Mathieu Hatt, Anjany Sekuboyina, Maximilian Löffler, Hans Liebl, Reuben Dorent, Tom Vercauteren, Jonathan Shapey, Aaron Kujawa, Stefan Cornelissen, Patrick Langenhuizen, Achraf Ben-Hamadou, Ahmed Rekik, Sergi Pujades, Edmond Boyer, Federico Bolelli, Costantino Grana, Luca Lumetti, Hamidreza Salehi, Jun Ma, Yao Zhang, Ramtin Gharleghi, Susann Beier, Arcot Sowmya, Eduardo A. Garza-Villarreal, Thania Balducci, Diego Angeles-Valdez, Roberto Souza, Leticia Rittner, Richard Frayne, Yuanfeng Ji, Soumick Chatterjee, Florian Dubost, Stefanie Schreiber, Hendrik Mattern, Oliver Speck, Daniel Haehn, Christoph John, Andreas Nürnberger, João Pedrosa, Carlos Ferreira, Guilherme Aresta, António Cunha, Aurélio Campilho, Yannick Suter, Jose Garcia, Alain Lalande, Emmanuel Audenaert, Claudia Krebs, Timo Van Leeuwen, Evie Vereecke, Rainer Röhrig, Frank Hölzle, Vahid Badeli, Kathrin Krieger, Matthias Gunzer, Jianxu Chen, Amin Dada, Miriam Balzer, Jana Fragemann, Frederic Jonske, Moritz Rempe, Stanislav Malorodov, Fin H. Bahnsen, Constantin Seibold, Alexander Jaus, Ana Sofia Santos, Mariana Lindo, André Ferreira, Victor Alves, Michael Kamp, Amr Abourayya, Felix Nensa, Fabian Hörst, Alexander Brehmer, Lukas Heine, Lars E. Podleska, Matthias A. Fink, Julius Keyl, Konstantinos Tserpes, Moon-Sung Kim, Shireen Elhabian, Hans Lamecker, Dženan Zukić, Beatriz Paniagua, Christian Wachinger, Martin Urschler, Luc Duong, Jakob Wasserthal, Peter F. Hoyer, Oliver Basu, Thomas Maal, Max J. H. Witjes, Ti-chiun Chang, Seyed-Ahmad Ahmadi, Ping Luo, Bjoern Menze, Mauricio Reyes, Christos Davatzikos, Behrus Puladi, Jens Kleesiek, Jan Egger
arXiv  ·  01 Jan 2023

2021

Kaytlyn A. Gerbin, Tanya Grancharova, Rory M. Donovan-Maiye, Melissa C. Hendershott, Helen G. Anderson, Jackson M. Brown, Jianxu Chen, Stephanie Q. Dinh, Jamie L. Gehring, Gregory R. Johnson, HyeonWoo Lee, Aditya Nath, Angelique M. Nelson, M. Filip Sluzewski, Matheus P. Viana, Calysta Yan, Rebecca J. Zaunbrecher, Kimberly R. Cordes Metzler, Nathalie Gaudreault, Theo A. Knijnenburg, Susanne M. Rafelski, Julie A. Theriot, Ruwanthi N. Gunawardane
Cell Systems  ·  01 Jun 2021

2020

Hongxiao Wang, Hao Zheng, Jianxu Chen, Lin Yang, Yizhe Zhang, Danny Z. Chen
IEEE BIBM Conference  ·  16 Dec 2020
Jianxu Chen, Liya Ding, Matheus P. Viana, HyeonWoo Lee, M. Filip Sluezwski, Benjamin Morris, Melissa C. Hendershott, Ruian Yang, Irina A. Mueller, Susanne M. Rafelski
bioRxiv  ·  13 Dec 2020
Peixian Liang, Jianxu Chen, Yizhe Zhang, Hongxiao Wang, Hao Zheng, Pengfei Gu, Danny Chen
IEEE CBMS Conference  ·  01 Jul 2020

2019

Chinedu S. Madukoma, Peixian Liang, Aleksandar Dimkovikj, Jianxu Chen, Shaun W. Lee, Danny Z. Chen, Joshua D. Shrout
Journal of Bacteriology  ·  01 Oct 2019
Hao Zheng, Lin Yang, Jianxu Chen, Jun Han, Yizhe Zhang, Peixian Liang, Zhuo Zhao, Chaoli Wang, Danny Z. Chen
AAAI Conference  ·  17 Jul 2019
Peixian Liang, Jianxu Chen, Hao Zheng, Lin Yang, Yizhe Zhang, Danny Z. Chen
IEEE ISBI Conference  ·  01 Apr 2019
Pavel A. Brodskiy, Qinfeng Wu, Dharsan K. Soundarrajan, Francisco J. Huizar, Jianxu Chen, Peixian Liang, Cody Narciso, Megan K. Levis, Ninfamaria Arredondo-Walsh, Danny Z. Chen, Jeremiah J. Zartman
Biophysical Journal  ·  01 Feb 2019

2018

Peixian Liang, Jianxu Chen, Pavel A. Brodskiy, Qinfeng Wu, Yejia Zhang, Yizhe Zhang, Lin Yang, Jeremiah J. Zartman, Danny Z. Chen
IEEE ISBI Conference  ·  01 Apr 2018

2017

O.V. Kim, R.I. Litvinov, J. Chen, D.Z. Chen, J.W. Weisel, M.S. Alber
Matrix Biology  ·  01 Jul 2017
Xiaoming Chen, Jianxu Chen, Danny Z. Chen, Xiaobo Sharon Hu
ACM Design Automation Conference  ·  18 Jun 2017
Yizhe Zhang, Lin Yang, Jianxu Chen, Maridel Fredericksen, David P. Hughes, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2017
Lin Yang, Yizhe Zhang, Jianxu Chen, Siyuan Zhang, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2017
Jianxu Chen, Sreya Banerjee, Abhinav Grama, Walter J. Scheirer, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2017

2016

Jianxu Chen, Mark S. Alber, Danny Z. Chen
IEEE Transactions on Medical Imaging  ·  01 Sep 2016
Dhagash Mehta, Jianxu Chen, Danny Z. Chen, Halim Kusumaatmaja, David J. Wales
Physical Review Letters  ·  06 Jul 2016
Jianxu Chen, Feng Shen, Danny Ziyi Chen, Patrick J. Flynn
IEEE Transactions on Information Forensics and Security  ·  01 Jul 2016
Jianxu Chen, Yiqing Cai, Chen Wei, Lin Yang, Mark S. Alber, Danny Z. Chen
IEEE ISBI Conference  ·  01 Apr 2016

2015

Jianxu Chen, Feng Shen, Danny Z. Chen, Patrick J. Flynn
IEEE International Conference on Identity, Security, and Behavior Analysis  ·  01 Mar 2015
Jianxu Chen, Shant Mahserejian, Mark Alber, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2015

2014

Jianxu Chen, Oleg V. Kim, Rustem I. Litvinov, John W. Weisel, Mark S. Alber, Danny Z. Chen
IEEE CBMS Conference  ·  01 May 2014
Jianxu Chen, Cameron W. Harvey, Mark S. Alber, Danny Z. Chen
MICCAI Conference  ·  01 Jan 2014