Multi Scale Human
Multiscale Human is an european Marie Curie ITN project which analyses the functionality of the human body under a dynamic 3D multi-scale approach. The aim is to obtain a better understanding of joint diseases and an efficient diagnosis and treatment of patients.
Welfenlab works on an innovative project for 3D visualization of the musculoskeletal system. The Leibniz Universität Hannover is involved the first time as a partner in an "EU - Marie Curie Initial Training Network Research". Among other advantages, the project supports the Ph.D. studies of two international students at the Leibniz Universität Hannover.
The interactive 3D simulation model of the human body combines molecular, cellular, organic, metabolic and behavioural scales. The aim of the project MultiscaleHuman is to show the functionality of the human body in a new and dynamic way, obtaining the most adapted treatment for a patient with diseases on the musculoskeletal system. For this purpose, an European network with partners from four countries are involved, such as the Hannover Medical School (MHH) . The research group headed by Prof. Franz-Erich Wolter and Dr. Karl-Ingo Friese has presented the project in March 2013 and 2015 at CeBIT.
The medical data visualization constitutes an important research topic of the Department of Computer Graphics. Data comes from several imaging techniques such as computed tomography or magnetic resonance imaging. From the perspective of computer science, the question arises of how such data can be displayed interactively in a readily understandable manner.
Closely related to the visualization of the complex data is the interaction with it. In the context of this project, new multimodal 3D-interaction paradigms (haptic and touchless) were developed and tested. For the haptic component, a previous work, founded by DAAD/Siemens, was used as a base for the development.
This project is coordinated by Prof. N. Thalmann (University of Geneva). Detailed information on the project can be found on http://multiscalehuman.miralab.ch/
Gallery (CeBIT 2013)
Gallery (CeBIT 2015)
Ricardo Manuel Millán Vaquero, Alexander Vais, Sean Dean Lynch, Jan Rzepecki, Karl-Ingo Friese, Christof Hurschler, Franz-Erich Wolter
Helical Axis Data Visualization and Analysis of the Knee Joint Articulation (+video)
Journal of Biomechanical Engineering
138. Issue 9. DOI: 10.1115/1.4034005
The American Society of Mechanical Engineers
We present processing methods and visualization techniques for accurately characterizing and interpreting kinematical data of flexion–extension motion of the knee joint based on helical axes. We make use of the Lie group of rigid body motions and particularly its Lie algebra for a natural representation of motion sequences. This allows to analyze and compute the finite helical axis (FHA) and instantaneous helical axis (IHA) in a unified way without redundant degrees of freedom or singularities. A polynomial fitting based on Legendre polynomials within the Lie algebra is applied to provide a smooth description of a given discrete knee motion sequence which is essential for obtaining stable instantaneous helical axes for further analysis. Moreover, this allows for an efficient overall similarity comparison across several motion sequences in order to differentiate among several cases. Our approach combines a specifically designed patient-specific three-dimensional visualization basing on the processed helical axes information and incorporating computed tomography (CT) scans for an intuitive interpretation of the axes and their geometrical relation with respect to the knee joint anatomy. In addition, in the context of the study of diseases affecting the musculoskeletal articulation, we propose to integrate the above tools into a multiscale framework for exploring related data sets distributed across multiple spatial scales. We demonstrate the utility of our methods, exemplarily processing a collection of motion sequences acquired from experimental data involving several surgery techniques. Our approach enables an accurate analysis, visualization and comparison of knee joint articulation, contributing to the evaluation and diagnosis in medical applications.
Ricardo Manuel Millan Vaquero, Sean Dean Lynch, Benjamin Fleischer, Jan Rzepecki, Karl-Ingo Friese, Christof Hurschler, Franz-Erich Wolter
Enhanced Visualization of the Knee Joint Functional Articulation Based on Helical Axis Method
Bildverarbeitung für die Medizin 2015, Informatik aktuell 2015
Springer Berlin Heidelberg
Comprehensive descriptions of the motion in articulating joints open new opportunities in biomedical engineering. The helical axis is a established method that describes flexion-extension at joints, which currently lacks an intuitive visualization. In this paper, we present a comprehensive visualization of knee joint motion based on a direct measurement of the helical axis. The proposed approach incorporates the three-dimensional motion of patient-specific bone segments and the representation of helical axes on the bone, facilitating the observation of the flexion-extension motion at the knee joint.
Ricardo Manuel Millan Vaquero, Alexander Vais, Sean Dean Lynch, Jan Rzepecki, Karl-Ingo Friese, Christof Hurschler, Franz-Erich Wolter
Helical axis data visualization and analysis of the knee joint articulation (presentation)
Accepted as a lecture presentation in 29th International Congress and Exhibition of Computer Assisted Radiology and Surgery (CARS).
Accepted as a lecture presentation in 29th International Congress and Exhibition of Computer Assisted Radiology and Surgery (CARS 2015).
Ricardo Manuel Millán Vaquero, Asan Agibetov, Jan Rzepecki, Marta Ondrésik, Alexander Vais, Joaquim Miguel Oliveira, Giuseppe Patanè, Karl-Ingo Friese, Rui Luís Reis, Michela Spagnuolo, Franz-Erich Wolter
A semantically adaptable integrated visualization and natural exploration of multi-scale biomedical data
12th International Conference BioMedical Visualization (MediVis)
2015 19th International Conference on Information Visualisation. IEEE
The exploration of biomedical data which involves heterogeneous sources coming from different spatial scales and medical domains is a challenging topic in current research. In this work, we combine efforts regarding multi-scale visualiza-tion, multimodal interaction and knowledge formalization for the exploration of multi-scale biomedical data. The knowledge formalization stores and organizes the information sources, the integrated visualization captures all relevant information for the domain expertise of the user and the multimodal interaction provides a natural exploration. We present a concrete example of use of the proposed exploratory system designed for a biologist investigating multi-scale pathologies.
Asan Agibetov, Ricardo Manuel Millán Vaquero, Karl-Ingo Friese, Giuseppe Patanè, Michela Spagnuolo and Franz-Erich Wolter
Integrated Visualization and Analysis of a Multi-scale Biomedical Knowledge Space
Proceedings of the EuroVis Workshop on Visual Analytics
The Eurographics Association
The study and analysis of relationships in a complex and multi-scale data set is a challenge of information and scientific visualization. This work proposes an integrated visualization to capture all the important aspects of multi-scale data into the same view by leveraging the multi-scale biomedical knowledge encoded into an underly- ing ontology. Ontology supports visualization by providing semantic means to identify relevant items that must be presented to the user. The study and analysis of relationships across the scales are presented as results of queries to the multi-scale biomedical knowledge space. We demonstrate the prototype of the graphical interface of an integrated visualization framework and the knowledge formalization support in an example scenario related to the musculoskeletal diseases.
Jan Rzepecki, Ricardo Manuel Millan Vaquero, Alexander Vais, Karl-Ingo Friese, Franz-Erich Wolter
Multimodal Approach for Natural Biomedical Multi-scale Exploration
Lecture Notes in Computer Science
Pathologies which simultaneously involve different spatial scales are often difficult to understand. Biomedical data from different modalities and spatio-temporal scales needs to be combined to obtain an understandable representation for its examination. Despite of requests to improve the exploration of multi-scale biomedical data, no major progress has been made in terms of a common strategy combining the state of art in visualization and interaction. This work presents a multimodal approach for a natural biomedical multi-scale exploration. The synergy of a multi-layered visualization environment based on spatial scales with hand gestures and haptic interfaces opens new perspectives for a natural data manipulation.
|Beiträge in Büchern|
R. M. Millán Vaquero, J. Rzepecki, K.-I. Friese, F.-E. Wolter
Visualization and User Interaction Methods for Multiscale Biomedical Data
N. Magnenat-Thalmann, O. Ratib, and H. F. Choi
The need for handling huge amounts of data from several sources is becoming increasingly important for biomedical scientists. In the past, there were mainly different modalities in imaging techniques that had to be combined. Those modalities usually measured different physical effects from the same object and shared dimensions and resolution. Nowadays, an increasing number of complex use cases exist in biomedical science and clinical diagnostics that require data from various domains, each one related to a different spatiotemporal scale. Multiscale spatial visualization and interaction can help physicians and scientists to explore and understand this data. In the recent years, the number of published articles on efficient scientist-centric visualization and interaction methods has drastically increased. This chapter describes current techniques on multiscale visualization and user interaction and proposes strategies to accommodate current needs in biomedical data analysis.