Name: メタバースにおける仮想実験のための自動シミュレーションワークフローと3D可視化の統合 (動画) | JoVE Journal
Uploaded: 2026-07-21T14:30:00.000+00:00
Duration: 9 min 23 s
Description: 学ぶ自動シミュレーションワークフローと3D可視化の統合手法。メタバース環境で核融合中性子学の仮想実験を行い、再現性とFAIRデータ原則に準拠した計算物理学研究を支援します。

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

playerTrialDesktop

This project has been supported by the UK Atomic Energy Authority through the Fusion Industry Program. The Fusion Industry Program is stimulating the growth of the UK fusion ecosystem and preparing it for the future global fusion powerplant market. More information about the Fusion Industry Program can be found online: https://ccfe.ukaea.uk/programmes/fusion-industry-programme/
The example repository accompanying this protocol is available at https://github.com/williamjsmith15/galaxy-omniverse-example (a public fork of https://github.com/UoMResearchIT/omniverse-workflows-fusion).

The authors have no conflicts of interest to disclose.

There are a few critical steps within the protocol. Most concern the initial setup of the workflow engine instance such as: adding the admin email (protocol step 1.2.2) as this is required for admin access to the tools and jobs panels; generating the API key correctly for the metaverse platform extension (protocol step 1.5.3) and pasting this correctly into the default values file; and when adding tools, ensuring that these are added to the tool config file (protocol step 4.1.6) before restarting as these are loaded in a...

The industrial metaverse combines digital and physical worlds to support design, simulation, and collaborative 3D visualization of engineered systems. It would typically consist of many interconnected digital twins of components to give an overall system view. Large organizations such as Boeing, BMW, Amazon, and many more are taking multiple approaches to create metaverses1. Systems for allowing multiple chains of simulation and processing tools have been developed and are being used. However, these examples are typically either bespoke to the application area2 or are commercial options3,4 with some lock-in to proprietary systems. Some open-source alternatives for building digital twins have been used to create some systems, such as Python Flask, with built-in simulation capabilities. Still, these are configured as bespoke pieces of code to carry out specific tasks relating to the particular model5. In the context of this protocol, the metaverse platform (NVIDIA Omniverse) functions as a 3D visualization and workflow interaction front-end: simulation outputs are loaded into a shared scene after a workflow run completes, and new runs can be triggered from within the same environment. This differs from live digital-twin systems in which real-time sensor feeds update the model continuously; the method demonstrated here supports batch workflow execution and post-run exploration of results. However, this is done in such a way that would support future work to integrate more systems into the metaverse platform to enable the creation of digital twins with workflow engines as the computational backend.
Workflows can be defined as chains of software tools explicitly specifying the data flow between them. They allow wrapping of existing simulation codes, processing scripts, and other steps in a typical analysis pipeline, without altering the function of these, but instead allowing them to be configured and reconfigured with standardized inputs and outputs that are tool agnostic. Workflows allow easy replication of results via the sharing of tools, also providing metadata and provenance about what versions of tools were used, in what order, and with which inputs. Tools themselves can be reused in many simulation pipelines, allowing researchers to spend less time setting up simulations and more time designing experiments and exploring the results. Workflow systems are also scalable, with methods to connect to different local compute, cloud and HPC resources, enabling many large-scale workflows to be run on specific hardware in an automated manner6.
The typical manual approach is inherently slow, error-prone, and difficult to reproduce, in which a researcher runs each simulation or post-processing tool by hand, moves intermediate files between environments, and has to document individual run inputs and outputs. In contrast to this, a workflow manager formalizes the data flow once and re-runs it deterministically. This brings many benefits relative to manual pipelines: the same workflow can be executed identically on different inputs, supporting parameter studies without bespoke scripting; every run automatically captures full provenance metadata, addressing any reproducibility gap; and once a tool has been wrapped, its reuse cost in subsequent workflows drops to near zero, other than compute time. These benefits have been quantified for bioinformatics by Wratten et al.7 and for proteomics/metabolomics by Perez-Riverol and Moreno8 and Verhoeven et al.9.
Historically, workflows have been used primarily in the bioinformatics field8,9 to great success with large public instances such as the European Galaxy server10,11, which by 2022 hosted more than 50,000 users, 2500 tools, executed over 47 million jobs and 260,000 workflow runs. The same workflow engine stack supports scaling onto HPC and cloud resources via the Pulsar distributed job-execution system6,11, with operational deployments spanning 13 Pulsar endpoints across 10 European countries. Among the many available workflow managers, including Snakemake, Nextflow, Toil, and CWL-compatible engines, the Galaxy workflow engine11 was selected for a few reasons. One of the primary reasons is its mature browser-based interface which lowers the barrier to entry for domain experts who do not work primarily on the command line; it exposes a complete representational state transfer (REST) application programming interface (API) (used in the present work to bridge to the metaverse front-end); its history and jobs model captures provenance in a form that is straightforward to surface to non-specialist collaborators; and it supports transparent HPC offload via the aforementioned Pulsar system (although this is not discussed in the protocol section in this paper). The approach described in this paper, however, is workflow-engine-agnostic in principle: equivalent integrations could be built atop alternative engines. The contribution of this work is not the workflow manager itself but the translation of a general-purpose workflow manager originally developed for bioinformatics to other fields (with the specific example of fusion neutronics here), and its integration with an industrial-metaverse platform (NVIDIA Omniverse), inside a fully containerized, locally deployable stack, applied to 3D virtual experiments.
Finally, containerization enables the sharing of many pieces of software by packaging code with the operating system and all the dependencies it needs to run. These environments avoid the issues of missing dependencies and the hassle of installing some simulation codes. They are similar in purpose to virtual machines but much lighter and more portable. They drastically increase the shareability and reproducibility of software packages. In this method, the workflow manager and the individual tools run in Docker12 containers, increasing compatibility with different operating systems as long as the user can run containers.
This protocol is intended for domain-expert researchers, for example, fusion neutronics engineers, computational fluid-dynamics analysts, or finite-element practitioners, who are fluent in the simulation tools of their own field but have not previously used a workflow manager or container-based deployment. Familiarity with a single simulation code and basic command-line operation is assumed; familiarity with Galaxy or the Omniverse is not. Readers new to containerization should consult the official Docker documentation (<a href="https://docs.docker.com/" target="_blank">https://docs.docker.com/</a>) or introductory training available at: <a href="https://uomresearchit.github.io/docker-introduction/" target="_blank">https://uomresearchit.github.io/docker-introduction/</a> before following Section 1; the basic commands needed to run the software are all contained within the protocol.
The rest of this report will cover the setup and use of the locally deployable system. Then, it will follow steps for developing new tools for the system and a method for linking other external packages to the workflow engine, such as a metaverse platform. Throughout the report, a neutronics simulation using OpenMC13 serves as the case study. OpenMC was selected because it demonstrates the full CAD-to-simulation-to-output-visualization pipeline that motivates the workflow architecture. A geometry file and a configuration file serve as structured inputs; the Monte Carlo neutron transport simulation produces a scalar metric (the tritium breeding ratio, TBR) that can be compared to a known range of values, and a spatially resolved neutron-track dataset that can be processed and presented in a visualizable format for the 3D rendering in the metaverse application.

<table><tbody><tr><td>Bioblend</td><td>Galaxy Project</td><td>v1.2+</td><td>Python library providing a high-level wrapper around the Galaxy REST API. This is used in the Omniverse extension helper scripts to list workflows, retrieve input definitions, and launch jobs. Installed automatically within the relevant Docker images; no host installation required.</td></tr><tr><td>Docker Containers</td><td>Docker</td><td>v24.0.5</td><td>Containerization runtime used to package each simulation and post-processing tool with all its dependencies, ensuring portability and reproducibility.</td></tr><tr><td>Galaxy</td><td>Galaxy Project</td><td>v22.05</td><td>Open-source workflow engine used to orchestrate the chained simulation and processing tools and to expose them via a REST API.</td></tr><tr><td>Git</td><td>Git SCM</td><td>v2+</td><td>Required to clone the repository to follow along with the protocol</td></tr><tr><td>NVIDIA RTX GPU</td><td>NVIDIA</td><td>-</td><td>Required for real-time ray-traced rendering in Omniverse (Section 3). Users without RTX hardware can complete all steps through Section 2 and use ParaView for visualisation (see Discussion).</td></tr><tr><td>Omniverse</td><td>NVIDIA</td><td>Code 2022.3.3</td><td>NVIDIA&#039;s collaborative 3D platform. This is used as the visualization and interaction front-end for workflow outputs via a custom Kit extension.</td></tr><tr><td>ParaView</td><td>Kitware</td><td>v5.11</td><td>Open-source scientific visualization application used as a non-RTX fallback for inspecting intermediate .vtk/.vtp outputs.</td></tr><tr><td>Protocol Repository</td><td>Custom</td><td>v1.0</td><td>Contains Galaxy configuration along with all tool XML wrappers, run scripts, Dockerfiles, test data, and the Omniverse extension. Cloned in Step 1.2.1. Key files are also provided as direct supplementary uploads (see I.2).</td></tr><tr><td>Python</td><td>Python</td><td>v3.10+</td><td>Runtime required for the OpenMC run script and the Omniverse extension helper scripts. Included within the relevant Docker images or with Omniverse download; no separate host installation is required.</td></tr><tr><td>The OpenMC Monte Carlo Code</td><td>OpenMC</td><td>v0.13.3</td><td>Open-source Monte Carlo particle-transport code used here for fusion neutronics simulation. This provides the tritium breeding ratio (TBR) and neutron-track outputs.</td></tr><tr><td>Windows Subsystem for Linux (WSL)</td><td>Microsoft</td><td>v2</td><td>Required to run Docker on Windows hosts (install via `wsl --install` in powershell). Linux and Mac users do not need this.</td></tr></tbody></table>

integrating automated simulation workflows with 3d visualization for virtual experiments in the metaverse

Integrating Automated Simulation Workflows with 3D Visualization for Virtual Experiments in the Metaverse

In many virtual experiments, multiple software packages are used with varied simulation types, pre- and post-processing tools, and tools to visualize the experiments&#39; results&#8212;often a combination of all. The typical method of integrating these is a manual one, with bespoke solutions created for each application area, which scales poorly and impedes sharing and reproducibility.
This protocol demonstrates the deployment and use of a locally containerized workflow system. Following it, users will launch a local Galaxy instance using Docker, create and run an OpenMC neutronics simulation workflow, pass the outputs through a chain of format-conversion tools, and load the results into both ParaView and NVIDIA Omniverse for visualization. The containerized deployment promotes reproducibility and portability on any machine meeting the hardware requirements described in Section 1.
Once the system is running, workflows can be re-run against new inputs without manual reconfiguration, additional simulation codes can be wrapped as new tools with modest effort, and tools can be used in multiple workflows and application areas. The approach supports the findable, accessible, interoperable, reusable (FAIR) data principles: run histories capture full provenance metadata, workflows are exportable as portable files and can be shared directly between Galaxy instances, and tools are packaged in version-controlled containers that can be published in a public repository. Scalability to high-performance computing (HPC) or cloud resources via Galaxy&#39;s Pulsar system is a natural extension of the architecture described here.
The method is demonstrated through a fusion neutronics case study. OpenMC is used to simulate neutron transport in a Direct Accelerated Geometry Monte Carlo (DAGMC) computer-aided design (CAD) geometry, producing a tritium breeding ratio (TBR) result and a neutron-track dataset. The simulation workflows are then connected to the NVIDIA Omniverse as the metaverse platform for invocation and visualization.

If the simulations are run with the provided inputs in the git repository, the following results should be obtained:
On successful completion of Step 2.1.3, both the TBR and Tracks output datasets will appear in the History panel in green, indicating a successful run. A representative TBR value using the supplied configuration file (5 batches of 1,000 particles) is approximately 0.76, with variations between runs of approximately ±0.01. Theref...

A generalized, FAIR-compliant method is presented for domain-expert researchers seeking to integrate simulation and data-processing tools into automated workflows for 3D virtual experiments. A neutronics example demonstrates setting up a local Galaxy instance, wrapping OpenMC and file-conversion tools, launching workflows from Omniverse, and visualizing the converted 3D outputs.

In many virtual experiments, multiple software packages are used with varied simulation types, pre- and post-processing tools, and tools to visualize the ...

Integrating automated simulation workflows with 3D visualization for virtual experiments in the Metaverse. A workflow is a chain of tools defining the flow of data between them. In many virtual experiments, researchers manually connect multiple simulation and processing tools, which scales poorly and impedes reproducibility.Workflows solve this because they are abstract, automated, scalable, portable, shareable, and citable. They allow existing simulation codes and processing steps to be wrapped into tools that are available in an easy-to-use interface. These can then be linked together and reconfigured without manually creating bespoke automation scripts.The tools can also be shared, reducing the requirement to learn new interfaces and allowing researchers to instead focus on configuring simulations and interpreting results. This protocol demonstrates the deployment of a locally containerized workflow manager. In this configuration, the end user interacts with a 3D visualization platform as the front end.The link to the workflows comes in the form of a lightweight Python extension that makes API calls to the workflow manager to launch simulations and receive the results, all from

integrating-automated-simulation-workflows-with-3d-visualization-for

Research

JoVE Journal

Engineering

A new computational system featuring GPU-accelerated molecular dynamics simulation and 3D/VR visualization, analysis and manipulation of nanostructures has been implemented, representing a novel approach to advance materials research and promote innovative investigation and alternative methods to learn about material structures with dimensions invisible to the human eye.

Novel 3D/VR Interactive Environment for MD Simulations, Visualization and Analysis

This paper describes a method for conducting multi-user experiments on decision-making and navigation using a networked computer laboratory.

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Virtual reality (VR) experiments can be difficult to implement and require meticulous planning. This protocol describes a method for the design and implementation of VR experiments that collect physiological data from human participants. The Experiments in Virtual Environments (EVE) framework is employed to accelerate this process.

Virtual Reality Experiments with Physiological Measures

This work presents a three-dimensional virtual simulation experiment for material deformation and failure that provides visualized experimental processes. Through a set of experiments, users can become familiar with the equipment and learn the operations in an immersive and interactive learning environment.

A Virtual Simulation Experiment of Mechanics: Material Deformation and Failure Based on Scanning Electron Microscopy

This study describes a WebVR-based online virtual reality (VR) laboratory system that provides users with immersive and interactive experimentation capabilities supported by VR devices. The proposed system not only helps to enhance the realism of user participation in online experiments but is also applicable to a wide range of online laboratory frameworks.

Online Virtual Reality Networked Control Laboratory Applied in Control Engineering Education

Motor imagery in a virtual reality environment has wide applications in brain-computer interface systems. This manuscript outlines the use of personalized digital avatars that resemble the participants performing movements imagined by the participant in a virtual reality environment to enhance immersion and a sense of body ownership.

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

This paper presents a system for photorealistic 3D reconstruction using 360-degree images, Gaussian Splatting, and virtual reality integration. The approach can be applied to different applications such as education, simulating learning environments; construction, to simulate works off-sites and retrieve metrics; or healthcare, to train autistic people in daily-life tasks.

Photorealistic Learned Landscapes for Augmented Reality

This video describes the fundamentals of digital fringe projection techniques, which provide dense 3D measurements of dynamically changing surfaces. It also demonstrates the design and operation of a high-speed binary defocusing system based on these techniques.

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques

The high-pressure and high-temperature experiments described here mimic planet interior differentiation processes. The processes are visualized and better understood by high-resolution 3D imaging and quantitative chemical analysis.

Simulation of the Planetary Interior Differentiation Processes in the Laboratory

Accurate modeling of nanohelical structures is important for predictive simulation studies leading to novel nanotechnology applications.  Currently, software packages and codes are limited in creating atomistic helical models.  We present two procedures designed to create atomistic nanohelical models for simulations, and a graphical interface to enhance research through visualization.

Scalable Nanohelices for Predictive Studies and Enhanced 3D Visualization

学ぶ自動シミュレーションワークフローと3D可視化の統合手法。メタバース環境で核融合中性子学の仮想実験を行い、再現性とFAIRデータ原則に準拠した計算物理学研究を支援します。

Integrating Automated Simulation Workflows with 3D Visualization for Virtual Experiments in the Metaverse

さらに動画を探す