Intelligent Light and FieldView

This tag contain 1 private blog which isn't listed here.

In Situ Data Management at DOE Workshop and SIAM CSE

​As CFD datasets get larger and unsteady computation becomes more common, file I/O is an increasing bottleneck. Methods that write post-processing extracts directly from solvers as they are running have proven to be a solution to this problem. Intelligent Light has long advocated for this approach and recently we were asked to participate in activities to advance the state of the art in this area.

In January, I participated in the DOE's "In Situ Data Management (ISDM)" workshop which focused on defining areas for research intended to ease the analysis and understanding of massive simulations enabled by exa-scale computing. A workshop report is forthcoming.

In February, I was invited to present at a mini-symposium at the SIAM CSE 2019 meeting aimed at avoiding the big data problem through in situ techniques.

If you would like to know more about In Situ Data Management and CFD Data Analytics or to schedule a meeting with Steve Legensky, send email to datascience@ilight.com.

Data from Juan D. Colmenares, Svetlana Poroseva, Yulia T. Peet, and Scott M. Murman. "Analysis of uncertainty sources in DNS of a turbulent mixing layer using Nek5000", 2018 Fluid Dynamics Conference, AIAA AVIATION Forum, (AIAA 2018-3226). Simulations were performed on the Pleiades Computer system at NASA Ames Research Center. Images created by Intelligent Light.


Continue reading
  0 Comments
0 Comments

HPC, In Situ and Data Analytics at SC18

Advances in the use of HPC, In Situ and Data Analytics for CFD dominate our contribution to SC18. Join us at events, in workshops and technical sessions and on the exhibit floor in Booth #826 to learn how these advances will help you.

Data Science Meets CFD - Steve Legensky, Invited speaker at In Situ Analysis and Visualization Workshop

VisIt Users and Developers Reception - Get an update on VisIt 3.0 and VisIt Prime

SENSEI Tutorial: Cross-Platform View of In Situ Analytics

Data from Juan D. Colmenares, Svetlana Poroseva, Yulia T. Peet, and Scott M. Murman. "Analysis of uncertainty sources in DNS of a turbulent mixing layer using Nek5000", 2018 Fluid Dynamics Conference, AIAA AVIATION Forum, (AIAA 2018-3226). Simulations were performed on the Pleiades Computer system at NASA Ames Research Center. Images created by Intelligent Light.


Invited talk: Data Science Meets CFD, Steve Legensky, Intelligent Light

Presentation to the ISAV 2018 Workshop: In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization

Monday, November 12, 3:30-4:25PM, Room D168

Advances in computational fluid dynamics (CFD) and high-performance computing (HPC) have allowed an amazing increase in model fidelity. For CFD practitioners, these new capabilities present challenges with the analysis of highly unsteady flows of ever-increasing complexity. Simultaneous advances in data science offer promising techniques for resolving these issues that are just starting to be applied to CFD post-processing and knowledge extraction workflows.

ISAV 2018: In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization

Session: Monday, November 12, 9:00-5:30PM Room D168

The considerable interest in the HPC community regarding in situ analysis and visualization is due to several factors. First is an I/O cost savings, where data is analyzed and visualized while being generated, without first storing to a file system. Second is the potential for increased accuracy, where fine temporal sampling of transient analysis might expose some complex behavior missed in coarse temporal sampling. Third is the ability to use all available resources, CPU's and accelerators, in the computation of analysis products.

The workshop brings together researchers, developers and practitioners from industry, academia and government laboratories developing, applying and deploying in situ methods in extreme-scale, high-performance computing. 

Data from Juan D. Colmenares, Svetlana Poroseva, Yulia T. Peet, and Scott M. Murman. "Analysis of uncertainty sources in DNS of a turbulent mixing layer using Nek5000", 2018 Fluid Dynamics Conference, AIAA AVIATION Forum, (AIAA 2018-3226). Simulations were performed on the Pleiades Computer system at NASA Ames Research Center. Images created by Intelligent Light.

Tutorial: SENSEI Cross-Platform View of In Situ Analytics
Presenters: E. Wes Bethel, David Thompson, Burlen Loring, Silvio Rizzi, Brad Whitlock, Matthew Wolf, Patrick O'Leary

Sunday, November 11, 1:30-5:00PM Room C147

This tutorial covers the design and use of SENSEI, a platform for in situ visualization and analysis. Attendees will learn the basics of in situ analysis and visualization — which eliminates the need for writing large simulation state files or other data that prevents scaling to large machines — while being exposed to advanced analysis such as autocorrelation, interactive monitoring and computational steering.

Image courtesy of Michael Brazell and Prof. Dimitri Mavriplis, University of Wyoming

Spend time with our experts:

Come by Booth #826 or request a meeting, to learn and explore how we can help you advance your CFD.

In-booth presentation: Data Science Meets CFD, Steve Legensky

Tuesday, 4:00PM in Booth #826, followed by reception including beer and hors d'oeuvres

Continue reading
  0 Comments
0 Comments

Advance your CFD - IL at SC17

Get the latest info on high performance CFD workflows and In Situ processing using HPC from sessions in the technical conference and on the exhibit floor in booth #807.

  • Delivered: VisIt to Cinema - Scalable Knowledge Extraction for Industrial CFD
  • VisIt Update: Ongoing performance enhancements and new features
  • HPC Powers Wind Energy: 10TB of data made interactive with XDBs and In Situ
  • We're moving HPC-powered CFD forward with In Situ

    ISAV2017: In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization

    SC17 Workshop
    Sunday, Nov. 12th, 9:00-5:30 pm room 605

    The considerable interest in the HPC community regarding in situ analysis and visualization is driven by the desire to save I/O costs and time, increase accuracy with fine sampling of transient analysis and full utilization of HPC resources. As a member of the ISAV Program Committee, Intelligent Light will bring real world experience from our work on ultra scale simulations.

    Intelligent Light is a co-organizer with a team including four US National Laboratories. We also participate on the program committee and have a role in reviewing submissions for this full day workshop.

    Tutorial: In Situ Analysis and Visualization with SENSEI
    Presenters: Bethel, Bauer, Whitlock, Wolf, Loring, Rizzi
    Monday, Nov.13th, 8:30 am - 12:00 pm room 355-D

    The SENSEI community in situ data interface is an API that promotes code portability and reusability. From the simulation view, a developer can instrument their code with the SENSEI API and then make use of any number of in situ infrastructures. From the methods view, a developer can write an in situ method using the SENSEI API, then expect it to run in any number of in situ infrastructures. Attendees will learn the fundamentals of in situ data analysis and visualization leveraging this generic interface.

    click to enlarge

    Spend time with our experts

    Come by booth #807 or request a meeting, ask questions and explore how we can help you advance your CFD. Learn more about the ways IL is advancing CFD with HPC-powered innovation.

    Continue reading
      0 Comments
    0 Comments

    Workshop: Extract-based and In Situ Methods for HPC Enabled CFD

    To be held August 3, 2017, in conjunction with the ASME Fluids Engineering Division Summer Meeting​ at the Hilton Waikoloa Village, Waikoloa, Hawaii

    Workshop Objectives

    This workshop will assess the state-of-the-art in CFD Visualization and Post-Processing in High Performance Computing (HPC) environments. Specifically the issues of data transfer from remote HPC resources, a comparison of remote graphics vs. extract methods, and the trend toward in situ methods. Real world examples of industrial CFD workflows will be presented that offer a path to greater fidelity and faster throughput enabling an increased use of unsteady simulation.

    Presenters

    Prof. Kozo Fujii, Tokyo University of Science/ ISAS-JAXA 
    Revisit the Role of Research Graphics in HPC Post Processing

    Yves-Marie Lefebvre, FieldView Product Chief, Intelligent Light
    Unblocking Data Bottlenecks in HPC CFD with Extract-based Workflows

    Steve Legensky, Founder and General Manager, Intelligent Light
    In Situ: Real and in Production

    Read presentation abstracts

    Who should attend

    Researchers and practitioners in aeroacoustics, combustion, LES and large scale CFD and CFD solver code technologists.

    Thursday, August 3, 2017
    Lunch for all FEDSM participants sponsored by Intelligent Light
    Workshop from 1:30 to 4 PM

    This event is free, but seating is limited and advanced registration is required.

    To register, please send email to events@ilight.com with your full contact information and the number of people in your party. Location details will be provided with your registration confirmation.

    Continue reading
      0 Comments
    0 Comments

    Updated: In Situ Processing and Workflow Innovation at Par CFD

    UPDATED with new speaker info 4/17/2017

    The state of the art in HPC-driven CFD will be explored this May, at Parallel CFD (ParCFD) is Glasgow, Scotland, and Intelligent Light will share news from the front lines of CFD as it is used in production. 

    In a plenary session, Steve M. Legensky, Founder and General Manager of Intelligent Light, will present ​A Survey of Production Applications of In Situ Post-Processing to Enable HPC-Scale CFD", giving real world examples of how our clients are using in situ workflows designed by Intelligent Light to eliminate file transfer bottlenecks, allow increased fidelity and faster turnaround. 

    A mini symposium "In Situ Processing for Computational Fluid Dynamics Data Analysis and Visualization" will be co-chaired by Dr. Earl Duque, Manager of Applied Research at Intelligent Light, and Dr. E. Wes Bethel, Senior Computer Scientist at Lawrence Berkeley National Laboratory. Speakers include:

    • ​E. Wes Bethel - Lawrence Berkeley National Lab -  "In Situ Methods, Infrastructures, and Applications on HPC Platforms: Knowledge Discovery with Minimal I/O"
    • Seiji Tsutsumi - Japan Aerospace Exploration Agency - "Best practice for in-situ visualization of large-scale data in supercomputer"
    • Brad Whitlock - Intelligent Light - "Recent improvements to VisIt/Libsim" 
    • Hadi Salimi - French Institute for Research in Computer Science and Automation  - "Damaris: In Situ Data Analysis and Visualization in Support of Large-Scale CFD Simulations" 
    • Dave Pugmire - Oak Ridge National Lab - "In transit visualization of full and reduced simulation data on high performance computing platforms"

    If you plan to participate at ParCFD we hope you will take the opportunity to meet with Steve Legensky and Earl Duque at the sessions mentioned above or at our table in the exhibit area. If you are not able to attend but would like to learn about in situ processing and workflow innovation for production CFD, please contact us

    ParCFD is an annual international conference devoted to recent developments in parallel computing and its applications to the field of CFD. The 29th International Conference on Parallel Computational Fluid Dynamics will take place at the University of Strathclyde in Glasgow, Scotland from 15-17 May 2017, at the flagship Technology and Innovation Centre.

    Continue reading
      0 Comments
    0 Comments