Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences. Issue 3 (7th March 2023)

• Record Type: Journal Article
• Authors: Paar, Gerhard; Ortner, Thomas; Tate, Christian; Deen, Robert G.; Abercrombie, Parker; Vona, Marsette; Proton, Jon; Bechtold, Andreas; Calef, Fred; Barnes, Robert; Koeberl, Christian; Herkenhoff, Ken; Hausrath, Elisabeth M.; Traxler, Christoph; Caballo, Piluca; Annex, Andrew M.; Gupta, Sanjeev; Bell, James F.; Maki, Justin
• Is Part Of: Earth and space science. Volume 10:Issue 3(2023)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2023-03-07
• Subjects: Mars exploration -- visualization -- Mars 2020 -- Mastcam‐Z; Space sciences -- Periodicals; Geophysics -- Periodicals; 500.5
• DOI: 10.1029/2022EA002532
• Languages: English
• ISSNs: 2333-5084

Abstract

Abstract: The Mars 2020 Mastcam‐Z stereo camera investigation enables the generation of three dimension (3D) data products needed to visualize and analyze rocks, outcrops, and other geological and aeolian features. The Planetary Robotics Vision Processing framework "PRoViP" as well as the Instrument Data System on a tactical—sol‐by‐sol—timeframe generate 3D vision products, such as panoramas, distance maps, and textured meshes. Structure‐from‐motion used by the Advanced Science Targeting Toolkit for Robotic Operations (ASTTRO) "Landform" tool and long baseline stereo pipelines add to the 3D vision products' suite on various scales. Data fusion with textured meshes from satellite imagery and 3D data analysis and interpretation of the resulting large 3D data sets is realized by visualization assets like the Planetary Robotics Vision 3D Viewer PRo3D, the 3D Geographical Information System GIS CAMP (Campaign Analysis Mapping and Planning tool), the ASTTRO 3D data presentation and targeting tool, and the Mastcam‐Z planning tool Viewpoint. The pipelines' workflows and the user‐oriented features of the visualization assets, shared across the Mars 2020 mission, are reported. The individual role and interplay, complements and synergies of the individual frameworks are explained. Emphasis is laid on publicly available 3D vision data products and tools. A representative set of scientific use cases from planetary geology, aeolian activity, soil analysis and impact science illustrates the scientific workflow, and public data deployment modes are briefly outlined, demonstrating that 3D vision processing and visualization is an essential mission‐wide asset to solve important planetary science questions such as prevailing wind direction, soil composition, or geologic origin. Plain Language Summary: Image processing enables to describe the surface of Mars in three dimension (3D) using the Mastcam‐Z stereo cameras' images. The 3D reconstruction of the rocks, geological outcrops, as well as aeolian and mineralogical features, are crucial for understanding the planet's past. Image processing tools to reconstruct the surface of Mars from the images are available to the Mars 2020 Team, generating 3D data products with various information about the surface on Mars like elevation maps or distance maps that record the 3D coordinates of each point. To interpret these products, tools needed for their visualization and analysis are presented here. In a combination with data from other sensors or sources—including 3D models obtained from satellite, and at different scales the interpretation of the processed products is enhanced. The reader learns about the synergies and interplay between these tools, including publicly available tools. Demonstrative planetary science examples, processed by the Mastcam‐Z science team with the above mentioned tools, are presented. Geological features, such as wind activity, soil analysis, and impact science, are analyzed, illustrating the scientific work carried out and in particular the benefit of 3D vision processing and visualization for such analysis work. Key Points: The Mars 2020 Mastcam‐Z investigation's stereoscopic zoom camera pair enables the assembly of 3D models of the rover environment Processing and visualization for scientific 3D data exploitation establishes mission science in full knowledge about spatial relationships Important scientific use cases for Mastcam‐Z 3D vision processing and visualization illustrate the importance of 3D for Mars science