A number of new features related to the processing of aerial LiDARs have been added to the program in Agisoft Metashape 2.2.x, as well as the ability to improve the quality of orthomosaic based on data with more detailed resolution, the ability to save a geoid file in the project files, automatic generation of masks using AI and additional tools that will be described in the article below:


Download Agisoft Metashape 2.2.x


Agisoft Metashape 2.2.x is available and can be downloaded from our website:


https://www.agisoft.com/downloads/installer/ 


New features in Metashape 2.2.1


Set and refine GNSS and INS offset separately

In Metashape 2.2.1, the ability to use GNSS and INS parameters separately has been added and adjusted. You need to enable the appropriate option in the Camera Calibration > GNSS/INS offset tab dialog box (select Tools > Camera Calibration):


Enable Adjust GNSS offset and Adjust INS offset checkbox to calculate and adjust the parameters during alignment and optimization process. The parameters will be displayed after refinement in the same dialog box :


NOTE: it is important that if you do not know the offset for GNSS and INS data, but you would like to calibrate these parameters, then it is important that the project has control points, checkboxes for coordinates and/or angles are enabled, and it is important to set zero values as a first approximation:




Group images by flight line

In Metashape 2.2.1 it is possible to group images by routes (flight line):



The images will be grouped based on the reference coordinates and the order of the images in the project. If there are no coordinates for the images in the project, they will not be grouped. To group image by flight line - select images on the Workspace pane and choose Move Images > Group by command from the photos context menu. And enable the Flight line option in the Group Images dialog window: 



New parameters for filtering Tie points

Additional filtering tools have been added in version 2.2.1 that would be useful when analyzing alignment results. The ability to filter data by Duration and by Group Count.


Filter by Duration

The option is available in Tools > Tie Point > Filter by Duration menu:



The tool filters tie points by the specified time interval. The Min and Max values for interval are set in seconds. As a result of filtering, you will get tie points, the projections of which are present in the images taken during the specified period of time.


Filter by Group Count

Filtering is applied to images from groups. If you grouped images, for example, by flight line, and you need to get only tie points which are contained in the overlap between neighboring routese, then you can filter by group. Select Tools > Tie Points > Filter by Group Count and specify the minimum and maximum number of groups in which the tie points projections should be included. And click Apply button. The filtered points will be displayed in the Model view:



Different icons for control and check point

Starting from version 2.2.1, control and check points have different icons and will be displayed differently:



Markers are shown as blue flags in Model view.


You need to enable or disable checkbox for markers on the Reference pane to change the type: 

  • If the checkbox is enabled, the point is the control point. 
  • When the checkbox is disabled, the point is the check point. 




GUI changes

Replace and rename Gradual Selection tool 

The Gradual Selection tool was renamed to Clean Tie Points and Clean Model option for more convenient use. The tool has also been moved to the Tools section. To use gradual selection for tie points in your project you need to select Tools > Tie Points > Clean Tie Points:


And select Tools > Model > Clean Model... option for a model:




Moved show/hide commands for panes

To display the panels you need, select View > Panes and the panel you want to display or hide:




Agisoft Viewer

Zoom to 

Zoom to option has been added to layer context menu in Agisoft Viewer, which allows you to quickly open the desired data in your layer:


Snapping tool

Added snapping support for shape drawing tools in Agisoft Viewer. The following snapping options are available:

  • Axis Snap;
  • Vertex Snap;
  • Edge Snap;
  • 2D Snap.

Your project should have a vector layer in which you will perform vectorization. To enable one of the snapping modes, select Edit > Snap Type and choose for example Vertex Snap to use snapping, you need to hold down SHIFT key:



New features in Metashape 2.2.0

Aerial LiDAR boresight calibration support

It is now possible to perform boresight calibration for aerial LiDARs. This process allows for better alignment between aerial LiDAR scans. A detailed workflow is described in our article - Aerial laser scans data processing in the "Aerial LiDAR boresight calibration" section.



Accuracy view for LiDAR point clouds comparison

To evaluate the accuracy of the alignment of LiDAR data sets, the Difference View tool has been added. Tool displays the area of overlap of LiDAR point clouds and query the points according to the error value. To use the tool, select the appropriate tool on the Toolbar (Show Laser Scans > Difference View):


Important! Keep in mind that when using this tool, Model view does not display the original point clouds, but clouds with errors that are needed to assess accuracy, and they cannot be edited (Selection tools for these areas are not available).


The legend displays the error value and is calculated for each project separately. The points are colored according to the error values in this area. Blue is the point with the least error, red is the largest error:



Measure point cloud accuracy using check point coordinates

The new tool helps to estimate the altitude error for control and check points. The dialog box will display the altitude values for the original marker (imported into the project) and the altitude values on the surface. To calculate this value, select the Measure Elevation command from the markers' context menu on the Reference pane:




The values will be calculated for those markers that are selected on the Reference pane. If you need to calculate the value for all markers, select them all on the Reference pane, and then use the tool.


The Surface alt. (m) column displays the altitude value for the marker on the selected surface, in our example, on the surface of a laser scan:




AprilTags coded-targets

In Agisoft Metashape 2.2, it is possible to automatically detect AprilTags. To start tag detection, select Tools > Markers > Detect Markers... and select the appropriate label type in the dialog box:



You can view information on the types of AprilTags on the following pages:
https://april.eecs.umich.edu/software/apriltag
https://github.com/AprilRobotics/apriltag


Align cameras by reference

Tool allows you to make unaligned images aligned according to the loaded reference. It is important that the cameras have the values of coordinates and angles, then the tool will work. To use the tool, select the unaligned images in the Reference pane and then select the Align Cameras by Reference command from the context menu:



This method is useful when there is a water surface with not aligned cameras corresponding to it. Aligning such images by the reference will help to fill the holes during the orthomosaic generation. That is, these images will only be used for building orthomosaic or texturing. But it is important to have the existing surface for the corresponding areas, i.e. if you use DEM as the surface, then the area corresponding to the not aligned cameras can be filled using either DEM editing tool or use Interpolation - Extrapolated when building a DEM.


In version 2.2.1, it is possible to use the tool through batch processing.


Pansharpening 

Starting from Agisoft Metashape 2.2, it is possible to improve the quality of orthomosaic based on higher resolution data. Below is an example of orthomosaic before and after pansharpening (image on the left before, on the right after):



We have described the detailed workflow and processing parameters in our article - Pansharpening.



An experimental feature to improve the area near the edges of the roofs

In version 2.2, the test algorithm has been  developed that can help improve areas near the edges of roofs ("wavy" effect, white areas, and so on). The algorithm has been added in test mode and is available by tweak - main/enable_refine_roof_edges = True. 


Please note that the algorithm may take a little longer than the General refine seamlines algorithm.


To create a tweak, select Tools > Preferences and open Advanced tab. In the Advanced tab, click the Tweaks button:



And click OK button. Then a new parameter Refine seamlines - Roof edges will appear in the Build Orthomosaic dialog box (Workflow > Build Orthomosaic):




It is important to use DEM as a Surface for this parameter. It is also important to consider that the DEM surface and alignment will affect the quality of the resulting orthomosaic.


A comparison of the result is shown in the image below:


Before
After



Build texture from orthomosaic

Starting from version 2.2, it is possible to build textures using orthomosaic rather than the original images. You need to select Orthomosaic as the Source data in the Build Texture dialog window:



Build orthomosaic from textured model

It is also possible to build an orthomosaic from a textured model or a tiled model.  In this case it is important to select the Model (or a Tiled Model) as the Source data and to enable the Transfer model texture option:



Splitting the mesh model into blocks

If you have already built a mesh model, then you can divide it into blocks by building a block model based on the mesh model. In this case you need do select Source data - Model in the Build Model dialog window (Workflow > Build Model) when building the block model, i.e. have Split in Blocks option enabled:



Saving geoid files in a project

It is possible to save the geoid file that was used in the project. Select Tools > Geoids... command. The dialog box will display a list with the geoids that are saved on your computer and the geoid that is used in the project:



The used geoid will have a check mark in the Used column in the Geoids dialog window. You can also use the Show Used geoids only option for filtering:



To store the geoid file in the project files directly, select the desired geoid from the list and use Embed Geoids command from the context menu:


Geoid file will be copied to the project.files folder.


Added support for basemaps with non-Earth reference systems

Metashape Professional 2.2 supports non-earth reference systems (for other planets or the Moon) for basemaps.  


For example: 
https://www.openplanetary.org/opm-basemaps/opm-moon-basemap-v0-1



You can find detailed steps on how to set up basemap in our article - Configure custom basemap.



Multiple masks instances support

It is now possible to store several mask sets in different layers and choose whether to use masks during building depth maps, orthomosaic, texture or not. 


Layers with masks are displayed in the Workspace pane in the chunk's contents. In order for masks to be used during processing, you need to make the mask layer active. To do this, double-click on the desired layer with masks or select Set an active command from the layer context menu on the Workspace pane:




Only one mask layer can be made active at a time, if you need to use all masks, then the layers with masks need to be merged. Select masks on the Workspace pane and choose Merge... command from the mask context menu.




Automatic (AI) background masking

AI can be used to generate masks for the background. To use this method to create masks, select Tools > Generate Masks... option. In the Generate Masks dialog box, select Method - Automatic (AI), as shown in the screenshot below:



When using the tool for the first time, it is important that you have an Internet connection to download the AI model.


After the mask generation process is finished to display the mask in Photo view click Show mask on the Toolbar:


To see which image masks have been created, you can also click on the Show mask in the Photos pane:


Restart processing after power failure

The reconstruction algorithms include subtasks during processing. If there is a problem during processing related to the unexpected Metashape termination (crash, shut down, etc) now it is possible to continue the processing operation from the moment when the problem occurred. That is, after the problem occurred when reopening the project, processing will automatically continue from the previous saved task on which the failure occurred.


In order for this algorithm to be available, it is important that the processing of each stage is saved. For this, the Save project after each step parameter was added to the processing dialog boxes. It should be enabled when selecting the parameters in processing dialog, as in the example below for Align Photos dialog box:



If this option was not enabled before processing, then the failed processing operation has to be started from scratch.



Changes in network processing

Network processing server should be started from the dedicated utility now named "metashape-server" included to Metashape Professional package:

metashape-server.exe --server --host 0:0:0:0


All information related to the network batches is now stored in database on the server side, therefore the failover (slave) server feature is no longer needed and has been removed from 2.2.0 version. 


Starting from 2.2.0 version working nodes are started by default in paused state, if it is necessary to override this setting, use --resume-workers key when starting the server instance.



To do this, enable the appropriate option in the Camera Calibration > GNSS/INS offset tab dialog box.