Introduction

For details on how to record a MCAP file, please see Maivin Dataset Recording, and for details on how to playback MCAP files on Foxglove, please refer to Playback MCAP with Foxglove Studio.

The /detect/boxes2d stream is the default output stream from the Maivin detection services.  Because of the amount of data included within this stream, it is not compatible with the default bounding-box overlay API for Foxglove Studio.  The instructions below describe how to install and use a Foxglove Studio extension purpose-built for integrating the /detect/boxes2d stream into Foxglove Studio.

Additionally, the /detect/mask stream for Segmentation masks is not compatible with the default overlay API for Foxglove Studio. The Foxglove Studio extension will integrate drawing and overlaying the Segmentation mask and allow visualization of the mask.

Installing the Plugin

1. Download the edgefirst.detect-1.0.1.foxe Foxglove Extension (.foxe) file from Github.

2. Open Foxglove Studio

3. Open the Foxglove Extension file in Foxglove Studio.  This can be done one of two ways:

   1. Double-click on the downloaded .foxe file.
   2. Drag and Drop the .foxe file onto the Foxglove Studio window.
4. There should be a popup that says the extension successfully installed.
5. Close Foxglove Studio and restart it.
6. Open the user settings on the top right of the window and click Extensions.
   
7. A local extension called EdgeFirst Detect should be available
   
8. Clicking the plugin will bring up details about it
   

Using the plugin

Viewing /detect/boxes2d Messages

1. Record a MCAP file that has the /detect/boxes2d message in it. See Maivin Dataset Recording for details

2. Play the MCAP file in Foxglove Studio. See Playback MCAP with Foxglove Studio for details.

3. The /detect/boxes2d message should appear under the list of valid image annotations:
   

4. Enable the Image annotations /detect/boxes2d by clicking the eye icon. This will draw boxes around the detected objects.

Viewing /detect/mask Messages

1. Record a MCAP file that has the /detect/mask message in it. See Maivin Dataset Recording for details

2. Play the MCAP file in Foxglove Studio. See Playback MCAP with Foxglove Studio for details.

3. The /detect/mask message should appear under the list of valid image annotations:
   

4. Enable the Image annotations /detect/boxes2d by clicking the eye icon. This will draw a mask overlay on top of the camera stream.
   

5. To view the masks directly without overlaying, the Topic for the image panel can be changed to the /detect/mask topic.
   
6. This will draw the Mask directly onto the Image Panel.