LogoLogo
  • Tensorleap
  • Examples
    • Semantic Segmentation
    • Image Analysis
    • Sentiment Analysis
    • MNIST Project Walkthrough
    • IMDB Project Walkthrough
  • Quickstart using CLI
  • Guides
    • Full Guides
      • MNIST Guide
        • Dataset Integration
        • Model Integration
        • Model Perception Analysis
        • Advanced Metrics
      • IMDB Guide
        • Dataset Integration
        • Model Integration
        • Model Perception Analysis
        • Advanced Metrics
    • Integration Script
      • Preprocess Function
      • Input Encoder
      • Ground Truth Encoder
      • Metadata Function
      • Visualizer Function
      • Prediction
      • Custom Metrics
      • Custom Loss Function
      • Custom Layers
      • Unlabeled Data
      • Examples
        • CelebA Object Detection (YoloV7)
        • Wikipedia Toxicity (using Tensorflow Datasets)
        • Confusion Matrix
        • CelebA Classification (using GCS)
  • Platform
    • Resources Management
    • Project
    • Dataset
    • Secret Manager
    • Network
      • Dataset Node
      • Layers
      • Loss and Optimizer
      • Visualizers
      • Import Model
      • Metrics
    • Evaluate / Train Model
    • Metrics Dashboard
    • Versions
    • Issues
    • Tests
    • Analysis
      • helpers
        • detection
          • YOLO
    • Team management
    • Insights
  • API
    • code_loader
      • leap_binder
        • add_custom_metric
        • set_preprocess
        • set_unlabeled_data_preprocess
        • set_input
        • set_ground_truth
        • set_metadata
        • add_prediction
        • add_custom_loss
        • set_visualizer
      • enums
        • DatasetMetadataType
        • LeapDataType
      • datasetclasses
        • PreprocessResponse
      • visualizer_classes
        • LeapImage
        • LeapImageWithBBox
        • LeapGraph
        • LeapText
        • LeapHorizontalBar
        • LeapImageMask
        • LeapTextMask
  • Tips & Tricks
    • Import External Code
  • Legal
    • Terms of Use
    • Privacy Policy
Powered by GitBook
On this page
  • Dashboard
  • Dashlet
  • Bar
  • Line
  • Area
  • Table
  • HeatMap
  • Donut
  • Confusion Matrix

Was this helpful?

  1. Platform

Metrics Dashboard

PreviousEvaluate / Train ModelNextVersions

Last updated 2 years ago

Was this helpful?

Tensorleap provides real-time and historical metrics monitoring.

The metrics defined in the Integration Script are stored during model Evaluation / Training for each sample, batch, and epoch. In addition, each sample is monitored and stored with its metadata.

All stored metrics and metadata can be presented aggregatively in a custom Dashlet.

Dashboard

A Dashboard is a panel that layouts various metric charts, also called Dashlets.

Dashboards in Tensorleap are presented via the Dashboard panel, which is shown when you click the tab at the top.

To add a new Dashboard, click at the top bar.

Selected Models

The dashboard displays visualizations of the currently selected model(s). To select models, click to open the Versions panel on the left, expand the version, and select the model(s).

The dashboard will automatically update and show data for the selected models. At the top bar, you can see tags with the selected models. From there, you can also toggle to filter models.

Dashlet

The different Dashlet types, and their properties, are described below.

Bar

Property
Description

Name

The Dashlet's title

Bar Size

Points to the metric that is correlated with the bars' height

Aggregation

Mathematical operation for aggregating the presented data: Average, Min, Max, Mid

Data Distribution

  • Continuous

  • Distinct

    • Order-By: Metric / Alphabetical

    • Order: Ascending / Descending

X-Axis

The data property the X-Axis represents

Display only last epoch

Show results filtered to the latest epoch

Split series by subset

Separate thetraining / validation / test subsets

Line

Property
Description

Name

The Dashlet's title

Y-Axis

Points to the metric that is correlated with the y-axis

Aggregation

Mathematical operation for aggregating the presented data: Average, Min, Max, Mid

Data Distribution

  • Continuous

  • Distinct

    • Order-By: Metric / Alphabetical

    • Order: Ascending / Descending

X-Axis

The data property the X-Axis represents

Display only last epoch

Show results filtered to the latest epoch

Split series by subset

Separate thetraining / validation / test subsets

Area

Property
Description

Name

The Dashlet's title

Y-Axis

Points to the metric that is correlated with the bars' height

Aggregation

Mathematical operation for aggregating the presented data: Average, Min, Max, Mid

Data Distribution

  • Continuous

  • Distinct

    • Order-By: Metric / Alphabetical

    • Order: Ascending / Descending

X-Axis

The data property the X-Axis represents

Display only last epoch

Show results filtered to the latest epoch

Split series by subset

Separate thetraining / validation / test subsets

Table

Property
Description

Name

The Dashlet's title

Metric

Add columns with selected metrics

Metadata

Add columns with selected metadata

Display only last epoch

Show results filtered to the latest epoch

Split series by subset

Separate thetraining / validation / test subsets

HeatMap

Property
Description

Name

The Dashlet's title

Color

  • Field: selected field to be represented by the heat-map's color

  • Aggregation: mathematical operation for aggregating the presented data: Average, Min, Max, Mid

X-Axis

  • Field: selected field to be represented by the x-axis

  • Distribution

    • Continuous

    • Distinct

      • Order-By: Metric / Alphabetical

      • Order: Ascending / Descending

Y-Axis

  • Field: selected field to be represented by the y-axis

  • Distribution

    • Continuous

    • Distinct

      • Order-By: Metric / Alphabetical

      • Order: Ascending / Descending

Display only last epoch

Show results filtered to the latest epoch

Split series by subset

Separate the training / validation / test subsets y

Donut

Property
Description

Name

The Dashlet's title

Slice by Size

  • Count - slice represents the count

  • UniquCount - slice represents the unique count

  • Sum - slice represents the sum

Metric

Add a slices with a selected metric

Metadata

Add a slices with a selected metadata

Display only last epoch

Show results filtered to the latest epoch

Split series by subset

Separate thetraining / validation / test subsets

Confusion Matrix

F1

Property
Description

Name

The Dashlet's title

X-Axis

The data property the X-Axis represents

Data Distribution

  • Continuous

  • Distinct

    • Order-By: Metric / Alphabetical

    • Order: Ascending / Descending

Interval

The interval on which to aggregate results

Balanced Accuracy

Property
Description

Name

The Dashlet's title

X-Axis

The data property the X-Axis represents

Data Distribution

  • Continuous

  • Distinct

    • Order-By: Metric / Alphabetical

    • Order: Ascending / Descending

Interval

The interval on which to aggregate results

PR Curve

Property
Description

Name

The Dashlet's title

ROC Curve

Property
Description

Name

The Dashlet's title

PR Curve

A Dashlet is an interactive visualization that updates in real-time, displaying aggregated metrics against various parameters. To add a new Dashlet click and choose the chart type on the left.

Models Selection for the Dashboard
Bar Dashlet
Line Dashlet
Area Dashlet
Table Dashlet
HeatMap Dashlet
Donut Dashlet
F1 metric Dashlet
Balanced Accuracy Dashlet
PR Curve Dashlet
ROC Curve Dashlet