Metrics Dashboard

Tensorleap provides real-time and historical metrics monitoring.

The metrics defined in the Integration Script are stored during model Evaluation / Training for each sample, batch, and epoch. In addition, each sample is monitored and stored with its metadata.

All stored metrics and metadata can be presented aggregatively in a custom Dashlet.

Dashboard

A Dashboard is a panel that layouts various metric charts, also called Dashlets.

Dashboards in Tensorleap are presented via the Dashboard panel, which is shown when you click the tab at the top.

To add a new Dashboard, click at the top bar.

Selected Models

The dashboard displays visualizations of the currently selected model(s). To select models, click to open the Versions panel on the left, expand the version, and select the model(s).

The dashboard will automatically update and show data for the selected models. At the top bar, you can see tags with the selected models. From there, you can also toggle to filter models.

Models Selection for the Dashboard

Dashlet

A Dashlet is an interactive visualization that updates in real-time, displaying aggregated metrics against various parameters. To add a new Dashlet click and choose the chart type on the left.

The different Dashlet types, and their properties, are described below.

Bar

Bar Dashlet

Property	Description
Name	The Dashlet's title
Bar Size	Points to the metric that is correlated with the bars' height
Aggregation	Mathematical operation for aggregating the presented data: Average, Min, Max, Mid
Data Distribution	Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
X-Axis	The data property the X-Axis represents
Display only last epoch	Show results filtered to the latest epoch
Split series by subset	Separate thetraining / validation / test subsets

Line

Line Dashlet

Property	Description
Name	The Dashlet's title
Y-Axis	Points to the metric that is correlated with the y-axis
Aggregation	Mathematical operation for aggregating the presented data: Average, Min, Max, Mid
Data Distribution	Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
X-Axis	The data property the X-Axis represents
Display only last epoch	Show results filtered to the latest epoch
Split series by subset	Separate thetraining / validation / test subsets

Area

Area Dashlet

Property	Description
Name	The Dashlet's title
Y-Axis	Points to the metric that is correlated with the bars' height
Aggregation	Mathematical operation for aggregating the presented data: Average, Min, Max, Mid
Data Distribution	Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
X-Axis	The data property the X-Axis represents
Display only last epoch	Show results filtered to the latest epoch
Split series by subset	Separate thetraining / validation / test subsets

Table

Table Dashlet

Property	Description
Name	The Dashlet's title
Metric	Add columns with selected metrics
Metadata	Add columns with selected metadata
Display only last epoch	Show results filtered to the latest epoch
Split series by subset	Separate thetraining / validation / test subsets

HeatMap

HeatMap Dashlet

Property	Description
Name	The Dashlet's title
Color	Field: selected field to be represented by the heat-map's color Aggregation: mathematical operation for aggregating the presented data: Average, Min, Max, Mid
X-Axis	Field: selected field to be represented by the x-axis Distribution Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
Y-Axis	Field: selected field to be represented by the y-axis Distribution Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
Display only last epoch	Show results filtered to the latest epoch
Split series by subset	Separate the training / validation / test subsets y

Donut

Donut Dashlet

Property	Description
Name	The Dashlet's title
Slice by Size	Count - slice represents the count UniquCount - slice represents the unique count Sum - slice represents the sum
Metric	Add a slices with a selected metric
Metadata	Add a slices with a selected metadata
Display only last epoch	Show results filtered to the latest epoch
Split series by subset	Separate thetraining / validation / test subsets

Confusion Matrix

F1

F1 metric Dashlet

Property	Description
Name	The Dashlet's title
X-Axis	The data property the X-Axis represents
Data Distribution	Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
Interval	The interval on which to aggregate results

Balanced Accuracy

Balanced Accuracy Dashlet

Property	Description
Name	The Dashlet's title
X-Axis	The data property the X-Axis represents
Data Distribution	Continuous Distinct Order-By: Metric / Alphabetical Order: Ascending / Descending
Interval	The interval on which to aggregate results

PR Curve

PR Curve Dashlet

Property	Description
Name	The Dashlet's title

ROC Curve

ROC Curve Dashlet

Property	Description
Name	The Dashlet's title

PR Curve