Metrics Dashboard
Last updated
Last updated
Tensorleap provides real-time and historical metrics monitoring.
The metrics defined in the Integration Script are stored during model Evaluation / Training for each sample, batch, and epoch. In addition, each sample is monitored and stored with its metadata.
All stored metrics and metadata can be presented aggregatively in a custom Dashlet.
A Dashboard is a panel that layouts various metric charts, also called Dashlets.
Dashboards in Tensorleap are presented via the Dashboard panel, which is shown when you click the tab at the top.
To add a new Dashboard, click at the top bar.
The dashboard displays visualizations of the currently selected model(s). To select models, click to open the Versions panel on the left, expand the version, and select the model(s).
The dashboard will automatically update and show data for the selected models. At the top bar, you can see tags with the selected models. From there, you can also toggle to filter models.
The different Dashlet types, and their properties, are described below.
Name
The Dashlet's title
Bar Size
Points to the metric that is correlated with the bars' height
Aggregation
Mathematical operation for aggregating the presented data: Average, Min, Max, Mid
Data Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
X-Axis
The data property the X-Axis represents
Display only last epoch
Show results filtered to the latest epoch
Split series by subset
Separate thetraining / validation / test subsets
Name
The Dashlet's title
Y-Axis
Points to the metric that is correlated with the y-axis
Aggregation
Mathematical operation for aggregating the presented data: Average, Min, Max, Mid
Data Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
X-Axis
The data property the X-Axis represents
Display only last epoch
Show results filtered to the latest epoch
Split series by subset
Separate thetraining / validation / test subsets
Name
The Dashlet's title
Y-Axis
Points to the metric that is correlated with the bars' height
Aggregation
Mathematical operation for aggregating the presented data: Average, Min, Max, Mid
Data Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
X-Axis
The data property the X-Axis represents
Display only last epoch
Show results filtered to the latest epoch
Split series by subset
Separate thetraining / validation / test subsets
Name
The Dashlet's title
Metric
Add columns with selected metrics
Metadata
Add columns with selected metadata
Display only last epoch
Show results filtered to the latest epoch
Split series by subset
Separate thetraining / validation / test subsets
Name
The Dashlet's title
Color
Field: selected field to be represented by the heat-map's color
Aggregation: mathematical operation for aggregating the presented data: Average, Min, Max, Mid
X-Axis
Field: selected field to be represented by the x-axis
Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
Y-Axis
Field: selected field to be represented by the y-axis
Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
Display only last epoch
Show results filtered to the latest epoch
Split series by subset
Separate the training / validation / test subsets y
Name
The Dashlet's title
Slice by Size
Count - slice represents the count
UniquCount - slice represents the unique count
Sum - slice represents the sum
Metric
Add a slices with a selected metric
Metadata
Add a slices with a selected metadata
Display only last epoch
Show results filtered to the latest epoch
Split series by subset
Separate thetraining / validation / test subsets
Name
The Dashlet's title
X-Axis
The data property the X-Axis represents
Data Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
Interval
The interval on which to aggregate results
Name
The Dashlet's title
X-Axis
The data property the X-Axis represents
Data Distribution
Continuous
Distinct
Order-By: Metric / Alphabetical
Order: Ascending / Descending
Interval
The interval on which to aggregate results
Name
The Dashlet's title
Name
The Dashlet's title
A Dashlet is an interactive visualization that updates in real-time, displaying aggregated metrics against various parameters. To add a new Dashlet click and choose the chart type on the left.
