LogoLogo
  • Tensorleap
  • Examples
    • Semantic Segmentation
    • Image Analysis
    • Sentiment Analysis
    • MNIST Project Walkthrough
    • IMDB Project Walkthrough
  • Quickstart using CLI
  • Guides
    • Full Guides
      • MNIST Guide
        • Dataset Integration
        • Model Integration
        • Model Perception Analysis
        • Advanced Metrics
      • IMDB Guide
        • Dataset Integration
        • Model Integration
        • Model Perception Analysis
        • Advanced Metrics
    • Integration Script
      • Preprocess Function
      • Input Encoder
      • Ground Truth Encoder
      • Metadata Function
      • Visualizer Function
      • Prediction
      • Custom Metrics
      • Custom Loss Function
      • Custom Layers
      • Unlabeled Data
      • Examples
        • CelebA Object Detection (YoloV7)
        • Wikipedia Toxicity (using Tensorflow Datasets)
        • Confusion Matrix
        • CelebA Classification (using GCS)
  • Platform
    • Resources Management
    • Project
    • Dataset
    • Secret Manager
    • Network
      • Dataset Node
      • Layers
      • Loss and Optimizer
      • Visualizers
      • Import Model
      • Metrics
    • Evaluate / Train Model
    • Metrics Dashboard
    • Versions
    • Issues
    • Tests
    • Analysis
      • helpers
        • detection
          • YOLO
    • Team management
    • Insights
  • API
    • code_loader
      • leap_binder
        • add_custom_metric
        • set_preprocess
        • set_unlabeled_data_preprocess
        • set_input
        • set_ground_truth
        • set_metadata
        • add_prediction
        • add_custom_loss
        • set_visualizer
      • enums
        • DatasetMetadataType
        • LeapDataType
      • datasetclasses
        • PreprocessResponse
      • visualizer_classes
        • LeapImage
        • LeapImageWithBBox
        • LeapGraph
        • LeapText
        • LeapHorizontalBar
        • LeapImageMask
        • LeapTextMask
  • Tips & Tricks
    • Import External Code
  • Legal
    • Terms of Use
    • Privacy Policy
Powered by GitBook
On this page
  • Insights Overview
  • What are insights
  • Insights review

Was this helpful?

  1. Platform

Insights

Extracting automatic insights using Tensorleap

PreviousTeam managementNextAPI

Last updated 2 years ago

Was this helpful?

Insights Overview

Tensorleap insights could be viewed via the insights panel which is shown once you click on the dashboard view at the top. In order to see insights, a model must be loaded and evaluated or trained using the Tensorleap system.

What are insights

Insights are essentially clusters in your model's latent space, that have unique properties that should be considered for the sake of model & dataset analysis.

Each Cluster is composed of a group of samples, that have some shared features, and a unique behaviour as detected by the TensorLeap platform.

We detect 4 types of clusters:

  • High-Loss Cluster - a collection of similar samples that the model performs poorly on.

  • Overfitting Cluster - a collection of samples on which the model scored significantly better on the train subset than on the validation subset.

  • Repetitive Cluster - a collection of samples, that have very low variance in features, compared to the rest of the samples.

  • Underrepresentation Cluster - a collection of samples that are composed of an uneven representation from the validation and train subsets, i.e. the cluster has a significantly higher number of samples that are from the training subset than the validation subset or vice versa.

Insights review

On the top-right of the insights panel the number of insights, per type, is shown. Clicking the Display button on the insights will refer to the display of the specific cluster.

Once we filter the relevant samples that make out an interesting cluster we can use Tensorleap to better understand each sample and analyze the root cause for the cluster's behaviour.

Sample Analysis
Zooming in to interesting clusters using Tensorleap insights