Tensorleap Integration

Integrating your own model and dataset to the platform and reviewing the development proces

This page outlines the different elements of the tensorleap integration and reviews the integration flow and development cycle within the platform.

Prerequisites

• Access to Tensorleap and an installed and authenticated CLI.

• .onnx or .h5 model

• A valid code integration that instructs Tensorleap on how to load the dataset and parse and visualize different elements.

• Tensoleap configuration yamls:

  • A leap.yaml file that contains the setup of your integration.

  • (optionally) leap_mapping.yaml that instructs the platform on which visualization, metrics, and losses, should be connected to which predictions, inputs, or GTs.

  • (optionally) requirements.txt file if non-default requirements are needed

Expected Folder Structure

The expected file structure for a Tensorleap code integration is the following:

my_leap_project/
├── ...
├── leap_binder.py
├── leap.yaml
├── (optional)leap_mapping.yaml

Here, leap_binder.py contains the integration script.

The Tensorleap integration flow

1. Start from an existing repo from our Leap Hub or use the CLI to add template Tensorleap integration files into your existing repository.

2. Make sure your data is accessible to the Tensorleap Server.

3. Create a basic Integration script. This can include an input_encoder, GT encoder, loss, and a basic visualizer for the input, prediction and GT.

4. Verify your integration validity locally using an Integration test.

5. Use the CLI to push the code and models to the platform

6. If leap_mapping.yaml was not pushed to the server, create a new mapping file.

7. Validate the assets after uploading to the server

8. Use the Platform to Evaluate and process the data using your model.

After the integration step the model and dataset can be analyzed using the platform. Usually, during the analysis phase the insights and analysis being done points to a missing metadata, better visualization method, or a new metric. These elements should then be added to the integration script and then steps 4-7 are repeated.