# Runs and Processes

<figure><img src="https://3509361326-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9UXeOlFqlw8pl79U2HGU%2Fuploads%2FpvO878G7i3oMAF9y3Ylh%2Fimage.png?alt=media&#x26;token=24e9af16-2d9c-439b-8041-bf07fb73d75b" alt=""><figcaption><p>The Runs &#x26; Processes window </p></figcaption></figure>

The purpose of the runs & processes window is to have an in-depth view of the Tensoleap processes that were started by the user - their progress, status, and logs. This window also allows to extract logs from failing processes for debugging purposes,  re-run failed evaluations, and kill processes.

## Overview

The Runs and processes window presents all of the processes that was started in the platform. The table lists:

* The [Model Name](https://docs.tensorleap.ai/user-interface/versions#switching-and-modifying-model-versions) that is used by process
* The [Model Run](https://docs.tensorleap.ai/user-interface/versions#switching-and-modifying-model-versions) that is used by process
* The [Code Integration](https://docs.tensorleap.ai/user-interface/network/code-integration/code-version-controller#script-versioning-at-tensorleap) Name, branch, and version that is used by the process
* The Type & status of the process
* Creation time and total process duration.

The top of the runs & processes bar supports a filtering of specific types of processes, stopping all jobs, and deleting all logged processes from the window.

Each process could be expanded (by clicking the process Name), to show additional process attributes.

### Process Types in Tensorleap

* [Import Model](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/import-model-process): The process of uploading a new model to the platform via the [CLI](https://docs.tensorleap.ai/tensorleap-integration/uploading-with-cli/cli-assets-upload#uploading-a-model) or [UI](https://docs.tensorleap.ai/user-interface/versions/import-model#import-model-using-ui).
* [Dataset Parse](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/dataset-parse-process): The process of parsing an integration script uploaded via the [CLI](https://docs.tensorleap.ai/tensorleap-integration/uploading-with-cli/cli-assets-upload#uploading-code-only) or [UI](https://docs.tensorleap.ai/user-interface/network/code-integration/code-viewing#the-top-controller).
* [Graph Validate](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/graph-validate-process): The process of [validating the assets](https://docs.tensorleap.ai/user-interface/project/network/network-mapping/validate-mapping) of a mapping.
* [Evaluate](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/evaluate-process): The process of running [an evaluate](https://docs.tensorleap.ai/user-interface/project/menu-bar/evaluate-a-model) of a model.
* [Population Exploration](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/population-exploration-process): The process of analyzing the model latent space. This triggers when:
  * An [evaluate](https://docs.tensorleap.ai/user-interface/project/menu-bar/evaluate-a-model) was complete
  * The state of the Population exploration Dashlet changes
  * A change in the [dashboard filters](https://docs.tensorleap.ai/user-interface/project/dashboards)
* [Visualizers Calculation](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/visualizers-calculation-process): The process of visualizing the different samples within the population exploration using the provided [visualizers](https://docs.tensorleap.ai/user-interface/project/network/network-mapping/create-a-mapping-deprecated/visualizer-node).
* [Fetch Similar](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/fetch-similar-process): The process of fetching similar samples from within the population exploration.
* [Sample Analysis](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/sample-analysis-process): The process of analyzing a specific sample from within the population exploration.
* [Import Project](https://docs.tensorleap.ai/user-interface/project/menu-bar/runs-and-processes/process-types/import-project-process): The process of [importing a gallery project](https://docs.tensorleap.ai/getting-started/quickstart/quickstart-using-gallery) to the platform.

### Filtering, killing, and removing process logs

#### Filtering a process

In order to only view some of the types you can open the filter icon at the top of the runs and process, and select the relevant process.

Killing a process

* Clicking the top "Skull" next to the filter kills all processes (in case multiple processes are stuck)
* For active processes, hovering over them would add another in-line "skull" icon. pressing it would kil the process

Clearing logs and previous processes

The right-most button removes all previous process logs from the platform.

### Inspecting a process

Inspecting a process allows a user to monitor logs from the process (live) or download a .tar.gz of the most recent logs once a process is terminated.

#### How to inspect a process

To inspect a process - click the process within the Runs & processes and then click "Inspect Process"

<figure><img src="https://3509361326-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9UXeOlFqlw8pl79U2HGU%2Fuploads%2FrqBUfeAoT5iH9Dmtdl3A%2Fimage.png?alt=media&#x26;token=d7e68df7-108e-44f7-ad25-849f3fcac41a" alt=""><figcaption><p>Inspecting an evaluate process</p></figcaption></figure>

#### The process inspection view

In the process inspection view we can download the logs (top right cloud icon downloads a .tar.gz file), or review them within the paltform.

The logs are divided into tab, each tab essentially describe the logs from a [kubernetes](https://kubernetes.io/) pod that takes part in the work needed for this process to complete.

There are tabs per pod, named describe-POD-NAME and POD-NAME.

* The desribe-POD-NAME pod is essentially the output of a [kubectl describe pod](https://kubernetes.io/docs/reference/kubectl/generated/kubectl_describe/) command. It provides information on the status of the pod, if it encountered an OOM, and other high-level configurations (limits, etc.)
* The POD-NAME contains the most recent logs from the pod.&#x20;

<figure><img src="https://3509361326-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9UXeOlFqlw8pl79U2HGU%2Fuploads%2F4gi9nQ9xPXCGxLL0xhgh%2Fimage.png?alt=media&#x26;token=2959ccd3-ead9-421a-94bd-d72971d4dac1" alt=""><figcaption><p>An example of a process inspection view</p></figcaption></figure>

#### Debugging process errors

Most Process error result in a [meaningful notification](https://docs.tensorleap.ai/user-interface/project/menu-bar/notifications) that should point a specific issue that should be resolved. To further debug the issue, it is possible to examine the logs - and review any errors that might appear.
