# Evaluate Process

<figure><img src="https://3509361326-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9UXeOlFqlw8pl79U2HGU%2Fuploads%2FWlGmUsnNTREoySx9NWc0%2Fimage.png?alt=media&#x26;token=3840f552-dbf7-4df7-b044-3063b00c7554" alt=""><figcaption><p>Filtering for evaluate processes in the platform</p></figcaption></figure>

### Overview

Once the [Evaluate](https://docs.tensorleap.ai/user-interface/project/menu-bar/evaluate-a-model) button is clicked , a new evaluate process will initiate.

This process will infer your model on all of the provided data, and run Tensorleap analysis on top of it. It:

* Initializes the Preprocess from the [integration script](https://docs.tensorleap.ai/tensorleap-integration/writing-integration-code).
* Iteratively loads all of your samples, feeds them to the model and calculate all of your metrics, metadata and losses
* Extracts a latent space representation from each sample
* Uses the Tensorleap engine to estimate values on unlabeled data and bulk labelling suggestion

### Resuming an evaluate process

The evaluate process is stateful, so if it failed mid-run due to server instability or any other, non reproducible error, it is possible to continue the evaluation.<br>

To continue a terminated or Failed evaluation, within the runs and processes click the relevant Evaluate job, and click continue.

<figure><img src="https://3509361326-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9UXeOlFqlw8pl79U2HGU%2Fuploads%2FVBoQiblC297PKQJJAYE2%2Fimage.png?alt=media&#x26;token=39172fb7-7eb4-4e8f-b39d-5c80c0fd309f" alt=""><figcaption><p>Resuming an evaluate process that was terminated</p></figcaption></figure>

### Common Run Issues:

{% hint style="danger" %}
Evaluate mostly fail due to these reasons:

* An evaluation was initiated before [Assets validation](https://docs.tensorleap.ai/user-interface/project/network/network-mapping/validate-mapping) and assets are not valid.  It is recommended to validate the assets first (and see [common validation issues](https://docs.tensorleap.ai/user-interface/project/network/network-mapping/validate-mapping)) - and make sure that the connected [code integration](https://docs.tensorleap.ai/user-interface/project/network/code-integration) is the intended script to use.
* Only a small amount of the samples are able to be parsed using the [integration script](https://docs.tensorleap.ai/tensorleap-integration/writing-integration-code). Since the Asset Validation only verify a successful ingest of the first sample in the dataset, it might be that other samples return invalid inputs (i.e. different shapes, types) that would cause the evaluate to fail. It is recommended to run the[ integration test](https://docs.tensorleap.ai/tensorleap-integration/integration-test) on a larger amount of samples to verify validity and ensure all [Tensorleap decoders](https://docs.tensorleap.ai/tensorleap-integration/python-api/code_loader/decorators) are static - i.e. return the same shape and type for every sample. It is highly advised to ensure [metadata](https://docs.tensorleap.ai/tensorleap-integration/writing-integration-code/metadata-function) return flat dictionaries for every sample with the same type per value.
* OOM in evaluate. please adjust the limits in the [settings](https://docs.tensorleap.ai/user-interface/settings) page.
* Server shutdown in the middle of evaluate or any other instability. It is possible to [resume](#resuming-an-evaluate-process) the evaluate.
  {% endhint %}
