Import External Code
To include any existing code in your Tensorleap Dataset Script you can create a library and import all your existing classes and functions to your script.
- 1.First, create a file that includes the custom layers that are included in your model. Here we show an example of a custom dense layer.
custom_dense.py
import tensorflow as tf
class CustomDense(tf.keras.layers.Layer):
def __init__(self, n, **args):
super(CustomDense, self).__init__()
self.n = n
self.dense = tf.keras.layers.Dense(self.n)
def call(self, inputs):
return self.dense(inputs)
def get_config(self):
config = super().get_config()
config.update({
"n": self.n,
})
return config
2. In your Tensorleap Data Folder, create a new folder that will include the file you've created and an empty __init__.py file. For example:
|
├── ....
| ├── custom_layers/
| ├── __init__.py
| └── custom_dense.py
3. Now, use one of two possible methods to import the classes Into the dataset script.
Tensorleap dataset script
# custom function imports
import sys
sys.path.append('/home/username/tensorleap/data/custom_layers')
from custom_dense import CustomDense
...
leap_binder.set_custom_layer(CustomDense, 'CustomDense')
OR
Tensorleap dataset script
# custom function imports
import importlib.util
import sys
from inspect import getmembers, isclass
...
# adding custom layers from a file using imports
spec = importlib.util.spec_from_file_location('custom_layers.custom_dense',
'/home/username/tensorleap/data/custom_layers/custom_dense.py')
custom_layers_module = importlib.util.module_from_spec(spec)
spec.loader.exec_module(custom_layers_module)
custom_layers_titles = getmembers(custom_layers_module, isclass)
for i in range(len(custom_layers_titles)):
class_name = custom_layers_titles[i][0]
function_class = getattr(custom_layers_module, class_name)
leap_binder.set_custom_layer(function_class, class_name)
...
Parsing the dataset will now import the custom layers from the external files and add it to your Tensorleap environment.
Last modified 1mo ago