Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

...

Info

The Remote Python Execute can be installed only on Groundplexes and not on Cloudplexes.

Start RPE

Docker Images

A Docker container is an instance created from a Docker image. We provide RPE as a Docker images image, which you can download from here. This is the type available: min: the minimal version for CPU instances.

Below is the list of Python libraries in the ds and ds-cuda9-cudnn7 tags. 

...

Library

...

Version

...

simplejson

...

3.16.0

...

requests

...

2.20.0

...

jsonpickle

...

1.0

...

python-dateutil

...

2.7.4

...

more-itertools

...

4.3.0

...

pydub

...

0.23.0

...

numpy

...

1.15.3

...

scipy

...

1.1.0

...

scikit-learn

...

0.20.0

...

xgboost

...

0.80

...

lightgbm

...

2.2.1

...

pillow

...

5.3.0

...

bokeh

...

0.13.0

...

pandas

...

0.23.4

...

tensorflow

...

1.5.0

...

keras

...

2.2.4

...

nltk

...

3.3

...

textblob

...

0.15.1

...

.

...

CPU Instance

Execute the following command to start the RPE container minimal version:

...

Execute the following command to start the RPE container minimal version for GPU instance:

Code Block
sudo docker pull snaplogic/rpe:min-cuda9-cudnn7
sudo docker run --runtime=nvidia --memory-swap="-1" --restart=always -dti -p 5301:5301 -e "REMOTE_PYTHON_EXECUTOR_TOKEN=" -v /opt/remote_python_executor_log/:/opt/remote_python_executor_log/ --name=rpe snaplogic/rpe:min-cuda9-cudnn7   

Options

The following table describes each option:

Option

Format

Description

--memory-swap="-1" --restart=always

--memory-swap="<memory_swap_limit>" --restart=always

The container can use unlimited space for memory swapping. See Memory Swap for more information.

"–restart=always" automatically restarts the docker container if the machine restarts.

-p 5301:5301

-p <host_port>:5301

The RPE is accessible from the host port which is 5301 by default. You may change the host port to support multiple containers on the same node.

-e "REMOTE_PYTHON_EXECUTOR_TOKEN="

-e "REMOTE_PYTHON_EXECUTOR_TOKEN=<token>"

The default token is empty. A strong token is recommended.

-v /opt/remote_python_executor_log/:/opt/remote_python_executor_log/

-v <log_dir>/opt/remote_python_executor_log/

The log is mounted to /opt/remote_python_executor_log/by default. This location can be changed.

--name=rpe

--name=<container_name>

The container’s name can be changed in case of multiple containers on the same node.

...

Download the custom RPE package. This package contains Dockerfile and others. You can modify the Dockerfile and add required libraries in requirements.txt. Then, run the following command to build the Docker image.

Tip

Make sure to to run cd into the directory containing the Dockerfile.

...