> ## Documentation Index
> Fetch the complete documentation index at: https://io-migration.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Deploy Ray Cluster

> This document explains how to deploy a Ray cluster by leveraging compute power in io.net's DePIN network.

## Payments

IO Cloud customers can load their io.net account prior to deploying clusters, or they can pay at the end of the deploy process. The main two ways to pay for clusters is using Solana and credit cards. To use Solana, you must set up a wallet. This can be done when you register your account or later in **Account Settings**.

To learn more about the types of payments we offer and step-by-step guides, see [IO Cloud Payments](https://io-migration.mintlify.site/docs/io-cloud-payments.md).

[Deploy Ray Cluster on IO Cloud](https://www.youtube.com/embed/opWBPu98iR4)

## Configure Cluster

### 1. Create Cluster

Select Ray from the Cluster menu.

![](https://mintcdn.com/io-migration/Bv_oYBZcsAQogZqq/images/docs/7be3fe5c51a8696d5933b951897f4b8bee94387cce8aa1d73c2bd54df2b793e9-Ray1.jpg?fit=max\&auto=format\&n=Bv_oYBZcsAQogZqq\&q=85\&s=e1f2fdf0ae7418db53569af395a03153)

### 2. Select Cluster Type

Select the cluster type that meets the scope of your project.

* **General** - This option works well for prototyping or general E2E workloads.
* **Inference** - Choose if you require production-ready clusters for low-latency inference and heavy workloads.
* **Train** - Choose if you require production-ready clusters for machine learning models, training, and fine-tuning.

![](https://mintcdn.com/io-migration/kh-vnEATGQnWyqTf/images/docs/c35726eb588c50a0ed8ba435617b98b29b97096e364fc861a5da644eb22d2a9b-Bitmap2.jpeg?fit=max\&auto=format\&n=kh-vnEATGQnWyqTf\&q=85\&s=990e27bfa29566c72e1d11ae603c938a)

### 3. Rename Cluster

Click the pencil icon to the right of the name to rename your cluster. In the screenshot below, the icon is highlighted in the blue box. Provide a unique name for your cluster.

![](https://mintcdn.com/io-migration/XJ5nypdM1l0ptpX6/images/docs/eb660e1-rename.png?fit=max\&auto=format\&n=XJ5nypdM1l0ptpX6\&q=85\&s=9951db50745ef871d422b0e597b34378)

Click **Next Step**.

### 4. Security Compliance

Select the level and type of security for your cluster.

* **E2E Encrypted** - A method of secure communication that prevents bad actors from accessing data while it's transferred. It restricts data access to the sender and recipient. All data traffic between GPUs is encrypted.
* **SOC2/HIPAA** - (Coming Soon) A framework for managing and securing data related to technology and cloud computing services. All data traffic between GPUs is encrypted.

![](https://mintcdn.com/io-migration/Bv_oYBZcsAQogZqq/images/docs/8a79ab3-sec_com.png?fit=max\&auto=format\&n=Bv_oYBZcsAQogZqq\&q=85\&s=b3cc8d18f6eefb5ae219f6e92681d0cb)

Click **Next Step**.

### 5. Location

To select a location for our GPUs, enter a country name in the Search field or browse the country list (screenshot below is truncated). You can select multiple locations. Residents of countries with strict data residency can use this option to meet those requirements.

> [!NOTE]
>
> One reason to select a specific location is to reduce latency. If you're located in USA and select USA for location, then your clients can get results more quickly if, for example, your GPUs are inferencing.

![](https://mintcdn.com/io-migration/IwUWwB8xp-N74Lcf/images/docs/23f3bce-ray_location.png?fit=max\&auto=format\&n=IwUWwB8xp-N74Lcf\&q=85\&s=571d7330b3783ba86a947f16b95a0b33)

Click **Next Step**.

### 6. Connectivity Tiers

Select the connectivity speed for your project.

* **Ultra High Speed** - Download 1600 MB/s / 1200 MB/s Upload
* **High Speed** - Download 800 MB/s / 600 MB/s Upload
* **Medium** - Download 400 MB/s / 300 MB/s Upload
* **Low Speed** - Download 100 MB/s / 10 MB/s Upload

![](https://mintcdn.com/io-migration/IwUWwB8xp-N74Lcf/images/docs/2991dc1-connect_ray.png?fit=max\&auto=format\&n=IwUWwB8xp-N74Lcf\&q=85\&s=2ef8a809bfc02681584fd23474eaea88)

Click **Next Step**.

### 7. Select GPUs

Select the type of computing your project requires, **GPU** or **CPU**.

* If you select GPU, also select NVIDIA and browse for the model that satisfies your requirements.
* If you select CPU, you can choose between Apple of AMD CPUs.

![](https://mintcdn.com/io-migration/IwUWwB8xp-N74Lcf/images/docs/2507166-ray_clus_select.png?fit=max\&auto=format\&n=IwUWwB8xp-N74Lcf\&q=85\&s=fa050049bc8a91da213940b7163d6157)

Click **Next Step**.

### 8. Cluster Base Image

Ray is the only selection for now. We will release additional cluster base images soon such as:

* IOG
* Ludwig (Ludwig – Ludwig is an open-source, declarative deep learning model building framework developed by Uber AI Labs. It aims to provide a simple and flexible way to train and test deep learning models without requiring extensive knowledge of machine learning or deep learning frameworks. Ludwig enables users to build and deploy deep learning models for a variety of tasks, including natural language processing (NLP), computer vision, time series forecasting, and more.)
* Pytorch FSDP (PyTorch FSDP – PyTorch FSDP stands for PyTorch Fully Sharded Data Parallelism. It's a distributed training technique designed to efficiently train large deep learning models across multiple GPUs or even across multiple machines. FSDP achieves this by sharding (splitting) the model parameters and activations across multiple devices, allowing for parallel computation during training.)
* Unreal Engine 5 (Unreal Engine 5 – Unreal Engine 5 (UE5) is a powerful and popular real-time 3D creation platform primarily used for developing video games, architectural visualizations, virtual reality (VR) experiences, and more. Machine learning algorithms for computer vision can be used to enhance augmented reality (AR) or mixed reality (MR) experiences created with Unreal Engine 5. For example, object recognition and tracking algorithms can enable more realistic interactions between virtual and real-world objects in AR applications.)
* Unity Streaming (Unity Streaming – Unity Render Streaming is a technology that brings Unity's powerful rendering capabilities to web browsers, allowing users to experience high-quality graphics directly in their browser without additional software installations.)

![](https://mintcdn.com/io-migration/a0SgPTMLRmp_SOmy/images/docs/67a82eda17320fe5cd529db6bc82da5071188c4aa556096236702b858512991d-Bitmap.jpg?fit=max\&auto=format\&n=a0SgPTMLRmp_SOmy\&q=85\&s=42feaf171a72704fb3f2c475fb5bdce7)

Click **Next Step**.

### 9. Master Configuration

All clusters include a preconfigured master node. These nodes are selected by io.net from reliable and security compliant data centers.

![](https://mintcdn.com/io-migration/Bv_oYBZcsAQogZqq/images/docs/78bc942-ray_ms_config.png?fit=max\&auto=format\&n=Bv_oYBZcsAQogZqq\&q=85\&s=b88a79ba44db1d1d806bab65e92f31be)

Click **Next Step**.

### 10. Summary

On the Summary page, the choices you made in the process are displayed. You must select the number of GPUs and the duration of time that you will use them.

1. In the **Enter GPUs Quantity** field, select the number of GPUs in the dropdown. 2 GPUs will increase the cost.
2. In the **Enter Duration** field, select the length of time: Hourly, Daily, or Weekly. To the right, you can increase the quantity.
3. Review all the details of your cluster, including the **Total Cost**.
4. Click **Deploy Cluster**.

![](https://mintcdn.com/io-migration/IwUWwB8xp-N74Lcf/images/docs/3142dc3-fees1.png?fit=max\&auto=format\&n=IwUWwB8xp-N74Lcf\&q=85\&s=d7074736a0665aecd77744034625d8bd)

### View Cluster

After payment is processed you can view your cluster loading.

![](https://mintcdn.com/io-migration/ZqZ-cn1FIuLLjj1R/images/docs/b30fc8f-Cluster_load.png?fit=max\&auto=format\&n=ZqZ-cn1FIuLLjj1R\&q=85\&s=9362f9887d7e8e41d9221990f9ca6672)

Click **Return to Clusters** after your cluster is successfully deployed. The screenshot below is a detail page of your cluster.

![](https://mintcdn.com/io-migration/a0SgPTMLRmp_SOmy/images/docs/72c4867-view_cluster2.png?fit=max\&auto=format\&n=a0SgPTMLRmp_SOmy\&q=85\&s=cca92f225f9ae2c5bab21704200ac898)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.