Official Website

Getting started with Determined AI

Determined AI

Determined Community Slack

Run Determined AI deep-learning training platform in cloud. Build models easier with GPU and out-of-the box experiment tracking. No need to manage cloud instances.

An AWS S3 object storage to keep checkpoints and trial metadata. If not set, experiment will fail with error. It's possible to setup S3 bucket later.

[How to find Access Key](https://docs.aws.amazon.com/general/latest/gr/aws-sec-cred-types.html#access-keys-and-secret-access-keys).

Access Key

Bucket Name

[How to find Secret Key](https://docs.aws.amazon.com/general/latest/gr/aws-sec-cred-types.html#access-keys-and-secret-access-keys).

Secret Key

Checkpoint storage configuration

A primary permanent Pod, required for Determined AI to operate.

Determined AI master

It's not recommended to change this value.

Replicas

Global parameters

Fast [NVM-e based Data Storage](https://puzl.cloud/nvme-based-data-storage) will be used.

PostgreSQL Volume

PostgreSQL

A default configuration for Pods that will be launched to execute CPU-only tasks (e.g. TensorBoard, CPU-only notebooks).

CPU-only tasks

A default configuration for Pods that will be launched to execute tasks that require GPU (e.g. experiments, notebooks).

GPU tasks

Volumes that will be mounted to each of your experiments by default.

Volume

Experiments configuration

Official Documentation

An official guide on how to get started with GitLab CI/CD

Getting started with GitLab CI/CD

How to install your own GitLab Runner to Kubernetes and why it might be better and cheaper than using 400 free cloud pipeline minutes

How to run your own Gitlab CI Runner for 1.28€/mo and why it's worth a try

Gitlab Runner

Community Support Forum

An open source project that is used to run your CI/CD jobs and send the results back to GitLab.

Gitlab CI Runner

The [GitLab Server URL (with protocol)](https://docs.gitlab.com/runner/commands/README.html#gitlab-runner-register) that want to register the runner against

Gitlab Url

Configuration of the Pod, that will be launched for the whole time while the App is running to provide its work.

Limits should be higher or equal to the requests.

Resources Limits

Resources Requests

System Pod configuration

The Runner Token for adding new Runners to the GitLab Server. This must be retrieved from your GitLab Instance. It is token of already registered runner. [Where to get token](https://docs.gitlab.com/ee/ci/runners/#reset-the-runner-registration-token-for-a-project)

The runner Registration Token

Configuration for the Pods that the runner launches for each new job

Is being lauched with pipeline for build purposes.

Build Container

GitLab Runner uses a specific container to handle Git, artifacts and cache operations.

Helpers Container

To run concurrent pipelines we recommend to use Shared File System data storage. NVMe-based storage provides better speed but can support only 1 pipeline at a single moment.

Is being launched with pipeline to run auxiliary services (e.g. database).

Services Container

Runners configuration

A step-by-step guide on how to run Jupyter Notebook and boost it with GPU

Running Jupyter Notebook in cloud with GPU in 30 seconds

JupyterLab

Official Discourse Forum

Official Gitter Chatroom

Web-based interactive environment for a wide range of data science, machine learning and computing workflows.

Jupyter Notebook

Setup password to access Jupyter Notebook later.

Password

New Volume

Existing Volume

Official documentation

PostreSQL Docker Image

Official Docker Community Forum

Official Docker Community Slack

Open source object-relational database system with a strong reputation for reliability, feature robustness, and performance.

Database name

Database user name

Anyone can access PostgreSQL from the Internet using login and password

Public access

Access is available only with your Kubernetes account credentials

Access only within the cluster

Access to postgresql

Volume Name

Volume Capacity

Postrgesql version

How to upload data efficiently with the help of ssh and rsync.

Transfer files over SSH with rsync

OpenSSH

SSH server to securely transfer data to/from Volumes. Supports scp, rsync, wget, curl, rclone.

Cloud Marketplace

Cloud Services

Compute Resources
TCP/UDP Balancer
NVMe^®-based Data Storage
Shared File System Data Storage
Cloud Marketplace
Pod Configurator
Resources

Cloud Marketplace

Cloud Services

Compute ResourcesTCP/UDP BalancerNVMe®-based Data StorageShared File System Data StorageCloud MarketplacePod ConfiguratorResources

Compute Resources
TCP/UDP Balancer
NVMe^®-based Data Storage
Shared File System Data Storage
Cloud Marketplace
Pod Configurator
Resources