Workshop Setup

This section includes the steps that the workshop organizer should follow to setup the workshop:

  • AWS account setup
  • OpenShift prerequisites
  • Deploy a RedHat OpenShift cluster with GPU-based worker nodes using AWS ROSA.
  • Deploy the NVIDIA NIM Operator and NVIDIA GPU Operator.
  • Deploy a Large Language Model (LLM) using NVIDIA NIM to the cluster.
  • Create OpenShift logins and namespaces for each workshop user, with appropriate permissions.
  • Install the Cluster Receiver component of the Splunk OpenTelemetry collector.
  • Deploy a Weviate vector database to the cluster.
  • Deploy a service that mimics the Portworx Prometheus exporter.