Workshop Setup
This section includes the steps that the workshop organizer should follow to setup the workshop:
- AWS account setup
- OpenShift prerequisites
- Deploy a RedHat OpenShift cluster with GPU-based worker nodes using AWS ROSA.
- Deploy the NVIDIA NIM Operator and NVIDIA GPU Operator.
- Deploy a Large Language Model (LLM) using NVIDIA NIM to the cluster.
- Create OpenShift logins and namespaces for each workshop user, with appropriate permissions.
- Install the Cluster Receiver component of the Splunk OpenTelemetry collector.
- Deploy a Weviate vector database to the cluster.
- Deploy a service that mimics the Portworx Prometheus exporter.