High Availability on Kubernetes

Ensuring high availability (HA) is crucial for maintaining uptime, minimizing service disruption, and supporting critical workloads in production. This guide explains how to design, deploy, and operate Prisme.ai with HA in mind on Kubernetes.

​

Why High Availability Matters

A high-availability deployment ensures:

• No single point of failure
• Redundant services distributed across zones or regions
• Automated failover and recovery
• Increased uptime for business-critical use cases

​

Key HA Components

​

Example: Minimal HA Setup

apiVersion: apps/v1
kind: Deployment
metadata:
  name: api-gateway
spec:
  replicas: 3
  selector:
    matchLabels:
      app: api-gateway
  template:
    metadata:
      labels:
        app: api-gateway
    spec:
      containers:
      - name: api-gateway
        image: prismeai/api-gateway:latest
        ports:
        - containerPort: 3001
        livenessProbe:
          httpGet:
            path: /health
            port: 3001
          initialDelaySeconds: 5
          periodSeconds: 10
        readinessProbe:
          httpGet:
            path: /ready
            port: 3001
          initialDelaySeconds: 5
          periodSeconds: 10

​

Resilient Databases

​

Monitoring and Self-Healing

• Use Prometheus and Grafana for live dashboards and alerting.
• Implement Kubernetes PodDisruptionBudgets (PDBs) to prevent all pods from being evicted at once.
• Add Horizontal Pod Autoscalers (HPA) for runtime services.

Example PodDisruptionBudget:

apiVersion: policy/v1
kind: PodDisruptionBudget
metadata:
  name: runtime-ha-pdb
spec:
  minAvailable: 2
  selector:
    matchLabels:
      app: runtime

​

Next Steps