Tempo doc

docs/REFERENCE.md

@@ -29,6 +29,7 @@
 | **Secret Management** | Sealed Secrets (Bitnami) |
 | **Monitoring** | Prometheus + Grafana |
 | **Logging** | Loki + Fluent-Bit |
+| **Tracing** | Tempo (OTLP) |
 | **Container Scanning** | Trivy |
 
 ### Network Architecture
@@ -81,6 +82,7 @@ sturdy-adventure/
 │   ├── prometheus.yaml
 │   ├── grafana.yaml
 │   ├── loki.yaml
+│   ├── tempo.yaml
 │   ├── fluent-bit.yaml
 │   ├── trivy.yaml
 │   ├── sealedsecrets.yaml
@@ -90,6 +92,7 @@ sturdy-adventure/
 │       ├── prometheus-values.yaml
 │       ├── grafana-values.yaml
 │       ├── loki-values.yaml
+│       ├── tempo-values.yaml
 │       └── fluent-bit-values.yaml
 │
 ├── apps/                          # Business applications
@@ -703,6 +706,7 @@ kubeStateMetrics:
 **Datasources**:
 - Prometheus
 - Loki
+- Tempo
 
 ### Loki
 
@@ -720,6 +724,45 @@ promtail:
   enabled: false  # Using Fluent-Bit instead
 ```
 
+### Tempo
+
+**Chart**: `grafana/tempo`
+**Version**: 1.24.4
+**Namespace**: `monitoring`
+
+**Purpose**: Distributed tracing backend receiving OTLP traces from Traefik and other instrumented services.
+
+**Configuration**:
+```yaml
+tempo:
+  storage:
+    trace:
+      backend: local
+      local:
+        path: /var/tempo/traces
+  receivers:
+    otlp:
+      protocols:
+        grpc:
+          endpoint: "0.0.0.0:4317"
+        http:
+          endpoint: "0.0.0.0:4318"
+
+persistence:
+  enabled: true
+  size: 10Gi
+```
+
+**Endpoints**:
+- gRPC OTLP receiver: `:4317`
+- HTTP OTLP receiver: `:4318`
+- Query API: `:3200`
+
+**Grafana Integration**:
+- Trace-to-logs correlation with Loki (by namespace, pod, container)
+- Trace-to-metrics correlation with Prometheus (by service name)
+- Service graph and node graph visualization
+
 ### Fluent-Bit
 
 **Chart**: `fluent/fluent-bit`
@@ -1184,6 +1227,19 @@ GET /api/v1/query_range?query={promql}&start={time}&end={time}&step={duration}
 GET /api/v1/label/__name__/values
 ```
 
+### Tempo API
+
+```
+# Search traces
+GET /api/search?q={traceql}
+
+# Get trace by ID
+GET /api/traces/{traceID}
+
+# Service tag values
+GET /api/v2/search/tag/resource.service.name/values
+```
+
 ### Loki API
 
 ```
@@ -1315,6 +1371,7 @@ team: platform
 | **Prometheus** | 2.47.0+ | Latest |
 | **Grafana** | 10.0.0+ | Latest |
 | **Loki** | 2.9.0+ | Latest |
+| **Tempo** | 2.6.0+ | 1.24.4 |
 | **Fluent-Bit** | 2.1.0+ | Latest |
 | **PostgreSQL** | 16-alpine | N/A |
 | **Trivy** | Latest | Latest |