Increase your step interval ( step=300 for 5m steps) or reduce your time range. 4. Header Conflicts (The Reverse Proxy Issue) If you run Prometheus behind an NGINX or AWS ALB, the proxy might strip or modify required headers.
Check your up metric. If you see weird label values, you have found your problem. The "400 Bad Request" error is Prometheus's way of saying, "I don't understand what you want, and I refuse to guess." It is frustrating, but it is safe . It protects your Prometheus instance from crashing due to bad input.
curl -G http://localhost:9090/api/v1/query \ --data-urlencode 'query=upjob="node"' (This is the safest way to use curl with Prometheus.) Sometimes, it genuinely isn't your fault. A bug in a third-party exporter or a service discovery crash can inject NaN or Inf values into the label set. If your query tries to filter on a label that contains a newline character ( \n ) or a control character, the JSON marshaller fails.