Do I know any #VictoriaMetrics experts?

I'm seeing an issue where it's not generating an `up` metric but it is generating a `scrape_duration_seconds` (and related) metric and I can't figure out why.

I'm only seeing the problem for a specific label combination. It's working fine with for other targets. 🤔

Can #victoriametrics please stop answering questions about #prometheus with "this is how it works in our product"? It's really annoying, especially when no one asked for it.

#ops #observability #rant

Hi all,
wrote a small devops story about setting up #victoriametrics in my homelab with kustomize and the helm chart inflation generator. #kubernetes

https://deb4sh.github.io/2023/04/06/2023-04-06-DevOpsStories-Victoria-Metrics-Setup-Homelab/

Dinge fummeln #logseq #traefik #docker #victoriametrics

It's time to talk about the unspoken challenges of #monitoring #Kubernetes.
Check out my article @thenewstack, inspired by my OpenObservability Talks episode with with #VictoriaMetrics CTO valyala
https://thenewstack.io/how-to-fix-kubernetes-monitoring/

Typical #Kubernetes deployments generate massive amounts of #metrics. But do we really need them all?
Evidently, only a fraction of these metrics are actually ever being used on #dashboards or #alerts.

Check out last month's OpenObservability episode with #VictoriaMetrics CTO Aliaksandr Valialkin on your favorite app:
🎧 Spotify https://lnkd.in/eUHvdeky
🎧 Apple https://lnkd.in/dw7k-MTE
🎧 Other https://lnkd.in/dMn3NhpV

and check out this article:
https://lnkd.in/dGTeVzS6

#DevOps #monitoring #SRE

The highly dynamic and ephemeral nature of #kubernetes results in high churn rate for the pod metrics. How does this impact #monitoring kubernetes?
Check out the OpenObservbility Talks #podcast episode with
#VictoriaMetrics CTO:
🎧https://anchor.fm/openobservability/episodes/Is-Kubernetes-Monitoring-Flawed----OpenObservability-Talks-S3E08-e1tvvf6
#DevOps #opensource

📢OpenObservability Talks episode is out!
Is Kubernetes Monitoring Flawed?
hosting host Aliaksandr Valialkin, founder and CTO of #VictoriaMetrics

Listen now on your favovite #podcast app:
🎧 Spotify: https://lnkd.in/dhK3VtKA
🎧 Apple: https://lnkd.in/dw7k-MTE
🎧 Other: https://lnkd.in/dMn3NhpV

Or watch the #videocast on YouTube:
📺 https://lnkd.in/deqBYwut

#DevOps #opensource #SRE #monitoring

Rules backfilling via vmalert

https://victoriametrics.com/blog/rules-replay/

#SLI #SLO #SLA #VictoriaMetrics #devops #monitoring #prometheus #grafana

Monitoring benchmark: how to generate 100 million samples/s of production-like data

While the fact that VictoriaMetrics can handle data ingestion rate at 100 million samples per second for one billion of active time series is newsworthy on its own, the benchmark tool used to generate that kind of load is usually overlooked. This blog post explains the challenges of scaling the prometheus-benchmark tool for generating such a load.

https://victoriametrics.com/blog/benchmark-100m

#victoriametrics #monitoring #tsdb

📢OpenObservability Talks episode is out!
Is Kubernetes Monitoring Flawed?
hosting host Aliaksandr Valialkin, founder and CTO of #VictoriaMetrics

Listen now on your favovite #podcast app:
🎧 Spotify: https://lnkd.in/dhK3VtKA
🎧 Apple: https://lnkd.in/dw7k-MTE
🎧 Other: https://lnkd.in/dMn3NhpV

Or watch the #videocast on YouTube:
📺 https://lnkd.in/deqBYwut

#DevOps #opensource #SRE #monitoring

Using node-exporter with VictoriaMetrics on K3s.

https://blog.differentpla.net/blog/2023/01/24/victoria-metrics-node-exporter/

#VictoriaMetrics #homelab #k3s #k8s

Using node-exporter with VictoriaMetrics on K3s.

#VictoriaMetrics #homelab #k3s #k8s

Or: you can use a ClusterIP service with VMServiceScrape. Again: it'll connect to that port on the service. I suspect you'll need to use a headless service to get the discovery to find all of the pods.

#k8s #victoriametrics

How do I glue prometheus node-exporter and VictoriaMetrics together?

I've got the node-exporter daemonset running happily. port-forward to 9100 shows them collecting the metrics I'm interested in.

I'm using a VMNodeScrape object, and it's discovering the targets, but they're showing DROPPED.

Do I need to do something with relabeling? I don't have any, 'cos I don't understand how that's supposed to work.

#k3s #victoriametrics #prometheus #homelab

📢live-streaming TOMORROW January 24th at 11:00 AM PT/ 2:00 PM ET / 20:00 CET at OpenObservability Talks🎙
I'll host Aliaksandr Valialkin, CTO at #VictoriaMetrics and creator of the #opensource project, for a fireside chat on the flaws of current #Kubernetes #monitoring, and what we can do.
Join us on the live stream and bring your questions and comments to the live chat.
https://www.youtube.com/watch?v=Z-58C8HFGb8
#devops #observability #monitoring #SRE

📢 OpenObservability Talks live-stream 🎙
I'll host Aliaksandr Valialkin, CTO at #VictoriaMetrics and creator of the #opensource project, for a fireside chat on the flaws of current #Kubernetes #monitoring, and what we can do.
Join us on the live stream and bring your questions and comments to the live chat.
📅 24 January, 11:00 AM PT / 2:00 PM ET / 20:00 CET
https://www.youtube.com/watch?v=Z-58C8HFGb8
#devops #opensource #observability #SRE

VictoriaMetrics Meetup December 2022

https://youtu.be/Mesc6JBFNhQ

#victoriametrics #monitoring #observability

Do you still use VictoriaMetrics from the previous year? It's time to upgrade to the latest release and enjoy new features!

https://docs.google.com/presentation/u/0/d/1jI7XZoodmuzLymdu4MToG9onAKQjzCNwMO2NDupyUkQ

#victoriametrics #observability #freebsd #OpenBSD #monitoring #KubernetesTips

watching the network usage of my #victoriametrics agents dropping from 35GB/s in/3GB/s out to what looks like will end up about 3 GBs in/out. Thanks scrape time compression. $$$