{"id":1414,"date":"2023-07-18T11:49:42","date_gmt":"2023-07-18T11:49:42","guid":{"rendered":"https:\/\/imesh.ai\/blog\/?p=1414"},"modified":"2023-09-05T05:20:25","modified_gmt":"2023-09-05T05:20:25","slug":"how-to-configure-istio-prometheus-and-grafana-for-monitoring","status":"publish","type":"post","link":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/","title":{"rendered":"How to configure Istio, Prometheus and Grafana for monitoring"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Intro to Istio observability using Prometheus<\/h2>\n\n\n\n<p>Istio service mesh abstracts the network from the application layers using side-car proxies. You can implement security and advance networking policies to all the communication across your infrastructure using Istio.&nbsp;<\/p>\n\n\n\n<p>But another important feature of Istio is observability. You can use Istio to observe the performance and behavior of all your microservices in your infrastructure. One of the primary responsibilities of Site reliability engineers (SREs) in large organizations is to monitor the golden metrics of their applications, such as CPU utilization, memory utilization, latency, and throughput.&nbsp;<\/p>\n\n\n\n<p>In this article, we will discuss how SREs can benefit from integrating three open-source software- Istio, Prometheus, and Grafana. While Istio is the most famous service software, Prometheus is the most widely used monitoring software, and Grafana is the most famous visualization tool.&nbsp;<\/p>\n\n\n\n<p><strong>Note<\/strong>: The steps are tested for Istio 1.17.X<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Watch the video of Istio, Prometheus and Grafana configuration<\/h2>\n\n\n\n<p>Watch the video if you want to follow the steps from video,&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe title=\"Configuring Istio with Prometheus | Grafana | Metrics Monitoring\" width=\"1130\" height=\"636\" src=\"https:\/\/www.youtube.com\/embed\/jZvKKvgirpM?start=55&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Step-1: Go to Istio addons and apply Prometheus and Grafana yaml file<\/h2>\n\n\n\n<p>First go to the addon folder in Istio directory using the command. Since I am using 1.17.1, the path for me is <strong>istio-1.17.1\/samples\/addons<\/strong><\/p>\n\n\n\n<p>You will notice that Istio already provides a few yaml files to configure Grafana, Prometheus, Jaeger, Kiali, etc. You can configure Prometheus by using the following command:<\/p>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background\"><code>kubectl apply -f prometheus.yaml<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background\"><code>kubectl apply -f grafana.yaml<\/code><\/pre>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"380\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-1024x380.png\" alt=\"Apply Istio addon yaml files for Prometheus and Grafana in Kubernetes\" class=\"wp-image-1416\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-1024x380.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-300x111.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-768x285.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-1536x570.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-400x149.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-800x297.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1-1160x431.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernetes-1.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<p>Note these addon yaml are applied to <strong><em>istio-system<\/em><\/strong> namespace by default.&nbsp;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"1024\" height=\"127\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-1024x127.png\" alt=\"Apply Istio addon yaml files for Prometheus and Grafana in Kubernetes\" class=\"wp-image-1417\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-1024x127.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-300x37.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-768x95.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-1536x190.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-400x50.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-800x99.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete-1160x144.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Apply-Istio-addon-yaml-files-for-Prometheus-and-Grafana-in-Kubernete.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\">Step-2: Deploy new service and port-forward Istio ingress gateway<\/h2>\n\n\n\n<p>To experiment with the working model, we will deploy the httpbin service to an istio-enabled namespace. And we will create an object of Istio ingress gateway to receive the traffic to the service from the public.&nbsp;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"1024\" height=\"257\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-1024x257.png\" alt=\"Deploy new service and port-forward Istio ingress gateway\" class=\"wp-image-1418\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-1024x257.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-300x75.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-768x193.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-1536x386.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-400x101.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-800x201.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace-1160x291.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/deploy-the-httpbin-service-to-an-istio-enabled-namespace.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<p>We will also port-forward the Istio ingress gateway to a particular port-7777.&nbsp;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"242\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-1024x242.png\" alt=\"Deploy new service and port-forward Istio ingress gateway\" class=\"wp-image-1419\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-1024x242.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-300x71.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-768x181.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-1536x363.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-400x95.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-800x189.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777-1160x274.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Istio-ingress-gateway-to-a-particular-port-7777.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<p>You should see the below screen at localhost:7777<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"521\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-1024x521.png\" alt=\"localhost:7777\n\" class=\"wp-image-1420\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-1024x521.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-300x153.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-768x391.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-1536x781.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-400x204.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-800x407.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777-1160x590.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/localhost-7777.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\">Step-3: Open Prometheus and Grafana dashboard<\/h2>\n\n\n\n<p>You can open the Prometheus dashboard by using the following command.<\/p>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background\"><code>istioctl dashboard prometheus&nbsp;<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code has-white-color has-black-background-color has-text-color has-background\"><code>istioctl dashboard grafana<\/code><\/pre>\n\n\n\n<p>Both the Grafana and Prometheus will open in the localhost.&nbsp;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-1024x333.png\" alt=\"Open Prometheus and Grafana dashboard\" class=\"wp-image-1421\" width=\"1289\" height=\"419\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-1024x333.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-300x98.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-768x250.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-1536x500.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-400x130.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-800x260.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard-1160x377.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Open-Prometheus-and-Grafana-dashboard.png 2032w\" sizes=\"(max-width: 1289px) 100vw, 1289px\" \/><\/figure>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\">Step-4: Make HTTP requests from Postman<\/h2>\n\n\n\n<p>We will see how the httpbin service is consuming CPU or memory when there is traffic load. We will create a few GET and POST requests to the localhost:7777 from the Postman app.&nbsp;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh4.googleusercontent.com\/tU_4ym_q2PKV3PBJZGTT1jNhiUilqt-UevGut3z-9dCD6V_ShxWDmJXNBHIVrTQJeGmVkuON-C0uxHAykph6froPj5Bjqlb9YaO9Y0NTDJG8thU8nEr4j82xHjWcRnUuYENon7tHFV0LEUAkY3ZnzVw\" alt=\"\"\/><\/figure>\n<\/div>\n\n\n<p>Once you GET or POST requests to httpbin service multiple times, there will be utilization of resources and we can see them in Grafana. But at first we need to configure the metrics for httpbin service in Prometheus and Grafana.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Step-5: Configuring metrics in Prometheus<\/h2>\n\n\n\n<p>One can select a range of metrics related for any Kubernetes resources such as API server, applications, workloads, envoy, etc.&nbsp; We will select <strong><em>container_memory_working_set_bytes <\/em><\/strong>metrics for our configuration.&nbsp;<\/p>\n\n\n\n<p>In the Prometheus application, we will select the namespace to scrape the metrics using the following search term: <strong><em>container_memory_working_set_bytes { namespace= \u201cistio-telemetry\u201d}<\/em><\/strong><strong> <\/strong>(istio-telemetry is the name of our Istio enabled namespace where httpbin service is deployed)<\/p>\n\n\n\n<p>Note that, simply running this we get the memory for our namespace, since we want to analyze the memory usage of our pods, we can calculate the total memory consumed by summing the memory usage of each pod grouped by pod. The following query will help us in getting the desired result : <strong><em>sum(container_memory_working_set_bytes{namespace=&#8221;istio-telemetry&#8221;}) by (pod)<\/em><\/strong><\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/SfTAZXc72KHy9DeuOelOCKhZMZb0qYIoFa8OuxeLCrEyI1o22MATzBUTsU992ulgQXJT_XJUd1hR-z7Z5JbGCucDa0XzqtIsh90u-CjdsVwoaC7io2SEy3WTyF3JqCc1xihhXIOr4tSb_bWM8zJNGYE\" alt=\"\"\/><\/figure>\n<\/div>\n\n\n<p><strong>Note: <\/strong>Prometheus provides a lot of flexibility to filter, slice and dice the metric data. The central idea of this article was to showcase the ability of Istio to emit and send metrics to Prometheus for collection<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Step-:6 Configuring Istio metrics graphs in Grafana<\/h2>\n\n\n\n<p>Now you can simply take the query <strong><em>sum(container_memory_working_set_bytes{namespace=&#8221;istio-telemetry&#8221;}) by (pod)<\/em><\/strong> in Prometheus and plot a graph with time.&nbsp; All you need to do is create a new dashboard in Grafana and paste the query in the metrics browser. Grafana will plot a time-series graph. You can edit the graph with proper name, legends and titles for sharing with other stakeholders in the Ops team.&nbsp;.&nbsp;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"489\" src=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-1024x489.png\" alt=\"Configuring Istio metrics graphs in Grafana\" class=\"wp-image-1424\" srcset=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-1024x489.png 1024w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-300x143.png 300w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-768x367.png 768w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-1536x733.png 1536w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-400x191.png 400w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-800x382.png 800w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana-1160x554.png 1160w, https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/Configuring-Istio-metrics-graphs-in-Grafana.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<p>There are several ways to tweak and customize the data and depict the Prometheus metrics in Grafana. You can choose to make all the customization based on your enterprise needs. I have done a few experiments in the <a href=\"https:\/\/www.youtube.com\/watch?v=jZvKKvgirpM&amp;t=55s\">video<\/a>; feel free to check it out.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>Istio service mesh is extremely powerful in providing overall observability across the infrastructure. In this article, we have just offered a small use case of metrics scrapping and visualization using Istio, Prometheus, and Grafana. You can perform logging and tracing of logs and real-time traffic using Istio; we will cover those topics in our subsequent blogs.&nbsp;<\/p>\n\n\n\n<p>If you are a DevOps or an SRE, please check our <a href=\"https:\/\/www.youtube.com\/@imesh.ai_inc\/videos\">IMESH youtube channel<\/a> for the latest videos on Istio and Envoy.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Intro to Istio observability using Prometheus Istio service mesh abstracts the network<span class=\"excerpt-more\"><\/span><\/p>\n","protected":false},"author":9,"featured_media":1426,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[61],"tags":[73,53,65,72],"class_list":["post-1414","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-observability","tag-grafana","tag-istio","tag-observability","tag-prometheus"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to integrate Istio with Prometheus &amp; Grafana for observability<\/title>\n<meta name=\"description\" content=\"Learn how to configure metrics in Prometheus from Istio service mesh to understand the performance of Kubernetes application. You can use Grafana to visualize graphs of metrics.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to integrate Istio with Prometheus &amp; Grafana for observability\" \/>\n<meta property=\"og:description\" content=\"Learn how to configure metrics in Prometheus from Istio service mesh to understand the performance of Kubernetes application. You can use Grafana to visualize graphs of metrics.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\" \/>\n<meta property=\"og:site_name\" content=\"IMESH\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-18T11:49:42+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-09-05T05:20:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Md Azmal\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Md Azmal\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\"},\"author\":{\"name\":\"Md Azmal\",\"@id\":\"https:\/\/imesh.ai\/blog\/#\/schema\/person\/fdb37d3095697308d103c83ffdf37f10\"},\"headline\":\"How to configure Istio, Prometheus and Grafana for monitoring\",\"datePublished\":\"2023-07-18T11:49:42+00:00\",\"dateModified\":\"2023-09-05T05:20:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\"},\"wordCount\":823,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/imesh.ai\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png\",\"keywords\":[\"grafana\",\"istio\",\"observability\",\"prometheus\"],\"articleSection\":[\"Observability\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\",\"url\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\",\"name\":\"How to integrate Istio with Prometheus & Grafana for observability\",\"isPartOf\":{\"@id\":\"https:\/\/imesh.ai\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png\",\"datePublished\":\"2023-07-18T11:49:42+00:00\",\"dateModified\":\"2023-09-05T05:20:25+00:00\",\"description\":\"Learn how to configure metrics in Prometheus from Istio service mesh to understand the performance of Kubernetes application. You can use Grafana to visualize graphs of metrics.\",\"breadcrumb\":{\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage\",\"url\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png\",\"contentUrl\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png\",\"width\":1280,\"height\":720,\"caption\":\"How to configure Istio, Prometheus and Grafana for monitoring\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/imesh.ai\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to configure Istio, Prometheus and Grafana for monitoring\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/imesh.ai\/blog\/#website\",\"url\":\"https:\/\/imesh.ai\/blog\/\",\"name\":\"IMESH Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/imesh.ai\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/imesh.ai\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/imesh.ai\/blog\/#organization\",\"name\":\"IMESH\",\"url\":\"https:\/\/imesh.ai\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/imesh.ai\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/IMESH-LOGO-scaled.jpg\",\"contentUrl\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/IMESH-LOGO-scaled.jpg\",\"width\":2560,\"height\":1665,\"caption\":\"IMESH\"},\"image\":{\"@id\":\"https:\/\/imesh.ai\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.linkedin.com\/company\/imeshai\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/imesh.ai\/blog\/#\/schema\/person\/fdb37d3095697308d103c83ffdf37f10\",\"name\":\"Md Azmal\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/imesh.ai\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/1563300189291-150x150.jpg\",\"contentUrl\":\"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/1563300189291-150x150.jpg\",\"caption\":\"Md Azmal\"},\"description\":\"Azmal is one of the founding engineers at IMESH, who focuses on boosting enterprise performance and security using Istio and Envoy. He's a versatile full-stack developer skilled in building scalable and performant applications in the cloud. Azmal's interest in cybersecurity and networking has led him to work on various research projects in network security.\",\"sameAs\":[\"https:\/\/imesh.ai\",\"https:\/\/www.linkedin.com\/in\/md-azmal-570308160\"],\"url\":\"https:\/\/imesh.ai\/blog\/author\/azmal-mdimesh-ai\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to integrate Istio with Prometheus & Grafana for observability","description":"Learn how to configure metrics in Prometheus from Istio service mesh to understand the performance of Kubernetes application. You can use Grafana to visualize graphs of metrics.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/","og_locale":"en_US","og_type":"article","og_title":"How to integrate Istio with Prometheus & Grafana for observability","og_description":"Learn how to configure metrics in Prometheus from Istio service mesh to understand the performance of Kubernetes application. You can use Grafana to visualize graphs of metrics.","og_url":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/","og_site_name":"IMESH","article_published_time":"2023-07-18T11:49:42+00:00","article_modified_time":"2023-09-05T05:20:25+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png","type":"image\/png"}],"author":"Md Azmal","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Md Azmal","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#article","isPartOf":{"@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/"},"author":{"name":"Md Azmal","@id":"https:\/\/imesh.ai\/blog\/#\/schema\/person\/fdb37d3095697308d103c83ffdf37f10"},"headline":"How to configure Istio, Prometheus and Grafana for monitoring","datePublished":"2023-07-18T11:49:42+00:00","dateModified":"2023-09-05T05:20:25+00:00","mainEntityOfPage":{"@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/"},"wordCount":823,"commentCount":0,"publisher":{"@id":"https:\/\/imesh.ai\/blog\/#organization"},"image":{"@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage"},"thumbnailUrl":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png","keywords":["grafana","istio","observability","prometheus"],"articleSection":["Observability"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/","url":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/","name":"How to integrate Istio with Prometheus & Grafana for observability","isPartOf":{"@id":"https:\/\/imesh.ai\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage"},"image":{"@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage"},"thumbnailUrl":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png","datePublished":"2023-07-18T11:49:42+00:00","dateModified":"2023-09-05T05:20:25+00:00","description":"Learn how to configure metrics in Prometheus from Istio service mesh to understand the performance of Kubernetes application. You can use Grafana to visualize graphs of metrics.","breadcrumb":{"@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#primaryimage","url":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png","contentUrl":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png","width":1280,"height":720,"caption":"How to configure Istio, Prometheus and Grafana for monitoring"},{"@type":"BreadcrumbList","@id":"https:\/\/imesh.ai\/blog\/how-to-configure-istio-prometheus-and-grafana-for-monitoring\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/imesh.ai\/blog\/"},{"@type":"ListItem","position":2,"name":"How to configure Istio, Prometheus and Grafana for monitoring"}]},{"@type":"WebSite","@id":"https:\/\/imesh.ai\/blog\/#website","url":"https:\/\/imesh.ai\/blog\/","name":"IMESH Blog","description":"","publisher":{"@id":"https:\/\/imesh.ai\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/imesh.ai\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/imesh.ai\/blog\/#organization","name":"IMESH","url":"https:\/\/imesh.ai\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/imesh.ai\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/IMESH-LOGO-scaled.jpg","contentUrl":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/IMESH-LOGO-scaled.jpg","width":2560,"height":1665,"caption":"IMESH"},"image":{"@id":"https:\/\/imesh.ai\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/imeshai"]},{"@type":"Person","@id":"https:\/\/imesh.ai\/blog\/#\/schema\/person\/fdb37d3095697308d103c83ffdf37f10","name":"Md Azmal","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/imesh.ai\/blog\/#\/schema\/person\/image\/","url":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/1563300189291-150x150.jpg","contentUrl":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/03\/1563300189291-150x150.jpg","caption":"Md Azmal"},"description":"Azmal is one of the founding engineers at IMESH, who focuses on boosting enterprise performance and security using Istio and Envoy. He's a versatile full-stack developer skilled in building scalable and performant applications in the cloud. Azmal's interest in cybersecurity and networking has led him to work on various research projects in network security.","sameAs":["https:\/\/imesh.ai","https:\/\/www.linkedin.com\/in\/md-azmal-570308160"],"url":"https:\/\/imesh.ai\/blog\/author\/azmal-mdimesh-ai\/"}]}},"jetpack_featured_media_url":"https:\/\/imesh.ai\/blog\/wp-content\/uploads\/2023\/07\/How-to-configure-Istio-Prometheus-and-Grafana-for-monitoring.png","_links":{"self":[{"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/posts\/1414","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/comments?post=1414"}],"version-history":[{"count":3,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/posts\/1414\/revisions"}],"predecessor-version":[{"id":1430,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/posts\/1414\/revisions\/1430"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/media\/1426"}],"wp:attachment":[{"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/media?parent=1414"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/categories?post=1414"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/imesh.ai\/blog\/wp-json\/wp\/v2\/tags?post=1414"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}