{"id":138,"date":"2023-06-21T16:45:56","date_gmt":"2023-06-21T07:45:56","guid":{"rendered":"http:\/\/tech.itdesk.co.kr\/?p=138"},"modified":"2023-06-23T10:28:36","modified_gmt":"2023-06-23T01:28:36","slug":"grafana-slack-%ec%95%8c%eb%a6%bc-%ec%84%a4%ec%a0%95","status":"publish","type":"post","link":"https:\/\/iwgh.duckdns.org\/?p=138","title":{"rendered":"Grafana Slack \uc54c\ub9bc \uc124\uc815"},"content":{"rendered":"\n

\ucc38\uc870 : https:\/\/afsdzvcx123.tistory.com\/entry\/Grafana-Alert-Slack-%EC%97%B0%EB%8F%99%ED%95%98%EA%B8%B0<\/a><\/p>\n\n\n\n

    \n
  1. Slack API \ud648\ud398\uc774\uc9c0<\/li>\n<\/ol>\n\n\n\n

    https:\/\/api.slack.com\/apps\/<\/a>  -> \ub85c\uadf8\uc778 \ud544\uc694.<\/p>\n\n\n\n

    – “Create New APP” -> “From scratch”<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    – “App Name” : test, “Select a workspace” -> “workspace name”<\/p>\n\n\n\n

    \uc774\ubbf8\uc9c0 \uc0dd\ub7b5<\/strong><\/s>
    <\/p>\n\n\n\n

    – \uc0dd\uc131\ub41c APP \uc120\ud0dd\ub41c \uc0c1\ud0dc\uc5d0\uc11c “Oauth & Permissions” -> “Scopes” -> “Bot Token Scopes” -> “Add on Oauth Scope”<\/p>\n\n\n\n

    chat:write \/ files:write \uad8c\ud55c \uc120\ud0dd<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    – “Oauth & Permissions” -> “OAuth Tokens for Your Workspace” -> “Install to Workspace”<\/p>\n\n\n\n

    \uc774\ubbf8\uc9c0 \uc0dd\ub7b5<\/strong><\/s>
    <\/p>\n\n\n\n

    <\/p>\n\n\n\n

    – Feature-“Incoming Webhooks” -> ON<\/p>\n\n\n\n

    – Feature-“Incoming Webhooks”\u00a0 -> “Add New Webhook to Workspace”<\/p>\n\n\n\n

    -> \ucc44\ub110\uc120\ud0dd -> \ud5c8\uc6a9<\/p>\n\n\n\n

    \uc774\ubbf8\uc9c0 \uc0dd\ub7b5<\/strong><\/s><\/p>\n\n\n\n

    <\/p>\n\n\n\n

    -> URL \uc0dd\uc131<\/p>\n\n\n\n

    Webhook URL :<\/p>\n\n\n\n

    \nhttps:\/\/hooks.slack.com\/services\/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\n<\/div><\/figure>\n\n\n\n

    -> \ud574\ub2f9 \uc571 \ucc44\ub110\uc5d0 \ucd08\ub300\ud574\uc57c\ud558\ub098\u2026 \uc790\ub3d9\uc73c\ub85c \ucd08\ub300\ub428.(update)<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n
      \n
    1. Grafana\uc758 Alert -> Contact Point \uc0dd\uc131<\/li>\n<\/ol>\n\n\n\n

      Home -> Alerting -> Contact Point -> Add contact point<\/p>\n\n\n\n

      \"\"<\/figure>\n\n\n\n

      – Recipient : \ucc44\ub110\uba85.<\/p>\n\n\n\n

      – Token \ub610\ub294 Webhook URL \uc0ac\uc6a9\uac00\ub2a5. \ud14c\uc2a4\ud2b8\uc2dc Webhook URL\ub9cc \uc815\uc0c1\uc791\ub3d9.<\/p>\n\n\n\n

      – test \uba54\uc2dc\uc9c0 \uacb0\uacfc<\/p>\n\n\n\n

      \"\"<\/figure>\n\n\n\n
        \n
      1. Grafana Alert rules \uc0dd\uc131<\/li>\n<\/ol>\n\n\n\n

        – rule\ub85c \uc9c0\uc815\ud55c \uc870\uac74 \ucda9\uc871\uc2dc \uc9c0\uc815\ud55c contact point\ub97c \ud1b5\ud574 \uba54\uc2dc\uc9c0\ub97c \uc804\ub2ec.<\/p>\n\n\n\n

          \n
        1. Grafana \uc54c\ub78c \uc124\uc815. Alert rules \uc0dd\uc131 – Contact Points \uc218\uc815(1-3\uacfc\uc815) – Notification Policies \uc0dd\uc131<\/li>\n<\/ol>\n\n\n\n
            \n
          1. Home -> Alerting -> Alert rules -> +Create alert rule
            <\/li>\n<\/ol>\n\n\n\n

            \ucc38\uc870 : https:\/\/cleaning-toolbox.tistory.com\/94<\/a><\/p>\n\n\n\n

            (1) Set an alert rule name : \uc784\uc758\uc9c0\uc815<\/p>\n\n\n\n

            (2) Set a query and alert condition ; alert \ubc1c\uc0dd\uc2dc\ud0ac \ucee8\ub514\uc158 \uc815\uc758<\/p>\n\n\n\n

            A\ub294 Query, B\/C\ub294 expression \ud558\ub2e8\uc5d0 \uac01\uac01 \ucd94\uac00 \ubc84\ud2bc \uc788\uc74c.<\/p>\n\n\n\n

            A ; \uac12\uc774 \ub098\uc624\ub294 \ucffc\ub9ac\ubb38 -> \uc8fc\ub85c Dashboard\uc5d0\uc11c \uac00\uc838\uc624\uace0 \uc2f6\uc740 \uac12 \ud328\ub110\uc5d0\uc11c explorer\ub85c Query \ubb38\uc744 \ubcf4\uace0 \ucc38\uc870. \uc9c1\uc811\uc791\uc131 \ub610\ub294 editor\uc73c\ub85c \uc791\uc131\uac00\ub2a5.<\/p>\n\n\n\n

            ex> uptime\ub97c \uc22b\uc790(\ucd08)\ub85c \ucd94\ucd9c\ud558\ub294 \ucffc\ub9ac\ubb38<\/p>\n\n\n\n

            sum(time() – node_boot_time_seconds{origin_prometheus=~””,job=~”node_exporter”})by(instance)<\/p>\n\n\n\n

            B ; A\uc5d0\uc11c \ub098\uc628 \uac12\uc744 \uc5b4\ub5bb\uac8c \uac00\uacf5\ud560 \uac83\uc778\uc9c0\uc5d0 \ub300\ud55c \uc815\uc758<\/p>\n\n\n\n

             min,max.mean(avr),sum,count \ub4f1 \uc81c\uacf5 “make this the alert condition” \ubc84\ud2bc\uc73c\ub85c \uacb0\uacfc \ud655\uc778 \uac00\ub2a5.<\/p>\n\n\n\n

            “A\uc5d0\uc11c Last \uac12\uc744 Strict\ud558\uac8c \ubd88\ub7ec\uc634.”<\/p>\n\n\n\n

            C ; B\uc5d0\uc11c \uac00\uacf5\ub41c \uac12\uc5d0 \ub300\ud55c \uc870\uac74<\/p>\n\n\n\n

            “”threshold” 600\uc774\ud558\ub85c \uc815\uc758.”<\/p>\n\n\n\n

            Preview \ubc84\ud2bc\uc744 \ud1b5\ud574 \ud14c\uc2a4\ud2b8 \uac00\ub2a5.<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n

            (3) Alert evaluation behavior<\/p>\n\n\n\n

            \uc7a5\uc560\ub97c \ud3c9\uac00\ud558\uae30 \uc704\ud55c \uc870\uac74 ;<\/p>\n\n\n\n

            Folder; \uac19\uc740 \ud3c9\uac00\uc870\uac74 rule \ubd84\ub958\ub97c \uc704\ud55c \ud3f4\ub354.<\/p>\n\n\n\n

            Evaluation Group ; \uac19\uc740 \uccb4\ud06c\uc8fc\uae30\ub97c \uc815\uc758\ud558\ub294 \uadf8\ub8f9. \ucc98\uc74c\uc5d0 \ud558\ub098\ub3c4 \uc5c6\uc73c\ub098 \uc791\uc131\ud574 \ub193\uc73c\uba74 \ub2e4\ub978 alert rule \uc791\uc131\uc2dc \uc0ac\uc6a9\uac00\ub2a5.<\/p>\n\n\n\n

            “2\ubd84\uc5d0 1\ubc88\uc529, 6\ubd84\ub3d9\uc548 \ud655\uc778, \ub370\uc774\ud130\uac00 \uc5c6\uc744\uc2dc Error\ub85c \ucc98\ub9ac.”<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n

            -> \uc989 alert rule\uc5d0 \ud574\ub2f9\ub418\ub294 \uc870\uac74\uc774 \ub420\uc2dc 6\ubd84\ub3d9\uc548 \ud655\uc778\ud558\uace0 8\ubd84\uc9f8 \uccb4\ud06c\uc2dc \uacbd\uace0 \ubc1c\uc1a1\ud558\uac8c \ub428.<\/p>\n\n\n\n

            (4) Add details for your alert rule ; rule\uc5d0 \ub300\ud55c \uc124\uba85 \ubc0f \uc5d0\ub7ec\ucf54\ub4dc \ub4f1 \uc138\ubd80\uc815\ubcf4 \uc815\uc758\uac00\ub2a5.<\/p>\n\n\n\n

            (5) Notifications<\/p>\n\n\n\n

            ; notification policies\uc5d0\uc11c alert\ubc1c\uc0dd\uc2dc \ub204\uad6c\uc5d0\uac8c, \uc5b4\ub5a4 contact point\ub85c \uc54c\ub9bc\ud560\uc9c0 \uc815\ud558\uae30 \uc704\ud55c labels\uc744 \uc815\uc758.<\/p>\n\n\n\n

            \uc5ec\uae30\uc5d0 \uc815\uc758\ub41c labels\uc744 notification policies\uc5d0 \uc815\uc758<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n
              \n
            1. Home -> Alerting -> Notification policies<\/li>\n<\/ol>\n\n\n\n

              Default policy \uc544\ub798 “+New nested policy” \ud074\ub9ad\ud558\uc5ec \uc0dd\uc131<\/p>\n\n\n\n

              \"\"<\/figure>\n\n\n\n

              Label = Value<\/p>\n\n\n\n

              Contact Point \uc815\uc758<\/p>\n\n\n\n

              \"\"<\/figure>\n\n\n\n

              **firing \uc0c1\ud0dc\ub85c \ub4e4\uc5b4\uc640\uc57c \uba54\uc2dc\uc9c0 \uc804\uc1a1.<\/p>\n\n\n\n

              \uc774 \ubd80\ubd84\uc740 Evaluation Group \uc124\uc815 2\ubd84\ub9c8\ub2e4 1\ubc88\uc529 6\ubd84\ub3d9\uc548 \ud655\uc778\ud574\uc11c \uacc4\uc18d alert rule\uc5d0 \uac78\ub9ac\uba74 firing\ub418\uc5b4 \uc54c\ub78c\uc774 \uc804\uc1a1\ub428.<\/p>\n\n\n\n

              \"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

              \ucc38\uc870 : https:\/\/afsdzvcx123.tistory.com\/entry\/Grafana-Alert-Slack-%EC%97%B0%EB%8F%99%ED%95%98%EA%B8%B0 https:\/\/api.slack.com\/apps\/  -> \ub85c\uadf8\uc778 \ud544\uc694. – “Create New APP” -> “From scratch” – “App Name” : test, “Select a workspace” -> “workspace name” […]<\/p>\n","protected":false},"author":1,"featured_media":173,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[36,38,7,11,35],"class_list":["post-138","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","tag-alarm","tag-alert-rule","tag-grafana","tag-linux","tag-slack"],"_links":{"self":[{"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/posts\/138","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=138"}],"version-history":[{"count":1,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/posts\/138\/revisions"}],"predecessor-version":[{"id":174,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/posts\/138\/revisions\/174"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=\/wp\/v2\/media\/173"}],"wp:attachment":[{"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/iwgh.duckdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}