{"id":14779,"date":"2023-12-04T16:08:29","date_gmt":"2023-12-04T08:08:29","guid":{"rendered":"https:\/\/wx.kaifamiao.info\/?p=14779"},"modified":"2023-12-13T16:25:06","modified_gmt":"2023-12-13T08:25:06","slug":"kafka-xing-neng-you-hua-zen-me-zuo-zhi-dao-ma","status":"publish","type":"post","link":"http:\/\/wx.kaifamiao.info\/index.php\/2023\/12\/04\/kafka-xing-neng-you-hua-zen-me-zuo-zhi-dao-ma\/","title":{"rendered":"Kafka\u6027\u80fd\u4f18\u5316\u600e\u4e48\u505a\u77e5\u9053\u5417\uff1f"},"content":{"rendered":"

Kafka \u6027\u80fd\u4f18\u5316\u662f\u4e00\u4e2a\u590d\u6742\u7684\u4efb\u52a1\uff0c\u9700\u8981\u7efc\u5408\u8003\u8651\u591a\u4e2a\u56e0\u7d20\u3002\u4ee5\u4e0b\u662f\u4e00\u4e9b\u901a\u7528\u7684 Kafka \u6027\u80fd\u4f18\u5316\u7b56\u7565\uff1a<\/p>\n

    \n
  1. \n\u786c\u4ef6\u4f18\u5316\uff1a<\/strong><\/p>\n
      \n
    • \u4f7f\u7528\u9ad8\u6027\u80fd\u786c\u4ef6\uff0c\u4f8b\u5982 SSD \u66ff\u4ee3 HDD\uff0c\u4ee5\u63d0\u9ad8\u78c1\u76d8\u7684\u8bfb\u5199\u6027\u80fd\u3002<\/li>\n
    • \u4f18\u5316\u7f51\u7edc\u5e26\u5bbd\u548c\u5ef6\u8fdf\uff0c\u786e\u4fdd Kafka \u96c6\u7fa4\u4e4b\u95f4\u7684\u901a\u4fe1\u80fd\u591f\u9ad8\u6548\u8fdb\u884c\u3002<\/li>\n<\/ul>\n<\/li>\n
    • \n\u8c03\u6574\u5206\u533a\u6570\u548c\u526f\u672c\u6570\uff1a<\/strong><\/p>\n
        \n
      • \u5408\u7406\u8bbe\u7f6e\u5206\u533a\u6570\u548c\u526f\u672c\u6570\uff0c\u4ee5\u9002\u5e94\u96c6\u7fa4\u89c4\u6a21\u548c\u8d1f\u8f7d\u9700\u6c42\u3002\u8f83\u5c0f\u7684\u5206\u533a\u6570\u53ef\u80fd\u5bfc\u81f4\u74f6\u9888\uff0c\u8f83\u5927\u7684\u5206\u533a\u6570\u53ef\u80fd\u589e\u52a0\u5904\u7406\u8d1f\u62c5\u3002<\/li>\n<\/ul>\n<\/li>\n
      • \n\u5408\u7406\u914d\u7f6e JVM \u548c\u64cd\u4f5c\u7cfb\u7edf\uff1a<\/strong><\/p>\n
          \n
        • \u8c03\u6574 Kafka \u548c ZooKeeper \u8fdb\u7a0b\u7684 JVM \u53c2\u6570\uff0c\u5305\u62ec\u5806\u5927\u5c0f\u3001\u5783\u573e\u56de\u6536\u7b56\u7565\u7b49\u3002<\/li>\n
        • \u9488\u5bf9 Linux \u64cd\u4f5c\u7cfb\u7edf\uff0c\u4f18\u5316\u6587\u4ef6\u7cfb\u7edf\u53c2\u6570\u548c\u7f51\u7edc\u53c2\u6570\uff0c\u4f8b\u5982\u6587\u4ef6\u63cf\u8ff0\u7b26\u9650\u5236\u3001TCP \u7f13\u51b2\u533a\u7b49\u3002<\/li>\n<\/ul>\n<\/li>\n
        • \n\u6d88\u606f\u538b\u7f29\uff1a<\/strong><\/p>\n
            \n
          • \u542f\u7528\u9002\u5f53\u7684\u6d88\u606f\u538b\u7f29\u7b97\u6cd5\uff0c\u51cf\u5c0f\u7f51\u7edc\u4f20\u8f93\u548c\u78c1\u76d8\u5b58\u50a8\u5f00\u9500\u3002Kafka \u652f\u6301 Gzip\u3001Snappy\u3001LZ4 \u7b49\u591a\u79cd\u538b\u7f29\u7b97\u6cd5\u3002<\/li>\n<\/ul>\n<\/li>\n
          • \n\u6279\u91cf\u5904\u7406\u548c\u5f02\u6b65\u53d1\u9001\uff1a<\/strong><\/p>\n
              \n
            • \u8c03\u6574\u751f\u4ea7\u8005\u7684 batch.size<\/code> \u548c linger.ms<\/code> \u53c2\u6570\uff0c\u4ee5\u589e\u52a0\u6d88\u606f\u7684\u6279\u91cf\u5904\u7406\u548c\u5f02\u6b65\u53d1\u9001\uff0c\u964d\u4f4e\u7f51\u7edc\u5f00\u9500\u3002<\/li>\n
            • \u5bf9\u4e8e\u6d88\u8d39\u8005\uff0c\u8c03\u6574 fetch.min.bytes<\/code> \u548c fetch.max.wait.ms<\/code> \u4ee5\u63a7\u5236\u62c9\u53d6\u6570\u636e\u7684\u6279\u91cf\u5927\u5c0f\u548c\u9891\u7387\u3002<\/li>\n<\/ul>\n<\/li>\n
            • \n\u76d1\u63a7\u548c\u8c03\u4f18 ISR\uff1a<\/strong><\/p>\n
                \n
              • \u76d1\u63a7 ISR\uff08In-Sync Replica\uff09\u7684\u72b6\u6001\uff0c\u786e\u4fdd ISR \u4e2d\u7684\u526f\u672c\u80fd\u591f\u53ca\u65f6\u8ffd\u8d76 Leader Replica\u3002<\/li>\n
              • \u5173\u6ce8 ISR \u7684\u53d8\u5316\u60c5\u51b5\uff0c\u4e86\u89e3\u526f\u672c\u7684\u540c\u6b65\u72b6\u6001\u3002\u53ef\u4ee5\u6839\u636e\u9700\u8981\u8c03\u6574 replica.lag.time.max.ms<\/code> \u7b49\u53c2\u6570\u3002<\/li>\n<\/ul>\n<\/li>\n
              • \n\u5408\u7406\u914d\u7f6e\u65e5\u5fd7\u6e05\u7406\u7b56\u7565\uff1a<\/strong><\/p>\n
                  \n
                • \u9009\u62e9\u5408\u9002\u7684\u65e5\u5fd7\u6e05\u7406\u7b56\u7565\uff0c\u4f8b\u5982\u5220\u9664\u7b56\u7565\u6216\u8005\u538b\u7f29\u7b56\u7565\uff0c\u4ee5\u63a7\u5236\u78c1\u76d8\u7a7a\u95f4\u7684\u4f7f\u7528\u3002<\/li>\n
                • \u8bbe\u7f6e\u5408\u9002\u7684 log.retention.bytes<\/code> \u548c log.retention.ms<\/code> \u53c2\u6570\uff0c\u6839\u636e\u4e1a\u52a1\u9700\u6c42\u8c03\u6574\u6570\u636e\u4fdd\u7559\u7b56\u7565\u3002<\/li>\n<\/ul>\n<\/li>\n
                • \n\u751f\u4ea7\u8005\u548c\u6d88\u8d39\u8005\u6027\u80fd\u8c03\u4f18\uff1a<\/strong><\/p>\n
                    \n
                  • \u5bf9\u4e8e\u751f\u4ea7\u8005\uff0c\u4f18\u5316\u53d1\u9001\u6d88\u606f\u7684\u5e76\u53d1\u5ea6\u548c\u6279\u91cf\u5904\u7406\u3002<\/li>\n
                  • \u5bf9\u4e8e\u6d88\u8d39\u8005\uff0c\u9002\u5f53\u589e\u5927 max.poll.records<\/code>\uff0c\u63a7\u5236 max.poll.interval.ms<\/code>\uff0c\u4ee5\u63d0\u9ad8\u5904\u7406\u6548\u7387\u3002<\/li>\n<\/ul>\n<\/li>\n
                  • \n\u5347\u7ea7 Kafka \u7248\u672c\uff1a<\/strong><\/p>\n
                      \n
                    • \u5b9a\u671f\u5347\u7ea7 Kafka \u7248\u672c\uff0c\u4ee5\u83b7\u53d6\u6700\u65b0\u7684\u6027\u80fd\u6539\u8fdb\u3001\u4f18\u5316\u548c bug \u4fee\u590d\u3002<\/li>\n<\/ul>\n<\/li>\n
                    • \n\u5206\u5e03\u5f0f\u96c6\u7fa4\u7ba1\u7406\uff1a<\/strong>\n<\/li>\n<\/ol>\n
                        \n
                      • \u5408\u7406\u89c4\u5212\u548c\u7ba1\u7406 Kafka \u96c6\u7fa4\u7684\u62d3\u6251\u7ed3\u6784\uff0c\u5206\u914d Broker \u548c\u5206\u533a\u4ee5\u4fdd\u6301\u8d1f\u8f7d\u5747\u8861\u3002<\/li>\n
                      • \u5408\u7406\u5206\u914d ZooKeeper \u7684\u8282\u70b9\u548c\u8fde\u63a5\u6570\uff0c\u786e\u4fdd ZooKeeper \u7684\u7a33\u5b9a\u6027\u548c\u53ef\u7528\u6027\u3002<\/li>\n<\/ul>\n

                        \u6027\u80fd\u4f18\u5316\u662f\u4e00\u4e2a\u6301\u7eed\u7684\u8fc7\u7a0b\uff0c\u9700\u8981\u4e0d\u65ad\u5730\u76d1\u63a7\u548c\u8c03\u6574\u53c2\u6570\u4ee5\u9002\u5e94\u53d8\u5316\u7684\u8d1f\u8f7d\u548c\u9700\u6c42\u3002\u5728\u8fdb\u884c\u8c03\u6574\u4e4b\u524d\uff0c\u5efa\u8bae\u4ed4\u7ec6\u5206\u6790\u7cfb\u7edf\u7684\u74f6\u9888\u548c\u6027\u80fd\u74f6\u9888\uff0c\u5236\u5b9a\u6709\u9488\u5bf9\u6027\u7684\u4f18\u5316\u7b56\u7565\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

                        Kafka \u6027\u80fd\u4f18\u5316\u662f\u4e00\u4e2a\u590d\u6742\u7684\u4efb\u52a1\uff0c\u9700\u8981\u7efc\u5408\u8003\u8651\u591a\u4e2a\u56e0\u7d20\u3002\u4ee5\u4e0b\u662f\u4e00\u4e9b\u901a\u7528\u7684 Kafka \u6027\u80fd\u4f18\u5316\u7b56\u7565\uff1a \u786c\u4ef6 […]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[122],"tags":[],"class_list":["post-14779","post","type-post","status-publish","format-standard","hentry","category-kafka"],"_links":{"self":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts\/14779","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/comments?post=14779"}],"version-history":[{"count":2,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts\/14779\/revisions"}],"predecessor-version":[{"id":48081,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts\/14779\/revisions\/48081"}],"wp:attachment":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/media?parent=14779"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/categories?post=14779"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/tags?post=14779"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}