{"id":48532,"date":"2024-04-29T14:56:42","date_gmt":"2024-04-29T06:56:42","guid":{"rendered":"https:\/\/wx.kaifamiao.info\/?p=48532"},"modified":"2024-05-10T17:15:53","modified_gmt":"2024-05-10T09:15:53","slug":"huggingface-ru-menmo-xing-shi-yong","status":"publish","type":"post","link":"http:\/\/wx.kaifamiao.info\/index.php\/2024\/04\/29\/huggingface-ru-menmo-xing-shi-yong\/","title":{"rendered":"Huggingface\u5165\u95e8\u2014\u2014\u6a21\u578b\u4f7f\u7528"},"content":{"rendered":"<h1><a id=\"huggingface%E5%85%A5%E9%97%A8%E2%80%94%E2%80%94%E6%A8%A1%E5%9E%8B%E4%BD%BF%E7%94%A8\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>Huggingface\u5165\u95e8\u2014\u2014\u6a21\u578b\u4f7f\u7528<\/h1>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/tInsYTdP6hRNj5w.png\" alt=\"image-20240429103004318\" \/><\/p>\n<h2><a id=\"%E4%BB%80%E4%B9%88%E6%98%AFhuggingface\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>\u4ec0\u4e48\u662fHuggingface<\/h2>\n<p>\u5b83\u5176\u5b9e\u5c31\u662fAI\u5f00\u53d1\u8005\u7684\u201cGitHub\u201d\uff0c\u4e3a\u6211\u4eec\u63d0\u4f9b\u4e86\u6d77\u91cf\u7684\u6a21\u578b\u3001\u6570\u636e\u96c6\uff08\u6587\u672c|\u56fe\u50cf|\u97f3\u9891|\u89c6\u9891\uff09\u3001\u7c7b\u5e93\uff08\u6bd4\u5982transformers|peft|accelerate\uff09\u3001\u6559\u7a0b\u7b49\u3002<\/p>\n<p>\u5305\u62ec\u5728NLP\uff08\u81ea\u7136\u8bed\u8a00\u5904\u7406\uff09\u9886\u57df\uff0c\u5b83\u4e5f\u662f\u6700\u5927\u7684NLP\u5f00\u6e90\u793e\u533a\u3002\u88ab\u79f0\u4e3a\u5927\u8bed\u8a00\u6a21\u578b\u5e95\u5ea7\u3002<\/p>\n<p>\u5982\u679c\u4f60\u662fAI\u5f00\u53d1\u8005\u6216\u8005\u7231\u597d\u8005\uff0c\u90a3\u4e48\u4f60\u4e00\u5b9a\u4e0d\u80fd\u9519\u8fc7\u3002<\/p>\n<p>\u5b98\u7f51\u5730\u5740\uff1a<a href=\"https:\/\/huggingface.co\/\">https:\/\/huggingface.co\/<\/a><\/p>\n<h2><a id=\"huggingface%E6%9C%89%E4%BB%80%E4%B9%88\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>Huggingface\u6709\u4ec0\u4e48<\/h2>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/ipOBrWfZ1sK9Tym.png\" alt=\"image-20240429103701840\" \/><\/p>\n<p>\u5728\u5b98\u7f51\u4e2d\u5927\u5bb6\u53ef\u4ee5\u770b\u5230\u6709\u8fd9\u4e48\u51e0\u4e2a\u680f\u76ee<\/p>\n<ul>\n<li>Models\uff1a\u8fd9\u91cc\u9762\u6709huggingface\u7684\u6240\u6709\u6a21\u578b\uff0c\u800c\u4e14\u8fd9\u4e9b\u6a21\u578b\u90fd\u662f\u514d\u8d39\u7684<\/li>\n<li>Datasets\uff1a\u8fd9\u662f\u4e00\u4e9b\u6570\u636e\u96c6<\/li>\n<li>Spaces\uff1a\u8fd9\u662f\u7528\u6237\u4eec\u6765\u5206\u4eab\u81ea\u5df1\u7684\u7a7a\u95f4\uff0c\u53ef\u4ee5\u628a\u5b83\u5f53\u6210huggingface\u7684\u670b\u53cb\u5708<\/li>\n<li>Pricing\uff1a\u8fd9\u662f\u4e00\u4e9b\u5f00\u901a\u4ed8\u8d39\u7684\u4ef7\u683c<\/li>\n<\/ul>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/yOgEx1NTiZt2wpV.png\" alt=\"image-20240429114007420\" \/><\/p>\n<h2><a id=\"%E6%A8%A1%E5%9E%8B%E4%BD%BF%E7%94%A8\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>\u6a21\u578b\u4f7f\u7528<\/h2>\n<p>\u5728Models\u4e2d\uff0c\u53ef\u4ee5\u770b\u5230<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/b352hUKYdt9yZTE.png\" alt=\"image-20240429143637526\" \/><\/p>\n<p>\u53ef\u4ee5\u770b\u5230\u6a21\u578b\u63cf\u8ff0\uff1a<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/IyehDuJfwGrkHNz.png\" alt=\"image-20240429143709598\" \/><\/p>\n<h3><a id=\"%E6%96%B9%E6%B3%951\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>\u65b9\u6cd51<\/h3>\n<p>\u6211\u4eec\u53ef\u4ee5\u901a\u8fc7 <code>transformers<\/code> \u4e2d\u7684 <code>pipeline<\/code> \u6765\u76f4\u63a5\u8c03\u7528<\/p>\n<p>\u9996\u5148\u8981\u5b89\u88c5\u5fc5\u8981\u7684\u5305\uff1a<\/p>\n<pre><code class=\"language-sh\">pip install transformers\n<\/code><\/pre>\n<p>\u73b0\u5728\u5c31\u53ef\u4ee5\u4f7f\u7528pipeline\u6765\u76f4\u63a5\u4f7f\u7528\u6a21\u578b<\/p>\n<pre><code class=\"language-python\">from transformers import pipeline\n# \u7b2c\u4e00\u4e2a\u53c2\u6570\u662f\u4efb\u52a1\u7c7b\u578b\uff0c\u7b2c\u4e8c\u4e2a\u53c2\u6570\u662f\u6a21\u578b\u540d\u79f0\nunmasker = pipeline('fill-mask', model='bert-base-uncased')\nunmasker(\"Hello I'm a [MASK] model.\")\n<\/code><\/pre>\n<p>\u8fd9\u91cc\u5728\u7b2c\u4e00\u6b21\u6267\u884cpipeline\u7684\u65f6\u5019\u4f1a\u81ea\u52a8\u53bb\u4e0b\u8f7d\u6a21\u578b\u5230\u672c\u5730\u3002windows\u4e0a\u7684\u6a21\u578b\u5b58\u50a8\u5730\u5740\u4e3a\uff1a<code>C:\\Users\\\u3010\u81ea\u5df1\u7684\u7528\u6237\u540d\u3011\\.cache\\huggingface\\hub<\/code>\u3002<\/p>\n<p>\u8fd9\u662f\u4e00\u79cd\u6700\u57fa\u672c\u7684\u8c03\u7528\uff0c\u5728\u5bf9\u8fd9\u4e9b\u5927\u6a21\u578b\u4f7f\u7528\u7684\u65f6\u5019\u901a\u8fc7\u5b98\u7f51\u7684\u63cf\u8ff0\u548c\u6587\u6863\u662f\u6700\u597d\u7684\u65b9\u5f0f\u3002<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/7eXtNWYx46Zq8rk.png\" alt=\"image-20240429144403831\" \/><\/p>\n<p>\u8fd9\u91cc\u7ed9\u5927\u5bb6\u6f14\u793a\u51e0\u4e2a<code>transformers<\/code> \u4e2d\u7684\u81ea\u5b9a\u4e49\u65b9\u6cd5<\/p>\n<h4><a id=\"autotokenizer\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>AutoTokenizer<\/h4>\n<pre><code class=\"language-python\">from transformers import AutoTokenizer\n#AutoTokenizer\u53ef\u4ee5\u81ea\u52a8\u52a0\u8f7dbert-base-uncased\u4e2d\u4f7f\u7528\u7684\u5206\u8bcd\u5668\ntokenizer=AutoTokenizer.from_pretrained(\"bert-base-uncased\")\n<\/code><\/pre>\n<h4><a id=\"automodel\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>AutoModel<\/h4>\n<pre><code class=\"language-plain_text\">from transformers import AutoModel\n#AutoModel\u53ef\u4ee5\u81ea\u52a8\u52a0\u8f7dbert-base-uncased\u4e2d\u4f7f\u7528\u7684\u6a21\u578b\uff0c\u6ca1\u6709\u6700\u540e\u7684\u5168\u8fde\u63a5\u8f93\u51fa\u5c42\u548csoftmax\nmodel=AutoModel.from_pretrained(\"bert-base-uncased\")\n<\/code><\/pre>\n<p>\u5f53\u7136\u4e86AutoModel\u662f\u4e0d\u5305\u62ec\u8f93\u5165\u5206\u8bcd\u5668\u548c\u8f93\u51fa\u90e8\u5206\u7684<\/p>\n<h4><a id=\"automodelforsequenceclassification\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>AutoModelForSequenceClassification<\/h4>\n<pre><code class=\"language-python\">from transformers import AutoModelForSequenceClassification\n# AutoModelForSequenceClassification\u53ef\u4ee5\u81ea\u52a8\u52a0\u8f7dbert-base-uncased\u4e2d\u4f7f\u7528\u7684\u6a21\u578b\uff08\u5305\u62ec\u4e86\u8f93\u51fa\u90e8\u5206\uff09\uff0c\u6709\u6700\u540e\u7684\u5168\u8fde\u63a5\u8f93\u51fa\u5c42\nmodel=AutoModel.AutoModelForSequenceClassification(\"bert-base-uncased\")\n<\/code><\/pre>\n<h3><a id=\"%E6%96%B9%E6%B3%952\" class=\"anchor\" aria-hidden=\"true\"><span class=\"octicon octicon-link\"><\/span><\/a>\u65b9\u6cd52<\/h3>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/hmFOspiX2CIjvwN.png\" alt=\"image-20240429144929808\" \/><\/p>\n<p>\u4ee5\u8fd9\u4e2aChatGLM2-6B\u4e3a\u4f8b\uff0c\u5148\u5728github\u4e0agit\u4e0bChatGLM2-6B\u9664\u6a21\u578b\u5916\u7684\u76f8\u5173\u6587\u4ef6\u3002<\/p>\n<pre><code class=\"language-sh\">git clone https:\/\/github.com\/THUDM\/ChatGLM2-6B.git\ncd ChatGLM2-6B\n<\/code><\/pre>\n<p>\u5b89\u88c5\u76f8\u5173\u4f9d\u8d56<\/p>\n<pre><code class=\"language-sh\">pip install -r requirements.txt\n<\/code><\/pre>\n<p>\u76f4\u63a5\u6267\u884c\u4e0b\u9762\u4ee3\u7801\uff0c\u7a0b\u5e8f\u4f1a\u5728\u7f51\u4e0a\u81ea\u52a8\u4e0b\u8f7d\u6a21\u578b\u6587\u4ef6<\/p>\n<pre><code class=\"language-python\">>>> from transformers import AutoTokenizer, AutoModel\n>>> tokenizer = AutoTokenizer.from_pretrained(\"THUDM\/chatglm2-6b\", trust_remote_code=True)\n>>> model = AutoModel.from_pretrained(\"THUDM\/chatglm2-6b\", trust_remote_code=True, device='cuda')\n>>> model = model.eval()\n>>> response, history = model.chat(tokenizer, \"\u4f60\u597d\", history=[])\n>>> print(response)\n\u4f60\u597d\ud83d\udc4b!\u6211\u662f\u4eba\u5de5\u667a\u80fd\u52a9\u624b ChatGLM2-6B,\u5f88\u9ad8\u5174\u89c1\u5230\u4f60,\u6b22\u8fce\u95ee\u6211\u4efb\u4f55\u95ee\u9898\u3002\n>>> response, history = model.chat(tokenizer, \"\u665a\u4e0a\u7761\u4e0d\u7740\u5e94\u8be5\u600e\u4e48\u529e\", history=history)\n>>> print(response)\n\u665a\u4e0a\u7761\u4e0d\u7740\u53ef\u80fd\u4f1a\u8ba9\u4f60\u611f\u5230\u7126\u8651\u6216\u4e0d\u8212\u670d,\u4f46\u4ee5\u4e0b\u662f\u4e00\u4e9b\u53ef\u4ee5\u5e2e\u52a9\u4f60\u5165\u7761\u7684\u65b9\u6cd5:\n\n1. \u5236\u5b9a\u89c4\u5f8b\u7684\u7761\u7720\u65f6\u95f4\u8868:\u4fdd\u6301\u89c4\u5f8b\u7684\u7761\u7720\u65f6\u95f4\u8868\u53ef\u4ee5\u5e2e\u52a9\u4f60\u5efa\u7acb\u5065\u5eb7\u7684\u7761\u7720\u4e60\u60ef,\u4f7f\u4f60\u66f4\u5bb9\u6613\u5165\u7761\u3002\u5c3d\u91cf\u5728\u6bcf\u5929\u7684\u76f8\u540c\u65f6\u95f4\u4e0a\u5e8a,\u5e76\u5728\u540c\u4e00\u65f6\u95f4\u8d77\u5e8a\u3002\n2. \u521b\u9020\u4e00\u4e2a\u8212\u9002\u7684\u7761\u7720\u73af\u5883:\u786e\u4fdd\u7761\u7720\u73af\u5883\u8212\u9002,\u5b89\u9759,\u9ed1\u6697\u4e14\u6e29\u5ea6\u9002\u5b9c\u3002\u53ef\u4ee5\u4f7f\u7528\u8212\u9002\u7684\u5e8a\u4e0a\u7528\u54c1,\u5e76\u4fdd\u6301\u623f\u95f4\u901a\u98ce\u3002\n3. \u653e\u677e\u8eab\u5fc3:\u5728\u7761\u524d\u505a\u4e9b\u653e\u677e\u7684\u6d3b\u52a8,\u4f8b\u5982\u6ce1\u4e2a\u70ed\u6c34\u6fa1,\u542c\u4e9b\u8f7b\u67d4\u7684\u97f3\u4e50,\u9605\u8bfb\u4e00\u4e9b\u6709\u8da3\u7684\u4e66\u7c4d\u7b49,\u6709\u52a9\u4e8e\u7f13\u89e3\u7d27\u5f20\u548c\u7126\u8651,\u4f7f\u4f60\u66f4\u5bb9\u6613\u5165\u7761\u3002\n4. \u907f\u514d\u996e\u7528\u542b\u6709\u5496\u5561\u56e0\u7684\u996e\u6599:\u5496\u5561\u56e0\u662f\u4e00\u79cd\u523a\u6fc0\u6027\u7269\u8d28,\u4f1a\u5f71\u54cd\u4f60\u7684\u7761\u7720\u8d28\u91cf\u3002\u5c3d\u91cf\u907f\u514d\u5728\u7761\u524d\u996e\u7528\u542b\u6709\u5496\u5561\u56e0\u7684\u996e\u6599,\u4f8b\u5982\u5496\u5561,\u8336\u548c\u53ef\u4e50\u3002\n5. \u907f\u514d\u5728\u5e8a\u4e0a\u505a\u4e0e\u7761\u7720\u65e0\u5173\u7684\u4e8b\u60c5:\u5728\u5e8a\u4e0a\u505a\u4e9b\u4e0e\u7761\u7720\u65e0\u5173\u7684\u4e8b\u60c5,\u4f8b\u5982\u770b\u7535\u5f71,\u73a9\u6e38\u620f\u6216\u5de5\u4f5c\u7b49,\u53ef\u80fd\u4f1a\u5e72\u6270\u4f60\u7684\u7761\u7720\u3002\n6. \u5c1d\u8bd5\u547c\u5438\u6280\u5de7:\u6df1\u547c\u5438\u662f\u4e00\u79cd\u653e\u677e\u6280\u5de7,\u53ef\u4ee5\u5e2e\u52a9\u4f60\u7f13\u89e3\u7d27\u5f20\u548c\u7126\u8651,\u4f7f\u4f60\u66f4\u5bb9\u6613\u5165\u7761\u3002\u8bd5\u7740\u6162\u6162\u5438\u6c14,\u4fdd\u6301\u51e0\u79d2\u949f,\u7136\u540e\u7f13\u6162\u547c\u6c14\u3002\n\n\u5982\u679c\u8fd9\u4e9b\u65b9\u6cd5\u65e0\u6cd5\u5e2e\u52a9\u4f60\u5165\u7761,\u4f60\u53ef\u4ee5\u8003\u8651\u54a8\u8be2\u533b\u751f\u6216\u7761\u7720\u4e13\u5bb6,\u5bfb\u6c42\u8fdb\u4e00\u6b65\u7684\u5efa\u8bae\u3002\n<\/code><\/pre>\n<p>\u6216\u8005\u4e5f\u53ef\u4ee5\u627e\u5230huggingface\u4e0aChatGLM2-6B\u6a21\u578b\u5730\u5740\uff0c\u76f4\u63a5git<\/p>\n<pre><code class=\"language-sh\">git clone https:\/\/huggingface.co\/THUDM\/chatglm2-6b\n<\/code><\/pre>\n<p>\u5728\u7ec8\u7aef\u76f4\u63a5\u6267\u884c\u4ee3\u7801<\/p>\n<pre><code class=\"language-sh\">python web_demo.py\n<\/code><\/pre>\n<p>\u8fd9\u91cc\u4f1a\u751f\u6210\u4e00\u4e2aURL\uff0c\u5728\u5730\u5740\u680f\u4e2d\u8bbf\u95ee\u8fd9\u4e2aURl\u5373\u53ef\u4f7f\u7528ChatGLM2-6B<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s2.loli.net\/2024\/04\/29\/OyFXUPTrB5zwnMJ.png\" alt=\"image-20240429145413384\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Huggingface\u5165\u95e8\u2014\u2014\u6a21\u578b\u4f7f\u7528 \u4ec0\u4e48\u662fHuggingface \u5b83\u5176\u5b9e\u5c31\u662fAI\u5f00\u53d1\u8005\u7684\u201cGitHub\u201d\uff0c [&hellip;]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[99],"tags":[],"class_list":["post-48532","post","type-post","status-publish","format-standard","hentry","category-javabase"],"_links":{"self":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts\/48532","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/comments?post=48532"}],"version-history":[{"count":1,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts\/48532\/revisions"}],"predecessor-version":[{"id":48533,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/posts\/48532\/revisions\/48533"}],"wp:attachment":[{"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/media?parent=48532"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/categories?post=48532"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/wx.kaifamiao.info\/index.php\/wp-json\/wp\/v2\/tags?post=48532"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}