Skip to content

Commit

Permalink
rebuilding site Mon Nov 13 23:03:23 CST 2023
Browse files Browse the repository at this point in the history
  • Loading branch information
xbugliu committed Nov 13, 2023
1 parent efb259c commit df7a563
Show file tree
Hide file tree
Showing 13 changed files with 17 additions and 17 deletions.
2 changes: 1 addition & 1 deletion blog/2023/06/19/gptq2/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1098,7 +1098,7 @@ <h2 id="四未完的事">四、未完的事</h2>
<nav class="post-nav">
<a class="prev" href="/blog/2023/09/02/continuous-batch/">
<i class="iconfont icon-left"></i>
<span class="prev-text nav-default">大模型推理 - Continuous batch和FasterTransformer结合</span>
<span class="prev-text nav-default">大模型推理 - Continuous batching和FasterTransformer结合</span>
<span class="prev-text nav-mobile">Prev</span>
</a>
<a class="next" href="/blog/2023/04/26/gptq/">
Expand Down
10 changes: 5 additions & 5 deletions blog/2023/09/02/continuous-batch/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<title>大模型推理 - Continuous batch和FasterTransformer结合 - 书写|记下人生痕迹</title>
<title>大模型推理 - Continuous batching和FasterTransformer结合 - 书写|记下人生痕迹</title>
<meta name="renderer" content="webkit" />
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1"/>

Expand Down Expand Up @@ -39,18 +39,18 @@
<link rel="stylesheet" href="https://cdn.bootcdn.net/ajax/libs/fancybox/3.1.20/jquery.fancybox.min.css" integrity="sha256-7TyXnr2YU040zfSP+rEcz29ggW4j56/ujTPwjMzyqFY=" crossorigin="anonymous">


<meta property="og:title" content="大模型推理 - Continuous batch和FasterTransformer结合" />
<meta property="og:title" content="大模型推理 - Continuous batching和FasterTransformer结合" />
<meta property="og:description" content="什么是continuous batch 介绍continuous batch之前,先说下Batch。Batch将多个请求合并一次处理,是提升GPU推理吞吐" />
<meta property="og:type" content="article" />
<meta property="og:url" content="http://towriting.com/blog/2023/09/02/continuous-batch/" /><meta property="article:section" content="post" />
<meta property="article:published_time" content="2023-09-02T12:24:53+08:00" />
<meta property="article:modified_time" content="2023-09-02T12:24:53+08:00" />
<meta itemprop="name" content="大模型推理 - Continuous batch和FasterTransformer结合">
<meta itemprop="name" content="大模型推理 - Continuous batching和FasterTransformer结合">
<meta itemprop="description" content="什么是continuous batch 介绍continuous batch之前,先说下Batch。Batch将多个请求合并一次处理,是提升GPU推理吞吐"><meta itemprop="datePublished" content="2023-09-02T12:24:53+08:00" />
<meta itemprop="dateModified" content="2023-09-02T12:24:53+08:00" />
<meta itemprop="wordCount" content="4568">
<meta itemprop="keywords" content="大模型推理,FasterTransfromer," /><meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="大模型推理 - Continuous batch和FasterTransformer结合"/>
<meta name="twitter:title" content="大模型推理 - Continuous batching和FasterTransformer结合"/>
<meta name="twitter:description" content="什么是continuous batch 介绍continuous batch之前,先说下Batch。Batch将多个请求合并一次处理,是提升GPU推理吞吐"/>

<!--[if lte IE 9]>
Expand Down Expand Up @@ -140,7 +140,7 @@
<article class="post">

<header class="post-header">
<h1 class="post-title">大模型推理 - Continuous batch和FasterTransformer结合</h1>
<h1 class="post-title">大模型推理 - Continuous batching和FasterTransformer结合</h1>

<div class="post-meta">
<span class="post-time"> 2023-09-02 </span>
Expand Down
2 changes: 1 addition & 1 deletion blog/2023/09/17/leader-weicao/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -189,7 +189,7 @@ <h2 class="post-toc-title">Contents</h2>
<span class="prev-text nav-mobile">Prev</span>
</a>
<a class="next" href="/blog/2023/09/02/continuous-batch/">
<span class="next-text nav-default">大模型推理 - Continuous batch和FasterTransformer结合</span>
<span class="next-text nav-default">大模型推理 - Continuous batching和FasterTransformer结合</span>
<span class="next-text nav-mobile">Next</span>
<i class="iconfont icon-right"></i>
</a>
Expand Down
2 changes: 1 addition & 1 deletion categories/开发/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@ <h2 class="archive-name">开发</h2>
</span>
<span class="archive-post-title">
<a href="/blog/2023/09/02/continuous-batch/" class="archive-post-link">
大模型推理 - Continuous batch和FasterTransformer结合
大模型推理 - Continuous batching和FasterTransformer结合
</a>
</span>
</div><div class="archive-post">
Expand Down
2 changes: 1 addition & 1 deletion categories/开发/index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
</item>

<item>
<title>大模型推理 - Continuous batch和FasterTransformer结合</title>
<title>大模型推理 - Continuous batching和FasterTransformer结合</title>
<link>http://towriting.com/blog/2023/09/02/continuous-batch/</link>
<pubDate>Sat, 02 Sep 2023 12:24:53 +0800</pubDate>

Expand Down
2 changes: 1 addition & 1 deletion index.html
Original file line number Diff line number Diff line change
Expand Up @@ -183,7 +183,7 @@ <h1 class="post-title"><a class="post-link" href="/blog/2023/09/17/leader-weicao

<article class="post">
<header class="post-header">
<h1 class="post-title"><a class="post-link" href="/blog/2023/09/02/continuous-batch/">大模型推理 - Continuous batch和FasterTransformer结合</a></h1>
<h1 class="post-title"><a class="post-link" href="/blog/2023/09/02/continuous-batch/">大模型推理 - Continuous batching和FasterTransformer结合</a></h1>
<div class="post-meta">
<span class="post-time"> 2023-09-02 </span>
<div class="post-category">
Expand Down
2 changes: 1 addition & 1 deletion index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
</item>

<item>
<title>大模型推理 - Continuous batch和FasterTransformer结合</title>
<title>大模型推理 - Continuous batching和FasterTransformer结合</title>
<link>http://towriting.com/blog/2023/09/02/continuous-batch/</link>
<pubDate>Sat, 02 Sep 2023 12:24:53 +0800</pubDate>

Expand Down
2 changes: 1 addition & 1 deletion post/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@ <h2 class="archive-year">2023</h2>
</span>
<span class="archive-post-title">
<a href="/blog/2023/09/02/continuous-batch/" class="archive-post-link">
大模型推理 - Continuous batch和FasterTransformer结合
大模型推理 - Continuous batching和FasterTransformer结合
</a>
</span>
</div>
Expand Down
2 changes: 1 addition & 1 deletion post/index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
</item>

<item>
<title>大模型推理 - Continuous batch和FasterTransformer结合</title>
<title>大模型推理 - Continuous batching和FasterTransformer结合</title>
<link>http://towriting.com/blog/2023/09/02/continuous-batch/</link>
<pubDate>Sat, 02 Sep 2023 12:24:53 +0800</pubDate>

Expand Down
2 changes: 1 addition & 1 deletion tags/fastertransfromer/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@ <h2 class="archive-name">FasterTransfromer</h2>
</span>
<span class="archive-post-title">
<a href="/blog/2023/09/02/continuous-batch/" class="archive-post-link">
大模型推理 - Continuous batch和FasterTransformer结合
大模型推理 - Continuous batching和FasterTransformer结合
</a>
</span>
</div>
Expand Down
2 changes: 1 addition & 1 deletion tags/fastertransfromer/index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
</item>

<item>
<title>大模型推理 - Continuous batch和FasterTransformer结合</title>
<title>大模型推理 - Continuous batching和FasterTransformer结合</title>
<link>http://towriting.com/blog/2023/09/02/continuous-batch/</link>
<pubDate>Sat, 02 Sep 2023 12:24:53 +0800</pubDate>

Expand Down
2 changes: 1 addition & 1 deletion tags/大模型推理/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@ <h2 class="archive-name">大模型推理</h2>
</span>
<span class="archive-post-title">
<a href="/blog/2023/09/02/continuous-batch/" class="archive-post-link">
大模型推理 - Continuous batch和FasterTransformer结合
大模型推理 - Continuous batching和FasterTransformer结合
</a>
</span>
</div>
Expand Down
2 changes: 1 addition & 1 deletion tags/大模型推理/index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
</item>

<item>
<title>大模型推理 - Continuous batch和FasterTransformer结合</title>
<title>大模型推理 - Continuous batching和FasterTransformer结合</title>
<link>http://towriting.com/blog/2023/09/02/continuous-batch/</link>
<pubDate>Sat, 02 Sep 2023 12:24:53 +0800</pubDate>

Expand Down

0 comments on commit df7a563

Please sign in to comment.