Skip to content

Commit

Permalink
Site updated: 2024-03-22 01:12:40
Browse files Browse the repository at this point in the history
  • Loading branch information
@xxzuo
xxzuo committed Mar 21, 2024
1 parent 31f4be2 commit d89afef
Show file tree
Hide file tree
Showing 11 changed files with 13 additions and 13 deletions.
4 changes: 2 additions & 2 deletions 2024/03/22/大数据/datax任务主键切分数量分析/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -190,7 +190,7 @@

<span class="post-meta mr-2">
<i class="iconfont icon-chart"></i>
15 字
74 字
</span>


Expand Down Expand Up @@ -233,7 +233,7 @@
<h1 style="display: none">datax任务主键切分数量分析</h1>

<div class="markdown-body">
<p>datax 在执行任务时，支持对主键做切分</p>
<p>在执行 某个离线同步任务时， 数据库告警，发现是datax查询 没有做分页<br>直接告警<br><figure class="highlight sql"><table><tr><td class="gutter"><pre><span class="line">1</span><br></pre></td><td class="code"><pre><code class="hljs sql"><span class="hljs-keyword">select</span> <span class="hljs-operator">*</span> <span class="hljs-keyword">from</span> <span class="hljs-keyword">table</span><br></code></pre></td></tr></table></figure><br>目前对大表 不允许 直接 <code>select</code> 不加 <code>where</code> 条件<br>因此考虑 进行切片<br>datax 在执行任务时，支持对主键做切分</p>

</div>
<hr>
Expand Down
4 changes: 2 additions & 2 deletions index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down Expand Up @@ -239,7 +239,7 @@ <h1 class="index-header">



datax 在执行任务时，支持对主键做切分
在执行 某个离线同步任务时， 数据库告警，发现是datax查询 没有做分页直接告警1select * from table目前对大表 不允许 直接 select 不加 where 条件因此考虑 进行切片datax 在执行任务时，支持对主键做切分

</a>
</p>
Expand Down
2 changes: 1 addition & 1 deletion local-search.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@
<link href="/2024/03/22/%E5%A4%A7%E6%95%B0%E6%8D%AE/datax%E4%BB%BB%E5%8A%A1%E4%B8%BB%E9%94%AE%E5%88%87%E5%88%86%E6%95%B0%E9%87%8F%E5%88%86%E6%9E%90/"/>
<url>/2024/03/22/%E5%A4%A7%E6%95%B0%E6%8D%AE/datax%E4%BB%BB%E5%8A%A1%E4%B8%BB%E9%94%AE%E5%88%87%E5%88%86%E6%95%B0%E9%87%8F%E5%88%86%E6%9E%90/</url>

<content type="html"><![CDATA[<p>datax 在执行任务时，支持对主键做切分</p>]]></content>
<content type="html"><![CDATA[<p>在执行 某个离线同步任务时， 数据库告警，发现是datax查询 没有做分页<br>直接告警<br><figure class="highlight sql"><table><tr><td class="gutter"><pre><span class="line">1</span><br></pre></td><td class="code"><pre><code class="hljs sql"><span class="hljs-keyword">select</span> <span class="hljs-operator">*</span> <span class="hljs-keyword">from</span> <span class="hljs-keyword">table</span><br></code></pre></td></tr></table></figure><br>目前对大表 不允许 直接 <code>select</code> 不加 <code>where</code> 条件<br>因此考虑 进行切片<br>datax 在执行任务时，支持对主键做切分</p>]]></content>


<categories>
Expand Down
2 changes: 1 addition & 1 deletion page/2/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/3/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/4/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/5/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/6/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/7/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/8/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down
2 changes: 1 addition & 1 deletion page/9/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
</nav>

<div class="banner" id="banner" parallax=true
style="background: url('/img/p1.png') no-repeat center center;
style="background: url('/img/default.png') no-repeat center center;
background-size: cover;">
<div class="full-bg-img">
<div class="mask flex-center" style="background-color: rgba(0, 0, 0, 0.3)">
Expand Down

0 comments on commit d89afef

Please sign in to comment.