Skip to content

Commit

Permalink
w
Browse files Browse the repository at this point in the history
  • Loading branch information
gbenson committed Jun 1, 2024
1 parent 8d1c0fc commit d7e8afb
Showing 1 changed file with 14 additions and 14 deletions.
28 changes: 14 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,20 +35,20 @@ this shiz aims to do the same but for HTML, such that:
> <code> X
becomes:

> <code style="background-color: #ccbfee;">&lt;</code><code style="background-color: #beedc6;">html</code><code style="background-color: #f6d9ab;">&gt;</code><code style="background-color: #f4aeb1;">&lt;</code><code style="background-color: #a4dcf3;">head</code><code style="background-color: #ccbfee;">&gt;</code><code style="background-color: #beedc6;">&lt;</code><code style="background-color: #f6d9ab;">meta</code><code style="background-color: #f4aeb1;">_</code><code style="background-color: #a4dcf3;">http</code><code style="background-color: #ccbfee;">equiv</code><code style="background-color: #beedc6;">=</code><code style="background-color: #f6d9ab;">utf</code><code style="background-color: #f4aeb1;">8</code><code style="background-color: #a4dcf3;">&gt;</code><code style="background-color: #ccbfee;">&lt;/</code><code style="background-color: #beedc6;">meta</code><code style="background-color: #f6d9ab;">&gt;</code>
- <code style="background-color: #f4aeb1;">a</code>
- <code style="background-color: #a4dcf3;">b</code>
- <code style="background-color: #ccbfee;">c</code>
- <code style="background-color: #beedc6;">d</code>
- <code style="background-color: #f6d9ab;">e</code>
- <code style="background-color: #f4aeb1;">f</code>
- <code style="background-color: #a4dcf3;">g</code>
- <code style="background-color: #ccbfee;">h</code>
- <code style="background-color: #beedc6;">i</code>
- <code style="background-color: #f6d9ab;">j</code>
- <code style="background-color: #f4aeb1;">k</code>
- <code style="background-color: #a4dcf3;">l</code>
> <span style="background-color: #ccbfee;">&lt;</span><span style="background-color: #beedc6;">html</span><span style="background-color: #f6d9ab;">&gt;</span><span style="background-color: #f4aeb1;">&lt;</span><span style="background-color: #a4dcf3;">head</span><span style="background-color: #ccbfee;">&gt;</span><span style="background-color: #beedc6;">&lt;</span><span style="background-color: #f6d9ab;">meta</span><span style="background-color: #f4aeb1;">_</span><span style="background-color: #a4dcf3;">http</span><span style="background-color: #ccbfee;">equiv</span><span style="background-color: #beedc6;">=</span><span style="background-color: #f6d9ab;">utf</span><span style="background-color: #f4aeb1;">8</span><span style="background-color: #a4dcf3;">&gt;</span><span style="background-color: #ccbfee;">&lt;/</span><span style="background-color: #beedc6;">meta</span><span style="background-color: #f6d9ab;">&gt;</span>
- <span style="background-color: #f4aeb1;">a</span>
- <span style="background-color: #a4dcf3;">b</span>
- <span style="background-color: #ccbfee;">c</span>
- <span style="background-color: #beedc6;">d</span>
- <span style="background-color: #f6d9ab;">e</span>
- <span style="background-color: #f4aeb1;">f</span>
- <span style="background-color: #a4dcf3;">g</span>
- <span style="background-color: #ccbfee;">h</span>
- <span style="background-color: #beedc6;">i</span>
- <span style="background-color: #f6d9ab;">j</span>
- <span style="background-color: #f4aeb1;">k</span>
- <span style="background-color: #a4dcf3;">l</span>


tokenizers for generation need to be able to decode reversibly,
Expand Down

0 comments on commit d7e8afb

Please sign in to comment.