Skip to content

Commit

Permalink
thecharlieblake published a site update
Browse files Browse the repository at this point in the history
  • Loading branch information
thecharlieblake committed Nov 4, 2024
1 parent 34ba48a commit 038fd76
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 7 deletions.
5 changes: 3 additions & 2 deletions _sources/index.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,9 @@ Unit Scaling
Welcome to the :code:`unit-scaling` library. This library is designed to facilitate
the use of the *unit scaling* and *u-µP* methods, as outlined in the papers
`Unit Scaling: Out-of-the-Box Low-Precision Training (ICML, 2023)
<https://arxiv.org/abs/2303.11257>`_ and `u-μP: The Unit-Scaled Maximal Update Parametrization
<https://arxiv.org/abs/2407.17465>`_.
<https://arxiv.org/abs/2303.11257>`_ and
`u-μP: The Unit-Scaled Maximal Update Parametrization
<https://arxiv.org/abs/2407.17465>`_

For a demonstration of the library, see `u-μP using the unit_scaling library
<https://github.com/graphcore-research/unit-scaling/blob/main/examples/demo.ipynb>`_ — a notebook showing the definition and training of a u-µP language model, comparing against Standard Parametrization (SP).
Expand Down
6 changes: 2 additions & 4 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -79,10 +79,8 @@
<h1>Unit Scaling<a class="headerlink" href="#unit-scaling" title="Permalink to this heading"></a></h1>
<p>Welcome to the <code class="code docutils literal notranslate"><span class="pre">unit-scaling</span></code> library. This library is designed to facilitate
the use of the <em>unit scaling</em> and <em>u-µP</em> methods, as outlined in the papers
<a class="reference external" href="https://arxiv.org/abs/2303.11257">Unit Scaling: Out-of-the-Box Low-Precision Training (ICML, 2023)</a> and <a href="#id1"><span class="problematic" id="id2">`</span></a>u-μP: The Unit-Scaled Maximal Update Parametrization</p>
<blockquote>
<div><p>&lt;<a class="reference external" href="https://arxiv.org/abs/2407.17465">https://arxiv.org/abs/2407.17465</a>&gt;`_.</p>
</div></blockquote>
<a class="reference external" href="https://arxiv.org/abs/2303.11257">Unit Scaling: Out-of-the-Box Low-Precision Training (ICML, 2023)</a> and
<a class="reference external" href="https://arxiv.org/abs/2407.17465">u-μP: The Unit-Scaled Maximal Update Parametrization</a></p>
<p>For a demonstration of the library, see <a class="reference external" href="https://github.com/graphcore-research/unit-scaling/blob/main/examples/demo.ipynb">u-μP using the unit_scaling library</a> — a notebook showing the definition and training of a u-µP language model, comparing against Standard Parametrization (SP).</p>
<section id="installation">
<h2>Installation<a class="headerlink" href="#installation" title="Permalink to this heading"></a></h2>
Expand Down
2 changes: 1 addition & 1 deletion searchindex.js

Large diffs are not rendered by default.

0 comments on commit 038fd76

Please sign in to comment.