Code

feat: 1TFLOPs Matmul + autograd ops#1

Code

Merged

zanussbaum merged 83 commits intomainzanussbaum/surfgrad:mainfrom opszanussbaum/surfgrad:opsCopy head branch name to clipboardNov 9, 2024

+3,226

Commits

Commits on Sep 26, 2024

• feat: working demo shaders !

  zanussbaum

  committed
  e44fbbc

  Copy full SHA for e44fbbc

Commits on Sep 27, 2024

• feat: working matmul forward backward

  zanussbaum

  committed
  9c127bd

  Copy full SHA for 9c127bd

Commits on Sep 28, 2024

• feat: working "single" thread matmul

  zanussbaum

  committed
  0cb3aa8

  Copy full SHA for 0cb3aa8

• refactor: trying to optimize?

  zanussbaum

  committed
  61b171b

  Copy full SHA for 61b171b

Commits on Sep 30, 2024

• feat: added unit tests

  zanussbaum

  committed
  849d359

  Copy full SHA for 849d359

Commits on Oct 1, 2024

• ci: ignore integration tests

  zanussbaum

  committed
  cdc1ca4

  Copy full SHA for cdc1ca4

• refactor: move to unit test directory

  zanussbaum

  committed
  ee64bee

  Copy full SHA for ee64bee

• tests: unit and integration tests setup

  zanussbaum

  committed
  18961f5

  Copy full SHA for 18961f5

• chore: ignore test-results

  zanussbaum

  committed
  8c2ed7f

  Copy full SHA for 8c2ed7f

• tests: ignore results

  zanussbaum

  committed
  4ff6f5f

  Copy full SHA for 4ff6f5f

• feat: throw error if wrong shapes

  zanussbaum

  committed
  7c2c668

  Copy full SHA for 7c2c668

• ci: fix unit command

  zanussbaum

  committed
  964a75e

  Copy full SHA for 964a75e

• feat: elementwise mul (only one requires grad)

  zanussbaum

  committed
  5eea14f

  Copy full SHA for 5eea14f

Commits on Oct 2, 2024

• feat: ability to run benchmarks

  zanussbaum

  committed
  4326783

  Copy full SHA for 4326783

• feat: elementwise (broadcastable) multiplication

  zanussbaum

  committed
  9c2878a

  Copy full SHA for 9c2878a

• style: prettier

  zanussbaum

  committed
  37f84ef

  Copy full SHA for 37f84ef

• fix: actually run benchmark

  zanussbaum

  committed
  8f387c2

  Copy full SHA for 8f387c2

• feat: 1.6TFLOPS matmul

  zanussbaum

  committed
  71b159c

  Copy full SHA for 71b159c

Commits on Oct 3, 2024

• refactor: don't use auto layout

  zanussbaum

  committed
  dd9cb6d

  Copy full SHA for dd9cb6d

• fix: workgroup size (doesn't do much) still at 1.5 TFLOPS

  zanussbaum

  committed
  d06fb99

  Copy full SHA for d06fb99

• refactor: don't pass explicit context

  zanussbaum

  committed
  eb8a681

  Copy full SHA for eb8a681

• feat: add op

  zanussbaum

  committed
  b7bbd91

  Copy full SHA for b7bbd91

• feat: refactor boilerplate + exp,log

  zanussbaum

  committed
  5a7e7a6

  Copy full SHA for 5a7e7a6

Commits on Oct 4, 2024

• feat: til you can label buffers!

  zanussbaum

  committed
  bd77b7a

  Copy full SHA for bd77b7a

• feat: ln op

  zanussbaum

  committed
  324104f

  Copy full SHA for 324104f

• feat: ln op

  zanussbaum

  committed
  c3b6e23

  Copy full SHA for c3b6e23

• feat: ln log exp ops

  zanussbaum

  committed
  a76bab7

  Copy full SHA for a76bab7

• feat: relu op, refactor to actually return grad_output * grad

  zanussbaum

  committed
  6aec3bd

  Copy full SHA for 6aec3bd

Commits on Oct 5, 2024

• wip: i think this is in the right direction for autograd graph creation?

  zanussbaum

  committed
  aeb6eed

  Copy full SHA for aeb6eed

Commits on Oct 10, 2024

• feat: working autograd! now need to clean up interface

  zanussbaum

  committed
  b5796d3

  Copy full SHA for b5796d3

• refactor: make ops methods, remove print, simplify parents

  zanussbaum

  committed
  32d01a4

  Copy full SHA for 32d01a4

• refactor: tests to use methods instead of ops directly

  zanussbaum

  committed
  5c22b96

  Copy full SHA for 5c22b96

• fix: actually calculate past 256 !

  zanussbaum

  committed
  08219c7

  Copy full SHA for 08219c7

• style: remove prints, prettier

  zanussbaum

  committed
  fcd04d2

  Copy full SHA for fcd04d2

• fix: iterating on matmul, can do 4096, but only 50GFLOP/s

  zanussbaum

  committed
  04ce98a

  Copy full SHA for 04ce98a

Commits on Oct 11, 2024

• chore: license

  zanussbaum

  committed
  8afb5d2

  Copy full SHA for 8afb5d2

• chore: license, keywords, readme

  zanussbaum

  committed
  9012fa4

  Copy full SHA for 9012fa4

• chore: remove unused, update readme

  zanussbaum

  committed
  32a4ef8

  Copy full SHA for 32a4ef8

• refactor: remove unused

  zanussbaum

  committed
  315b52c

  Copy full SHA for 315b52c

• docs: update readme

  zanussbaum

  committed
  75cc481

  Copy full SHA for 75cc481

• styel: border

  zanussbaum

  committed
  b8fc082

  Copy full SHA for b8fc082

• fix: license

  zanussbaum

  committed
  102cdbe

  Copy full SHA for 102cdbe

• feat: logo

  zanussbaum

  committed
  6892680

  Copy full SHA for 6892680

Commits on Oct 12, 2024

• fix: (slower) shared memory doesn't seem to help

  zanussbaum

  committed
  1aa1a4e

  Copy full SHA for 1aa1a4e

Commits on Oct 16, 2024

• feat: 4k matmul and 280 GFLOP/s

  zanussbaum

  committed
  3fb91ba

  Copy full SHA for 3fb91ba

Commits on Oct 17, 2024

• style: prettier

  zanussbaum

  committed
  e2e0395

  Copy full SHA for e2e0395

• feat: calculate 1d 8 results per thread (300 GFLOP/s) at 2048 but slower at 4k

  zanussbaum

  committed
  c12b269

  Copy full SHA for c12b269

• feat: 8 results per thread is 150 GFLOP/s

  zanussbaum

  committed
  287283a

  Copy full SHA for 287283a

• refactor: revert back to 4

  zanussbaum

  committed
  05a0a18

  Copy full SHA for 05a0a18

• feat: 2d tiling 360 GFLOP/s

  zanussbaum

  committed
  ae66be6

  Copy full SHA for ae66be6

Commits on Oct 18, 2024

• feat: 2d tiling unrolled

  zanussbaum

  committed
  fd55984

  Copy full SHA for fd55984

• feat: 8x8 2d tile 1TFLOP!

  zanussbaum

  committed
  27ef53f

  Copy full SHA for 27ef53f

Commits on Oct 24, 2024

• style: prettier, eslint pt 1, fix tests

  zanussbaum

  committed
  7ac665d

  Copy full SHA for 7ac665d

• style: eslint

  zanussbaum

  committed
  40d4e62

  Copy full SHA for 40d4e62

• build: ci github action?

  zanussbaum

  committed
  f6cd178

  Copy full SHA for f6cd178

• build: add back package-lock

  zanussbaum

  committed
  106e41b

  Copy full SHA for 106e41b

• build: try npm package lock install and claude headless?

  zanussbaum

  committed
  a06ef15

  Copy full SHA for a06ef15

• build: playwright config?

  zanussbaum

  committed
  6bc7f84

  Copy full SHA for 6bc7f84

• build: try chromium only?

  zanussbaum

  committed
  3c8333b

  Copy full SHA for 3c8333b

• build: let's try with vulkan

  zanussbaum

  committed
  1215ca7

  Copy full SHA for 1215ca7

• build: try to get working with ci, if you do revert it's this one

  zanussbaum

  committed
  b68a723

  Copy full SHA for b68a723

• build: working integration local + on ci

  zanussbaum

  committed
  52c8cbe

  Copy full SHA for 52c8cbe

• build: playwright test report

  zanussbaum

  committed
  692e57e

  Copy full SHA for 692e57e

• style: playwright

  zanussbaum

  committed
  b73e632

  Copy full SHA for b73e632

• build: release please

  zanussbaum

  committed
  f31635d

  Copy full SHA for f31635d

• style: prettier

  zanussbaum

  committed
  13f6a37

  Copy full SHA for 13f6a37

• build: test-release

  zanussbaum

  committed
  02a583e

  Copy full SHA for 02a583e

• ci: does this make release-please launch?

  zanussbaum

  committed
  b72c1f7

  Copy full SHA for b72c1f7

• ci: huh?

  zanussbaum

  committed
  b239f80

  Copy full SHA for b239f80

• refactor: try again

  zanussbaum

  committed
  1f64741

  Copy full SHA for 1f64741

• fix: get branch name (for release-pleas)

  zanussbaum

  committed
  f5f42f1

  Copy full SHA for f5f42f1

• fix: action version?

  zanussbaum

  committed
  cf0eec2

  Copy full SHA for cf0eec2

• fix: version

  zanussbaum

  committed
  b4964bb

  Copy full SHA for b4964bb

• fix: use secret

  zanussbaum

  committed
  5d15211

  Copy full SHA for 5d15211

Commits on Oct 30, 2024

• build: pacakge lock for test-release

  zanussbaum

  committed
  d52d5d2

  Copy full SHA for d52d5d2

• refactor: changelog sections

  zanussbaum

  committed
  2ad4046

  Copy full SHA for 2ad4046

• fix: does this rerun release-please

  zanussbaum

  committed
  673e513

  Copy full SHA for 673e513

• fix: don't run ci tests on release please merge

  zanussbaum

  committed
  d98ddf4

  Copy full SHA for d98ddf4

• fix: pacakge json

  zanussbaum

  committed
  6fd91e3

  Copy full SHA for 6fd91e3

• fix: imports

  zanussbaum

  committed
  efaf8b1

  Copy full SHA for efaf8b1

• refactor: make wgsl files ts files so we can package

  zanussbaum

  committed
  48edb81

  Copy full SHA for 48edb81

• docs: remove named annotations

  zanussbaum

  committed
  6cb8a2f

  Copy full SHA for 6cb8a2f

Commits on Oct 31, 2024

• fix: import autograd function

  zanussbaum

  committed
  1b68232

  Copy full SHA for 1b68232