Code

Quantization#2

Code

Draft

electriclilies wants to merge 124 commits intomainelectriclilies/tvm:mainfrom quantizationelectriclilies/tvm:quantizationCopy head branch name to clipboard

+4,657-116

Commits

Commits on Sep 18, 2020

• hacky version of quantize pass implemented

  

  Lily Orth-Smith

  authored and

  Lily Orth-Smith

  committed
  58813dc

• quantize / dequantize instead of casting

  electriclilies

  committed
  40f988d

Commits on Sep 21, 2020

• more updates

  electriclilies

  committed
  24b7fa1

• Add preprocessing.

  jwfromm

  committed
  6f1df09

Commits on Sep 22, 2020

• start of requantize pass

  electriclilies

  committed
  cd7121f

• requantize pass runs

  electriclilies

  committed
  8d116cd

Commits on Sep 24, 2020

• requantize after conv2d in most cases

  electriclilies

  committed
  24dea2e

• some notes to self

  electriclilies

  committed
  2acc2b4

• testing maxpool no option

  electriclilies

  committed
  f4615dc

Commits on Sep 29, 2020

• added skipping layers and quantization of dense operator

  electriclilies

  committed
  94ea3aa

Commits on Sep 30, 2020

• added variables for scale, zp, and skip_layers

  electriclilies

  committed
  01269b2

Commits on Oct 2, 2020

• some stuff

  electriclilies

  committed
  dfdea03

Commits on Oct 5, 2020

• first attempt at calibration_map for conv2d

  electriclilies

  committed
  16a1499

• remove node_map

  electriclilies

  committed
  bc885b8

Commits on Oct 6, 2020

• attempt at global calibration pass with Let

  electriclilies

  committed
  84dbc3e

Commits on Oct 8, 2020

• global calibration runs!

  electriclilies

  committed
  514fec5

• remove prints

  electriclilies

  committed
  c726aed

Commits on Oct 12, 2020

• test script compares global calibration to unquantized

  electriclilies

  committed
  d0e7f23

Commits on Oct 13, 2020

• calibration pass in progress, pad bug

  electriclilies

  committed
  2aba530

Commits on Oct 14, 2020

• subgraphs run!

  electriclilies

  committed
  f172f01

• separate quantization for weights and activation

  electriclilies

  committed
  2a5dcdd

Commits on Oct 20, 2020

• refactor calibration_map

  

  Lily Orth-Smith

  authored and

  Lily Orth-Smith

  committed
  1f6dac3

• merge with main

  electriclilies

  committed
  2487817

• change calibration_callback

  electriclilies

  committed
  fe23ae8

Commits on Oct 21, 2020

• cleaning up code

  electriclilies

  committed
  0841b14

• add is_weight util

  electriclilies

  committed
  cb2b412

Commits on Oct 22, 2020

• unit testing

  electriclilies

  committed
  7c067ec

• Merge remote-tracking branch 'upstream/main' into quantization

  electriclilies

  committed
  230275c

Commits on Oct 23, 2020

• add more testing for quantization

  electriclilies

  committed
  460f5b8

• debugging bind_params_by_name

  electriclilies

  committed
  afd2690

Commits on Oct 26, 2020

• fix calibration callback bug

  electriclilies

  committed
  03de111

• change calibration_callback to return a dictionary

  electriclilies

  committed
  2631792

Commits on Oct 29, 2020

• first attempt at kl_divergence

  electriclilies

  committed
  ffd1e1d

• forgot some files

  electriclilies

  committed
  1b7850b

Commits on Nov 2, 2020

• average mean calibration runs

  electriclilies

  committed
  4ac5012

• change qnn.add to add and qnn.mul to multiply

  electriclilies

  committed
  f87678a

• changes to turn subgraph_fn to subgraph_mod

  electriclilies

  committed
  49df674

• Merge remote-tracking branch 'upstream/main' into quantization

  electriclilies

  committed
  ef00747

• fix bad merge

  electriclilies

  committed
  027e47b

Commits on Nov 4, 2020

• some debug statements

  electriclilies

  committed
  9ab5619

• Merge remote-tracking branch 'upstream/main' into quantization

  electriclilies

  committed
  9d54885

• add dynamic dequantize

  electriclilies

  committed
  7a5535c

• register quantize and dequantize as opaque

  electriclilies

  committed
  ef30a98

• make tests better

  electriclilies

  committed
  3cd5b4f

• black

  electriclilies

  committed
  f96398d

• remove main fn

  electriclilies

  committed
  b0e7cec

• fix black again

  electriclilies

  committed
  95cdd5a

• Merge branch 'dequantize_expr_scale' into quantization

  electriclilies

  committed
  6faea23

• _average_mean_calibration is fastgit status!

  electriclilies

  committed
  b1898cb

Commits on Nov 5, 2020

• remove warning message

  electriclilies

  committed
  441f88c

• move tests

  electriclilies

  committed
  b7d2163

• fix import

  electriclilies

  committed
  fe1150c

• fix import again

  electriclilies

  committed
  e54bc6d

• try again

  electriclilies

  committed
  e2fc37b

• Merge branch 'dequantize_expr_scale' into quantization

  electriclilies

  committed
  76b1aa0

• import run_infer_type

  electriclilies

  committed
  33aa7c5

• fix import again

  electriclilies

  committed
  966082e

• fix import

  electriclilies

  committed
  4e70bb2

• Merge branch 'dequantize_expr_scale' into quantization

  electriclilies

  committed
  684ad95

• fix add/mul unit tests

  electriclilies

  committed
  9ce1f6f

Commits on Nov 9, 2020

• small updates

  electriclilies

  committed
  a4894fb

• trying to find bug

  electriclilies

  committed
  da12e5b

Commits on Nov 16, 2020

• merge and refactor

  electriclilies

  committed
  a83852c

• Assign type to scale, zp if channelwise

  electriclilies

  committed
  3b92e5d

Commits on Nov 19, 2020

• calibration inputs don't require names, some requantize

  electriclilies

  committed
  1847a58

• clean up prints

  electriclilies

  committed
  970fa14

• push onnx file for matt

  electriclilies

  committed
  acb1859

• Fix pattern matcher bug

  electriclilies

  committed
  ac1963a

Commits on Nov 20, 2020

• first attempt at requantizer

  electriclilies

  committed
  1b1dcd5

• add cifar model

  electriclilies

  committed
  1004fd8

Commits on Nov 24, 2020

• most of requantize working, except resnets

  electriclilies

  committed
  941fff9

Commits on Dec 2, 2020

• trying to get requantize to work with resnets

  electriclilies

  committed
  7c04964

Commits on Dec 3, 2020

• not working! :(

  electriclilies

  committed
  337c0cb

Commits on Dec 7, 2020

• allow pattern matcher to optionally rewrite overlapping patterns

  

  mbrookhart

  committed
  9db2647

• Merge pull request #1 from electriclilies/lily/quantization

  Show description for 80c6970
  

  Lily Orth-Smith

  authored
  80c6970

• update demo

  electriclilies

  committed
  57057be

• Merge branch 'quantization' of github.com:electriclilies/incubator-tvm into quantization

  electriclilies

  committed
  b98289a

Commits on Dec 11, 2020

• let qnn support int32s, quantized BERT builds!

  electriclilies

  committed
  2781f0b

• merge w/ main

  electriclilies

  committed
  050b431

Commits on Dec 14, 2020

• remove prints

  electriclilies

  committed
  bd85023

Commits on Dec 15, 2020

• added relay node and attrs to calibration map

  electriclilies

  committed
  9d43962

Commits on Dec 17, 2020

• per channel quantization works now!

  electriclilies

  committed
  c8ae881

Commits on Dec 18, 2020

• per channel quantization mostly working

  electriclilies

  committed
  1dcc00b

Commits on Jan 4, 2021

• good progress on C++ version of quantization

  electriclilies

  committed
  b1dd207

Commits on Jan 5, 2021

• more progress on c++ quantization

  electriclilies

  committed
  b992b50

• merge main in

  electriclilies

  committed
  c6e997d

Commits on Jan 7, 2021

• most of C++ implemented!

  electriclilies

  committed
  1187e65

Commits on Jan 8, 2021

• C++ done

  electriclilies

  committed
  11013ff

Commits on Jan 12, 2021

• new quantizer and calibrater

  electriclilies

  committed
  986e0b1

• add more calibrater and dont add scale/zps to partitioned func args if they're exprs

  electriclilies

  committed
  96e5509

Commits on Jan 14, 2021

• AverageMeanCalibrater and rearranging files

  electriclilies

  committed
  bbfd691

• AverageMeanQuantize demo works

  electriclilies

  committed
  15ec074

Commits on Jan 25, 2021

• skip layers and per channel avg mean quantize

  electriclilies

  committed
  94ca0ee

• requantize debugging

  electriclilies

  committed
  515ae8c

• fix reshape

  electriclilies

  committed
  c303254

• requantize working on resnet18 now

  electriclilies

  committed
  18a6da9

Commits on Jan 27, 2021

• moved new_quantize to relay.transform.quantize

  electriclilies

  committed
  cb34a79

• moving to relay.transform.quantize

  electriclilies

  committed
  262d545

• Added checks to requantizer

  electriclilies

  committed
  88a4d4c

• changed tolerance

  electriclilies

  committed
  04c919e

Commits on Jan 28, 2021

• cleaning some things up

  electriclilies

  committed
  4534266

Commits on Jan 29, 2021

• add proper pass, try to add VM

  electriclilies

  committed
  ca6381f

• remove vm

  electriclilies

  committed
  63a1ada

Commits on Feb 2, 2021

• lots of little bugs, tests

  electriclilies

  committed
  d42da94

• merged with main, allow poverlap in pattern groups

  electriclilies

  committed
  cd848bc

• fix some lint

  electriclilies

  committed
  236a2ba

• Update test_op_qnn_dequantize.py

  

  Lily Orth-Smith

  authored
  4c48417

Commits on Feb 3, 2021

• lint and docstrings

  electriclilies

  committed
  bfcab0a

• Merge branch 'quantization' of github.com:electriclilies/incubator-tvm into quantization

  electriclilies

  committed
  7f9b9e9

• adding docs and lint

  electriclilies

  committed
  e90d777

Commits on Feb 4, 2021

• run black and clang, add docs

  electriclilies

  committed
  102bf73

• lint + more doc strings

  electriclilies

  committed
  96e6879

• fix spelling of calibrator

  electriclilies

  committed
  4f73067

Commits on Feb 5, 2021

• cleaning up code

  electriclilies

  committed
  14d9618

• black

  electriclilies

  committed
  a738cf5

• finish quantize and calibrate tests, more docs

  electriclilies

  committed
  fa72484

Commits on Feb 9, 2021

• problem with average max quantize??

  electriclilies

  committed
  8411824

Commits on Feb 11, 2021

• move dataset manager and add DenseBiasAddPattern

  electriclilies

  committed
  3f05c65

• fix imports

  electriclilies

  committed
  d7e9fc2

Commits on Feb 12, 2021

• fix bias add

  electriclilies

  committed
  08e1c67

Commits on Feb 16, 2021

• tutorials

  electriclilies

  committed
  2496eb1

Commits on Feb 17, 2021

• requantizer tests

  electriclilies

  committed
  f52a81f

• more tests, fixing bugs in tests

  electriclilies

  committed
  62a43b5

Commits on Feb 18, 2021

• test relay pass:

  electriclilies

  committed
  e7a0c8d