Code

[WIP] Offload DG method to GPUs#1485

Code

Draft

jkravs wants to merge 96 commits intotrixi-framework:maintrixi-framework/Trixi.jl:mainfrom jkravs:dg_gpu_portjkravs/Trixi.jl:dg_gpu_portCopy head branch name to clipboard

+2,795-2,027

Commits

Commits on May 24, 2023

• Initial; Added KernelAbstraction dependency

  jkravs

  committed
  096b860

Commits on May 29, 2023

• Add bad initial gpu offloading for volume integral

  jkravs

  committed
  61adfd3

• Add possiblity to test correctness using CI

  jkravs

  committed
  3aa6897

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  92b9e68

Commits on Jun 6, 2023

• Fixed data race

  jkravs

  committed
  fabd803

• RWTH cluster CI added

  jkravs

  committed
  bf5102c

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  5f14874

• Fixed invalid typo in yml key

  jkravs

  committed
  4a13bde

Commits on Jun 7, 2023

• Change Backend with trixi_include

  jkravs

  committed
  22cf6e4

• Fixed gitlab ci

  jkravs

  committed
  92c9f34

• Removed after scripts

  jkravs

  committed
  35f4926

• Install OrdinaryDiffEq in CI

  jkravs

  committed
  a05ed8a

• Fixed ODE version because of dependency breakage

  jkravs

  committed
  a848f72

• Added KernelAbstractions dependency in CI

  jkravs

  committed
  fdf3931

• Fixed crash of default cpu computation

  jkravs

  committed
  54d9fc7

Commits on Jun 12, 2023

• Removing workgroupsize autotunes kernels in CUDA.jl

  jkravs

  committed
  48c31b8

Commits on Jun 13, 2023

• Initial interface flux calculation offloaded

  jkravs

  committed
  651d26d

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  9b0bc7e

Commits on Jun 14, 2023

• Fixed CUDA offloading bugs

  jkravs

  committed
  ad2763f

• Fixed scalar indexing issue during interface init

  jkravs

  committed
  79c5286

Commits on Jun 19, 2023

• Julia 1.9 test pipeline

  jkravs

  committed
  e79d8bb

• Fixed invalid yaml file

  jkravs

  committed
  9e3db29

Commits on Jun 20, 2023

• Added Extensions to better deal with missing KA API calls

  jkravs

  committed
  eeb04d2

• Removed runtime downcasting bottleneck

  jkravs

  committed
  7e48fb7

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  1b3ac6c

Commits on Jun 21, 2023

• Boundary GPU ported

  jkravs

  committed
  b4dd4da

Commits on Jun 28, 2023

• Fixed issues with zero element arrays and CUDA.jl

  jkravs

  committed
  382712f

• Prolong2mortars on gpu

  jkravs

  committed
  ee93f61

• Dummy for mortar calc

  jkravs

  committed
  baf75e2

• Surface integral computation offloaded

  jkravs

  committed
  6b7a738

Commits on Jun 30, 2023

• apply_jacobian offloaded

  jkravs

  committed
  39cbf80

• calc_sources offloaded

  jkravs

  committed
  58d165e

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  ba1a530

Commits on Jul 5, 2023

• Added suggestions

  jkravs

  committed
  f27bb8e

• Initalize derivative_dhat on GPU

  jkravs

  committed
  b075711

• surface_flux_values initalized on gpu

  jkravs

  committed
  6df94be

• boundary_interpolation initalized on gpu

  jkravs

  committed
  8fc47fe

• initalize inverse_jacobian on gpu

  jkravs

  committed
  3eb35d0

• Fixed init of derivative matrix

  jkravs

  committed
  5350e78

• Fixed scalar indexing issue

  jkravs

  committed
  7e23af5

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  530d10a

Commits on Jul 12, 2023

• u/du initalized on gpu

  jkravs

  committed
  c39790b

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  7cd2045

Commits on Jul 17, 2023

• Better compability of StrideArrays and KA

  jkravs

  committed
  8a1de82

• Fix scalar indexing on test

  jkravs

  committed
  31915a7

• Removed unesseccary allocations in rhs_gpu

  jkravs

  committed
  9a81463

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  dce23a9

• fixed scalar indexing issues on analysis callback

  jkravs

  committed
  9a5a8c4

Commits on Jul 18, 2023

• Removed allowed scalar indexing because of performance bottleneck

  jkravs

  committed
  be39bb8

• Benchmark CI

  jkravs

  committed
  35843bf

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  19ba7c8

• Display benchmark results

  jkravs

  committed
  dd65936

• P4est advection basic testing

  jkravs

  committed
  14db899

Commits on Jul 25, 2023

• Replace Symbols with Int

  Show description for 1c17e35
  jkravs

  committed
  1c17e35

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  651ef17

• Typo

  jkravs

  committed
  ce44e4f

• Change Ints to Index Enum

  jkravs

  committed
  c243726

• Changed all Indices Symbols to Enum

  jkravs

  committed
  92736d8

Commits on Jul 26, 2023

• Separate internal loop for prolong2interfaces

  jkravs

  committed
  f877a12

• Inital CPU offloading possible

  jkravs

  committed
  184cf37

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  d428557

• Test p4est elixir in CI

  jkravs

  committed
  1edb32c

Commits on Aug 1, 2023

• Separated internal loop in calc_interface_flux

  jkravs

  committed
  93daf64

• calc_interface_flux offloaded to cpu

  jkravs

  committed
  0459fdf

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  44343de

• Separated shared loop of p4est weak form kernel

  jkravs

  committed
  a3cd9d4

• CPU offloading of p4est weak form kernel

  jkravs

  committed
  9d8c156

Commits on Aug 2, 2023

• Separated internal loop of surface integral calc

  jkravs

  committed
  c2eec36

• Add CPU Offloading of surface integral calc

  jkravs

  committed
  2084f33

Commits on Aug 9, 2023

• Longer CI Timeout

  jkravs

  committed
  8fb7a3e

• apply_jacobian offloaded for p4est meshes

  jkravs

  committed
  21dfe5a

• P4est advection basic on GPU

  jkravs

  committed
  6eb5933

• CI Test of p4est on GPU

  jkravs

  committed
  d81fe1a

• Init interfaces.u on GPU

  jkravs

  committed
  85efe0a

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  d3b5e09

• Init data from interface container

  jkravs

  committed
  38ea4bc

Commits on Aug 10, 2023

• Data from element container init on GPU

  jkravs

  committed
  2c6443e

• Removed scalar indexing with dg init on GPU

  jkravs

  committed
  bd2696d

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  ad1b7b6

Commits on Sep 6, 2023

• New elixirs

  jkravs

  committed
  8442991

• Remove all symbols

  jkravs

  committed
  2186fd4

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  1164e4c

• reset du offload

  jkravs

  committed
  a4fb500

• Flux differencing kernel offload

  jkravs

  committed
  3cfc529

• prolong2interfaces offloaded

  jkravs

  committed
  369518f

• calc_interfaces in 3d p4est offloaded

  jkravs

  committed
  50a3ba0

• dummy functions for p4est 3d boundaries/mortars

  jkravs

  committed
  0c1ea4b

• surface_integral p4est 3d offload

  jkravs

  committed
  6e89971

• apply jacobian p4est gpu offload

  jkravs

  committed
  4ea72b1

• calc source terms 3d offload

  jkravs

  committed
  a597b10

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  2ddb8d6

• elixir_advection_basic_fd offloaded to gpu

  jkravs

  committed
  3022e5c

• p4est euler taylor green vortex elixir offloaded to gpu

  jkravs

  committed
  74b61a1

Commits on Sep 13, 2023

• Reduced memory usage of calculate dt

  jkravs

  committed
  8e69091

Commits on Nov 27, 2023

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  a880c16

Commits on Nov 29, 2023

• Merge branch 'main' into dg_gpu_port

  jkravs

  committed
  c7df644