Code

feat: Generic Importers#1389

Code

Merged

calumcalder merged 34 commits intodtinit:masterdtinit/data-transfer-project:masterfrom calumcalder:feat/generic-exporterscalumcalder/data-transfer-project:feat/generic-exportersCopy head branch name to clipboardJan 6, 2025

+3,343-35

Commits

Commits on Nov 14, 2024

• Add @type annotations when serializing SocialActivity data

  Show description for fb65412
  calumcalder

  committed
  fb65412

  Copy full SHA for fb65412

• Implement basic GenericImporter for SOCIAL_POSTS

  Show description for 99cffe3
  calumcalder

  committed
  99cffe3

  Copy full SHA for 99cffe3

• Implement basic GenericFileImporter for BLOBS

  Show description for 80c55cb
  calumcalder

  committed
  80c55cb

  Copy full SHA for 80c55cb

Commits on Nov 15, 2024

• Add README with draft docs for generic importers

  calumcalder

  committed
  312862b

  Copy full SHA for 312862b

• Configure GenericFileImporter for MEDIA

  calumcalder

  committed
  40e18b1

  Copy full SHA for 40e18b1

• Configure GenericImporter for CALENDAR

  calumcalder

  committed
  161bf7e

  Copy full SHA for 161bf7e

Commits on Nov 27, 2024

• Extract generic BLOBS serializer to separate module

  Show description for cdaf814
  calumcalder

  committed
  cdaf814

  Copy full SHA for cdaf814

• Extract generic SOCIAL_POSTS exporter to separate module

  Show description for c78c125
  calumcalder

  committed
  c78c125

  Copy full SHA for c78c125

• Extract generic CALENDAR exporter to separate module

  Show description for c5bf7de
  calumcalder

  committed
  c5bf7de

  Copy full SHA for c5bf7de

• Extract generic MEDIA exporter to separate module

  Show description for f2592db
  calumcalder

  committed
  f2592db

  Copy full SHA for f2592db

• Move CachedDownloadableItem to BlobbySerializer

  Show description for 5eede87
  calumcalder

  committed
  5eede87

  Copy full SHA for 5eede87

• Serialize dates to strings in tests

  calumcalder

  committed
  21c0682

  Copy full SHA for 21c0682

• Preserve typing information of JSON payloads

  Show description for 46289c4
  calumcalder

  committed
  46289c4

  Copy full SHA for 46289c4

Commits on Nov 28, 2024

• Use custom schema for media GenericImporter serialization

  Show description for 07bf8f7
  calumcalder

  committed
  07bf8f7

  Copy full SHA for 07bf8f7

• Tidy up TypeNames of top-level schemas

  Show description for 23bec4a
  calumcalder

  committed
  23bec4a

  Copy full SHA for 23bec4a

• Configure endpoint and supported verticals for generic importers

  Show description for d6d75e2
  calumcalder

  committed
  d6d75e2

  Copy full SHA for d6d75e2

Commits on Dec 5, 2024

• Support OAuth Authorization Code-based auth for generic importers

  calumcalder

  committed
  18c3d47

  Copy full SHA for 18c3d47

• Tidy up MediaSerializer

  Show description for b276dbf
  calumcalder

  committed
  b276dbf

  Copy full SHA for b276dbf

• Tidy up BlobbySerializer

  Show description for 51c8539
  calumcalder

  committed
  51c8539

  Copy full SHA for 51c8539

Commits on Dec 6, 2024

• Add tests for GenericImporter

  calumcalder

  committed
  dec93ba

  Copy full SHA for dec93ba

• Simplify GenericFileImporter

  Show description for 8cecc29
  calumcalder

  committed
  8cecc29

  Copy full SHA for 8cecc29

• Set mimetype in GenericFileImporter

  calumcalder

  committed
  fe16106

  Copy full SHA for fe16106

• Tidy up old test code

  Show description for dd918e6
  calumcalder

  committed
  dd918e6

  Copy full SHA for dd918e6

• Flatten BlobbySerializer File data

  Show description for 47878b5
  calumcalder

  committed
  47878b5

  Copy full SHA for 47878b5

• Add schemas to README docs

  calumcalder

  committed
  76c37d7

  Copy full SHA for 76c37d7

• Correct OAuth doc

  calumcalder

  committed
  30fd368

  Copy full SHA for 30fd368

• Add configuration docs

  calumcalder

  committed
  02f0668

  Copy full SHA for 02f0668

• Remove test generic extension config file

  calumcalder

  committed
  e0cfc5f

  Copy full SHA for e0cfc5f

• Document GenericPayload wrapper

  calumcalder

  committed
  4aba1f1

  Copy full SHA for 4aba1f1

Commits on Dec 11, 2024

• Rename ContainerMapper to ContainerSerializer

  Show description for e5ae96f
  calumcalder

  committed
  e5ae96f

  Copy full SHA for e5ae96f

Commits on Dec 13, 2024

• Expand documentation

  Show description for 0d4bee3
  calumcalder

  committed
  0d4bee3

  Copy full SHA for 0d4bee3

• Fix 'favourite' typo

  calumcalder

  committed
  87184d2

  Copy full SHA for 87184d2

• Remove extra import

  calumcalder

  committed
  eb6435d

  Copy full SHA for eb6435d

• Use set for vertical config storage

  Show description for 581e23e
  calumcalder

  committed
  581e23e

  Copy full SHA for 581e23e