Skip to content

Commit

Permalink
feat: foreign mssql extractor (#345)
Browse files Browse the repository at this point in the history
* feat: first pass foreign mssql extractor

* chore: package-lock

* Update package.json

* Update package-lock.json

* feat: save connConfig obj to workbook metadata

* Add index on rowid

* feat: more logging

* feat: remove table/data transformations

* wip: initial hot RDS implementation

* fix: use env vars

* feat: add some retry logic to renaming db

* feat: improve comments

* feat: set database name to workbookId on creation & reorganize code

* chore: update package.json

* feat: use API endpoints

* Check for non-ok http statuses

* remove unused/moved code

* Reorganize & change build tool

* fix: correctly add sheets to workbook

* Reflect endpoint updates

* Update api endpoint

* feat: updates to match API changes

* chore: update workspaces

* feat: first pass foreign mssql extractor

* chore: package-lock

* feat: save connConfig obj to workbook metadata

* feat: more logging

* feat: remove table/data transformations

* wip: initial hot RDS implementation

* feat: add some retry logic to renaming db

* feat: improve comments

* feat: set database name to workbookId on creation & reorganize code

* chore: update package.json

* feat: use API endpoints

* remove unused/moved code

* Reorganize & change build tool

* fix: correctly add sheets to workbook

* Reflect endpoint updates

* feat: updates to match API changes

* chore: update workspaces

* Create README.md

* Match API terms

* Update README.md

* Update README.md

* Create serious-dolls-itch.md

* Update README.md

* Update README.md

* Update README.md

* Code review updates

* Update serious-dolls-itch.md
  • Loading branch information
carlbrugger authored Mar 8, 2024
1 parent 91d6a1d commit 12e8a9c
Show file tree
Hide file tree
Showing 11 changed files with 2,142 additions and 269 deletions.
5 changes: 5 additions & 0 deletions .changeset/serious-dolls-itch.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
---
'@flatfile/plugin-foreign-db-extractor': patch
---

The `@flatfile/plugin-foreign-db-extractor` plugin listens for `.bak` files uploaded to Flatfile, then restores the `.bak` to a Flatfile hosted Microsoft SQL Server database making the data available in the "Uploaded Files" view as a readonly File Workbook with each database table viewable as a Flatfile Sheet. The data is accessible the same as any other extracted file (i.e. `.csv` or `.xlsx`), however the source is coming from the restored database. This plugin is useful for customers who have very large datasets stored in a Microsoft SQL Server database and access that data in a Flatfile Workbook.
Loading

0 comments on commit 12e8a9c

Please sign in to comment.