Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(filesystem): implement Google Drive source #932

Merged
merged 36 commits into from
Feb 12, 2024
Merged

feat(filesystem): implement Google Drive source #932

Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
f13c9b3
WIP(gdrive): implement basic version of gdrive source
IlyaFaer Jan 10, 2024
cec612b
WIP: google drive source
IlyaFaer Jan 31, 2024
442afde
fixes
IlyaFaer Feb 5, 2024
5db1041
revert wrong changes
IlyaFaer Feb 5, 2024
81fa30f
lint fix
IlyaFaer Feb 5, 2024
8d8af68
add dependency
IlyaFaer Feb 5, 2024
c52a63e
type
IlyaFaer Feb 5, 2024
4883ea2
lint fixes
IlyaFaer Feb 5, 2024
c4c6876
lint fix
IlyaFaer Feb 5, 2024
f80ef52
dependency
IlyaFaer Feb 5, 2024
950cb06
add gdrive bucket into tests
IlyaFaer Feb 7, 2024
1ac6153
Merge branch 'devel' into gdrive_new_source
IlyaFaer Feb 7, 2024
94e3c5d
fix tests
IlyaFaer Feb 7, 2024
53006c5
fixes
IlyaFaer Feb 7, 2024
a4442f9
add config
IlyaFaer Feb 7, 2024
3cf7ab2
fix dependencies
IlyaFaer Feb 7, 2024
1c5b707
lint fix
IlyaFaer Feb 7, 2024
14689e1
lint fix
IlyaFaer Feb 7, 2024
14943bc
fix
IlyaFaer Feb 7, 2024
633c8de
fix
IlyaFaer Feb 7, 2024
96fa828
fix
IlyaFaer Feb 7, 2024
9b8213c
skip destination tests
IlyaFaer Feb 7, 2024
79debb9
add temporary fixture for gdrive testing
IlyaFaer Feb 8, 2024
877762e
return env preservation
IlyaFaer Feb 9, 2024
9b39de6
put dlt credentials
IlyaFaer Feb 9, 2024
c42f7bf
lint fix
IlyaFaer Feb 9, 2024
b5279f0
fix
IlyaFaer Feb 9, 2024
9aa4247
Merge branch 'devel' into gdrive_new_source
rudolfix Feb 10, 2024
4963303
refactors google drive fsspec
rudolfix Feb 11, 2024
4536f2f
documents and cleanups code
rudolfix Feb 12, 2024
e82f3b9
Merge branch 'devel' into gdrive_new_source
rudolfix Feb 12, 2024
9014566
Merge branch 'devel' into gdrive_new_source
rudolfix Feb 12, 2024
34c6902
TO-REVERT
IlyaFaer Feb 12, 2024
1ef0141
revert a commit
IlyaFaer Feb 12, 2024
7a5297e
add test retries
IlyaFaer Feb 12, 2024
35ba3c7
implements fs.info to be consistent
rudolfix Feb 12, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions dlt/common/configuration/specs/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@
from .api_credentials import OAuth2Credentials
from .aws_credentials import AwsCredentials, AwsCredentialsWithoutDefaults
from .azure_credentials import AzureCredentials, AzureCredentialsWithoutDefaults
from .gdrive_credentials import GoogleDriveFileSystem
IlyaFaer marked this conversation as resolved.
Show resolved Hide resolved


# backward compatibility for service account credentials
Expand All @@ -44,6 +45,7 @@
"GcpServiceAccountCredentials",
"GcpOAuthCredentialsWithoutDefaults",
"GcpOAuthCredentials",
"GoogleDriveFileSystem",
"GcpCredentials",
"ConnectionStringCredentials",
"OAuth2Credentials",
Expand Down
Loading
Loading