-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Add store_full_path
to converters (1/3)
#8566
Conversation
Pull Request Test Coverage Report for Build 11972752772Details
💛 - Coveralls |
store_full_path
parameter to converters to toggle between store file path or file namestore_full_path
to converters
store_full_path
to converters store_full_path
to converters (1/3)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes look quite good to me. I suggest that we move the store_full_path
parameter from the run method to the init method instead. I don't see a need to change the store_full_path
for different runs of the same component. If it turns out that's needed, we can add it later. For now, I would only add the parameter to the init method. Happy to discuss.
Once this is done and we merged the PR, could you please add a 2.9 milestone and add an issue about changing the default and removing the deprecation warning to the milestone please?
I agree with having |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! 👍 We can add the parameter to the run methods to if we see requests for that. Right now, I don't see why a user would want to have the full path in meta for some files and only the file name for some other files in the same pipeline. Let's see.
Related Issues
Proposed Changes:
Add a new parameter to the
__init__
method to allow users to toggle whether thefile_path
in metadata stores the complete file path or only the base file name. ADeprecationWarning
is generated about the upcoming change infile_path
storage behavior in the next release.How did you test it?
Added new test for checking the parameter function
Notes for the reviewer
This is 1/3 PRs that will add the same change to other converters.
Checklist
fix:
,feat:
,build:
,chore:
,ci:
,docs:
,style:
,refactor:
,perf:
,test:
.