Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rasterize Latest Poppler #32997

Merged
merged 9 commits into from
Mar 4, 2024
Merged

Rasterize Latest Poppler #32997

merged 9 commits into from
Mar 4, 2024

Conversation

tkatzir
Copy link
Contributor

@tkatzir tkatzir commented Feb 19, 2024

Status

  • In Progress
  • Ready
  • In Hold - (Reason for hold)

Related Issues

fixes: https://jira-dc.paloaltonetworks.com/browse/XSUP-32892

Copy link

github-actions bot commented Feb 19, 2024

Coverage

Coverage Report
FileStmtsMissCoverMissing
Packs/rasterize/Integrations/rasterize
   rasterize.py3779076%71–73, 80–82, 88–90, 129–131, 133, 146–148, 151–153, 156, 159–161, 165–167, 179–180, 184–185, 189–190, 218–220, 225–226, 234, 254–259, 276–280, 282, 286, 288, 297–298, 365–368, 371–374, 376, 381, 383, 385–388, 390, 489–490, 612–614, 624–625, 628–631, 667, 690–693, 704–707
TOTAL3779076% 

Tests Skipped Failures Errors Time
20 0 💤 0 ❌ 0 🔥 52.799s ⏱️

@tkatzir tkatzir requested a review from anara123 February 19, 2024 19:34
@tkatzir tkatzir marked this pull request as ready for review February 19, 2024 19:34

def test_poppler_version():
import pdf2image
poppler_version = pdf2image.pdf2image._get_poppler_version("pdftoppm")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lets have an e2e test like we have in ParseEmailFiles where we use test files and run the command and check for the output

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Poppler is a C executable, and pdf2image is a Python wrapper.
In order to reproduce the issue I'll need a DocuSign doc, which we don't have.

@tkatzir tkatzir added the ForceMerge Forcing the merge of the PR despite the build status label Feb 20, 2024
@tkatzir
Copy link
Contributor Author

tkatzir commented Feb 20, 2024

Needs to be force-merged due to unrelated build issues.

@tkatzir tkatzir requested a review from anara123 February 26, 2024 09:19
@tkatzir tkatzir merged commit 0d5c41d into master Mar 4, 2024
16 of 17 checks passed
@tkatzir tkatzir deleted the rasterize-latest-poppler branch March 4, 2024 11:40
MosheEichler pushed a commit that referenced this pull request Mar 4, 2024
MosheEichler added a commit that referenced this pull request Mar 21, 2024
…ation (#33155)

* fix default key

* rn

* docker

* docs review

* [ConvertFile] Bump Docker version (#33141)

* Update Docker version

* Bump version

* ruff

* Bump pack from version CommonScripts to 1.14.4.

* Bump Docker version

* Bump pack from version CommonScripts to 1.14.5.

* Bump pack from version CommonScripts to 1.14.6.

---------

Co-authored-by: Content Bot <[email protected]>

* Added Compatibility with new Allowed Indicator Module in CTIX 3.6 (#33062) (#33159)

I also ran all of the pre-commit hooks and resolved all of those issues.

Co-authored-by: Corey Bodendein <[email protected]>

* Fix/[XSUP-33795]/Logo does not shown in data collection form (#33154)

* change default to true

* add s flag

* add UT

* RN

* pre-commit

* mocker

* fix default key

* revert

* EWS v2: added arg to the command (#33096)

* added arg to the command

* Apply suggestions from code review

Co-authored-by: ShirleyDenkberg <[email protected]>

* fix validate

---------

Co-authored-by: ShirleyDenkberg <[email protected]>

* Rasterize Latest Poppler (#32997)

* Teams generate url command bug (#33164)

* fixed a bug in generate url command

* added rn

* added rn

* edit

* added bc rn

* edits

* fixed unit test

* updated do

* Enhancement | InfoBlox - add list host and network info, modify get IP cmds (#32619)

* added host records

* handle no comma,equal sign in extattrs

* wip: added network,to/from_ip args to get_ip_cmd

* added validation for invalid input args to get-ip

moved request params into client

* added max_results to list host cmd

* added network info cmd

* modified get-ip command to return a list

added rns

* format/validation fixes

* fixed context output for host records cmd

* fixed output table for net info cmd

* added additional return fields to list host args

parsed extattrs into dict for context

* updated integration docs

added command examples

fixed context key in net info command

added types to context outputs for list host and net cmds

* fixed netview context key in net uts

* changed context output types for get-ip

added bc mentions for get-ip context output keys

* fixed hardcoded default values in args description

add breaking changes in md

* mv test_files test_data

* mv test_files test_data

* converted integration readme from html to markdown

pr review: empty dict evaluates to false, no need to cast to bool

* strip whitespace from get-ip context path in readme

* add unique to ipv4address status

client params instantiated with _return_as_object=1

add capture stderr ignore

pr review: use any() instead of sum() == 0

* pr review: rm endpoint suffixes from client

pr review: rm max_results from list host commandres title

pr review: add default val for max results to bc

* pr review: rm ip,netmask input validation

rm max_results and added mode/val in title for get-ip-cmd

* mv request params into client methods

* rm transform_return_fields

* simplified raw to context mapping

* raise exception when extattrs input is invalid

* updated docker image

rm max results from hr for net info cmd

added todos for checking unexpected invalid extattrs

rm exception var

* fixed issue with additional return fields

* fix flake8 errs

* rm todos

fixed issue with too many args supplied to ip command

* revert changes to too many args handle in ip cmd

* fixed titles for get-ip, get host info, get network info

* added rn comment about get-ip mod outputs

* fix rn comment about get-ip mod outputs

* fix cmd outputs assertions in uts

* added args to get-ip in integration doc

* update docker image

* fix docs

* revert poetry

* fix docs

* Update README.md (#33211)

edited description of cron argument, per Dudu B.

* download and move images to content repo (#33204)

* download and move images to content repo

* commit test

* revert changes for gitlab_slack_notifier

* Update Docker Image To demisto/chromium  (#33175)

* Updated Metadata Of Pack rasterize

* Added release notes to pack rasterize

* Packs/rasterize/Integrations/rasterize/rasterize.yml Docker image update

* Updated Metadata Of Pack ExpanseV2

* Added release notes to pack ExpanseV2

* Packs/ExpanseV2/Scripts/ExpanseGenerateIssueMapWidgetScript/ExpanseGenerateIssueMapWidgetScript.yml Docker image update

* Bump pack from version ExpanseV2 to 1.10.51.

* Bump pack from version rasterize to 2.0.2.

---------

Co-authored-by: Content Bot <[email protected]>

* docker

* do not write files when running test-module

* RN

* ignore error 125

* docker

* Fix RN

* revert

* ignore investigation attachments in test module command

---------

Co-authored-by: Michael Yochpaz <[email protected]>
Co-authored-by: Content Bot <[email protected]>
Co-authored-by: content-bot <[email protected]>
Co-authored-by: Corey Bodendein <[email protected]>
Co-authored-by: Israel Lappe <[email protected]>
Co-authored-by: ShirleyDenkberg <[email protected]>
Co-authored-by: tkatzir <[email protected]>
Co-authored-by: merit-maita <[email protected]>
Co-authored-by: Kobbi Gal <[email protected]>
Co-authored-by: Tamar Schanfeld <[email protected]>
Co-authored-by: israelpoli <[email protected]>
pal-xmco pushed a commit to pal-xmco/content that referenced this pull request Jun 19, 2024
…ation (demisto#33155)

* fix default key

* rn

* docker

* docs review

* [ConvertFile] Bump Docker version (demisto#33141)

* Update Docker version

* Bump version

* ruff

* Bump pack from version CommonScripts to 1.14.4.

* Bump Docker version

* Bump pack from version CommonScripts to 1.14.5.

* Bump pack from version CommonScripts to 1.14.6.

---------

Co-authored-by: Content Bot <[email protected]>

* Added Compatibility with new Allowed Indicator Module in CTIX 3.6 (demisto#33062) (demisto#33159)

I also ran all of the pre-commit hooks and resolved all of those issues.

Co-authored-by: Corey Bodendein <[email protected]>

* Fix/[XSUP-33795]/Logo does not shown in data collection form (demisto#33154)

* change default to true

* add s flag

* add UT

* RN

* pre-commit

* mocker

* fix default key

* revert

* EWS v2: added arg to the command (demisto#33096)

* added arg to the command

* Apply suggestions from code review

Co-authored-by: ShirleyDenkberg <[email protected]>

* fix validate

---------

Co-authored-by: ShirleyDenkberg <[email protected]>

* Rasterize Latest Poppler (demisto#32997)

* Teams generate url command bug (demisto#33164)

* fixed a bug in generate url command

* added rn

* added rn

* edit

* added bc rn

* edits

* fixed unit test

* updated do

* Enhancement | InfoBlox - add list host and network info, modify get IP cmds (demisto#32619)

* added host records

* handle no comma,equal sign in extattrs

* wip: added network,to/from_ip args to get_ip_cmd

* added validation for invalid input args to get-ip

moved request params into client

* added max_results to list host cmd

* added network info cmd

* modified get-ip command to return a list

added rns

* format/validation fixes

* fixed context output for host records cmd

* fixed output table for net info cmd

* added additional return fields to list host args

parsed extattrs into dict for context

* updated integration docs

added command examples

fixed context key in net info command

added types to context outputs for list host and net cmds

* fixed netview context key in net uts

* changed context output types for get-ip

added bc mentions for get-ip context output keys

* fixed hardcoded default values in args description

add breaking changes in md

* mv test_files test_data

* mv test_files test_data

* converted integration readme from html to markdown

pr review: empty dict evaluates to false, no need to cast to bool

* strip whitespace from get-ip context path in readme

* add unique to ipv4address status

client params instantiated with _return_as_object=1

add capture stderr ignore

pr review: use any() instead of sum() == 0

* pr review: rm endpoint suffixes from client

pr review: rm max_results from list host commandres title

pr review: add default val for max results to bc

* pr review: rm ip,netmask input validation

rm max_results and added mode/val in title for get-ip-cmd

* mv request params into client methods

* rm transform_return_fields

* simplified raw to context mapping

* raise exception when extattrs input is invalid

* updated docker image

rm max results from hr for net info cmd

added todos for checking unexpected invalid extattrs

rm exception var

* fixed issue with additional return fields

* fix flake8 errs

* rm todos

fixed issue with too many args supplied to ip command

* revert changes to too many args handle in ip cmd

* fixed titles for get-ip, get host info, get network info

* added rn comment about get-ip mod outputs

* fix rn comment about get-ip mod outputs

* fix cmd outputs assertions in uts

* added args to get-ip in integration doc

* update docker image

* fix docs

* revert poetry

* fix docs

* Update README.md (demisto#33211)

edited description of cron argument, per Dudu B.

* download and move images to content repo (demisto#33204)

* download and move images to content repo

* commit test

* revert changes for gitlab_slack_notifier

* Update Docker Image To demisto/chromium  (demisto#33175)

* Updated Metadata Of Pack rasterize

* Added release notes to pack rasterize

* Packs/rasterize/Integrations/rasterize/rasterize.yml Docker image update

* Updated Metadata Of Pack ExpanseV2

* Added release notes to pack ExpanseV2

* Packs/ExpanseV2/Scripts/ExpanseGenerateIssueMapWidgetScript/ExpanseGenerateIssueMapWidgetScript.yml Docker image update

* Bump pack from version ExpanseV2 to 1.10.51.

* Bump pack from version rasterize to 2.0.2.

---------

Co-authored-by: Content Bot <[email protected]>

* docker

* do not write files when running test-module

* RN

* ignore error 125

* docker

* Fix RN

* revert

* ignore investigation attachments in test module command

---------

Co-authored-by: Michael Yochpaz <[email protected]>
Co-authored-by: Content Bot <[email protected]>
Co-authored-by: content-bot <[email protected]>
Co-authored-by: Corey Bodendein <[email protected]>
Co-authored-by: Israel Lappe <[email protected]>
Co-authored-by: ShirleyDenkberg <[email protected]>
Co-authored-by: tkatzir <[email protected]>
Co-authored-by: merit-maita <[email protected]>
Co-authored-by: Kobbi Gal <[email protected]>
Co-authored-by: Tamar Schanfeld <[email protected]>
Co-authored-by: israelpoli <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs-approved ForceMerge Forcing the merge of the PR despite the build status
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants