Skip to content

Implements feature based perf instrumentation comparision #3008

Implements feature based perf instrumentation comparision

Implements feature based perf instrumentation comparision #3008

Triggered via pull request October 5, 2023 14:14
Status Success
Total duration 26s
Artifacts

pre-commit.yml

on: pull_request
pre-commit
17s
pre-commit
Fit to window
Zoom out
Zoom in

Annotations

102 errors and 48 warnings
[mypy] varats-core/varats/report/tef_report.py#L72: varats-core/varats/report/tef_report.py#L72
error: Attribute "__uuid" already defined on line 70 [no-redef]
[mypy] varats-core/varats/report/tef_report.py#L75: varats-core/varats/report/tef_report.py#L75
error: Attribute "__uuid" already defined on line 70 [no-redef]
[mypy] varats-core/varats/report/tef_report.py#L188: varats-core/varats/report/tef_report.py#L188
error: Function is missing a return type annotation [no-untyped-def]
[mypy] varats-core/varats/report/tef_report.py#L188: varats-core/varats/report/tef_report.py#L188
note: Use "-> None" if function does not return a value
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L58: varats/varats/experiments/vara/feature_perf_precision.py#L58
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L100: varats/varats/experiments/vara/feature_perf_precision.py#L100
error: Argument 2 to "__init__" of "MultiPatchReport" has incompatible type "type[PerfInfluenceTraceReportAggregate]"; expected "type[TEFReportAggregate]" [arg-type]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L111: varats/varats/experiments/vara/feature_perf_precision.py#L111
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L170: varats/varats/experiments/vara/feature_perf_precision.py#L170
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L281: varats/varats/experiments/vara/feature_perf_precision.py#L281
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L372: varats/varats/experiments/vara/feature_perf_precision.py#L372
error: Non-overlapping identity check (left operand type: "str", right operand type: "Literal[ProjectDomains.TEST]") [comparison-overlap]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L408: varats/varats/experiments/vara/feature_perf_precision.py#L408
error: Unsupported right operand type for in ("Optional[set[str]]") [operator]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L426: varats/varats/experiments/vara/feature_perf_precision.py#L426
error: Call to untyped function "RevertPatch" in typed context [no-untyped-call]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L547: varats/varats/experiments/vara/feature_perf_precision.py#L547
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L651: varats/varats/experiments/vara/feature_perf_precision.py#L651
error: Unsupported right operand type for in ("Optional[set[str]]") [operator]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L669: varats/varats/experiments/vara/feature_perf_precision.py#L669
error: Call to untyped function "RevertPatch" in typed context [no-untyped-call]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L704: varats/varats/experiments/vara/feature_perf_precision.py#L704
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L769: varats/varats/experiments/vara/feature_perf_precision.py#L769
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L855: varats/varats/experiments/vara/feature_perf_precision.py#L855
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L927: varats/varats/experiments/vara/feature_perf_precision.py#L927
error: Non-overlapping identity check (left operand type: "str", right operand type: "Literal[ProjectDomains.TEST]") [comparison-overlap]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L1077: varats/varats/experiments/vara/feature_perf_precision.py#L1077
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L10: varats/varats/data/databases/feature_perf_precision_database.py#L10
error: Skipping analyzing "cliffs_delta": module is installed, but missing library stubs or py.typed marker [import]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L10: varats/varats/data/databases/feature_perf_precision_database.py#L10
note: See https://mypy.readthedocs.io/en/stable/running_mypy.html#missing-imports
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L281: varats/varats/data/databases/feature_perf_precision_database.py#L281
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "MultiPatchReport" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L315: varats/varats/data/databases/feature_perf_precision_database.py#L315
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L336: varats/varats/data/databases/feature_perf_precision_database.py#L336
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "MultiPatchReport" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L337: varats/varats/data/databases/feature_perf_precision_database.py#L337
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "PerfInfluenceTraceReportAggregate" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L371: varats/varats/data/databases/feature_perf_precision_database.py#L371
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "MultiPatchReport" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L485: varats/varats/data/databases/feature_perf_precision_database.py#L485
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "TimeReportAggregate" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L488: varats/varats/data/databases/feature_perf_precision_database.py#L488
error: Signature of "is_regression" incompatible with supertype "Profiler" [override]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L488: varats/varats/data/databases/feature_perf_precision_database.py#L488
note: def is_regression(self, report_path: ReportFilepath, patch_name: str) -> bool
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L534: varats/varats/data/databases/feature_perf_precision_database.py#L534
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L677: varats/varats/data/databases/feature_perf_precision_database.py#L677
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L734: varats/varats/data/databases/feature_perf_precision_database.py#L734
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L36: varats/varats/tables/feature_perf_precision.py#L36
error: Module "varats.utils.git_util" does not explicitly export attribute "git" [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L39: varats/varats/tables/feature_perf_precision.py#L39
error: Function is missing a type annotation [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L51: varats/varats/tables/feature_perf_precision.py#L51
error: Need type annotation for "step_list" [var-annotated]
[mypy] varats/varats/tables/feature_perf_precision.py#L52: varats/varats/tables/feature_perf_precision.py#L52
error: Incompatible types in assignment (expression has type "ndarray[Any, dtype[Any]]", variable has type "Union[list[Any], list[Any]]") [assignment]
[mypy] varats/varats/tables/feature_perf_precision.py#L251: varats/varats/tables/feature_perf_precision.py#L251
error: "OverheadData" has no attribute "mean_ctx" [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L262: varats/varats/tables/feature_perf_precision.py#L262
error: "OverheadData" has no attribute "config_wise_ctx_diff"; maybe "config_wise_time_diff", "config_wise_memory_diff", or "config_wise_fs_inputs_diff"? [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L361: varats/varats/tables/feature_perf_precision.py#L361
error: Function is missing a type annotation [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L469: varats/varats/tables/feature_perf_precision.py#L469
error: Call to untyped function "cmap_map" in typed context [no-untyped-call]
[mypy] varats/varats/tables/feature_perf_precision.py#L485: varats/varats/tables/feature_perf_precision.py#L485
error: Call to untyped function "truncate_colormap" in typed context [no-untyped-call]
[mypy] varats/varats/plots/feature_perf_precision.py#L301: varats/varats/plots/feature_perf_precision.py#L301
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/plots/feature_perf_precision.py#L317: varats/varats/plots/feature_perf_precision.py#L317
error: Name "text_obj" already defined on line 316 [no-redef]
[mypy] varats/varats/plots/feature_perf_precision.py#L358: varats/varats/plots/feature_perf_precision.py#L358
error: Call to untyped function "plot_pareto_frontier" in typed context [no-untyped-call]
[mypy] varats/varats/plots/feature_perf_precision.py#L404: varats/varats/plots/feature_perf_precision.py#L404
error: Function is missing a type annotation [no-untyped-def]
[pylint] varats/varats/plots/feature_perf_precision.py#L29 <116>: varats/varats/plots/feature_perf_precision.py#L29
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/plots/feature_perf_precision.py#L301 <116>: varats/varats/plots/feature_perf_precision.py#L301
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "Xs" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "Ys" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "maxX" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "maxY" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L6 <402>: varats/varats/tables/feature_perf_precision.py#L6
Use 'from matplotlib import colors' instead (consider-using-from-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L54 <3001>: varats/varats/tables/feature_perf_precision.py#L54
Lambda expression assigned to a variable. Define a function using the "def" keyword instead. (unnecessary-lambda-assignment)
[pylint] varats/varats/tables/feature_perf_precision.py#L55 <103>: varats/varats/tables/feature_perf_precision.py#L55
Variable name "old_LUT" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L56 <103>: varats/varats/tables/feature_perf_precision.py#L56
Variable name "new_LUT" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L70 <415>: varats/varats/tables/feature_perf_precision.py#L70
Import outside toplevel (matplotlib) (import-outside-toplevel)
[pylint] varats/varats/tables/feature_perf_precision.py#L251 <1101>: varats/varats/tables/feature_perf_precision.py#L251
Instance of 'OverheadData' has no 'mean_ctx' member (no-member)
[pylint] varats/varats/tables/feature_perf_precision.py#L262 <1101>: varats/varats/tables/feature_perf_precision.py#L262
Instance of 'OverheadData' has no 'config_wise_ctx_diff' member (no-member)
[pylint] varats/varats/tables/feature_perf_precision.py#L361 <116>: varats/varats/tables/feature_perf_precision.py#L361
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/tables/feature_perf_precision.py#L363 <209>: varats/varats/tables/feature_perf_precision.py#L363
Formatting a regular string which could be an f-string (consider-using-f-string)
pre-commit
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2, pre-commit/[email protected]. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
[pylint] varats/varats/plots/feature_perf_precision.py#L23 <611>: varats/varats/plots/feature_perf_precision.py#L23
Unused PlotConfig imported from varats.plot.plots (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L447 <1401>: varats/varats/tables/feature_perf_precision.py#L447
Anomalous backslash in string: '\D'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L447 <1401>: varats/varats/tables/feature_perf_precision.py#L447
Anomalous backslash in string: '\%'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L448 <1401>: varats/varats/tables/feature_perf_precision.py#L448
Anomalous backslash in string: '\D'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L448 <1401>: varats/varats/tables/feature_perf_precision.py#L448
Anomalous backslash in string: '\%'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L46 <212>: varats/varats/tables/feature_perf_precision.py#L46
Access to a protected member _segmentdata of a client class (protected-access)
[pylint] varats/varats/tables/feature_perf_precision.py#L29 <611>: varats/varats/tables/feature_perf_precision.py#L29
Unused CaseStudy imported from varats.paper.case_study (unused-import)
[pylint] varats/varats/containers/containers.py#L45 <238>: varats/varats/containers/containers.py#L45
Unused private member `ImageBase.__version_number` (unused-private-member)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L488 <221>: varats/varats/data/databases/feature_perf_precision_database.py#L488
Number of parameters was 3 in 'Profiler.is_regression' and is now 2 in overriding 'Baseline.is_regression' method (arguments-differ)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L579 <212>: varats/varats/data/databases/feature_perf_precision_database.py#L579
Access to a protected member __mean_major_page_faults of a client class (protected-access)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L586 <212>: varats/varats/data/databases/feature_perf_precision_database.py#L586
Access to a protected member __mean_minor_page_faults of a client class (protected-access)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L598 <212>: varats/varats/data/databases/feature_perf_precision_database.py#L598
Access to a protected member __mean_fs_outputs of a client class (protected-access)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L98 <511>: varats/varats/experiments/vara/feature_perf_precision.py#L98
TODO: clean up report handling, we currently parse it as a TEFReport (fixme)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L111 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L111
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L170 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L170
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L281 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L281
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L19 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L19
Unused get_base_image imported from varats.containers.containers (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L19 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L19
Unused ImageBase imported from varats.containers.containers (unused-import)