Skip to content

Implements feature based perf instrumentation comparision #3395

Implements feature based perf instrumentation comparision

Implements feature based perf instrumentation comparision #3395

Triggered via pull request October 9, 2023 18:44
Status Failure
Total duration 3m 16s
Artifacts
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

ci.yml

on: pull_request
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

106 errors and 57 warnings
[mypy] varats-core/varats/report/tef_report.py#L72: varats-core/varats/report/tef_report.py#L72
error: Attribute "__uuid" already defined on line 70 [no-redef]
[mypy] varats-core/varats/report/tef_report.py#L75: varats-core/varats/report/tef_report.py#L75
error: Attribute "__uuid" already defined on line 70 [no-redef]
[mypy] varats-core/varats/report/tef_report.py#L188: varats-core/varats/report/tef_report.py#L188
error: Function is missing a return type annotation [no-untyped-def]
[mypy] varats-core/varats/report/tef_report.py#L188: varats-core/varats/report/tef_report.py#L188
note: Use "-> None" if function does not return a value
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L87: varats/varats/experiments/vara/feature_perf_precision.py#L87
error: Non-overlapping identity check (left operand type: "str", right operand type: "Literal[ProjectDomains.TEST]") [comparison-overlap]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L97: varats/varats/experiments/vara/feature_perf_precision.py#L97
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L139: varats/varats/experiments/vara/feature_perf_precision.py#L139
error: Argument 2 to "__init__" of "MultiPatchReport" has incompatible type "type[PerfInfluenceTraceReportAggregate]"; expected "type[TEFReportAggregate]" [arg-type]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L150: varats/varats/experiments/vara/feature_perf_precision.py#L150
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L203: varats/varats/experiments/vara/feature_perf_precision.py#L203
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L309: varats/varats/experiments/vara/feature_perf_precision.py#L309
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L451: varats/varats/experiments/vara/feature_perf_precision.py#L451
error: Call to untyped function "RevertPatch" in typed context [no-untyped-call]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L572: varats/varats/experiments/vara/feature_perf_precision.py#L572
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L689: varats/varats/experiments/vara/feature_perf_precision.py#L689
error: Call to untyped function "RevertPatch" in typed context [no-untyped-call]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L724: varats/varats/experiments/vara/feature_perf_precision.py#L724
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L781: varats/varats/experiments/vara/feature_perf_precision.py#L781
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L863: varats/varats/experiments/vara/feature_perf_precision.py#L863
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L1083: varats/varats/experiments/vara/feature_perf_precision.py#L1083
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L10: varats/varats/data/databases/feature_perf_precision_database.py#L10
error: Skipping analyzing "cliffs_delta": module is installed, but missing library stubs or py.typed marker [import]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L10: varats/varats/data/databases/feature_perf_precision_database.py#L10
note: See https://mypy.readthedocs.io/en/stable/running_mypy.html#missing-imports
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L281: varats/varats/data/databases/feature_perf_precision_database.py#L281
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "MultiPatchReport" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L315: varats/varats/data/databases/feature_perf_precision_database.py#L315
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L336: varats/varats/data/databases/feature_perf_precision_database.py#L336
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "MultiPatchReport" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L337: varats/varats/data/databases/feature_perf_precision_database.py#L337
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "PerfInfluenceTraceReportAggregate" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L371: varats/varats/data/databases/feature_perf_precision_database.py#L371
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "MultiPatchReport" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L487: varats/varats/data/databases/feature_perf_precision_database.py#L487
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "TimeReportAggregate" [attr-defined]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L490: varats/varats/data/databases/feature_perf_precision_database.py#L490
error: Signature of "is_regression" incompatible with supertype "Profiler" [override]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L490: varats/varats/data/databases/feature_perf_precision_database.py#L490
note: def is_regression(self, report_path: ReportFilepath, patch_name: str) -> bool
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L536: varats/varats/data/databases/feature_perf_precision_database.py#L536
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L679: varats/varats/data/databases/feature_perf_precision_database.py#L679
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/data/databases/feature_perf_precision_database.py#L736: varats/varats/data/databases/feature_perf_precision_database.py#L736
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L36: varats/varats/tables/feature_perf_precision.py#L36
error: Module "varats.utils.git_util" does not explicitly export attribute "git" [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L39: varats/varats/tables/feature_perf_precision.py#L39
error: Function is missing a type annotation [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L51: varats/varats/tables/feature_perf_precision.py#L51
error: Need type annotation for "step_list" [var-annotated]
[mypy] varats/varats/tables/feature_perf_precision.py#L52: varats/varats/tables/feature_perf_precision.py#L52
error: Incompatible types in assignment (expression has type "ndarray[Any, dtype[Any]]", variable has type "Union[list[Any], list[Any]]") [assignment]
[mypy] varats/varats/tables/feature_perf_precision.py#L251: varats/varats/tables/feature_perf_precision.py#L251
error: "OverheadData" has no attribute "mean_ctx" [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L262: varats/varats/tables/feature_perf_precision.py#L262
error: "OverheadData" has no attribute "config_wise_ctx_diff"; maybe "config_wise_time_diff", "config_wise_memory_diff", or "config_wise_fs_inputs_diff"? [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L361: varats/varats/tables/feature_perf_precision.py#L361
error: Function is missing a type annotation [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L469: varats/varats/tables/feature_perf_precision.py#L469
error: Call to untyped function "cmap_map" in typed context [no-untyped-call]
[mypy] varats/varats/tables/feature_perf_precision.py#L485: varats/varats/tables/feature_perf_precision.py#L485
error: Call to untyped function "truncate_colormap" in typed context [no-untyped-call]
[mypy] varats/varats/plots/feature_perf_precision.py#L301: varats/varats/plots/feature_perf_precision.py#L301
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/plots/feature_perf_precision.py#L317: varats/varats/plots/feature_perf_precision.py#L317
error: Name "text_obj" already defined on line 316 [no-redef]
[mypy] varats/varats/plots/feature_perf_precision.py#L358: varats/varats/plots/feature_perf_precision.py#L358
error: Call to untyped function "plot_pareto_frontier" in typed context [no-untyped-call]
[mypy] varats/varats/plots/feature_perf_precision.py#L404: varats/varats/plots/feature_perf_precision.py#L404
error: Function is missing a type annotation [no-untyped-def]
build (3.9)
Process completed with exit code 2.
build (3.11)
The operation was canceled.
build (3.10)
The operation was canceled.
[pylint] varats/varats/plots/feature_perf_precision.py#L29 <116>: varats/varats/plots/feature_perf_precision.py#L29
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/plots/feature_perf_precision.py#L301 <116>: varats/varats/plots/feature_perf_precision.py#L301
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "Xs" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "Ys" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "maxX" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/plots/feature_perf_precision.py#L404 <103>: varats/varats/plots/feature_perf_precision.py#L404
Argument name "maxY" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L6 <402>: varats/varats/tables/feature_perf_precision.py#L6
Use 'from matplotlib import colors' instead (consider-using-from-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L54 <3001>: varats/varats/tables/feature_perf_precision.py#L54
Lambda expression assigned to a variable. Define a function using the "def" keyword instead. (unnecessary-lambda-assignment)
[pylint] varats/varats/tables/feature_perf_precision.py#L55 <103>: varats/varats/tables/feature_perf_precision.py#L55
Variable name "old_LUT" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L56 <103>: varats/varats/tables/feature_perf_precision.py#L56
Variable name "new_LUT" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L70 <415>: varats/varats/tables/feature_perf_precision.py#L70
Import outside toplevel (matplotlib) (import-outside-toplevel)
[pylint] varats/varats/tables/feature_perf_precision.py#L251 <1101>: varats/varats/tables/feature_perf_precision.py#L251
Instance of 'OverheadData' has no 'mean_ctx' member (no-member)
[pylint] varats/varats/tables/feature_perf_precision.py#L262 <1101>: varats/varats/tables/feature_perf_precision.py#L262
Instance of 'OverheadData' has no 'config_wise_ctx_diff' member (no-member)
[pylint] varats/varats/tables/feature_perf_precision.py#L361 <116>: varats/varats/tables/feature_perf_precision.py#L361
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/tables/feature_perf_precision.py#L363 <209>: varats/varats/tables/feature_perf_precision.py#L363
Formatting a regular string which could be an f-string (consider-using-f-string)
build (3.9)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
build (3.11)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
build (3.10)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
[pylint] varats/varats/plots/feature_perf_precision.py#L23 <611>: varats/varats/plots/feature_perf_precision.py#L23
Unused PlotConfig imported from varats.plot.plots (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L447 <1401>: varats/varats/tables/feature_perf_precision.py#L447
Anomalous backslash in string: '\D'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L447 <1401>: varats/varats/tables/feature_perf_precision.py#L447
Anomalous backslash in string: '\%'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L448 <1401>: varats/varats/tables/feature_perf_precision.py#L448
Anomalous backslash in string: '\D'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L448 <1401>: varats/varats/tables/feature_perf_precision.py#L448
Anomalous backslash in string: '\%'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
[pylint] varats/varats/tables/feature_perf_precision.py#L46 <212>: varats/varats/tables/feature_perf_precision.py#L46
Access to a protected member _segmentdata of a client class (protected-access)
[pylint] varats/varats/tables/feature_perf_precision.py#L29 <611>: varats/varats/tables/feature_perf_precision.py#L29
Unused CaseStudy imported from varats.paper.case_study (unused-import)
[pylint] varats/varats/containers/containers.py#L45 <238>: varats/varats/containers/containers.py#L45
Unused private member `ImageBase.__version_number` (unused-private-member)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L490 <221>: varats/varats/data/databases/feature_perf_precision_database.py#L490
Number of parameters was 3 in 'Profiler.is_regression' and is now 2 in overriding 'Baseline.is_regression' method (arguments-differ)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L581 <212>: varats/varats/data/databases/feature_perf_precision_database.py#L581
Access to a protected member __mean_major_page_faults of a client class (protected-access)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L588 <212>: varats/varats/data/databases/feature_perf_precision_database.py#L588
Access to a protected member __mean_minor_page_faults of a client class (protected-access)
[pylint] varats/varats/data/databases/feature_perf_precision_database.py#L600 <212>: varats/varats/data/databases/feature_perf_precision_database.py#L600
Access to a protected member __mean_fs_outputs of a client class (protected-access)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L137 <511>: varats/varats/experiments/vara/feature_perf_precision.py#L137
TODO: clean up report handling, we currently parse it as a TEFReport (fixme)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L150 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L150
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L203 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L203
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L309 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L309
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L19 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L19
Unused get_base_image imported from varats.containers.containers (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L19 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L19
Unused ImageBase imported from varats.containers.containers (unused-import)