From f8f0eb1c74e011848f29e3e0922b6bfd5b8ff75e Mon Sep 17 00:00:00 2001 From: "Documenter.jl" Date: Mon, 7 Oct 2024 02:35:17 +0000 Subject: [PATCH] build based on f0caaf0 --- previews/PR3838/.documenter-siteinfo.json | 2 +- previews/PR3838/JuMP.pdf | Bin 6232105 -> 6232080 bytes .../PR3838/api/JuMP.Containers/index.html | 30 +- previews/PR3838/api/JuMP/index.html | 556 +- .../algebraic_modeling_languages/index.html | 2 +- .../PR3838/background/bibliography/index.html | 2 +- previews/PR3838/changelog/index.html | 2 +- .../PR3838/developers/checklists/index.html | 2 +- .../PR3838/developers/contributing/index.html | 2 +- .../custom_solver_binaries/index.html | 2 +- .../PR3838/developers/extensions/index.html | 2 +- previews/PR3838/developers/roadmap/index.html | 2 +- previews/PR3838/developers/style/index.html | 2 +- .../extensions/DimensionalData/index.html | 2 +- .../PR3838/extensions/introduction/index.html | 2 +- previews/PR3838/index.html | 2 +- previews/PR3838/installation/index.html | 2 +- previews/PR3838/manual/callbacks/index.html | 2 +- previews/PR3838/manual/complex/index.html | 2 +- previews/PR3838/manual/constraints/index.html | 2 +- previews/PR3838/manual/containers/index.html | 2 +- previews/PR3838/manual/expressions/index.html | 2 +- previews/PR3838/manual/models/index.html | 2 +- previews/PR3838/manual/nlp/index.html | 2 +- previews/PR3838/manual/nonlinear/index.html | 2 +- previews/PR3838/manual/objective/index.html | 2 +- previews/PR3838/manual/solutions/index.html | 2 +- previews/PR3838/manual/variables/index.html | 2 +- .../PR3838/moi/background/duality/index.html | 2 +- .../infeasibility_certificates/index.html | 2 +- .../moi/background/motivation/index.html | 2 +- .../background/naming_conventions/index.html | 2 +- previews/PR3838/moi/changelog/index.html | 2 +- .../moi/developer/checklists/index.html | 2 +- previews/PR3838/moi/index.html | 2 +- .../PR3838/moi/manual/constraints/index.html | 2 +- previews/PR3838/moi/manual/models/index.html | 2 +- .../PR3838/moi/manual/modification/index.html | 2 +- .../PR3838/moi/manual/solutions/index.html | 2 +- .../moi/manual/standard_form/index.html | 2 +- .../PR3838/moi/manual/variables/index.html | 2 +- .../PR3838/moi/reference/callbacks/index.html | 2 +- .../moi/reference/constraints/index.html | 2 +- .../PR3838/moi/reference/errors/index.html | 2 +- .../PR3838/moi/reference/models/index.html | 4 +- .../moi/reference/modification/index.html | 2 +- .../PR3838/moi/reference/nonlinear/index.html | 2 +- .../moi/reference/standard_form/index.html | 2 +- .../PR3838/moi/reference/variables/index.html | 2 +- previews/PR3838/moi/release_notes/index.html | 2 +- .../submodules/Benchmarks/overview/index.html | 2 +- .../Benchmarks/reference/index.html | 2 +- .../Bridges/implementation/index.html | 2 +- .../Bridges/list_of_bridges/index.html | 2 +- .../submodules/Bridges/overview/index.html | 2 +- .../submodules/Bridges/reference/index.html | 2 +- .../FileFormats/overview/index.html | 2 +- .../FileFormats/reference/index.html | 2 +- .../submodules/Nonlinear/overview/index.html | 2 +- .../submodules/Nonlinear/reference/index.html | 2 +- .../moi/submodules/Test/overview/index.html | 2 +- .../moi/submodules/Test/reference/index.html | 2 +- .../submodules/Utilities/overview/index.html | 2 +- .../submodules/Utilities/reference/index.html | 4 +- .../tutorials/bridging_constraint/index.html | 2 +- .../PR3838/moi/tutorials/example/index.html | 2 +- .../moi/tutorials/implementing/index.html | 2 +- .../PR3838/moi/tutorials/latency/index.html | 2 +- .../manipulating_expressions/index.html | 2 +- .../moi/tutorials/mathprogbase/index.html | 2 +- previews/PR3838/packages/Alpine/index.html | 2 +- .../PR3838/packages/AmplNLWriter/index.html | 2 +- previews/PR3838/packages/BARON/index.html | 2 +- .../PR3838/packages/BilevelJuMP/index.html | 2 +- previews/PR3838/packages/CDCS/index.html | 2 +- previews/PR3838/packages/CDDLib/index.html | 2 +- previews/PR3838/packages/COPT/index.html | 2 +- previews/PR3838/packages/COSMO/index.html | 2 +- previews/PR3838/packages/CPLEX/index.html | 2 +- previews/PR3838/packages/CSDP/index.html | 2 +- previews/PR3838/packages/Cbc/index.html | 2 +- previews/PR3838/packages/Clarabel/index.html | 2 +- previews/PR3838/packages/Clp/index.html | 2 +- previews/PR3838/packages/DAQP/index.html | 2 +- previews/PR3838/packages/DSDP/index.html | 2 +- previews/PR3838/packages/DiffOpt/index.html | 2 +- .../DisjunctiveProgramming/index.html | 2 +- .../PR3838/packages/Dualization/index.html | 2 +- previews/PR3838/packages/EAGO/index.html | 2 +- previews/PR3838/packages/ECOS/index.html | 2 +- previews/PR3838/packages/GAMS/index.html | 2 +- previews/PR3838/packages/GLPK/index.html | 2 +- previews/PR3838/packages/Gurobi/index.html | 2 +- previews/PR3838/packages/HiGHS/index.html | 2 +- previews/PR3838/packages/Hypatia/index.html | 2 +- .../PR3838/packages/InfiniteOpt/index.html | 2 +- previews/PR3838/packages/Ipopt/index.html | 2 +- previews/PR3838/packages/Juniper/index.html | 2 +- previews/PR3838/packages/KNITRO/index.html | 2 +- previews/PR3838/packages/Loraine/index.html | 2 +- previews/PR3838/packages/MAiNGO/index.html | 2 +- previews/PR3838/packages/MadNLP/index.html | 2 +- previews/PR3838/packages/Manopt/index.html | 2 +- previews/PR3838/packages/MiniZinc/index.html | 2 +- .../PR3838/packages/MosekTools/index.html | 2 +- .../MultiObjectiveAlgorithms/index.html | 2 +- .../PR3838/packages/NEOSServer/index.html | 2 +- previews/PR3838/packages/NLopt/index.html | 2 +- previews/PR3838/packages/OSQP/index.html | 2 +- previews/PR3838/packages/Optim/index.html | 2 +- .../PR3838/packages/PATHSolver/index.html | 2 +- previews/PR3838/packages/Pajarito/index.html | 2 +- .../ParametricOptInterface/index.html | 2 +- previews/PR3838/packages/Pavito/index.html | 2 +- previews/PR3838/packages/Percival/index.html | 2 +- .../packages/PiecewiseLinearOpt/index.html | 2 +- previews/PR3838/packages/Plasmo/index.html | 2 +- previews/PR3838/packages/PolyJuMP/index.html | 2 +- previews/PR3838/packages/ProxSDP/index.html | 2 +- previews/PR3838/packages/SCIP/index.html | 2 +- previews/PR3838/packages/SCS/index.html | 2 +- previews/PR3838/packages/SDDP/index.html | 2 +- previews/PR3838/packages/SDPA/index.html | 2 +- previews/PR3838/packages/SDPLR/index.html | 2 +- previews/PR3838/packages/SDPNAL/index.html | 2 +- previews/PR3838/packages/SDPT3/index.html | 2 +- previews/PR3838/packages/SeDuMi/index.html | 2 +- .../PR3838/packages/SumOfSquares/index.html | 2 +- previews/PR3838/packages/Tulip/index.html | 2 +- previews/PR3838/packages/Xpress/index.html | 2 +- previews/PR3838/packages/solvers/index.html | 2 +- previews/PR3838/release_notes/index.html | 2 +- previews/PR3838/should_i_use/index.html | 2 +- .../benders_decomposition/index.html | 4 +- .../{c05bc532.svg => d6fec94f.svg} | 670 +- .../{5ee28c55.svg => fed380b4.svg} | 1002 +- .../index.html | 12 +- .../algorithms/parallelism/index.html | 2 +- .../{b8e75c9a.svg => 01df96c0.svg} | 200 +- .../{1ecba0be.svg => 8a899a70.svg} | 132 +- .../{02449198.svg => 9596998d.svg} | 650 +- .../algorithms/rolling_horizon/index.html | 4 +- .../{272fb190.svg => 1e061ecf.svg} | 214 +- .../{62961f95.svg => 2c70a7be.svg} | 214 +- .../tsp_lazy_constraints/index.html | 6 +- .../optimal_power_flow/index.html | 6 +- .../{9237f030.svg => 57e51ff9.svg} | 120 +- .../{6ea876e2.svg => 5aeeb529.svg} | 56 +- .../{31209046.svg => 7d13bdd7.svg} | 124 +- .../applications/power_systems/index.html | 10 +- .../two_stage_stochastic/0e110230.svg | 99 + .../two_stage_stochastic/1d9f60b6.svg | 81 - .../two_stage_stochastic/4f30c49c.svg | 96 - .../two_stage_stochastic/72c39399.svg | 76 + .../two_stage_stochastic/76eaf3ec.svg | 85 - .../two_stage_stochastic/808b7e5d.svg | 80 + .../two_stage_stochastic/8e906d6f.svg | 116 - .../two_stage_stochastic/b0e8dd41.svg | 108 + .../two_stage_stochastic/index.html | 60 +- .../tutorials/applications/web_app/index.html | 2 +- .../conic/arbitrary_precision/index.html | 4 +- .../tutorials/conic/dualization/index.html | 50 +- .../{695e189e.svg => 48ec82be.svg} | 4870 +- .../{ed5982a2.svg => b4c90619.svg} | 4872 +- .../tutorials/conic/ellipse_approx/index.html | 12 +- .../conic/experiment_design/index.html | 2 +- .../tutorials/conic/introduction/index.html | 2 +- .../conic/logistic_regression/index.html | 2 +- .../{f898c24e.svg => 91bf8e7a.svg} | 70 +- .../{d91a8a6d.svg => 9e49e91f.svg} | 76 +- .../tutorials/conic/min_ellipse/index.html | 6 +- .../conic/quantum_discrimination/index.html | 6 +- .../{0242bc27.svg => c8c5f047.svg} | 70 +- .../conic/simple_examples/index.html | 4 +- .../tutorials/conic/start_values/index.html | 16 +- .../conic/tips_and_tricks/index.html | 2 +- .../getting_started/debugging/index.html | 2 +- .../index.html | 2 +- .../getting_started_with_JuMP/index.html | 2 +- .../{3139a25e.svg => 45ac2d7b.svg} | 94 +- .../{d94e393a.svg => ad03704c.svg} | 118 +- .../{789d8e53.svg => fda83b00.svg} | 88 +- .../index.html | 10 +- .../getting_started_with_julia/index.html | 10 +- .../index.html | 2 +- .../getting_started/introduction/index.html | 2 +- .../performance_tips/index.html | 2 +- .../sum_if/{23d9d0bd.svg => 8220bdfd.svg} | 108 +- .../sum_if/{de89758d.svg => ab3233b9.svg} | 82 +- .../getting_started/sum_if/index.html | 8 +- .../getting_started/tolerances/index.html | 60 +- .../PR3838/tutorials/linear/basis/index.html | 2 +- .../tutorials/linear/callbacks/index.html | 2 +- .../tutorials/linear/cannery/index.html | 4 +- .../linear/constraint_programming/index.html | 2 +- .../PR3838/tutorials/linear/diet/index.html | 8 +- .../{0ab70411.svg => 491dad85.svg} | 108 +- .../{7b9ef6a0.svg => 626cc0b9.svg} | 94 +- .../{e19ddf83.svg => d22ea3ae.svg} | 84 +- .../{3ab94e28.svg => f8a9e3bf.svg} | 108 +- .../linear/facility_location/index.html | 8 +- .../{685cf118.svg => 16aad172.svg} | 292 +- .../{770dce83.svg => 2d072995.svg} | 296 +- .../{223d6540.svg => fa5f7d58.svg} | 124 +- .../linear/factory_schedule/index.html | 6 +- .../tutorials/linear/finance/index.html | 2 +- .../linear/geographic_clustering/index.html | 2 +- .../tutorials/linear/introduction/index.html | 2 +- .../tutorials/linear/knapsack/index.html | 4 +- .../linear/lp_sensitivity/index.html | 6 +- .../tutorials/linear/mip_duality/index.html | 2 +- .../PR3838/tutorials/linear/multi/index.html | 6 +- .../linear/multi_commodity_network/index.html | 4 +- .../multi_objective_examples/index.html | 8 +- .../{ad761c30.svg => 26da78ba.svg} | 78 +- .../{57151a29.svg => dda43991.svg} | 80 +- .../multi_objective_knapsack/index.html | 8 +- .../tutorials/linear/n-queens/index.html | 2 +- .../tutorials/linear/network_flows/index.html | 2 +- .../{f7522d63.svg => 044a3b21.svg} | 100 +- .../{b507a7ef.svg => 16c489f6.svg} | 96 +- .../{a7de0b0a.svg => 365cf2f3.svg} | 58 +- .../{45fcbf6c.svg => 68c98407.svg} | 96 +- .../{f0ca95a3.svg => 73500721.svg} | 56 +- .../{9bd7e877.svg => 81ee56a7.svg} | 70 +- .../{fd1897f7.svg => 897bf5b8.svg} | 90 +- .../{bcf7d56d.svg => 8ec5e5ed.svg} | 60 +- .../{a907712b.svg => ac0dee02.svg} | 92 +- .../{d32c72dd.svg => adebb149.svg} | 66 +- .../{f2b7bb48.svg => fb69c516.svg} | 62 +- .../{b9bf8efd.svg => fca7433c.svg} | 66 +- .../linear/piecewise_linear/index.html | 24 +- .../PR3838/tutorials/linear/sudoku/index.html | 2 +- .../linear/tips_and_tricks/index.html | 2 +- .../PR3838/tutorials/linear/transp/index.html | 2 +- .../{32566bbe.svg => 117cc728.svg} | 1056 +- .../{8ae95394.svg => 15748a25.svg} | 256 +- .../{5f35c36c.svg => 197f6567.svg} | 254 +- .../{b8b484f4.svg => 25ef36b9.svg} | 1072 +- .../{0e75b6aa.svg => 26a34877.svg} | 41796 ++++++++-------- .../{f300096c.svg => 5bbfc3eb.svg} | 1070 +- .../{8bc63f07.svg => a9d36cb7.svg} | 2054 +- .../{3499be38.svg => cdcacde4.svg} | 1056 +- .../{3d0bc893.svg => db428a09.svg} | 1058 +- .../nonlinear/classifiers/index.html | 18 +- .../nonlinear/complementarity/index.html | 4 +- .../nonlinear/introduction/index.html | 2 +- .../nonlinear/nested_problems/index.html | 6 +- .../nonlinear/operator_ad/index.html | 2 +- .../portfolio/{50a8ef93.svg => e8754326.svg} | 1126 +- .../tutorials/nonlinear/portfolio/index.html | 6 +- .../nonlinear/querying_hessians/index.html | 2 +- .../{1befcd64.svg => 89264e00.svg} | 206 +- .../nonlinear/rocket_control/index.html | 4 +- .../nonlinear/simple_examples/index.html | 4 +- .../{573098a9.svg => 6ee659b0.svg} | 148 +- .../{e1cffcfa.svg => 730ad8e6.svg} | 66 +- .../{44112ba4.svg => d66358df.svg} | 294 +- .../index.html | 6 +- .../nonlinear/tips_and_tricks/index.html | 2 +- .../user_defined_hessians/index.html | 4 +- .../transitioning_from_matlab/index.html | 4 +- 262 files changed, 34790 insertions(+), 34805 deletions(-) rename previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/{c05bc532.svg => d6fec94f.svg} (72%) rename previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/{5ee28c55.svg => fed380b4.svg} (69%) rename previews/PR3838/tutorials/algorithms/rolling_horizon/{b8e75c9a.svg => 01df96c0.svg} (86%) rename previews/PR3838/tutorials/algorithms/rolling_horizon/{1ecba0be.svg => 8a899a70.svg} (90%) rename previews/PR3838/tutorials/algorithms/rolling_horizon/{02449198.svg => 9596998d.svg} (87%) rename previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/{272fb190.svg => 1e061ecf.svg} (75%) rename previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/{62961f95.svg => 2c70a7be.svg} (75%) rename previews/PR3838/tutorials/applications/power_systems/{9237f030.svg => 57e51ff9.svg} (86%) rename previews/PR3838/tutorials/applications/power_systems/{6ea876e2.svg => 5aeeb529.svg} (85%) rename previews/PR3838/tutorials/applications/power_systems/{31209046.svg => 7d13bdd7.svg} (86%) create mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/0e110230.svg delete mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/1d9f60b6.svg delete mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/4f30c49c.svg create mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/72c39399.svg delete mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/76eaf3ec.svg create mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/808b7e5d.svg delete mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/8e906d6f.svg create mode 100644 previews/PR3838/tutorials/applications/two_stage_stochastic/b0e8dd41.svg rename previews/PR3838/tutorials/conic/ellipse_approx/{695e189e.svg => 48ec82be.svg} (57%) rename previews/PR3838/tutorials/conic/ellipse_approx/{ed5982a2.svg => b4c90619.svg} (58%) rename previews/PR3838/tutorials/conic/min_ellipse/{f898c24e.svg => 91bf8e7a.svg} (88%) rename previews/PR3838/tutorials/conic/min_ellipse/{d91a8a6d.svg => 9e49e91f.svg} (88%) rename previews/PR3838/tutorials/conic/simple_examples/{0242bc27.svg => c8c5f047.svg} (79%) rename previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/{3139a25e.svg => 45ac2d7b.svg} (84%) rename previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/{d94e393a.svg => ad03704c.svg} (82%) rename previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/{789d8e53.svg => fda83b00.svg} (85%) rename previews/PR3838/tutorials/getting_started/sum_if/{23d9d0bd.svg => 8220bdfd.svg} (60%) rename previews/PR3838/tutorials/getting_started/sum_if/{de89758d.svg => ab3233b9.svg} (54%) rename previews/PR3838/tutorials/linear/facility_location/{0ab70411.svg => 491dad85.svg} (79%) rename previews/PR3838/tutorials/linear/facility_location/{7b9ef6a0.svg => 626cc0b9.svg} (81%) rename previews/PR3838/tutorials/linear/facility_location/{e19ddf83.svg => d22ea3ae.svg} (80%) rename previews/PR3838/tutorials/linear/facility_location/{3ab94e28.svg => f8a9e3bf.svg} (79%) rename previews/PR3838/tutorials/linear/factory_schedule/{685cf118.svg => 16aad172.svg} (78%) rename previews/PR3838/tutorials/linear/factory_schedule/{770dce83.svg => 2d072995.svg} (78%) rename previews/PR3838/tutorials/linear/factory_schedule/{223d6540.svg => fa5f7d58.svg} (86%) rename previews/PR3838/tutorials/linear/multi_objective_knapsack/{ad761c30.svg => 26da78ba.svg} (87%) rename previews/PR3838/tutorials/linear/multi_objective_knapsack/{57151a29.svg => dda43991.svg} (83%) rename previews/PR3838/tutorials/linear/piecewise_linear/{f7522d63.svg => 044a3b21.svg} (84%) rename previews/PR3838/tutorials/linear/piecewise_linear/{b507a7ef.svg => 16c489f6.svg} (92%) rename previews/PR3838/tutorials/linear/piecewise_linear/{a7de0b0a.svg => 365cf2f3.svg} (85%) rename previews/PR3838/tutorials/linear/piecewise_linear/{45fcbf6c.svg => 68c98407.svg} (80%) rename previews/PR3838/tutorials/linear/piecewise_linear/{f0ca95a3.svg => 73500721.svg} (86%) rename previews/PR3838/tutorials/linear/piecewise_linear/{9bd7e877.svg => 81ee56a7.svg} (87%) rename previews/PR3838/tutorials/linear/piecewise_linear/{fd1897f7.svg => 897bf5b8.svg} (78%) rename previews/PR3838/tutorials/linear/piecewise_linear/{bcf7d56d.svg => 8ec5e5ed.svg} (81%) rename previews/PR3838/tutorials/linear/piecewise_linear/{a907712b.svg => ac0dee02.svg} (82%) rename previews/PR3838/tutorials/linear/piecewise_linear/{d32c72dd.svg => adebb149.svg} (94%) rename previews/PR3838/tutorials/linear/piecewise_linear/{f2b7bb48.svg => fb69c516.svg} (85%) rename previews/PR3838/tutorials/linear/piecewise_linear/{b9bf8efd.svg => fca7433c.svg} (82%) rename previews/PR3838/tutorials/nonlinear/classifiers/{32566bbe.svg => 117cc728.svg} (62%) rename previews/PR3838/tutorials/nonlinear/classifiers/{8ae95394.svg => 15748a25.svg} (73%) rename previews/PR3838/tutorials/nonlinear/classifiers/{5f35c36c.svg => 197f6567.svg} (72%) rename previews/PR3838/tutorials/nonlinear/classifiers/{b8b484f4.svg => 25ef36b9.svg} (63%) rename previews/PR3838/tutorials/nonlinear/classifiers/{0e75b6aa.svg => 26a34877.svg} (69%) rename previews/PR3838/tutorials/nonlinear/classifiers/{f300096c.svg => 5bbfc3eb.svg} (62%) rename previews/PR3838/tutorials/nonlinear/classifiers/{8bc63f07.svg => a9d36cb7.svg} (61%) rename previews/PR3838/tutorials/nonlinear/classifiers/{3499be38.svg => cdcacde4.svg} (62%) rename previews/PR3838/tutorials/nonlinear/classifiers/{3d0bc893.svg => db428a09.svg} (62%) rename previews/PR3838/tutorials/nonlinear/portfolio/{50a8ef93.svg => e8754326.svg} (79%) rename previews/PR3838/tutorials/nonlinear/rocket_control/{1befcd64.svg => 89264e00.svg} (89%) rename previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/{573098a9.svg => 6ee659b0.svg} (88%) rename previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/{e1cffcfa.svg => 730ad8e6.svg} (88%) rename previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/{44112ba4.svg => d66358df.svg} (88%) diff --git a/previews/PR3838/.documenter-siteinfo.json b/previews/PR3838/.documenter-siteinfo.json index 6bb437f047f..5f9f9e063d2 100644 --- a/previews/PR3838/.documenter-siteinfo.json +++ b/previews/PR3838/.documenter-siteinfo.json @@ -1 +1 @@ -{"documenter":{"julia_version":"1.10.5","generation_timestamp":"2024-10-07T01:54:07","documenter_version":"1.6.0"}} \ No newline at end of file +{"documenter":{"julia_version":"1.10.5","generation_timestamp":"2024-10-07T02:14:53","documenter_version":"1.6.0"}} \ No newline at end of file diff --git a/previews/PR3838/JuMP.pdf b/previews/PR3838/JuMP.pdf index 8684babe24b2f6142d059a8f64282d9b0a283e8a..6fa03c4a3790ca9a2119089aa73a966b049920aa 100644 GIT binary patch delta 239880 zcmYg$Wmr|w*0l-}lF}vJDJfmj9fC+ocXw_O>F#bMq$LiGfOL0vcXxdoz4yM~j{^_; z>{T0 zAjAP*BXv%#pu5{e3vlSPQ9o*@DiKyjv2Z3a8L=Rj$uz8)f zK^spbBTbqLH3lQmT7=~_P!1-O<45a7GOk)|e<74i4zE}69Z#m&79z5Xn66Y5D?-Pd z$z3S!un}ldVL9db<0W||?FH$CD=J#b2>`Osa}~!|)yN}xF-v+>|KzW8;quivPHg4U zkTzf=6{Sm@_;I@#xk~i1NH-ai)V%T8jLek_94xT5+%&+@=_o9ENa}z!;@9>sWwK=EEt|-l(fy{zidqTWU{PHcI(2`CK^~;%?FV%%=WRO!j zLW!Is*p!9-6p9*Im|rY;k~K`WQz!mF`7ry*u*KXwei2!zU@c73EE}B?Mzd8M4cWGf zj5f>r;ICvHopW0&I~SH`eZsM}#KSi`dl9l8S(3j_Id_P83wEXenI#S#u~NilC5hc= zAT-s>Gs8bVgKNk|+=Yta0ULX){%0+++n=v zp4`!xA=hdR1A5!firU!iliAvLcC%d7GNJ@?A?O`3x#g)1b-LfH60*xTx^=NsCBA<1 z<&0CVZ*6vrFT;sHS7nepPmcC&;Jhb+dpAbX$L>m-k)An6MMv^-82;FGU_vZu5Y^5T z&0ac*mOWG;yX-A-y8$oeJ2rtyplgdVd=MVJ-F4z@5B*q)LbnQQ+cB(5x{yu9wvgh- zm{N}DwPd;0k`B^bp}15wtXE}ONsZ9CQb;B7;Mz~;xLMm|Z4=y_E}L_VFlF19A+ror zpXNm8beEM&ykg@ikjMuc?z}bKDR^Z&1yH(?vf&naQM+No3#?&IqsCl`0iuGV7pFex zfAIXiy&8YtB=Bki*F${JD9-)>(}a2JA$zKeAx8ldH9mf(f#IXgD_zqh9&=nh)K&)i z1}fZ_Z`2Pj(~+1x6O$cOy~p>tcD}=4`E8E$h`*A>g`g?Rdn=_O`)hn3sSi8!GE6Lb z?<_pcKqHMWO+AUV-%xU5H~~b)jL`GBYFFoOSbK3h4evGluzP(kQn3cnGW4W7{`nQ& zbRYw+Q5_eL?@4g^9cS{xz;7O#`WKC47f9Yi>?gk^-^qXaRd@J~&%_D_B}^R$n^3do z@gy@_2!8I3&5Z0tdl)te>HeVtJ)9v8Ir$rN-6*8_l4LC(CAJ~#N=+JI#X_CxiRJCe z7L6i06lUe1wXzwOw-~IR@ypaOi$Wb1hqIlfqov2wizDcTu{(g2M#xVPs#RX#`mLW5 zTj!XwS9rxvQ<@%47JWxNW+&O(*zoF=y{eIIXlnJus>!2@I4o6dGN&|j!8!>wXa`x* zfbNRwUyVne`V&8cyTvd7_EqKeHqSM(3#O)3{l?oZVX3A^F3V=w6sCO@{Si?#Cf2pD zJJth5#B6`UVg@UJz%x)dBGtQ4a3*V0sk^)5o6dh9!-(AW%PB6(qb-@$ROfDxMn9n? zkWyB$G!a+{XjL^cJ*JU)5v=HwsQTjf;sBx56Y$Xbuvj>?b(nqwC`f(&rgVIs3n%7_ z67^Y1u(Qm_l9Flsb&d3+tb21~dmKf{K)DZm&^?PIt>IjHvaL?36WoiE!V64f+%w@V zILq(Z(~RMqip?1KiS?X%OEsD&t~LA&_%)x#y=RNKYRZb=A#`NTRau%(&!{&TAU|-^ zxjT6nBWvE;QlFFLz4}!&K&ohv>fYQ_VPQ3_s)@R9Ho1 zjH;Ptj@o8bxNSIWp7shD&n1g_Xwjzrl5~{~{P4@qRj3+kh{0}hwXVY`d<*!oWItg{ z$G35gf${P}&E8Eo+6L&EaoAYD8aHgA+f@`rptdCX5`j!`1Wd!>aP}lrUTh0$?JY-4 z`2}NHiaj1p_>l`c%tb%yB1k)s$bPS1as76-Vbg>WjsrVZ2f3iTgfBf$3zZH+v~S;ySEO6+-@+CjM8)H%Lk>)qzdCU-D+!*bwmH=&9)z%^poy_x$fO#g zW54rT4eJ5t3$O1IawZ#^1500q)(^-PRH?_xEpXrsnn(?tiu_`%bNrQtBA|C`?<}TV z7a`|zerP&Zp~NMh=w0f^q$sM|nN=Lx?b1!{XV-DWJIw_IPEtMfUgLV}k&`3bw{t+h ztQzhOCv&MLvZQ<8+yCiDKbKY3ojO9pQ77ByX3q)WTY%x@yB4zGFUfu1HbT=x|3Gyr zDs?(q84?W5dh{-5mxM+6Tgr6hzT!+>Z*k&5?&lg!og{78cIiAz)TQ%sQ5Rry(H)83 zQIk2XU&LB3RgZnyimZ(MF8r!?aASct7`?BG&I>?=#eli*QrKpG>!syFH>K-v@zv?4 zyF~ddY3BK(@DH*JNa_rm5Gl=}o1mKlMG2APhn|E5N;RVCG-8QVBX~8^REJbEouNiw%o=dpA`TbCRU08X__6Zw ze#-FRlHZ(N`$ETnKV^RK?Yq@{;JQ@^zJ##R+b-gsqtk60LrozOq+Gdh%x+Xso0X2z507xKMr1&q*{$XDmA*HfqrxMJ3&yE zo0x9r-luo(6$bR%;+V6wLhnvjnH~Eno~qyDO{E7cXrFFb*hsAT80e>RCMRNOtwt{o zil;oz3N~PPUWG9fA@uQd?LRf!eJzN23xf_p6o*#zOlS>-rh)|hfhK?jm?&b!2RIHV z&h^W`m4x!&*;j}%PF9M{2WIYdI-#q4zzOi5GHOfvNwH$7!-`)fdCrUe8atp`&=Tc$ zLL+;_@Q$i?gHJ6=`J0g)0TJ_}Owr?8X>)bsZfFBiLT)^V2kN^ICHksJ5TsPfHd zLQ`Y0Ey8N<@_)6F;^zeG18VCS0`&CB@c@I>+eA%?40%SH6?KcY`Ro@vHAZS^Fr`9{Z+(X@ zGsN)=?E_5BC=Nm=g_|pdSlIH;Et`F+aC@x6%ZLm0yKVY+*@*=KfP#SVm&L-1k{4xq z-8P8F>Tiy-N*2QuA2{2;IL}H|Cl&|QR!pfeYNu+*YF`n2b_p1v5b$@#f%clH;IA^O zKl#%BZYM23s>nHJT2*$?VBz8SR;Agg>CCOaa=nLHZ+-bEJACXAJN5iS$3_$ zxT2KD&JFY?W}c*{JK)dSfIRDKox_6JyT;;@gQTMLQ6A|4g!5d~Yd5E90;pMc7#vsD z_Mvc8n?5yAQpdCEP4A7rmZZ_J*KwAq;Bw#()M2pQkfD4brhYj&i2Q|m z<;CrwTBcIl?eRS;R>3tK0dF>(Q_M6c3;)k-6qY>+^-g`0oC-i!rOWKM?9V#D!~AR$ zJ#3dm|TSUHwMO^s%MYEnfQDH>@tc{MnwM1bx5mgNd1Je0Z##gf;c6+)Pr>05ZQt5--7F;c^5IeRs`tw8j2YnZXCBgLh!iNl}XvrB9hTE;0PS#*~ zB>wLk+GzNGpJ9^2Zi&7i82dR>jQJO)j^^^JxSIr@X`w?gD9MO2vwRWKDykd4#PQ9Z zP)OlQ|4rzwcd?8Y4!@oJnIJ7hE`vPh>GkyH_x1$lDQL`uwLxf%m+a4YK?P{Y#;j4I zHVu^x6REX{e;`s(EIc zq&lDVkRNBG&@UV9hZ7M&!8G7CbYYdhPX`eg{?bwJ5)tx)quS<#`%7mUYuP}()A%S? zAQr|&>16}cQHC~o1Bqz)2}^oj3x9LV{TYj6uR2-oSv%2^j^1k=iqI+FU!*uZ_t)mv zx2JpKW(Nq{@wZ!D5M8BH{PtbUR@xF#ULO_7Hart(p+vPfU6uE?CQU$$Q55|b)=Fx5 z`pL;;)Xb#xDzP|?rO~nq=;UPeXaS}x1Y(awHjdHxMFu?GZy9w(cQ31?pm&V0PLx7b zu9~C#oV3F^{9X;q=E&j;g%pWsR1Dvq74pbWAy6U(N3LF-VRPL}I%X7D{@GX>KXpG4 zMFvn>x=gey_Gnadv={)*;RM7!A>}Eb0S9m6I3nB%e(FU)v6 z0z~rv{QI2SKV7nQq44hQtVxt7^F+!~1Vs5Zm&UEVko3R%9R)Q|arl1dVVn#o~9 z;LeS2yKC;hs5_n=YNK;>G2eSaed$59NuOaWnVvu>!|#0*YWy|t1q-w9Lyya<9uGEx zgoX^9E*^qiiybz=U^nYen4=@i_Fjr z%KmyeYZ|B{3saC7H!p>us3B#<$9wVyIk59j?;Fzet6MB?sAxDIxsp9r57ckORvh?! zPs~{cR}3lg%o?O=GTrT?4hwB{Y%sH=MzIK0$FYm`oY>!qEfgZCv`~u$O%EjxKBUyz z8Q2zS>LWJg0tmb#Z*$DO!%ubIWJKJ2DL2ST^emAXiuJKiwn|d+lbI+EEnzdZE%;I# zODP2#HAvw*7z9{Uq zhL#W->->|{v=>v>cf5o^Y@O@4)kUe|)1wq`!-IBf43Pd%QiH!@O2f`Jsc;gCBl5&d z^kF3^G#^)#acE#5(dn-F8;zN6$r7Bh)Q0Z)&+M;nawhh9^c{w#;%zV9{rjF7m#SSX z@s)yGl`-=LZVIE!yRKdQjH`d&7DlyMR>$F?o^x{hR?$x(%oU8H)y#>zduscz)O!L+ zNDDqc29J#M)#^t$ws|0m%Z3pQ0}F_zkR!Up-u}Rv)=#Ec=ZH!}QHG~Crb&f!7k!b* zk??~Ykx~?~Dk1wcRmD&AGIyRjt>ebgmGF6#5?LF(a?%{FRQj_AcW?3-V^S^OI|`X3 zR(crFBjcvz>;8Sr@%*@2+XO%fxif8r&Ny2iKe~F8o`^fh;gXFmHuR<0(zGRlKMoq! zQqKyeYVHJ6Fw4t-@r6Qpn_5G+_(zmX6mo@!@Uj-~rVhEG! zwRD6&83$J)<>EpAW*HDi9$SRSN2pycG?#t-$~pq02Zbyh`K0i$6c88_IqF=h*!_2a}(Q(c3Y; zwbk^%zs8#Fw<8Rp!4;LR@hyitKrnl?#qHb>P`z3DwzJNiA9K-SwZ1H8q}c9Jmp0Sz zLFiyWB1_B~fFA_71&XLxv^kNKr9}(dcM%G>gL|fW^7?6d6N-uT7&@D2jHA=HN+!Fb z2s>5xYQB8rxkZMT-HGbmFPzoCFERmY$*Y+2B2M2EIgc)G7gth@K5^GXH44am;=8+4 zVWag|d-^pyCK96L74}I;cBG0m*tx9Y{Dt`J3*O^KfKePy={sleLQf;(`eY?HiKX9< z@-+4B*hrJY@2dEc5^RpIn)zZe8pWGlDd&l< zOzY9t8MG(B*HA45we&toL1t+R^lN#gQA6O@tK`H2WL5+-MZ2Hmqhvy!C3&&F+qo1cT4w$OJfD zQMGi6ndGz@sMeJqY)aX_a4)ico3#sizxhS-oOWm;RPW|yK1_X0&jFgu!(C1@owkJ& zMI{U>t|@G&D(MOKE_K@*0uqEZn1td8DM|?UBJ^um0OWgmbW>(E`tN^FiljW$P206- z2t(O^9F8q9V_Qf5W7n1n@01{sOJjsZlAeXm`(>a_NqBdb^kvQh}Gp zM#L~LsEf8u_o2#1hg}z6c<6jv2#u}n6$yBije|BrYZ_F;llo-lJrK&ThLEta0j&!- z2gq7T%S1Kn2lGXwG`rH#i|SdA`+d#=U&50mVlZXP`18|t7q-zmfo>!m8& zFVzhb!o!YXiPd6X#i1K}q(cysCR~rg8RQ)n`136m6qJxnYR9rMz0r;|a<_ySzWy5Z zEQxG-=dNrAoSvb##A~|GS|B&ZeQ4jm*sv#Hxe}C?)XL_}Hpp6QyiYYI%#V+*7+hVv zIWM(X7n-@ZjK5V%7my0*HpacCI2F;zdeO;s)DqE9acDS{Ad(N+G)>%=@_#@!hQXNK zPW5f@jOFahv>uYV<>55_%6OJBke>FtfVAfDBi0l;fNnUJN>zGM(OD?PnEZsHg-lSs zZSpF3KU_&5PkOwa41?hU>Dw3mpXk_hmi2qPJ$WD0e$)L3^1eDCev?>nA$fMdKB=_F z$L3x2g~wY@GU~RBXVw*+!$ve|*=3VSHrwayK`Go_;KlF8a=A;No}R9sU4y-eshUFg z2T?-!X@GN9ie1ScZS$1M{ElgQTO$scnJR6kp7}WRHIxP#y|x9(0)4L7H5C@j34M!w zC1?70nb}w}62HA)_J*7})Dcf2lAT*Sfv76JyZrJAb^7jvfg;qRubcfp$tsPN^d9+nH*UXdb;M9nyOnVX-3s2 z%_ODF1e&gULqyEcy$B4B72wWUfWc5`^Us6Ugee(++I*Ph90Cz$M6TK&Pw%UY5Z0;8 zXBFQ~oG#6mGi?M9cTi>XEayvpKmW1akG1DM9;}>*-WYut)`_f9^h93tt;JzDIyM!j zkcTob+3; zHqogP%5z>*0omlgsH+LbFJ`@=!raJzr4xmyPy{(Y?YLZ(CG6exeXv$?jORj9bvSBq z^8Ud2_&OXr?2!HiD_Z^4&_VH$nEhy($an4%ioUzOMJv_5JIizGl$S{_5 zg6fjl4qR6Y^tsE&eVOUQe-c3g=aDCPtwt%R9Ilx#Kd!;VGgWDaV3>GSJ;Cb6B3#m89uP{5ugrKk7Onq%=YtH*+T1 z1F;h9e%!bqBk=??FD=F3$DjI|6LOY9KXujTq*{<9Fr!U1c=kD!;tZu`b0ipy1)vHk zx&p_4pClVh?$nl$#sw}0jz`bpDFvbBlf`jfKyiqBG0ON$Y328r5IDz-T@9!nC z62zofS0C=o1*a3q`b-Bpi`TVF60wNj^Kl73;l`ECQQNfI{>YxxexI{0D5K-dggOkM z*(-|EM7?Hlg-+b6!Se(x#CpbF5%Ss+7w49Xb3*k8V7`<|n&mfwBX_yPRZ?BwYSN;k z?&yNU#z0y(ot3A@JhUC0;ryTr!aj{^)!en`z71$M5i)vSw$>39TIwj_M4Wg>}5#z4e@yK4zb;uXuIgg z*JvcN%aB<$(-XQb0s#`PDYTq=?&Q>%8F>j$xGrB$E?Q>|op1$>Vv@Vy7&99uop86R zCMNNVxy6K>dcuIh_x*J_xZFt(h>7t85my@p+m;K+!j?bggyJ|G=7iE_7Y{OlTgxLS z1+54&Omk?ah*#B#_lT)jh!Gz)0+++683Idus>YWcLgNp4UuOTX<3UxYbtA~sWVT+R z7VeuF@;2!?5#$N)ou3RR8^>zo*n|l9j@cW{b5`B1_eHX$SsSt}PE!kRtQ+a~RV8yP zIM0pkY3n*;n`IiDFgqkm|2izF2CTk2@N6L6v%^y@T@5O7GEE9rd2V61vc6PW696jfjecl`I1g`O&z5V z_wgHwXH9Yx?CONFh~R3DPWxl;0ti`G_ogPGOP)cn`* z-hs8%ZX?#>6dpDCoUK`oB6&#*2E{v5BOG7y*@Dw%Af^h88g-uAu%^>F@EJIzw zOOlt9aYYI2XCzz9(Zdk| zkstdf$GSd3`2?kf%o9A8(tKk@Jist{yhcCr>P%T$T`r%x{{SFA@Sd(LSTCTg?B!y% zskw-^B}(ek+2)Voo zD4M;L@mG_-^(Lu&`_bZ@2Dz?kZN{xJ_10e>aa6p`rq{jmTp6*)@|ye5D=*WQ$Dhyo z4WkqJSy~GKm;yCqHxgyzwL?m#cr72zJ662{Mx1}b!^Gv(8_kmh@ZYa4{3hRoa3>Yj zqMvCXB+C$$WAlAE_NBy6IpBs?bYRVVL$3%Ac}$C#+Qwe(D=yJu-i zkH5O_Op~Q5OQQJ_m}F}N zzRjW^Z)tw(c#&atin(4SfO|?KW(lNv-%BU!$Ja!@E9m;3V19z_!*^0Uzd6QK(~;7< z#!7gcNCqU7F;#!n#U}hUxlt!)eQ}*=omYRC0y!Ri>u-#|+s`8Xc@}$SQQ+~$F*$oP zA1+m|mqy34DM&gV$8sZDex{pZ?hslSz*hvdtjEPmU%Z1$jNbMP;|&7uUDxF(J+$cbd!&bvAi4 zn>W80$CjNn&e{`Zeh=7K2xaS=Wcgt9@smw8A5yb@ZdkWk{*_E`Qeyq9g_3Glz}ci# zQFdM#q2XLA`Qqi=<@^uowceYQh!C2v1x8H02-xrI zA_x$Pr?wly#WzG88!eX;KjBxcf7Lxf>BE*MFx#r3Lo%UYR$-x-KY&JUe?#>}P5CpF zzpvxxJuJ(;pZLb_Cd{g!T)M7F)76<2i@-qIRqBtL{2FWIk z6eJcjpdbl)YBdSw3`Qea^CTk7Na>T6;FoXyutiyS)tVqQfJX(mG+p1_Jw044sa|HD zqpS!_eKM(57bccJt$HnDzw5xQ;XWQiC7;e}93ID4Fh2e%OsqYU1M})=i3<9ZTwa5i zfq{X7;x)>uP^NKr4DSgs;U8bYp-3v%RUzI$Sf6wf`O`nXE~qG@tltIG*Mnfe7jlig zd3(^o5xf#ZF96qQDsYHPWco{RI&jDdF(1^rWI8xxRmcqnoU+8%<*7Q@vt^~V7?qIF zYciC}>;AeYhH6NiCMqiG9I**$-P8^Z%DKk~NlLZ*tAD!%_h5;1u}~Bh&NuE{%DZgO^7lO8COQ1YoIdZ4vtI0eX&3#s_mAo8raUHV z`UX}4loD;PmXYE7nG9p%13zhSwCQM0^?4^H+#XMH3X%~x5sVwfDESp~}AIw2M zSWK6jjARd_eCRV^@uwinh4}E=OMIKHN{mxpt6^X+HNENhfCfQ`AUC=Gf^{WV;_q_I z?y8^$9EHd&t@osqNra)iX<1qsxWZc>(8)ZK_myEujERZS*^6mwZ~yp1X+`KcCe#pi z^{0kHA0`fbK-;s362L{u4wg!Q;J2MDVl*H=V+6nRVnW;}&%3_&Pa^>Au zyJIlF!!{|gx|YkNZE~E>j1XLYU3v+Hz_w5PrKIm_}`l?n6n$jhzYeH`Rygg&w3WsMwmpFx=4Qu8ifREx$ zCucQO+%pe$5AhkZ67*a&uAT^{HIdV0ry&&?*;<(&n$3_>TB?}gRG3O_Z^LP<(X(|sfB$>>$p1}gie)r#0>;SBuM?x6UrY$ zBI5U$ueEhS1>>C|AvQ!vX^LnRLvg6uKxtHDYsWDeQaD*4+M=s(vAY(+wbP1DC5J(+ zy;(=7iN!>(Up_>)ytTEpy!=(|a4bJUR~-U8Jtni88_lxN5n^c8+O&dEv_4j%0f`WJ z#6fxG8lCT#UH_H<*qQ!_Zc9gp{wAF2Oq~yhkkBfDD#D=ReumJ2E2T_O=%nS?3}t<< ztff>re{ea#xJZCNAZldAR7N4f$*{--sMuiCP1IOwRM;&xx?Wyh z!k`4pB!93b#K0goik58AUMOExf0_9(@{?n&AO9i`a|PkqbCY)2h{>P+Qt1Rn;Sevc zi11v9eiyR1xVXIh5G=~lyL4_xGcb^_8PuzskF-gWVNqI`ne{tEL68k25_mk{8Iz9Z z4BaHgpu@}9x^!n)76@zK@9Pb_V@W(T#eq5A;nqOovB^KY z_qW)91wb~P1AN?Nsf}7WyWt~u_hzcoH~vtlTHW(>UDCD-N*H!Vc12gCCPF5`3g=uqdz);*2xkL zzdt;Vy9R1Yjjm_Y(`x@#5W#?jhz;OoOUrp|XaK)` zO)|8VHMWzTogLb>GEOW*!20U45~J1=HJz0?hBF8x=8`Yx6uNj^5;Yz7@IGwC!pD*XVY zU_?1ghJV*Ki-urzMG#>l;B#1@;Oy zb~>0$`liE+GM7srA@09qr7?3 z<_i|?tq{p32jSg$ItFgu6o@Zu<(kk%(;iK$57${vQ13lO2#5k;*<)Hu2Ej*{xlYsT z@!oZXY3&v?5ey6r-njv%e@fyNe9miV=s-hj>m#u+ydZWILa&y^ZJ`Q42t?tqqbuC- zDF#l*-Poq4ro)vTde%YM3%8~d{42}3ns$6FWorWcjB+}gSw0Vr9HQIe=PQD(F{*X?n(C;$RtaLtFZ1Y1fub!15 z#OP&pDYsr~)&WuF@?Z{ykoS7xvrb)oeQ+G;&a;yfX21d$9X)2mw^Ki|v!mnLK?4Jp zSBDF$^QeNE11o6xo+nfBj^p@G2b@8 zQ#OTzoj$U5)z)m0%-?Y@K6c(Ab;cFE&Rww( zc{NHvhDMdwq=FD5`EE1C+HA6TXJez5ruxA+jViQOc^M)#{j4eO?A-FAP^yUS|J zIn{n{B*Ij%&>t7pmexLm9-%O*l?%@MFlf}=-)v>*VI_&8)R>G2OMIE1ZF0XlCI;DP zQr)>yOwQ(0F>m?IA9R`LU9uI}oNW#~++98GR}Qhr=2ke2o8a~aO&ON>&?5%WB5g$)V{n!I}Q z0};6Vg4eNr+VL)3Gj~?TgOnjCX@W!YgI~E#QQS6_xSN&tB?XRyLp8Gtq_O(tY%Ld z*hefv4;qyEx;jf=f~^D{ujj;>mPFmRTJDWFsf9Sso~x%0mhND8?du-=-++19xb(RcWQPy{A_NMPW5O$QsBX^@5F zS%Rp*Zq%PxJdZ~R?FQPNbxQJP>-%`!=VV?|=Oh0gF2~0!?Rv;2jnnz^MA+B~GIO7b zRApsgI?85iEcaGcNC^KkaEwLw)s8J|T$Xbo4fIwQnUd|IioH2n8BlzwsX|56t3D`+A zQ?6RyqwkEf9i;Q4>TvX8Na#DV>eJ1mhO!f1%;W$gI7|PrUQTi}m!^hKF_)SOl!B ztn`4D?U5YOV2q#$c>z9K35o71(=kMRI99M2($mmL7EN64PV5B`dHwbk{2TdE(8?gT zptKMzn`@sb_nj<*i|m0!BTpvjmto)GbVYmlC`g61o80^jvszkxVH0RodKVX)^}E8s zH0l_NTEp_1yd_OdjNqbX|X#YD^ay-18)sH>M z?J3okeNMA$%h>Pw0sij(luTI;he0gSS)!>eX&Ei>`+^E7`h zG5ipQh9O|czlV>8_U%7iJ9;tCP;SiK6YfZse_sYJMIt|u#V|Jq2iAW(bv4^`$*wD@ zgECCNsmFfYa`C`A=*B=}$g#`PTy< zn;pJgNd9k%Cyj6X_WG)F6XxTpxRn2m34W9&4hE-#&_orvN!q{q(lfw%L_q_NAt!c| z`CsfI%l}zztCFI&lijJLL9P7oe-2=+gdSsKF4EGQ8uG{-Q}+aq4E)Dp-=QaHZ%%2z zx@IBtf2YfZR^I5Nq~jQL%^aJN_&*DkK_|$C&aK`EmO;|~H@kACv~2Jt!Mm-7={)jh zA?t7E@1V&@hHAg3^_o-Ci219IJtxX;v>&uM<-WQ;kn&#x&Dy2c|G6%x`-pxIRL}f( zR!a`~gNNDzu8(NR^+ZbFU!rM`A$iKT~S-vC0yXI6jb^6bRt{$7i$Z>82wq z!rvsRP*DG~_56|zP#Tlpz4bgT6p%#u=kl@1)A8=MQ3@As@9pD%@oUK-FZ+j~PE=vzfot1T5dqo2x!E^k9XDR$F zCk>81(j+1M-)MmK;_gkWiaJPK#yYD|Ynwq=jr3#Qb?vw;I z%0A0~EV(&SvY&%g!sa{6?_54BUZc4!VI43 z>&%%rIuDiSECE}|n0#5A)AgR{u-Um1sif^@4ja8E$Y%+PF(y^ZVVSZi^za$CXWIGW zS3fAbfb-@;deGCmP(F%nWRwFHdlpYLIZ{AbwDhFOANeE>f$!hHqdpG-iO^Bw*~{YYrKSIW1Pi|BIRv4}sp^s)Pmm^vTz@x=w^E0EWvocJ*FSLHCRa^O^83KVK7!X%ZAD(oGJ5Tv-lC$o-G(4^oc0 zJMuS3NCQ1vQ8pRxGmkUNN!G?_`L_4==D_B**y2lto@hIj#Pbybq=$7YC@}E4*#3&e zF?kNMtDYy;?$s`~_4}P%jCl7vY%aidzR~h=;JOL}#jY71Oc&pqEgJ4}P*!zXd-8C& z-<{a?fSRlVOs*!(A98-;w}SG1v^?y4{*pysCnqP@N^cQTkRgDXI;7d^zHlq7m2b?O z6m?CrP`?GLtU6;lGW-|$okXshXl7;j$x3zkjZ2Y`?&$>x0w?9#Pv zPub#P-jlw6gumQTe$X3zkJ)dq16Uv~Ap)*=xa>2METc>@un3MBb%uRd=sXH3dDCo6 zZYw4S51gI^&!TuQCtFO90p&ei{kq7_Xi&wXm0NZ2$-ny*NY7aD z_6Q(x!r@7Am_R`nLoP=p&0!{Byn?38VOcB#UO(IqVxq`6xV`HH{!WjI5}j{)GPm(0 znSVI3_*DM!iby_#-?B|Zb*YIK#A}!F3~=ts9x$DnA8+@1vC9(ni;j*ad~MB&G+>hgavNp+TYpa9F+_W`9KWCnjGMm57Kb zp|7&}p(u^@bN<-O+#EiCgWdJ9ZVs%U=XU~7g1*aul!K%hRIqTFoc5<}K`9yc!}V4M zK>NAWW1|<-HieOq5!5C;T74R*XHDo@`URy-@59pmas33~D^g3-&fP zU%{4!bv?;`sI|y=3?)oJeRIOg3 zrd(%d=sAg8ZUZXpU|WdIq^+sBF`Ok{RtpM@)6JfDG8&~iEzMx8{)-}b#DKx{5dm33 zp>&ty*94q4%V8fDuaDbNV3F`X{W6fu%A%A_o}QTr>RITk@w_}jBm|ygR(9<-TbN#Z z@wTYGqofoVKTnc^f`V(EVH6RCswJ~vov_BdwcW_rd*byOG0?K8IF;s;8+;(;M zAjrOb`?l`70Hl1NWfo3DgJSDY-mhd;;%3yW3E98+8>2Hqo_EpXb;e4=gy0HHqAo7i zU;+VJnwpdX@c%$V9kpi*MLNyB&`OgSw20F6_4WEth7M^I2JNSUKQSPmc&_?}nNv$B z$Dq;=A_>{^YugU>px)+rG4WYX$^C!& zLNfGF4}g6Qde?k7Q%FrMk&D;t8O2cwN+mIJ{!1zZT1~UG%d+AXYG&}q9o_xKO zl#?4w`A}9KvB-N_`qu|%qT3E9a|xoLgdP?`DbH(yhM0lP=X{u&^qnc2yXB}zK z{<%=5lMHE!BqU=rO!B$4c2}w4f*0cWFaLT5W?Xm5aO|$*NK<#y8h~Tr|Ia;!Ycfs~ z|4F${uKralf)BWDow2YC0bp@vhU@)%&(MK1o~fJvE{%LoMS}v!ztud#)cTqgI`jS9-jk4!oRfex8#Jc72@IH`{NVL8cq#haFM#=`gC23^ z7cQkN5=8~92g71BYErxMgGCp-u6<@dtm`-2ppq9Odt}c3ybG+|)(~taH@@`}$YL^^ zY4m59`}_MpvHy>&?+(QB{r;~MQF<~O2-zvJMOMllkrhHEWrghRRu3|>_uhMpNJRF? z-pR7bDit;dY$vIKBnM;EvK$&ZQuIoZ~ax59~*K0 z@K7-kk+8-@44?()a@3aVU9}O+YbD#aX90fErfL|YQqB^zqJM_sN1-m#7AK6Z*k5ff zmctzPVRZCg2e(|=1(}D@5C8%p2W$>C87||(tkCne5h3f2@tIK*()4;n+Kogl?P&Gv z;x}W}-`wztknh+2yimld(s0=g%Y&b@$2S_pfN0w6HkrMKrr#X;V z)Zoz2(%{E)e@r9mn!SLrZ4u6y%7e`(Xl(rI>T1mDfsJXefAr5l@}86!1Af#B-T@EZ zi8_z@_gc>mm;n%v=GA9I)6RbeqXvNa#lofz?!QBNbp~TG!ZoGgq8Z0{Z#jPCSaI>< zvuy#!Bs&!ATU#TW*Zw?k?F|3mm9p;MzuyJsv5jw!@Q)z`eZdg7zYy(zq5N%8)39Bn z2hL=F=a-}n@TMF26E?_hPIshfdD95d3C)3Qxnur%-}{8*_bqS!#%4=r5MF zWeA+FVsv*a+JhA*r5TRjWtbvJDw)t@0!|EnoI+p3lEVe_(qt>oo;{0O9tFPSuVu(L zVaBri(BXnC0C@I7eg?)H0-ji>^2V`kgzFsRrOtS;31+vU+xE-#BDsxjYn6ws`68HT z`NH_m@HZ%0)@?iZtQXyXe$PG*0Bni;1DG|2j}ly}H0#Y$JARd3pZoD=&!6}9@UY!| z42O0wMKgUq#(={V-7^-j8QctR`b5vhX1X~)03JDIzYY;0Ut5QLAoZ#Bt*$uBbStdp zijk>A7Ub^8XY01@Cp|vr6#ABcKI+FjP8((LanPSe{PImDiR~QlFSmga*o$EoxZaCl zz~7@N>o7qkzt=8(AkB67lVboE={Miuq{_^0!wi*7*KL=>PTwm{7awjf3^Ms|u({I7yJO ztT;d?l6*HXJRC06URmCu{2vD}kY z;T*bk0(C<}Pi$BhkGC7$tYEcsmqYE23Qg)+c!hF?8gMz9Id^{O*Im7xMi~DH}@Z>bAw~KRpiks#JH4#-CS8)GszU z3fdWw+Jc38(NnnahEpFCJkI)Pu_{zp+*h~Yf&cu8>D~)*k23+espVv4)N4bZf9gvu z_cx)B$+uI;jS4|Z53YXxt{ED3F9ufQpT)?hw^R>o0mQ$p@?S~*48Q)0rBoU099L)1 z3ezzwe2;%CGfp&aV;~&}nA}R&*%Sc2f&*jbk|x7{&xlux<6dxbHkn}2tgTezRk-or ztM$a;R+4ZbN7GkX7_zA&_(@{nRuG=++*01ocArK}U^}1a!f6crd#ccV?b$8OkYwyg z962=;5cJ=}i_t3S5=ZJa-iN@-{P!`p%a|d-Lji~o8~UWHIu3wYU^XSPSsYszhk>Nu zqQ5u`K2IS3je+wVrvr0!zBt&}`#mn*e}k}7ia%<2h3~1hkl^D>_21{@7K|QX2?H_R{VHfaCDWIqnW>bn@X??L7{QwQdQ2|V89SBV8Fr~sq?Ih^!smxzf;X!JKo!8nZafLQ^G;s+$nbv|UV5JgZz`_4F^Qm_|GmF1tmGSh$HeKq3K2>sVEX?615JyE-nMHyP96GUB;;m7uVRQI;^#eN zYv~TtNQL7QYJdKv7!3O_;z4-FHGvGFktON?_ z-S?Mle++yh$QcpOj!gIVqy>}iZzz76__xuNNC??fO$hDuECFg^YBCLUsF+YcsI z);ti2f$q(<4v$3ZK;aX$^9Y+gJ6`q!fVX&#E>>AKt>3}f8{ZvOBmOn35n46n( zFq!-;FBL{(%bA#u*Lc7LEdft09PBy_KBCrlVZ9{(ad}cMSZP%NUMwv= zg%edngG92zP8AO2v0%svZlT+jf-tJ?BTve0Rv^WAFE{}Nz0Jj}kGkCk8#C*z5}$kc~cs%Dy3mpgoa ztr#D?$HXU$i)Sv7d=aGMk>^evnba5JTH;-Nibd)~kG;=h!THa9s$~d*NQkB{n%RyP6#t$k4R|`F8L%5RQenAi1+Y+1a@psFofmZM-Ts;={=|A- zp(@@Kt+G&F-Zx{m!8!=w>fcyIlu&_~i&nfYc-{MT9m^%6WE7Z=zaf=ggystoMCQBM zau6DD?lRk+`tvoTBwfx&&u6eLW^IMOK8{VHl7q7v1nxMWb(sk2o8PTXlV12*U`0%J z2p?PeI6&uO8I|)pO?x(^55sm~38xa=KVn#<$Umloj?s0Gf`paVpa1P21ub_cN7=+4 zY%|r)rWIZvrOy1%!`Cx{_D)s+!g48cD!I0)fe6laFdjV`fkfDA07Z$mugx)+3l#Tb z@H;k4yO^C=uBEZme>T$af?Lh&r1~r!#uS+ ze*M<dl0&iacg;{a0~~cc=AJEY)@SSQ{2!US@vp64oRB>G_YS== zw&Uv;uVR4i;|p8Yz3Er2cB}G-vliAb{yPQX$PsH?ON1Os_}^KyT`Zg$o1vm0X_xwc zKDJBd){1d@m-MuZpI<xc&3^o4f!8wN1ig4HM z>V<{u@Mp~RH9~i~_%oP4Gl$zIzi!4>A06K}QNS8*YVtq7-H|G0lfqTX|w zl}l3QMB>zi;8N5l%F#?|1NoMhKz+rE({}aGTC)jiTkuM?2X>i zwS3-sT`PRi55=AT`BJvYsco4>2zgx%D;w&?Mq9&Ml}5uU)BIBZT)})14&9EYc#d?_ z=eEFe%W7=wFm{2%aQo%AC`_ian}mrKgn5TI|c&nzpgkXcv7Z|pY5cQNaS+e|9s46JV}6J za2Al^IhlmH&GA}}*gGvBxv6*R_YY|sR%R73%(F2;1~6DSwB1Wrl>2sC{;YpYJeUyz zS&4*(!yt?l$u#g3NAlhEpYkA6}Bxbhh*4t?7b!M1{3?z;Mruy>u+u=?qO<~ zlb}_!{Y1AhELyHkzGH1V_)i?OjeO+ANU(YDbjNA=>;!nVf=28P5^+aaG`rxD zCI8;-$#NXzRIw+@NEn>c|Gmv6`{m#HFYupyv>%FZEXj`8L+#N!tXj_yeRY5G??pZK zZ-zoz1qL0b*j^5nu6(hQBk3?)|B-QFNjh1f@XI$i#Qss-x1YvhQi(up`sFGdnm&## z+>s*@a@d?QXueNp$T`l?<{o|E<{SU-tG1x+K1x|0H~@0osqd)MwO6-u`@{B}@0PmL z%l45TmwZY_1QP=)B8{NL{< zIdE?5C1;w>ruL<9#R!z*kZk!>*uT~B}Na2_iLQ><~CU$2%zskRc4&=Sh+wk9X#DE@1tsd-`0Pvk|uiDK0RsL4;F~Ov2(?p3{$x2| zTA-kT^BRd@d%~9^JJb^a#}DEI5lf-F4iYn)Sj|1Jkx#RImgip|JLU4I;c8r-mU-y+^h5a$x{mSPXNU&nzs~`<^121v-rwJu!$@zr5AT zwYIPTmUy3Usr=XCVvH=Rc)z?*XK;ss|F>zb-LH^Wkthu66v$syCeROFGh7 zm8hDpy|S_r&fO11DsYmku12b%oJ2WYA$bHj65yi%CEjh#%*M)_QI=nHzNqXS!9Muc zdc1NnGBNO_++5`Eh;D6;LhTerkXz0Jm~1`*lHtL+pFaDs*jA~p~fZTVR1X>7~n|<4o-W*LnNo>3;x37V4PH*fyrQi=_cvyfyMg*AS z3)gt=T}ZjlFK`L(3~!hVfX;v+`JvO7*Vj4AXF^14_Ss6N&~#Ek+ig1-{O`Ff92-+2 zQ0jPz;=WLebDL#B2Gn=V-rsNwZNAM&j-GJ`{l(_@fGR~Ai|%XTaJr^N)4!yxFna1LCKia zmEz^yg8|@v;C7zvbsnhNftZ2{32`wo&&JVnKYjoCs@Gav-V+d)dl54#Ks5@Srmw0{ z2-vM-M9@rg7G*2H>Oq@_WWa&+!-o&M)3N7EfP@5+-o#K-DND6umqO{b0vry3u>vbJ zK*5`CtfSZk`gq&5sRZ1{Dy8lW<+*6Brv-Y`5Np-M1;uHzm8P%@hb_KE-R&pApwwF?xc27oU^ zd7PxIEZs##f~!}z+k}q%9&CE}`ofJdKmvTD;$2`YDB+ z_`7ytMA@33Ls%|AH!x69E2cigob{oe28g|1kF2lrA@hSDZ^79bq~_F~ug&0K%>J^; z;&;37`3@NPMF}hU8^jo!^yLhLIQo`K7SHqQ)9kitK=1|#A%}nr@bd8JXt11Dg-_xi zyoZ{C7u(BYr(de+?6WrmGb(7is>9w$59Mj&$ruN4!720*OH5Zv574`sz>14dH-dkV zT_7|A6~%|nH9R<#x-)D;IR}TG{P}JGpDFpnoZJR}|Nebv#37IcSN--l-4@ihG*CsZ zFO7^04Gj$pkf2@#(ujWuy7hSR@L=!#1#<1wG)XJP?ku&gH}pLI*wc6he*`w?AfzWzvyGr=z}B6jsOR102BbkUaHGA zl`K4?RQn7GY0*(pq};Fj0a%6=vivY4o&OV5>G^$wc!n80cDV;4FEvXbF!vJgzXL|#kH$i$Xf`i04voF4?6;_2U9-#^9x^iSPi0Xk-vS~(Y^n0-XCBj3-x)mO zv$(iaA@la~F8U6NjC6F#HY?-c{xo#w#+z9xnbZm^psVZ$zQAFBr5@Bc><+K6wPru&{BDHx4aEcZnV3}bzUFDk z(ACUwLM>FA;GRs-O<}dmP)GIoG4|%th#WorSW7s^$&)81{A6o5<;yo?z>xuYgBnU) z+DOoA*TaxII!u97a?l^YIfGbpW1v!Mv+ z3^uk_xlKoXeSKHgTGcm>0_7Zyoh~^cL}2^k%B^owRP|72>Fx?UL2kuv6G%903~oY^ z+R78tY6G74TZmm}g6CxFO&g{kM2GogQlRI9kHQ8E&H-gm{boavklzq7sW)WK4* zod9vRjxqIk=_`QJ%ZGv(!D#;XpPo2z&)D`2%u9tYuf=b_vB!uuI}cQe#Uh8cm>L~I z2JX*hlb))WqKy1<5JNE8nQ@Dhs6p zHWvyL=3TF83)Kpai(jdX+F$de4jEwjF_%N7fsEK*G9`~#zjLoEcr4A(O zKuQu45&4qy73+7=f6H~+ok;~ubZ=)TTEJeV0XrH9x(f zx`p!=)IHN}u~&vtlaem-g_??EUp?!*u#7yk#8MAEc@CR6^pZ68rO@!xf(%H{lU9@Y zPxzJ7xyz;_R2gX|Cxx9`Xw{yvhz|X*+Uj=Pb52-lUx+_)Vhk@}Zrbdps9e|_ZK)}i z@Z5hi{$9-L>D>Xxqc=M?+g+czqpwuGdpum9OFoL_fe4Sw>hhtkN4YKjGTizV7}PXo zS=B6&&ZR|BiL+nS=1Y32;-n1@GP=`2Cb3l6Zhmxr(c@?3I75=IzPFsUrqj37rSJmB z&0YPZ9R3QAfCiC~_Kns3wR#jPAcb1gV#aWH^yrHt|Nh)txfX1OBJ<&qO2H%?F?74I z<)d@D+FL`@i+%4a-()C$Jag}(_L)by+_zQ~6iB1|su0}pEiIep zZ~B*~OIXN1uk|g7mvS|E$&kFHyTx_hgpB6?1k0S*`SQ2DL5~URZ70r^VNpp&&3;#k zVt+*DBDO$m>gVbsLBgzK+B-Ff+$o-ZRsHVMqqv4B^?=szjr)iDzjdlZJr1JR-9)nn zT$1iY_{gXi&B%qzTI#Zs(V>^IJ53K|2AM;)kFRLM5OKu3A4d@Ql=Sk zx{u<@iGJ>3pRtbXvUy$Lpeug!7E?`?;fR>`kGJ*XD;O4 zk+K)s) zDm7}wFMUF&rySS5-=8se?@G|s(;0qjuC5Ci&mN3#-s&NEqr>C9S3S2gn)Z^<^Mcsq z2EPq!6V7r~QLe<^VdPs8X}Y5BC=PZtyw{xloNr$hBck+@`8exa*g6_>AKf=`$S%3r z+x^hL7*A&x=CyAu+T44WK-`Yei7WJ)IDbai_{cS!GXX5l6=~%|ql$8*cTBf)y&r~H zV7U@l^Co=X!&_jmor)3D@k)NQsV|k7@cQN=i=w30#|3FyK^v{Ib)~6mE3Q>n&g%Mv z6y0BlYYjs}HpjeqT84yiZY6Bs$7yojeGJ2ocef(oCq>8Tb0?Xx}9 zIZ_$A47WQNyc>DAgT8vj-ApyPXk#BvKBf0Ns42YZBpYIJ9`EMQk%JvYq0KtVXQa6%IS58dHdhc<$n0|3WzSp((Z)J|2a@|u~jf;5aP|7BSyX+vZ-fpKv zQZ4`R&IpGJ`#Gx?XO8P9pStOqio}>MbV~kms4^Kn_h~Ml|MlIOfg#o$CPOPfv%XHB zCM0^u(>Rn{Dd>KDgsT37=lvJ1dS>@>7mH9k9(>E~5n{rYb&_#1*0WO#t(U{*IJp(N zCx?9nQ+Skwo zxG&z+oDt^vv1@q$y+B@D#7mn59!xGWEe{Hyy}t< zYvbMFB(Jl6BA;1%%e#1KRB+pG?w4=;@V|Zey3l zc-@i*2i78|y)6qVa7hR3I%euF|HMG`GE!cl$ zBv7G`>e;$wXd@fEb+F4N_ktRWYEgf$Bsdpn^`C#yzjp4 z_KT1EH>_V2EcmooT*M}MbF;5&wb*TS^Cdc=P7QA)C-K1nN!=wC-*mlH7dIi*q1+Qm zAqzL|T@CJAJ5hau^2FJ$!=?63^o^oZ-)*xOQiJ`fI17gdHWL?wpIjWAeU(@$Bz zUGyrW4k4N;$UU>f^IG`Uoy1SXkA70|^}ObyuNE6hBzO}~{Uz_Bih0#%ybK&Ef~&Vg z+UTC#Q)eVEC<&cyd0^=8r<-08W!TOVI2~aY)9kdfr|O9t^!*+^eO&X$b{6r%xNmtK zs|TOD*m>u{|3pa2JDiDm&Zt% zQ$O3eTy?2-eX8dA#FNB4wc97Tu+7OV`G{qmq>DlL1#$VQuWbux zc=((UE%2y2>1-y~FjW|TPV!;u^oLW=Pccti)J_{Oce_7uEBhgkhN5^?8ZmuX6zdZX z7r3IHHpP4Vcy09!@d$~(RB`=5SaI3hHxk>EW$!A!zA+H1A~JmI%b%M~9ApYgd9TjXOKRjRY2|WT>8JH55=C3+lO7B@FSF|+tWk|dtbS!mHJtq8G_g?VI zG(6x=txZg^&IYR_yQ_q7g)0klSh0} zM&t;SNVk-;nfLO$geI1>xlranYATAKZXbTVbW!Ksb)2|}6K$NWb|*fo?+eR>Q1~-T z-6F}}6@8U%=XFI7)?4;D(sqj*^y~1R-*9;6fmmmDh7BjyS8`efdjSWFi}lWNOC=R0MM*NZ7bb>F_<0IvL`{wQ?X556XBi4>$EO}+RnrQ+bE4zZDLUaiJ#LGZ*GT1Zob-% zkulSq>S72LraH%pOf~~t0pftvXL3>sC$xSP+@~d^Iz8dRAAC}Qw^lp9Kwu7#7r5YY zRSdCjJrSO(UgyhN=)6F1YE>kr>7JIBma*||{F=3mF6sOZT8i;JG(aYEQ z&&uoiF|4}aU_Q6Rrn)XSfs4ZYWA^;Lm&O-{Ns zHf_{-h1lA}D8~pB1^=#sQ=W~D4bR=XF+zxz?N7_E=o7ZoNSl;+ORM%g``FK|gNF)Ifi?<1*|EH_=w7_u*w=NYyxE1T>*-dTmVDncrVm zIrutDq<*Eh`P{zs5gtm#8Apvt<^4lVLo%7f0nocdXBmlT`Unf)@2=RCD+opdRKRV} z?cTqPQ@@Su?hXzN1kZ2kbCO23y5XDz>nIa=IJey`idnGFO2Znh!do8Q7xkK3zb0-z z*&G!o%~zM6nPT|a{IPzFw1|iZvf<0ed^?2 z<4{Y;2Zc_R)BVaiNKFv0|AwAi5GFKPK*~1sd)svABs5#fhcYZ~x0~0aPkB z9^OqKos-to9EKYJs&2ggyF*`JfB8Ciejy&s<yn;NjEx^Za?eiI2F=9)*8Q0vdM><6 z90cF&y5FzOf zDHy}J8qAqNkBP*PgKHw_OD zH&SQ|bUvZ&EVrDyykiNq`GB+1@@*{)^_5u~Hlb+)|KLag6fZ#^2ceG$VrJ$wUY5m9 zBjm6}`pDHo3ghP2$MU-T)h%axNI899S+PBJm;T;6!;x%^b^{;0y;Atb)U*^iavBqW z8VPQ0ZbA={8^i%I!_d&k*9if0AhjnTBZ%(zo&HQv9Ea@@<=`%IqGGDq9|$8LjjKhpr?ej zP9ZETEYvHKf%K2|_BQ51V`46#5{$7X)MRQjtPTyNP`5*;#73(?Gm2TJ>5AeR@eK_P zAcB*YTV*O3aIcl2SG;>r z$B#>v(X`}W0p0Ec^jV|%=g%0CUFa$lcmNd+IV#ztykYaG^XD-xb8>b6o0|(1h{dbxlNOM;a1|OFt?vmMR2WwS8=zidEV~=bejw~2LQQTe zWH!+N35+6TrxTz3EHGY4X0$^JFB65_F?m8hZCGVQfO1{wL9Eo4>_vW6JCvERT}ter z8rzk{#7uVI_ZD*>$oFQy$Xi%&B5aSOq@*5E5aYQ*g-2dqo@#*(?o7J>;?+rZ(6!Ds zq@|@*Q!wohQwBEjL-fceD>VlG!Ck>?_4@m7R05wVWrVT*xQtoN_=z$~`Cu~pJWpZa?pF=5H82ckAQ-Yp;Vzzl|g|E6vU0n_j zkUd2Tcv4`_=ZU4IBTW?H7RlAC@qzs@o zBh+!`L232g)>5t-QkbHgsS<=kLrv{2*XZMihP}LUt_q6EpnlNS#^y)4t@%WQe^Q^M zZTt7{AGU*_o4eE45)KN8Sc66ciMI`ju{ha5MwG zXZ*A%EZ@9&vka8CEb-3nh9Thvt`9#UwEl2k$6osRMcUY?F@O#{8t`15d{v09$~Ja( z>QA0161hE5QUr^xc8ND@pa%FBCWW@fjy$$S|4CvYO?g>Gg& z<4R6j{d~?QPn-WL{N%%n_O`f(2X~F^t><~N%%6O@@X?@;R7n5S2J;jB(G?qC3IXaA zcklg4GyAL$GaAN^I8#`^H3*U@KV~*@qke=#R6KZEI>EG={G#Jm6+a>nBIK! zDL_wt!{nxIs}CC7Q=hbrf3a2hX?+@#So*vo`A8N=%@wz<{hKY`Rm||5v{!(D7qq6U zUVBYcUS6Iw$Hf}n5)>3DB3(c(XHm`lgN5J>YUYb~X2l6muw!Ru2Ag zj?4Sqx# z%MRW8`g$7f{g*;A7x9ua$zfwr#HPwE@bqi~6+`+#cfyw%H0Z43DpYB6X1de6Qr}U% zh1>+XP2yQ90&9#AOuM(9aJxV&A6aW$N@A6Oep&_Z2qCXk0+w5G5PoSCj+D>b3;gQ z>NCasOGDKXEzMbU{nMA#F1U~#9$FzFp#Y+qpP&EKsZ&t4*bStP+!@6;$meyVu{9kD zj_YDmD>jFRhuzvM3JpGfSP*{#{g!R_FAQLzPC=5@torU{Sp*^f4Iv8J_4%&C!u%;~ zf&S+r(?YKvvJ4dR*l!}Qftm_yIigp+KE%t*3+e>bj|P`MP6HPjgaeJr=3u6`M-%wN z0s<6DjE7CG;Lmp?)*l^i2^kD^c0x5dCIr)U8%Qk<30?Z4gwL;PDX=|Sg&wptG|Zj5 zMN^e?&aT@~KKJymL%~Yx0Ex@cY7h<*z>3E3n%9A}CIPnV8VhJ$I0MQXU*9(9cnYnn zL~Z@@v}^IOu&^LMS!I}=LHf`-LqC3Kz$V_+75F2_#|Pi?@cfRltgO##Xf_2bB536? z@1lv>4#u7ht6%Q;~E2L}f$>^3~ZuKal|T(u+f)~B+PUo(U3bMI5oYF_HR zLn2_ui7WK1|Lgkay*mScm4qtOg7GmX;ePZOl{&`a{LcGqtdN1g@*3 zUD}$cN1vb&8OCl<#D*MTvM3^8+?Ew~SOj=INT*}*Dy}FhDt@+Fh-hI;NlAguhD_hH zt1y@aH!RTLhow0wNj4M?kdgtFom}}noMU=O`8)IrmW$y(?uS4`L`g~Mx-|+8lU_S= zZi&}n`^}jj8?b#Fy?)Ka%-q%0#mvOiw6{14DQujLZOE2^l;?C60^$>WJv|9T6NEkC z;o&W8P;&TKS=rLc3iez60Ul@}_Nas#=vg57H}>zt;Z*y@3!y`ADD!9x#(~X;iM-*u zV+m$M#na<}OwiQAf|dnxnkGp7(hneOICt*cEe6yF5{{`Cwf9rIgpL=+`FPJ`$!wwRY#dQ)0measP( zaJDhCRhtYcWEoC*kVgayc8`5~PswX0G8G0sD{cL=5~+kF!tEqlmJyyE8)pvEAxlp`=Cxc|PF@MMn$0*^%9L(2Q{# z@?1*`3vX}lBx?dnO1VuxA^)Pj>?h*1(mrxOVCRD5ufZNw5F3GDAA7cwmmkGrwoFFG z7#v(UHG=>khzNW@4&Q+0%THuCP*GUHa}39OtHUcjnp_oNszy> zbp4Dq_`^V^CI#UEL5xrlp z1b3PB(nF=+3SS{plDrbRYq1U|powU7em>ibUf}N}3U5!(cgN68rDx!pM{mRzvcvr3 z&DVRE4^qy@a-xap47if#zs{|0>SgviuqPQ3UB0Yh6HMK?7l_#ILrZ6O4-bN)H*R<7 zb~KcBUxFhj%0=H5Xz)qP%mnWK3rJ@`pCqEIfGSXBvbhN0;*K;l zFwWJFT`Bsd5fSNE)~#-5Jb3=sKJ2MqCYMjX(Bev79fij?uKK|@2-jWDMEJsEGrTq#i^F69He*3D- zj)q#1cRdSBCum z{>!eWd|s*kW4P9bSkHV16lNFx^!yw475T9&jZ#8P;9reO<#``z_w3S8eR`ARMT&ho z(EOB&ARpM+*wjG5NO-2Ux%r$WnI&0+ZcKu2xXkBdwa3GmdST0P)n9+D+%yc<=_YaJ z59XF5h^*}|O`Da%*yH5!_CR+>0z2^eXJ`A75~=qXsQZK^8Du*FziGHUjMo_Mj7lk^ z0QUZSb)~1D|Gkp%$bD055?3_(bDauunrm~Sb1di(p-jR!Cs z1jvHp@i0}joV$>YqvB~EG)ag4_YHMx#=Xt=)E<)2I?%12I%XV;w+jD_R8BI6b-0zjwa4xCjVJ$@3zjw`!GEq3#QM(*DTX6!#A^kL`fFP}5?qVO(t$Q(ng@R^ zr8uxkOe@xrtvl^@=K8(=KAfl*OHyrZ!AFVM9rG+D{;36%jlNEzBkW#Vhja=57%rGu z?q}rau^(JD`|rcHAAau{RqEbtTc5@M9pU`|TethRpV+atz@~ zU(0U(Z!g*y^3R6`Qb!pT{|% z5_i9(>B`WQu9l@Z@xL)Cc^nQ|VlTuiRqxszc&9U$&EyQ~)K0GvoP+npzz_|JBoeZ+ z(Sm6v{SiX+OIxX>xcWK!Wp(x`t(q=6U>W2h1SheWrmttr3rCd|Em4(?p`)SF(qE_; z85z%t8w=Qggl?)9l=;{&4Vdt|eL;#c`w<%)Bq(k&!_DoL7f2Fq8wGTJV*2h6 zsoi@pTer~!u8y>YI^K&d?c$|;Il{&>OJ4Z(+51iC_gzn{`)bqKSLdtT-OsYH}PX?||Gcx&Qrr0QsuC^AvvwR>4Ywj~ZN9qzeC7k2VqtDh#%rbnhzIQ@K_QCc$dr1G zx=BiIxRQEpU)bXY%Jya$4rKC@OG{9NpcDCR4D{{I0|Vi&>+9+Q4j`cf*Ko&p*R|(n zOpZhRa7dX*_oD!SsKy$O89IBQ)z;bj_8z74IBhSDpurveZ2Bf`lj z-1#r{pb0(THy7wZbgyF%r&^H9CvMi)))JspCS=%wCy5r0S;gLZOF8^1=Q9O!

BuK^~6T&A}MApVG^C z-H%y*HbdZ53&&%Oe0vCzKNDb^AAPBYUU9&zK${I9hzkk*-B;Pa4{~fV@Abe?8TeI+ z!Kn<>WrbZXWiVsA(C^TkK0|a0u z7aGa^EHQ~~VY9fa`QQN!2gh0}g$7ik0GjjE0Vukx@xD`TnBb7AeOXzB{l#b`RS^S6y592^u{qA|)d$}b9m;9c=$X(g2e(ENH`IuMR< zhDsNxd0AXsTwA&bN^N^62RN_<_7fTzFgkpNJ2$qL5o6j)rl-#=E`DeeJ^9mwrVYXS z1(Vm2>&LK*9&!B*RS&YjSwTdZt%9QrrfdCf_6Q2j2kDxhx%0Uro%y-XM@V%VDnbw3xY{GF1Ee0hxqIm2m8W6opN*Cnw-7ky*yti-8tjoYAR@OoGE z?Ba;)`}fT@tbBZt^C&2T`tGCi>QxSu?TmhX3-f7lH+s+(ewe_d@&+v*95+UVoq?He zCVQlEx68?P>dgCs2v+st%_8ZLj}>$TKHF+#yw(%x{j)ac#Hpzq@0GR2RwGGzAkH`>1P~2S`V_}_!@iu* z+nO0cy7F@Q@E8fVIi>6s{*RD^Wle(4_fHJESdRC5-|)owmhPzcD(1mxt&9R&aHs9&}<%m+!#ucEA}hN%{t=4VtuLR$N%^9Jo=I z4vZzl4SsB-lgMFnK0J!w5VD!?*V|&L$EH(C2b0JP(;9HQ+65uLQv0U?X3&S^LP6hg zbX23enBNt)+06ds+ASN*Ym07NAA^%9uy4SI{Eh3A*Mv2aA?$6Yf2APyss)$`iV##_ zaf|(V-|yGuY_D^0aPad-9jrg}?2*x`A;P>9GsxHzI`klJK zTl|w(awsi!gWBqy8V``jFg-9cGlL(DkesLSN3W#*F{o=JfFx(<8{3%M%k@U}2nd(4wIa-Z(X>wM`jfX$^yo6@P(Tqj)FgY0iWdp29 zPA)E>u6V9tQZh{RwY?V<-gLKUaYa2b{CD19SDiLvqrje`4O9_A%#MeS1l&Al8jGG6qTGkj{FdEX$j+<7woAH}w7rDsQM{d?XfC-d%=P@fMh`Wvd6}5S++HPYsdtvg<-bgf$ z{d3>9G~TiyUz`p|;le+Yc#)W;EozjHF+}VKjuX;Aq~wkB;QoDxidd&kH55b7DN6!O zE(k%H$)u({%A3PJ+&<*&j450hh6BG)fT;!m8opo{N=>o<9h(LLtr+|3D>_lb46s`= zq)GhUh#rOT(-AIWRT5{0mr|kN9~vl#K7scSjAlOg__!h%=OdX=qi`=()4%;h0hRMz zTKBq~{0zlw*z=z~i);A~D7!Z$JR9ijM>79a&D*=*vu}xD|PzDlu3V!|o5PAC0 z`ye3kzx_P<&vLt=8WWo;HN^Jx;?@P*Q>CkM#2^`(n9%t@s=hj`s&4yQ3`*(lZjn+t zM7q1XL%RDY-QC?tNp}f?bVy2fcQ8<1OTW0?>Oa2MX#8Zl4ZYef4y^;B}bho(^(uC2%Ssg{%358 z%iMVid4AB~)hKcI7&41NOpdx4{q<<9^%&mkwQ=so2X>%~g!Nb$y>-+M_sQ?E?+XB+tL|V&PZZApp4#C@!Y{K`< z%%J~~60mB3pBQus9R8<^cnIPY7KVQY!Aj>e1fM+ULM@Mnz4AZH9#iO`xZ7b@?fT~n z49_B9hx{%xHGwGOIL`I(>8YYwlccX06D;!nQ(*oysJuRf9#P$cdoG9zF(20UUo-IJ z2Uh&|f|S6(diIy3>O$6l;S&A3vgC>x{${r!Z%%TNPb*otomlo0HY=i0z_WR~GV=1a z9+5VKL>K7tb@-=(Y@6y|?Al!{pVExG|GxL#@>f^WUegTtt@cB^n=>;yi27Le` zpz}$C@M({7=A^owkO^$D+HK~Sp59EuvYn#PKAJyx9I%$lD{V$ zBuRXLg>4TdUmToWpO7%m(Wj%>yt7 z^=i|vwr9XjgzAHICTq8Y-@}M)v82?h#Y4y6pKS0)iB<#d87SwVEP{oYv2*{F;P z1?>aPK>ojn^|$_0t;8u0`!DJeL)gQ^<8>O;Jd%iZt?Dgb$b`8Fn(6mDOrC%i$Rpu$ zrYCI#Om`UGfk+mBtb)j9f z+y`RS-n<*qOHUXA6vP?ec*|;NxC1wDRA+u}E)a%=nVI$ycmW@wc0v<|DG+?xEkB%3 zI6&%VDw>Wi5AA*vFTQNk;5#1=7P1Uyp?TreT2kL^+wb(A(M8sk8{p~OfT4MWJlMB1 zKkbq2rz1~|);5`Meg5?s!W%+GTBK30zd^>( z9V&oeSuy?;&d(5hGp6JxMSoVAN2Wv?LU3T^6!}H9k%7~akvb5ObK-%7L_G-ZeO1hZa>Rc9VAa{Ka@s^ zNl*8BeDFL$+lMCvYqF2(i1^#6BP9vR*Ryg%?mxOS@na_3bXm(n+*tqwW$UyUVFE8S z?+>iOUqeJAfSFio#qLD056h+F{oQ+plIlGIw35w>9to4&1`EAC&CUq$ec{_D`vCz# zRz4{RX+$*V6dm8Fo1a;gO_*#aOJUr6=_38-+yap{svO}C>kJjJvQHbl&u2;CrTyWe z*}F-QP8Q+`oDM9g-ZaoxlqKD`Rd!3UcM>LHn=q zqJR{kn$ehbzfHW2heKT;lc|;g&+vEm!30qs=CnBncfC0|jZqE#pNkP*{Vv09!YXL6 z!l+RDpNp;YpE0pOviAsHyI6ZiQT=zg;=Y2>XdVF|FR||~*)c4XZkhqC%+rBMjRfh4 zMJh!6tQs&0_jJPl-@tZW!C!#~KclazN4jg}k^^PHzb_2DFJZYX%06kn8ifI){|@-; z$vBRjvRiw{@oU#Z9n$|i$5+&eq+v88yiJ+dG%CUW-1zx=AxlT@*7yrLHHb9cX(I6W z_R*eBIoWhhvJImImu!pwd#REWRwMwEH|y1E!~NeeP^+f(N)!}uXfW-^!>=qn-A^`; z2ZRVP088}xbqD}5SwD)W_kcjG&SF~M((-=mH`$Xf3^D+1jsIR~J-)LO(h2Z?mH6zKqv=t31lLi92}rYK+^6TzKaj`5oQm9(>R4s1EvNlB7=jQ z14#mwG1^&CQNQc%`L{2CQv}jUK*%@MQ8@LKY3vr+b2oKv@O6|=c+DI=GrGA>*%&VhokL->WA_kg_ zhOLmFpo?K()i+DPG96vLy}&-vgnonl1Un+)llFKAkG^eB<)sLrHb@WytH$i_8$H_0 z1_HJKB$WHIuKJnzBQVpdZ!xEdJsW{)z`Lg&37C&p`QYVZJ5oj@C3=n4>QnX!gXGJR zZr)Ghs+#I*5c?S!8jgc-9yo@ww_FZeA3ZUi8dd>c4M+mR zInRKyukS$vf$Gy9kINkjY=Bs-@alhD;s4z&xdsO^B~J!MT;8N}uH^AePp@G5vwz(7 zZ{%P#4fe8SUY|)G3Xn=epMV1KUk8Yykfrkr*r>TkiPk?#9R9zHa1cGRWa7)be!@rn z$2e+`-_1olEYK*kunZmaOF#<9WWN0Kp<*=WX&ls;d?eM!^uP9jRxB+F)&&F!z#H2x zaN4Mdj{2XEuJwORUqeeuefr-qMpF$SHcKyZQVlv5Gjd?MJ_o_yzmE^h8Q%-aF5>^W z9oYwB$nLiWMjG7z{i6O45S@e)ybgqV6%^Hj26A9e#+4hqf{iLDORNn%#$}%9r;OV_ zgOo^%5(U;3n+q$C^ZTku+b4gJcK+wx7!|U_LOCa`;W5&pZ)bs6?VtCaHzW%^*TOzw zOV5W2f&RZMNr5W?_%ATUd7LGbc%pCqduwh-ee z?G%AJikSK-d;IScCwaUe`~vlqvi@gQp<;SL$ee+Ijn{5B^JC5+8O;L*8uEX)XG9I^ z+^+xZE_ENz16?z@XTWMNyz-zFI{ym#E?elSVD)zn6%{8{EiBn*N|F^eK6Y>N#_tl9 zB(<2jw4GJIC;#tEE4r}bOFPf=N;vDd)Z1n~Zcwo7J(e!_m6_SuRh=XH{^yGjLPbMz zR4+r(wTGHRm2j?B$AByY#zCp8Yki`}+i$(1u>XD5$Ut@+qWcycE=F-q zk2sNydtQ7l9dBOx{da)Ph`Kk0X*8HD;JA|uc>({@TY27XB-|L|LboNU36YRD_y?$Y zZ897$E&D()c9n0zK=?`&X?@7lGfOk z8m6r;BaA0f49e!GB8NB0*j$iZG0`eiEzULv-U&>&CtmK>%*z^R4-ctp0c-@!(^Tl@ zJ=%L6JX6PAcYYRQ5W;x`D$_nxlGbH~WeeSq5#vi7eiXx3iu1N1g12FKaL_Ssy;f-?iEUZ>YT}A`&HI5vuxqHs_a&PSSBpusGF%QZHLG zi?Z@L#8m9_(~}`ySfu=}m`}+jWi1fx1C)Z~?K-H&b^2rvDE|Ek4V9sZ2_HZS01z+8 z@Y_Aef^}Fm844)yV8!wsoIZ4_}_tWZOf{)`kPgr;`7Fp0aM#_8e4-=o`Bm5{Ds9VaJ$O35glYa-; z7S%7nr&{IksQ<8=o=nLRA$rBwi3sI*Wh!0 zrofvylnLPQPg@!Qi}~#=CNbD<;?+vXQtY)C64rXR4Zu^S_b5amzwYv=W#sbf4)2qG zJ($fmB-$K@>z?%RU@`i66DcSn>1iRg(nltw;ayPAc?kqgZx!U{SWrQb(zy(bH8t`7 z8C;$qIr1rs-<%=gElFUXHKSHR1^=;EbDr1JN8a9pIHOClxpVy4x7Ix@Nw&KkkdT9@;aiN{&Y%)V9LPx z*`So@y9w6$&p8Va77`MuzmGqh?Pl{_S{u=4_&PEMb8O%t~TyK-1I?fwogr-AcQUfwCT$7B!z%K^F%5^ti{p66#2C7l$ylztdW?sThc zWBcfF(C$f5FaKlNM%h|3XF{W(Dg7qZ&mPEGJgvRlLG`zyq0vtFJu(L`_~d>;iuocZ zCmI)XJ5UGO>erk`?+KnBiCQwg>iXhP>asO9s*@&bh6_QS8m~*! z`CY1bYn{FDH}-dPp0`JQ!Yc%rWYlE$7*uqWTmeI5^K3z)q*OQ$Mx1TkH;Z{8uVO;l zzb^CKo_mA+zv6HYa$yRWWug`D#rbMLLAx<9?P6@#ab&cBgZZ_4xqnguWV;CAi7c3j zdW!zKtJwkS{FUa8eeD@ppK}3PA;VJo^xEZ8E|FX-FQJGhln7#smte0HsJpadppD|Z z=VqxWhv^l{6QQEG{thrD>k(YciJi{Zr!A_IRL}#BJKBmVMQ z&EK9LWKPq4_@K1B`{pAgJuccr`@5){e~_ZhZ!CpelSJgQC_;Rcxzn^LzhTBG_;7;W zyw)!uGfWn>2` z{ub-^DrGDR*PElIhy~&NF+S(}fi{PGeKK0z7QUyt4Zm_c5bqyOA1L2x8jP+s8!|@Se5K0VR!oXZYcFM|%X2qo1B%FE9B@#U2HXDBW zjD9BqrPbYUt|z}}3d47KZ`@y_=ERoo27m)cf~I~2$vdPqQU2-;nz&8ZU7%e@XprZg zf1gK29*5E;ICV{R^S<`4GbbggNCk0IFK?cZrmscV*Iic~u{+-}{P5{f5VqM9wOUr7 zrfG-x5eD}1`Puzc@pgCSl-ocTCuP@e%(Q@M56j@K7;e>LCLB-9-#t8xfL6w3%m|Hk zDL+CtS)-c9WJVo%Smw{`i$TR_qfs#qeTFi(yK0-!4Qmm($n+criC{btU>+aAsZW8{@(-)Um)8_gZgfP)G${ro_Vg^I4jqXWXiOCvVq@>#NJ(ZoiEUW`YfO zxR*>waT?v3<8R5yZ@q9WJ2h2*x^1DZ7mJsoX?`2hZf7`p$Tm1*)uyD64LTrvK|-d> zN16B=G($1yynfNBnsa;u9R;%T-tPL>%Ekmxr0l}7!pmmy{em{RZ`4&a93~G&tYubPR6UD^gkWRdJ(U_nQgayy}jSu?pff&Q{79Qp6nP zw@ErQglYHV6bkUbd71Ed4Oy$bB)ND+*X~OGOH(|kE$L>0xc<%8Kpk6L(modKah10o;S<(9#nb0pX`1R@4ZID6 z3WA9t%I7(Eb^YCYxZO5vKkCvMcXF}!PN#Lwvod_|P90h+Cp&xODYH`U9kmAM7kbq( zDY3v9)X;rKx9iE$dI%~^XeNV)nG+g9O~WNZ#&4isAmBOX*IQTjxgyU2lz`(Kho*?h z$;9FUUSWtxRf4jpX<)Noxy9fK;l@4i&K?pL%p%7ACP`FVC(+hXcGvx(ZT?cI#5_dQ zA}nHf4Ee5iWkhOV0OwL(t8FIV{ne?;X>r+&4&HfsMMZ__thlzxnjSKKA$?jkCl=v} zv5jthk$-Ztkwz>G4>$Ke!_O|g+=b{2?jqt#&z>I?J1(#-60xnyRPUqyG-PH|wZi8% z?iskQ`ug?bZTx$$8R*)1 zdL@whGCc>0JLQZlI<5ov@bqq+>y!S+?{{Ulg44r76K>8ykf5NySfO%s z>uw>}Z3p1Uf#?v}k-P()sAgMugKqElQ>6e2XzzU(JK$F7Oo|yZl(~0PYt`X|dt*9F zvAS^YPMcgbLx*s~84gGce=Msf4RdIsPclA-QwIeGZ3T(a-eUv+Z=zagO$c3BP}t!@ z-**5I=Mj%(zb%qS{wP36rv#@T&JYm@S z4YSv8?J4J&3FGS>u8^+#0K}2hss0gz=QUd&r;gPrjYE!IUx7^;-{+Q+k6D{e%v8h; zT^^HAmY3gNM`%&}`?Y10;dyzC@uruE2-f%6c}nw)CY$dNMFs_qH{N(mUcQryEqO?l zQ%(XO28T{q7f(PYXMA(J_X0-BjlhnR+?s(WW4NwjezHb{O^N=4l&9sT!U5`ax+xa$ zXzAvCvP&Gi3}G+7E+(`t7&e|;Ov>2<_|Qq!g7fxFG2i~jQ5C{D!b!-PA(-Ezoe8>g zlo@8nCdlwY*6L&85rLWV0&#s{VBotK6Gr!ynF&AjU>f>ZfGnSnf8P(Z)m$XIk=|o) z0>nf|kNg2gUpcL-ENQQV$q{L~yeCioy`4VKukh=PTesmu_?T=u+sew%Y*wse1maa8 z_oVGA^zUzhEU7$i3{@CCIXO8cr7$lH4WHW?MAW|WAdqE@GCle8TCGd^X&;3MEB)eU zGYxnJdFKMpRL)AJPr*bE!%!CH;G7O07hKf+2(e+lC6Rq zMk=ef)lKfqx^JnH;&Ke61`dz@D)MOz{`H4&KETv*^1y9%BP`hK4W9P1{>>kReNK7%i#v{Q0PX$-CT`LPl-y@p?VHkC z(mcFau(7bFEX$4c;KJEiEO&ygR}l)(O|nvhb>PB(E(38l23A((bQ#>xz`(>RoA26f z>1+GG&0+RWsRzhWroPJ&Fqt{|gH{F8O{Mt{KbRB%$YK4c0fc=>L~Pl+Hd2G@H_65~ zX)q2MOjCi)C2^D4t!%7n?jC7nXph-n3hYrDCI#@k#7ufUrz-OikG%QaqBz*h=A^ZL99$r|OMUI}vD_Kr9Pr!bER15TBBz!i+XaK& zIEna&DK_W@9Rk$qYpJ8~OArIQt*9!Qz+Vpoez-vrSPV#M8p?CX)%|PDc0r%C0s{d%9(~TZC ze)V${S)b7{->-GU=Icb<0ck*qfTZEvUI>w^l+d^Unu)m7qyu1X-4YKa=RCZfZPEOoXTmX3^mB|E* zr;{}?kQvWyOHN7xBDu;Ni2$DmbQN4Re*#(2rP{ef;b2bHytLuMcUoHK)j2~)u`89d2yc5 z^&nNKDsDAbpOu|WdOtBY=dsZ2%G?bwmUM65hRz_u!<&Oj1)xKjk5j9YfL5GDczFHy z$$+f$JLZ=IP7#y&;QL}nC%O$QbzV!Yvz)8(y6x@bB(*~P@2OGo@$pGXy|0X3`m}$9 z1yFR_7Z$83T@ZbY$E!Y0jT6w04RB=Q9vT6W3e^02@xf%JeEIUs{1!k;L1mF%3KHo( zmwE2A8>XBh3ZpQzNSnzQc=-fsfBxzKDS8NT`v7o{<=YTJyPN50wT(moHzVS4i=6?` zy+u&Ml{jpt1sx-vlv=1{b&*gXu2zxI&>%4Yln8{5LEb(p{p~akE^Z^}Ew=LvC|dwH zCSafg;nCv4!t0xxe{hIkQWyyhnUer((R`-55D07lQdD8u*RNlJ)N@uX1!|C=pAab9 z%+`Fa1C?e_#`xrR1gb!wvi>CD1IT3!n(yqW=|E$-K;*t7DWyX|EQu6QL&3tjJlj?< za-W3XZU+F%!`V6{sm2m)psISdYb@(#KJ}d*88%WN2^kl+sJJ);zb_bI3R4mjfA|D1 z^K)@=y*K-tTyAHu1q$B@Ls%r3kT_pJPIca$w9M596PoQJ18RK$EeY^w;D&MlpqMN2dK#rT2dkbj2K+E;;3-bz~&4ac}f`~?b z#l>`=sObQC&vB&_ZcSDhAW+hPKIv6=cV}lN8p4xObV67B3lzvVmrng-09yhiQcy}7 zT0KS8eiI7TY#@GaTuxzHjthGAiXL+ zQqreeW3y{wBrzKWgO`4HeF}q!|1Cd1J~cH|QhXS^M1a=faKEq+loJOi>`_qL0{bnB z5;6m7TQB8tnVFe^G&@+h-vE0UXfObpFjUeVEr3sc1B(j?uYlSO{2>*z#YE8rP^bXp z%vOtO=9fw})ZB?iK++UoCxj{U$m!@pnrj%Dn7+bD1j$k>Dk)K5K+DC#k&6Lsj3B{J zwLk+VFo{RHG_IhJFHkt)^}2Hb1!xaybxI-yK)V9c1+*HY5Ktu!%zN46asb7Kl@f1_Y9axO z!Uuf^^#48Eo3;mBdq5PuqAV`qcG(`Kh&EYv?zqw|r3F02CdXa>OU68M0JXg15)=`M zu>?R}e6XQ}a{vd-+rqvz-4eh6${0z{{IyurC1k5P+LD9!d?8?CbPdSb!`5 zwTV$30PzH0b<0(((XCKj`!EmM^k!32SXo)+&Q|6=15~TZusXlI_Tk|}&JG^)mBvSqvugk zQf{nZjQCF7Uu&^^OUo)-SNUx z;174oyCFq0=IPL`Z)~udjjn-BD_RK81oF+r5{k{eB0uY zmu85Fh-AW{#6lSSO7tMI+>;N4Jl8l%v>C%9vQOI3>{+IGx!bupZdk43uJY_B0Dp|Tf(C54+$y!_V8beP_)JevFW%E- z44YJ_^3?<6rJJy@FcXhx_}y`7)C*AD)dot+&*Bc+(Ws^*LY{XW;>;=qEN1FoawC0wUyt*o&-UB!SKxa(O z830Pzo2kK-Y5(}(BT^l{9@l>fsKA^+ZX1ZiFE+cbZfpqWvH}&M?HZ?pIkE3Gy6xUy zzI*{7I2jok7?=Q=S9Fy?a|MBj_f8sWO$IV9P1>#Z(?2Tg$B!R?(5(z=*NyMv0B8G} zt|2}rhpYl%d6AB@!5zQpB4HW>Aj~46up6XPdHhBM=*9pZeF~5zcD6p69Tw^iCwNj! zFiTLNMlUKV0$Nm}Jfa6@z#h5Kg9|9e!vO88)q6i6r=b8LO=|~41_G5&>giV9+}RP6&z1NU!YiC!Kb~TcB6pb(|?k`UK_Pmc!&V21l$Q$i)Sm=z`sQ z^a=blk_hSM_BJLB$PMiQoiTD-G$IXEalcR!J39v~wHUd5*@S##n2 z=ifj}bnw%YjrQ1B^wFRcCIg5tkXH~E{snSzcpuEk&x!Q_!yPP#Ked(`Knx~=ZF~G;QEZXeQ@we z6MP&e7c5P%l4$qZ!Qlkn=tQYT0_PV8q@ba1d?+kZfNY%)%)en9V93^tb#?j82$+s! zwgX{{JfLF%*7`R=a#XkvxT&+CKC1^TRMf#pcZ*LPh-)K0G)m zwD+{7h+wIa9$`qdPznFh3hXF_)}Tsgf6Yf#CpZB;0u5OkL+LZCLaX!H$IF723~I0U zFo{m+8Pjl`lMA!Fit7z5R+PLtwX)@Fia zJS{_55(!d7uC4;CfBab6`%Iz2SWP}ieD05q<)!+8=i%NCM{=SuqlM2~E_|LyUTQQc z*O=Ak;A%TakGrIvu)^sglNW#BT1>ATLq^T>nvS3k&mC0WtS7Po_j4=rkpeAyO% zG)3cL`b!!aXysdL;?d9Fuk&Ir`= zWO{cNmflIqTW<||%^H~6TUFOICkeaGGWW7VHIgwOcxNPG5=5MqgUiDg-XTW^s~sOv z&b=MArL5~7o77L;FGq|qrmVk~RJ|+@O#8s%A5<0p1J>ugf?KVycEW?RPNHYCSB_JT zCnRh%{i`q`Mn#OTaOM8Js7z>;pZvG1!p$DfRP^j)2l-sTL<-LDZcF%N{tL`)n+31D z)TXZQ@jWfNLOaYhN-RG^*GLN7seRV5vB9m16Ba+(l`o`h?X}bhvX)OVEw-0t6e5V2 zOVJ7pk4!8$4?0G*S5YJc*h4?#6BFW}E0BZ5)>8dk@|gsUYUv1n{30pUwVm7J&sihp zl7y59mM{w@A5cc}5t8|51wU9$F=$y%H=ZPI=w_o{WR#8O!H1+zeu{7k=TVyNsIumFeG3i%3^q zqLqfzL!an1viVP*y+r)Tn(>f$b+)>GcYl(=P)PantvAZpWF@dlcC|&iA zvwQoS^Dz6YZO*Yg_Jrtn0vYu4$7i(d@~>?i+P5dDkM<#LTa6>`f%_eY;BBN%6MPg*Ew2$IOuXFqy~Pgf>}&?Y*+_NDA!=Hz7Ynl>W}u$}&)0ZWg$0fag@^kTL68Fu>YQA#!SJOBlV(H!+gt=Xl0(&z)+V8*<2^sz zng8Cn6EY0yiy-pehm)0Slbi2OpFFUGcad|#Aa|=Y$T?_|bgo>Tv}pJ#_vepLE32{= zA1z2}ToF6tRhyJv>6cjKzpUkGKHM%P-z5HcUf%bzcVOTWeo2>@Mi{A$dm8AEuMJH+VX0(U@OJcV~T2@_VpT z^Ta23Krw6;ft!QT_ZV^(3_r(Y&&8dB5L<76%VwIXJ7iq(TA)d( zbF#;7eUQm9jc45)pXg=8dObmxxY3*6={wyiCn|5*og}^%yhW27wWod#cQS81k#Re~ zTLT-iNA9ikC)Y-w(d)$FmdQiotst$C;ppH_Wb%OQCi5DxLj(ufO)h6gl9`qlcObUO^uIgWM)Eh6kxqG4B>) zcPXylK)8JaWGYds7HBoN2Kz1C)`cZYtXJ~nDq{7;#5GY*$%&v zZ;Ik~h`W<3Ya&Igom1D&qY+rgmD_9bZg3u_&dIoD7{E)t(J*PIdGRN;OHmsQf)nB3 zNkF+7bcG}Fg@fe{TqxZ7-u$dcw}}UV80wEu4|b_DX`gsTtP9^^y!l}bxZ;k_GTy87;~af@ta_YF-Cbs~9E@wu7`b#QOcB~U?bj~B z+|a`(+&9GG%vnbbNN5%Q@i}bi9)kYId77s$sJQI06^%_LD&h{V%%yQ_Sy)6+NMjBQo)4-L!D(Of=)7ZLg@Ihcp=|_QbmM@7_=KA$+=x`j}v$*8#}|(pp5kU zz^fcW{^e}9=tSE+iK|zPLIT*iZd3x=#&V1BNySa0T`9FNod+Y%4EJg`2kx%EtuTs& z-ww4;a?a)@TJo(61K|?rAtxQshO2_|sXzO_?wF2>F81e~AA~Swc55GWMV}%ILKl*S zbG(5SnzrRAN)|U_spj`znNUS1?MqD_tl-&v|cRs%c73zLHA)>Dx8^yQ};Q z5qn7z)G^s6s(snh+=k3IRp|3B(*`l~4VtP*427No0Vf;_MwhXR-yv}}eX!5x2XcQ^ z!&oF&b?Ch{ded5iiFQcyrwOVxBepw^J zno)bPd3SG8Xe|<}VO$R(bjRPb_~U>RQ0JgOyU16>QF_HV5)LT?cKL1fU)e-82&{Qzah*iMKbIXIrr#IlF7q$- zU7%xAKI@)rhdXj|d;VG3BO*Fh57n?BcRwb)-@SmT4+*sngJKLK_PLBvd+ywa8Rx4P zkn8+*xjJ(eFflSn{{5Rm3~mj9MnK_0)_WOdS;u4Hx&lLa?!mko`N^inZ64A2iVngU zk2QknibpPoSSNjvAUaNQ%2Bpor%)Oa`M)K+%g$xZUkWg#+&IR!9bD7IN~o~Ev+9go zl1*Q_;FpumKco+d;*+p&Pe;Zx{Yyg<5BmPz%=-xQ2k(G+)k zb6_|-L*+t8VIr>mY;5*{%z&qwR<(6PZ$r<_bFk%@t2f1qBc1$?v~I(EMDzvBJT&rKFgM$GIE6pHxNjbbGut*h$|)H9kZ?mO@yszQULsaEDTCugF~b|;q@q6Y zqu#G%A}RGn8)>*}gQ#AmCTbp>S7i%n#gR-B^mFpk>5u)+SO_5o(mu+i0be2|onq%7 zk0UWh*zJYY_pnT%e=#h-DGifo&7-hqcsU{|&U3P8YLxJaB59+j;F$0BJ#9BRn{_sd zSr7^xK@<%Cs8u|LWytQ@)vHz_ z1k&1Fn`#P6#y7GiX8i^$Trky3!kjQ|fsdp0O=6G5XC;vZdzyb5w*^Pl$ROFF5llSRXD+SKo*%^-_QIk$w~q#V`kDHp?@Zrz zB_}!`wyj~fwRSL#inhJHh%$wAp&!rEH*oJk^SyXeZ@O;tILnKggX7k#mOZ@vHI4&S zVj_x(Ao_8itb$UopC&r&8C_HsCAm6de~5UCNl5HbG?sOA&<|MS*GuZ(Nd-oR7?vgB z_fEg0g$e_` zxAY|*=KVwY%~g3HZH&?j=cTEY;G0M3`Nx<(XyrP5r~gS>t=QZN@un1bZDcGUqvF+t zV>ygXV;UkmwVbHnQA!-*!dcjUx-6ILPrOIa(>V<-)xeEWQytNjLtQ!8lGBHpkQT~p z;wAl#^2Ka%f5t9l@7+b zxTS?Z=`V_8vQnH`bQ`Hqgq38p2rZovNCze*NSn2a zgPP>UlSJD(3#0<4G5fb>+>7SXk<70bVhYLCiurJE#~sg z^Pmt;`hMugh#sP<&^~Mke1BtR$Bfh`v`>;z;(TTEe1-1tu5sTfkwaTA@KY;u7DLW; z_})BfYac$eOy)s|U*|8J)LA<}_(jLU)4%nG$En=qd#v$jxSfTqnJ=sLzVrDUrZp&# zhRm<@`a^@{xayRu0lD(;vyIZ<(}R`FX>X`Y-sr#T4MkQf!TIDb$^3c?^7cOc%NbA65i;b#kD+a> ziOB4`gVVKj;&rL+az9c3V$00;A9+PIKZJG)b&(i#zHscK{(*mK&{ugju%@iCEvLQ zi_<#1WZ1Co?-!^$%SR2pSL+S9gm2Js?E!FwIG@s}FMs(iOoz)k$y)cqjLuTKmBS47 zJGN;>u+_(VEHCcQ$jbxc`v-EldYg(=AL`E*Kg|E8C4sc@%&Pv3)s(A@v&3f>@jMf~ zJdNBlQjo~d&);Sqruc2Pwlb!C2kYQOhLGlEfP5V+J?!LPa>DdtAe6;Qy>@iqx5bj2 z{LUx4b(FD&GUO`gUfEE(&DLvG%FmQG4_2jwg7#N8gjsM$lpG^lByL#qON+C$UolMb zpR{DVsAr@EAOnN6^4qeZL(YjQ5yeyWEbC(P?L6;XXmzZ(#I)`Ie; zQTbW8Z{?#^JP(h4^UF=aZdACnAwbMs_r+Q%AtjAlq9$9>Vkj>jKayM^hZ}w3s&VSP z8$=+GFJp$Cylz)U_s&%i(nU4lWsUJ=Etw=4?-g+i0jw&`67-CdGhNvN^+g@=E>EkQ zNf|yCdEGpx$GJ4La_yJC!BB+pwIkxSFPxT*oqp{qldn+{{i8NY^PMVRmAe)MD3H*f z!(RPzPg9iUFye&LY?u*jAF{_f(&U}}rtl{d zv3OB`1?40TrqXUA>{J5(T%y|^;U2ty2NevA5|y~Av87Z7Ns@<(@-V^5wi-!2A;rVT z@mZeS58oi{W989za2pnwP2)8%LM7*KqeRFt4?_lhQ9;5fb`-i5p;WJuW`CG!y~>I& z2Q~C@W24a3aE$bKG{le9&gP1yB{&(h3m(;}#tC5*CUVuT;-XfOYBYz`>FKeJ$iOX2Scv7Lh53!rl(9S9 zV0+P@L{fiH=m_V|&5g`vJdN}j&(29D)a!$c)bTwg`qS}MjxqL2`vf>=3ilO=H^|3| zIp*$2O_7=6zyIum9#`CD?`_ml%yt{p)5F_st>D@br@vxco#5;82 zXc#3(qikSRJDu1=UF^FeibcD=Yr?kEsaG~5IgxzN+2`Ykh|a^HlUNyBQFL{G*njTF z&+9XIB%X!=vaaqsFiJD2{5P=oTi@T`Bje)~sqxj*QqVC3<*M(cAO{=2FhO0gR^ZeT zmci!#Mah~?6>9t|5y!1e8wr>5`gKv76!I%0NMzB(z*_gL7rpyesbYd?g?;kPVglr0 zq<7Bb!(9XzLhkxY_vI0qEMHgX^d9w4X5A>$^gH?t`qZO46yaO2BftO{Z#mzTL^-yc~j0 z2f4!T%~gh37C;<^=@W+W$)Tq+BYAUUUL$SC zdL(uJUZ-6MN`N~sCMH;(PVKp>SiYk|S3xp9!{V3U2Nfl{zOhVye3UyWFj#(Vv5LKc zThZV~Zi7nr`#bi&lsW!-QE{(Kngesl4A#&Fp3U_9BZek%=bnKs%EyMReaW3@-G+A` zS8ypWQWNM|p&teoX2NU^2rl50x&1c{md*-m?Jcjdn-ye23e_=bTai~4pHEYcF#kyO zNMtcTfnl2I(%+=9a zBoB?@B7Q5C1vf(W4&5Ra-`w2fPod8yiZ5&a&olMye?8dW0Q_7Z=_ z0whx!M=HlNkxtzwjPHiY$V3V0y>kQj()2yTS4vIYgI+EL)J3*361{!XO`7+3x2#{# zABKC2M0G%p+YZp&)$&ACE)kfO-t>vrHD?x43mZpkD+B+)xFi=$a=8iakP(6C+sfPkHoW13i38kfuvGvR+&Hd31E20rG@G-Z4+budhEg9_STd<}j zE4wWD(3R+t9VuAJbgjor0(i+unQfVj>q)AY%JMX^pr%{4Mx&bi^ifO6%HMxNzuFe> z^I0N>HSNmFolXBl$z3)rTkelL;3*!v@P`TJr2cZ;0S$B$T9;4)db7zR*x?sf(CAH$ zoAHf)X-?c)MT={0!xLZWLkd4*AMOXB@%?vQ*5k%39CK#&mI0H8BudNB&XFF-o6$`u zU$Bo4#keUp==X|GP^jX`xxAHP_77!?%?0H7+T{In z&%frA99fenB!zg3Lk$0Wl774OJ(nb~bxE=9=#r9zkk3I31zUX6<;JK~JDQR*&H9pity6!m!?;yU)|1>e zz0_@sA<@@q-wWrD?R%jYFeEkZCw7G@KrNUS!!vP;?Xc-3T^TmLq@m|4vWYuTBK@d) z7RmmxBgouxm0uB`mp|JOofTmHZk_YUS=2Jxyfg*-rQ<$K8?-|obbA$CS8zk)E%hTj zOA6PE9E-WhvCN9nL_83*#f-;vhynRbA^HCj!Z*J1>volQNqXn<%89+nTg03Ee!x*AC0z|q@2&R=7zP=B?ym2ly9d|l_bEW7o z^xM)I-(Qum^n`G9i1$|m!hb*iNymfki}+l4uRI%CKsqGdxrIB*y``r(9h#ohCbmo0 zgz@M1U%!5S;Yo$1^T*fAe_ygP(l~~8&_*&2IQ;hg<(FUi@GrXe^T3&McKBa-^1FXp zFo!t&XZYvK-=6^_on;n)8pRqQAoWqk0}P2z7w9sQ^ho-HKNA*6nt#9}p79YhY9-c^ zfuhC*b)uh1ETm)-75$DPPqjwJv=e7(&6yR0){04Ev(ic@O)zOi8p18v%)Y-$Z9NF| zGKbHE4a8T1yO?DFNO*8^4*<`k*OmeIkZ|TCWbuAQz}f`dFB zF!~ANyD)DNMTq~u3V)Q+ORM|2(HEEXRmhZ;XE}?cHeKI6 z=%n)_{r-4Y_?Gmf$U&Voda8Myq+z6U(Md1sBozZ`&eI8S(!JLw40}K1qvcF;^qbd6 zn++NXWE@8;nPrVgS}^jwK;{he-G@My#&fU?#bPi{Z_tA)CV#jpde}uh(9ubpHo6>> z!u8#UQ3c7U{OpnR_e7vH3 z>L|B?8~*(F@H^?;wOSYYG~6izlfPn9=nD!22m=5xbS0g6`Wn*lBSr)C$jCk{23i=D zBx4TapMO997`iL}_-WLK^l;qtJxbodRh~BVzR>;C>Lc}QC}1#={)B#;D|NpH7!}lg zOWu)NU-s8#Wg(r3x=bYJpSxv|+%m)UoGi5uYA%Wo*8aCFAti9+Q)}{O@D-aY@*U-B z?+~fI^I3aB=*Fg)bD#Gc^|2N^su;P$gM35~ zoy6kXy#G*6@j0@67`?!}xXrH44OInH33a`H&RBLwqu#Qh`$pZoNmc`uxrdHNqkrLEy|2S zC+h**mHgE9z+pa{WscK6U5^q>gE<@W&n6S(()=Sv|vCV#5( zMXn?*!KK9Hjl9t2s>L=PuS-meadzGvOq>Kc*&W(e&v1vf#l7y(z8zvDRxvV9Lq0YA zoZW*v95Fp;=G;`RC#FY71*@AFOvF`GFS<8*SWzWaluc{2k9bXqdGl*Bn8kWdwuC18 zWNaj2P)K@C_6pueaWsDaN$gAMoZG$AI-cKPTVjix&T0F3VTZ zJgoH!nh1Wb;2JQAJ=$)L_G8RZ0myrr37M$~7NVj^ei}S}w!EuqJKTuwQ506dg)PhH z`?KHK?G|~dSkO*hll`PZRyo5Mb97g>KgNl$SfVshY>{2(_5z1~ntxEZj%!VYQm=W( zVOUn+mXQx!Gx#JjK2B|^*^+H7KPWBQ1hKPRT8H*91S`;rNHDH}Rsh``=gQ2uvtb=l zphUhe=RT_4z|@dRv+`j_u}%Ac6ZD~tN4f`jm+?kZ9ER+s1*8L6#Da}e8-sG=xAtdw#QrMo7x2?G9<9`Zw&|MGXvw}MYvUN7` zJh|B-Ekv$z3GWnOnc{9{*5#Js6UKd5OS27CvAuCl=D0p9IH^cHt{F|rFon&A#-?5^ z1FBvewGHdm;}GM1PnYF-KA$E6UN-QhJ$`;SN!-x45$D5rtl%sotGEVdsi`GV1D)Xv zThmkNiudA?kAKz+=N8@OCUZ8&pu^g(peSV6#&iveX-{vC{a7ue)E{5qUxwmgZC6m_ zksDltA_oRW)r(={EX=d{R|Mf&nD`DFd|0LDP&pem8UDbU(cTuet&%yz-1Drtv`E&k z#%=iSR0DIe-EVR)Vcnsq~L`f`3PpJ-tt-+wxOu(=_QRQ@33F z3ro*xl(=xX92y>{>?sq|f2v-OYQg69ReXS^0bzs&+%$5qT$O_8N>|ll&iy zG)T}2Ws?&I5w{_i2W%aeicu3Mx3she{|JAsN+aXH_VIA{MO~V{cLKc|kPV=z=M~4` z44i;6HO>i5f5_%GJ|dovlbfoZK0dfOvn|sdh4xN%9YY(4!!a1T!ydHIYFQOSWH}vE z_PTdt*hxHgPj($c6PUpv7+Mz|vll{hs(57&RSK{zM6`b&b@zNWU=qY?@kr6 zMJ|-8*J)Mn*`e|Mzap7vmtn9J6Ngm32e(wd2npYp^BE~7mxG-NFal?~m$jV88fP2*I=x!^ijG=dYYgO`j`$fODnjW9YY~ZruELE;wt{luXcGK?{aJCis!Etj_z=0f^53K*uzLh?lZJxzU! z9Q$_>BFPTo@D5$`_ps-Su1L#h>yZXAf6iSoO_=7>)p}y$gH%G*YLV6EEg~00!*pHN zyNFq88TOI(Hn$4V3IvIfmY@c($iZ+jOW>Id6fLbQa5vZnQ)vXfB2Um ze_W$xLgjblYgYdx)MeE5Q2;**^2XAmriUE?)wN9bc>T6_r@@S=NWssmlF_K&3L3-H zy|lH`+DGDDg z#dQlLB@;@1)&k9KiKv!wZ>ziqe*zC*-ho^_bH2zC3) z-+tIN%ec|^PEx(GbB;=1_fAs3vU8Sd5%4uZMDIIf6-u|$)h8c zY(mQ2OYp@NMSwBb3)IK4$vy-_G~VSUyowwLYNnr2G>Mjvt;TV+srEAH!cVe7;qE0_ zBwJI<(OTgAT6j_w3KaI4U{+%SMqzqbbo%<%UCkz8=(nbUJ_%E_9T0L7)=@3`#pxA> z{tx~7RoqqJ7n)KGrF&KPPS8@ea;m})9GOxNsPF?Py@5|v_z#oV$C+}1 zi4Cfx9S(c4e>)2M$^qqNB^>0hO^K+}atcC9J*|{_u2JFqL6Hn~`J^=)3HNECHn6gs zNeX)IMYphfXS#)7?U*F{_n5^slA&H$TQdf6SSKJ`>vo#q4It1mMdtj@KsaVJIaf-0 zNO6nL!paYnvyZIXB_Xk6jRB;9M(qXcgzL0e8*qW4e|Qca1Q&&&8m2BDs{mrPT8r}v zRw}?n5oL8=eT&s=84r2(p?eyI4Rn3#@9;tB67$*?53YEnj45J;6vrlobXA_tGj?^9 zn(oY+>?%^-Li4oL8)!;ouDB77Q&4TLd9B9B2> zQ>HssqV_`!*v8-fEbj3TpN3)sVu<0%V<1M!cvXtSF|KK1^A_Gqda7p9n%wgMZYOM~ zf5qE?O&OB#K>@e~!T4B0TQIG=^i?jHgg()^ySkpnX9IT`L#cbmmG`Dw_!Ti0c}QF- zNngZxXj0WrF4d9U+j8BYN}G39SI*0`ffJ9>#AEgoO(Lq^j!7C?_Eeoo*(R#i<1VAv z`I+`e8^DOvxaIpCLyur;$nw39p{a|fe+{%ZXgLkYI?%#}xZ)u=3ul-Vrp7s=8II|5 zE5WsBt_6wjFQ=XtXagus^riaD;m=_b`_8+Bw#=?aSa)pGfAc+0 z8cH>7ES{9Jan*JW&otoKx}k3EZ1U_0x(24?q+?BUW=N>NqGL_?Dw!${FSqekeb7fb z*97;ik;SY}5l#q-(0UvZGb$c_hd)7#=1zSat_5@4^s{gbJJEg}YngpR5N!=ZAzS}q zY2=2~240$#t|Rl=6kruOht{$8f5QUgHm07BONk#Y^Zb)zG7cv1-R{#@lNQfcmc;4a zMc>clIvOZH&m5{?AUfs_sHWCTXgT3*zDq4FY_|F4)BH;z{k}cTzLXfU(vHA^R<;zc zcMCe^^E$qG}Ft?e@nAuU#F=I zly-T&X|mX_Q{P!#d>`fZ9Lo7l&}9v96j1d*kG2bE{>?|z2r65ZZr)Y7&hLjz%_4fC%xEB4=%Rs0`9 zK_r(!X*(0Qa;OOlWtVvf2PT)Wz7q`wMmHL-DwUVE4GJRz=_e?c+zkpSGgV47d|mh= zDV5^O^6!rC`t6$n$0NY=1#jOhK^TAI>&nj|jf>x_W1|Gk7xI($_(b{Fmp2Xyrhm;y z3>;y`Y32tplQeUSm_=HLr-5Hk#|2i>HSs9?&fJMSnXIVcM#bvrqIR&-AS}XZa;v&0 z%dPs76xQIAHkU|9y|K6KL5R{_hrR9Hx5EnW0D)dOsm=z%M`evtLi*}WgYS!cHfimV z!Uke(0%HMB48a2Kw_%YWK|3!HF7Pl5|kfWiuwE#}XcOy(YdDfEed2f&~} zsMiTrup5bplW=xT!6yVEymg{`7=;~lL$GoBN$9e5f>jk=IU%D-n9+OqtP;{^>;uNK zU>EVdlyO*4U%2ducOROESA8E%?TzsFL-rTYlv1#9Rwoxs`(q4C5y?x!CVwCu@yUD+ zIBmE>$mG;&LUEZl=N9DjL3(`YJCM2*w$Bc8XUnbnS}mmX&k1wdI)UCS;~Zvliq0zU zB26}XG_l5X+?rbp^5i8M)OPHUCS}a>+R2Z@xa{CMPUJb;m6My2vQ0zdADLr`( z#HfUpI4^4gH=EqNh4(!_RV!r;mek&N!ghFhJFrR5q5W9_3{YrNJFc~huejk7=7rAb z9^o)P_i-nmQmM1^%CqHGeO<^!>~r!;uDgW6wf@O__E53d*zOxl%I41Q%JKE=;AB%a z@f3R^>xD5j|6XFZ&Yi!3lWhVMjRvyOyk~==(cklhTrrAti+d z^_7#Kheh-qb_KEOetNZa*fl>@>o{{HzFS%Sc-%L&?3gI9v-V>;Rov^Lq*1APT)(rB zg45YTE7-r;m}M2yo3u-7W0NzB03zSM&;D9HmsBQfyjz@0@>8$NvE)o@k8SWaY8sT& zLdlw5M)-Uxv43Nj%bm&CT2zy6`g>jsvAFuyAJ5$K^W)e(owGJ!gC1lOI?78iRKQj#a` z8*=htt?kv(fnXQgw{NxexL~Cvp@_CvS&Y3T68ic$1AoX1pv6pEY}6|HvDxUds}dX1GQV1(=q`Rdipa`BA#*uDi;vc!)ycb(<$1t+DPFjSM@ zv8`VMQfcr<4b-Fya@`I#dh>|q!Jy_#L6|-Pby1^5ekD|)X9H$#!4pm?T zlAd-#+JD%)7IzPXsch=)Y@3cD2eo!|tq^Z*KSo|!cNc;c+~S5Lt={?D=bc_{l*t`K*=?PhJ_9rCM;dd^XBuPlL#OiDmgosKEvW6 ziCk=WztDGV0k5x8bE(3W!0cP{R!Wcl0H55Kynn4S4Lv(T9INt=#~GwBz9u)5R9wcK zJ<6~Pfcfa!k1B`WS$laqz-ayiy7l2eVC+Jla>%ZyeN$L3pAYDW=!LhgQ%6)JP%ZXK ztI_JHbb*UsIiOPxjh#B>Byg_NMp_pf)trIZi=$)zI(dihdMC_o-J9SOzzzFPz#8uL z$bYz~;NX&q&pSmX61xS-$`WU>W3zCbwj4#ts)tw6z(T`YZGcVR)lLrMQ*rW*EU3j}#^H4w zqKwjaByf0ve282qSvDZPc5Jty<8>pNM}M%pw{Wn+b7(=7oFY`h=l;~&89-U5{v z*2ij6Z==E?5x|^`N;~~7Dqvh0R?@m#8+6mqWZdYjUqeUhcz~(zA_Lw`d%j>ck$(ZN z_y%Vo!~T=heERyr#2A0p$F$H2B%VwfTeVse@ zK1znu4p+kt_-&N9l-ob`eS|xljepFh-&<-yq!Ub-fC)PN`H{bp)06r-t}BN_Jd5_e z137Z>ZP0?;`!;eROCmVeL(ir^DQ*>jdr(3rixu9FWueINcI4P)8!1kLl+!08)lPqQ zER#t6ymB3W3pFQOBd@O8XoWtcI@y`Gv!CS5(HPTDD|nr}Q?u*|%6WC>ze~Bo)0uvWCZ%R^WIo9$f8&K|`?KM12pdvN@gHak3X4=s# zUCE}Bsy$3QfqMKNWu``D=jYn4bX8qB1T-tB9sGbp6>~=$XZUWs#8e)yK55!HARKeC zT_E1>9JRZ&0r6d|+eS6*g;R8XCbTrbzM?IsDxQn1nYMP)-i5X-8e7uaXQYd8Q_odr z8%3Ebv5&jpigLVauNJFrpxPoDaTQ=KG+*X=7)y_J6=!0XW6^Ekylg7`555E8*_Uzh z2^5Dl7Yc_p7Ym0q7Yv6r7Y&Cs7Y>It7Z0~J7ZAtDmlwxTCV$0SxsK#E5Y6W+^aD$? z$l?Vo8kp&wS-_d?$qYxn5^rE9{(V>R5_PrMnid>rHBC{as#iD3mBXKd9KJriygz;S zrg3n>8*plP|6>4pAn9L_G-%D>0EE>rynh>h{w$@kbiL4pQff_?qrW}f&E=B@PctCU z1(#0_f#<)`b$_Mjkmkkr>fA`d(52|fb9|!1=R8Z&Wof2$iLNQv<(K#GpJWz6ieULq zzRiEVzCZo_G#AJkB|r_oetY6^)F8B1gQADQ4FCK-{PFa|oM?-d2SQ6)Ys>^KkOUzP z)&`;ZQ9{cQT1ZkGLJ3Jm!(L#e7k(Ik}>5O@|sW( zNDS0}{`qs5jr{nv0-!*#JTn$aFH*q-()xlj!l{K&Q8BDAyq^W_1$wvOVdML#1X21rTY@)^{62~Du+ccwM zIBOQZ7k><_QUVcMOE8&kk&dNB`Y>kc&^D5XG{){7`F+kVVe)gHSNOJ!bEZS4k4k0f z`HK-xJ-*Fv8e3;E!kDqR@+iAaMBxhh1q$w$G+t4wGgtY$eBx(Q9_t&S%$#tlGBzR0 z$6tPKxtybCcG0VE-?A#4QZ!KC(xcqvTOg-)SATR(_J=+cU03_6x?!3++IL0<5`P-p z8h@FO6!_zaEx!t;>1|(hqNmoKD5QvmcKmHJMo~*RBF*~D^kw5SFQZSumo;D5Pa(!r zP7FBDAz($&_QN^Ecqf8`Er&14ts-BO8cmtwdveG}f_Ta!Gd8zkI5?re%xCvRfRyGQ z#ecLng05b!eGp4cs2fJ9x(u@B?wH0u5{V5}F;r?**4{4B>yn{Fx|LSDC!G~wn*e00ZO#1!5UG5g6DiRs zz9^d%xJXZ9DHF#_g!9qDO38au;yWUNF@*P0Vy=VbdNiZkTq9px ztK$q=lkvI@>)VFf08(;psc9I@>l~3wDP(p_JfJ%?_f?BmNR>ai`@Bh_d(g$=3x9>N z6Z7$Np8j5vM27-RV3I%oB8T7T;rBFI2S5B9r+%xSk;7lZPwY}VggrSG69%CuNZ%kV z2g+DvpNZ^9!ssBVbi1EKCuf#uq*imAELle|bGkRf2Jvb%5!a$N1@a50NG|a7A`Yjb zG$l|N=hak7_t&kGcbbsdMIKx7Uw@Vrb*lQ0r`k&?MPs(Dr9)5W9YesPY2=8T{b^M8 z#A~V<9oF}b9U=FV`eAe{zYnHc`PJO9nv?7vsrL42!}6Eeqfc{(Io?4+If2?f8i^pB zRm8LuPSu3M>uAxEZR?@M{%gZDZFX@I6yVwk*I}`C;Gzx+ojVDxcpuj;x_^t48ba0$ ztY9}9;_bR%AKk+!?4T>D@Bx1ky7Un*ZM!m5jnU@V{G1B)Y>**iuTs&UuxktYJhGb5 zn%;d6&BIdPMpFkA=5{@E98DdlXhK(moLNik3)hw@#no0STR1?$QiW*{K-YNw8r~~) zX{_jxgpGHEyYC*NO6BGj$bX%RO7KP)30m!& zRL#$z6Vk(???9?kopKJOs0F!nyM(c~-H>4pV~=R^8XOs_pF;e~nIv^^90P!&1?cgL z>sPP&H+#xkGoR<$+w*%HvEvZ#s79qC=N#2&C1lX|s|L+7tKU|Q&)5HHrdU;Kt)t#^&7Jmm;X@&Rx@io?i=@x!fNQKZT zRh9}tC~zxF5ACAX>vqfCbex?F6UXJ*!O6!0<`i#H-VU8K~M6= zJB5tdN=5b`K5X>7^dD|iQfTVL`6wPcFuPR2oP)D-f=sf-xqqNJX#-!XL0+duxV8_o zwxH1)gpNzQgQ87E%Q+}oE5^{SOtZ^UHrFRh=%<5tSlAs9O)4+W0nr$teXZ2F)E;;0 zZY@C?gm4U|!{Y3~gh7DBkL)JhO`>lDO`#V-nj;%%^PRemW1k8v38N;fr7!byQm4n{_}$1u<;a&Llg*7176T`c z@#jsExQDzL{qbw@g#~gHas_%jM{a$!Bp>BjdPKYbyrm;;$m^tAe909F-Rfb9a`MSM zPtHX(=j86umfzHSmktk}yaG=-58X*8uOMh)#vPUWRDXBy$Ys}lJWy!yZe>4SILfz& z_T#Cc6ZrVucrbk4OMN7M-c6#DGqkaaKczJQN1zqFM)O= zlb11-O@A1r&+7RmSssB#h&ZY@4m_*bf#>{wPsmR+uQ|D{aH2o2#lJe&uYjH28L1?= zHWI9+L9jEpHg+R!;jXP0j_h_yh#Gfo3OdYVZR#&6*|}C~O0_m zM_`b`xY>8*+v5ZahU%2LeXpz}_b_Xy)zB1S7cShAQtb4&=%e_r{{_kl7*Cv-j?+$2 zImhG#N5)A*(~p*Vsl?cPr=;>9V{y-^x54NTT4$F6JwhjcTuF~Bw-LV2ujoH847cI} zJO~(RMh1L~^KOPuPV7tGA-?4Ar?@tk-n*4Uk2Kv>vG~(Eoc~-N>nQ+U9G`snC&GSl{(YOSLudI0e z`u_Hxw{{Ug72!$^zyEl152Rp37(Os9h?Zvf>tDkkZ-37u5@|||dxw92s%RQQk)~1# zU$vw8>u+@UCqDcc2McS4|N5an+;B=P*x}#9Kaf6uEm1cNQKw1)RH!pcwBktI65$>N z)TzS=kq5*{BBFp8OLKcy)L|^+6L14X7$FgB(BaidLs9NQJDfy6bD zLT8&5Zdvv{bW8VBeOB2nGQU&M9Av#hAG>>kRkB(L7 zjW8dEV+Cf;2^aiDFmoWlYz{yXylwDG!&C)-uZN3A7*&K3p%o^^vPZZl*hWYXFMS14 zXVhA}2vQ~qsI0gS4yU-E!K9@s48ICA{y#ao2loW^)YJ%n;eWzKo%q^ZZVLJ}{!gF# z#!I?UGKUddkqkv5Ouk4mR1k!5zi8a3HnLwM8hl}o7l`LDjLYHy6EdflhzBeuN{TFh zo)`pu!X;-#^AVp4^hcb@N+jFGu?^Pa%U^+28ziD$1gpUs!^jmEzsVN(jGKyRkGRv2 zp?K`g3ifg%_J=WA!Cr;L?&>V}YPy+U2#L{4vRnYCGpf&W#YgmjPDj4F+9>+PR1>*T zm>_JE>*4jR;3Pw4^BS9yh8UWwf%)oxG20L=EhSZX$Be@8p1lc{V#B9{G+`2Hgn zo;3cy73jl&tN<;1zVjNKg(gOt66b_wRg2%VMm}mStO7@@v0dugd91Aw;OJskFyt;X zc~L0^ToGf&96!MVV@Va@`oDpAc(p4ivXDT$21N$Mj>!p&7Oy9JMcE(T-a#^ddkm$+ zt64#bTB2YjH{`^cM0SF;y(HE+ON~TJNal$seuRMggYW+Ob7=1TlC(=tYZronNJ@>u<~i`n)JlY^9XqR|9M^%I zwp3DsXr0Ab{)9p(SWnrvtV-U0D3Oj_`r~J*?)hKP zO&*hjD|i+FTdjwq`E=FrlnrDP31+}AGy|j2&#?}T88fh$!?a_A6~t@5E=#5f(-XR! zSNdGhUg;$2ynjPs#xgMn(b6tirpJ;M+P23sqsOdgaqxDEJhI_tPHU+m0G&)my*;1h zq%4dZqQ?muXE~i(?%639O5&?%^Gx)W7?gJIlShgc^D}uUWnQilgcStSqBB*(ZW0?g zGaQ56iyC0U07jQ01AkqM$f@f;+IH;IciwNxf3$lB1r=I9+1mL(j?N0|8UYe7+FTb} z65u&6W3UNz8AdjkJ$9n6Cec?1kUxyj3i8SzNbHm)?j^C&`5;-kOm=I%?v(`0U(R03%TqXi!B~lbC!cn? zOkgRdW1Z|NBOu3}XxcOw9#My3q8aO+$=f@4y>NTjUJuKC2KV|o-L`ccGs=0|v}m$t z`7uu9mI?tED5ftAs3exO*CftTgCuoG!(B+*waVQ|Hh-7TONnuNw(6jg`Jk^Mw1|xw}ewIve1j2Op_U+0J1+& zDqWo@mVf)Pi`hoV^0~sAncMQvZQg|5(P4C(7^na(wdop$2~5klYDbH&{qx3-Y(t5e z&Ucs# zDW-Pf@~X$tl1N||pv@U~#(d#IV%MXkct1fgbbmpwQ|;8xT&9>uOHQ=B1nkfOZ3(I4 z3vp*hz+UK>xGP(fS+V+E6ftURtyg?q9&H$*q60e?gk4wxbj-SnDsVii)WlYTN;UXQ zOsNQ+(1jFIYI^p3M5zg05KwA@upCe7!6(8=O-P=PCYK2=1(TZK{d_E0;;;)PXMs+U zq<^Mk&IghubvYDAE+d%2$R?aq6giD^3?f&VWsV`2!IDDARR)qH$dYPx0i+r{7e6Er z$?|srbB(&gc-@}35-p{<=n*&6+IdycL5RDVA($20gL@op^quuAGZB|*{5(_b=yoeG zAts!=$Q{A{+`;icSW})uFh;q0u$Vdla(|y+1b1yfS;23{b0)bJ`7B$I*Pb;=oS@SL z0aaVTj%Ni!Bcjm2-VAttypU@8wS);ffhzO>tfA1T9wbEVqWzCV#hY zJl_vDigK{6Idgq*PHB>if##eEKa!J4Hc+3~ZRBI!bG1qEFSAVLw=Y)zN+V-kQPYE)eWLcKvXk=&(jCYEA!mzYE zw{5OAteWaZ!}>gKSj{TV8&*y53d3qBt{7H5daGgW2T(~unb^u*ES*~M=IG-i^hxt- zMR|>REy}YquV#JIX*xqRl(n;I`qDmZ+E86JjG|09qQ*6gE_(C1(||xU?|&BMe-y@j zW&c2u6Wb3h4{Wjj(9XXRL>`YxxXo4fUZ?{pPgIpn{AN`-!0%&TrO}|v0@TpjgN`iM^zCss)ZsORfSVplJ)cX2UvCI|w#-2Hgx0}Q^&QO`Tc+Kfd z>%JUkCcYCs@ztU6OQgjQV`PJlsow^-;4*=!Q&D2W_cEs4&Mki(J4)$tJmY!Xb- z9Obriea-9t05g0ZmvIYQ6PIIL5g3;;i&G|-p6QKQAP5cda=ls!|#I}et3EN z{_?jEq`?ZO!K&f=Zv*fH$-hDJO```3APmCr{g2`2uTm<**Bf6XB_dyz|91STU%wzY zZULSzc>Q7tLi-QC?))55yZByh8zpGI6hFDeC+NTCR+2BnEsafbb-r$|zkL7kMdm30 ze?s&5fByaDKQH|x$dN$u!>@n5ga?Em(5V5u7RH$2&wmZSz5Kn3D59ls;V=IE!$hVN zl4bIX{Aq*CpMR0VKl$O0+!(zZ{u`VA5t>WkwIBXH{DbAo7Ig=Vx->@X3F_d5HHw9M zf#Fd?JzzwPo@Vqle-fjr?dumK1I85Ys`Nxde|ka+D1i1YG*Xe41Y0ww2~--rkPOlB zX>Guzwcx)mf=fG=WGY-X!^N=ikEDA7hA4oO{||scfiMDV#}*MvQ?aWk21TuEe@{vp zlvRD~ME5WX8|V@VND6)dx?}~Rt?0@|8BM~BZsA^4NT0C}7|ViP#P_YVQw4RE)!C1n ze=*+s&^$cr4Kxu2c(@2nG=i)vXa)tv84fek4h=E2h$v+Z2Pjx7KXn3R8_Qq9+x51< zUA(0>@*cX|$-!Z)HaJj9C{(A(t>ZmeZXGYjNoDbDonfIGSvUz@-J7iLNM-X&geNko zabu$*ty5p*MFm)mHInZF1r^z;9*1Gse}G%E5TJ`pRH9%&s>8#K$~}jZ;P5`SLI)a{ z#*Sd2H3c#$ekh$&qyTh@Eow}e(C&o!FdXYJYnSqnOJLSs2}4*@%M9K=c*%j8hGt06 zMHo$nk)cJ`gzNAO_Cb1l>Kl;Sl&f3=spD+jQPtdlN6_4F$)?FPmOlwJ@jn{sdPvJHKgFfh7Vd?1C#;93zX2<0p~0V?Wt}az zju&GhbV-t>(F#Xyo@L=J8(`3jfA`0$?q<;n}XEe@H&17nh(& zo`i&PK?K?6?P9H>DMM-ke+Z`I)7gN@Sz&R*SdSJi^0$| zaE2?!VmFmamYx*)AL^*$e`)YQJ0Yb$u|2?tqeH_$z)Wx~n6x8f_=2?ZD|Rxu^V7=c z$qS$!0-&cmr~)-co#_OA>o!eFV=D}&KGVj_6`-`TUdno6NSCckNbl4dk+D2XzyT@; zlRNF`3z=+d+K+Ax}1 z`n(*4A3*>$U3^ehO91Vs7uh4Df*C+^5eN)$;t~#-n;GuP34_(q>$dXMupK3oEf0%{ z%lIn}esZT}*BAk2){E37LPVg(f?3@T*A#w_*vte>fnHZOIbaJ1gEup%WY;ddaFXv&&g39o9N4fNfSKviZ!)MN2kN zO(dCtI?)U`SR!k5kH!Nt@SI8aZIcz`>v>%!umbFYF4viUY-le9MuY3`Bs{Q8?$20U zv&@JkG}`uzWoC~#?IrM;78twi5nL$#&`ipy_QXnPVx+J7GQcnYVR3%BN4IB#~%I0Kkz|#QMSsEzeNlXBJLRi`Y3b%@NwrHAO)* z$e%DK=3A*se<{R|CLDJ_Y%HPALc@}CjS{fFP0iA|tuDVW-CufZ(w0`=+Lqh&uzyqF zI71uE^Wupyyoh>#oF zeK5P2r=%kt`{qgZkFj*Fk2sJ0!z^vE&sl(U_9FI?e_4*<57*2rX?sZ4Xf13uTxnyPPL-sp=70kk`5WWYgxJ6+tiTZHH%6WQP-J zk=*v&M)>@;ybGTCH02CPSCCA2qlMHqOKnqg1IP zwfLkhj!DB#r^6|ja?6#vHMOahS+iV1)1ll7)*a%0nbHIGP@Lj@Qfj^CJhx-1$_ULZ$+ zPEuDEeM(~9Na!TS3>TNn`DHdCY)adH1+Z*TKh-}9!_l{wwp{21pEcap#!$D2rSCeaIY4>sb{uKj!>B~5JqT7m}Zn2`jK0FBIkwQM;hpLnLTf7U!7g3_qMzEL+Ho{d zR-LMLQ;}O1bLIfb%)1eobrlF1Eo|w)DSA=HH|-JZ`uKut({x~b4?Io|3!pd>`!Rud z&=Yy|ne<(Y1aQW;`Scvi6MNF_qNm%@I@R1k$=G%qFrocz7i=xHFA- zD)EH#Y@I;+XpbB}-+IU4fc}$LDE|Y*I*^r@QCtxfm%U~Y6qliNRwsYGT)C1XHxl*xE9wUZi^Pox z#Y9ZAyA>gCwe2ZnX;*S~jFqF`SK_|vB3N95O%4l8WWGF+0ERAqEOhzt<@NLBA0J#S znivV1EuX(HfDb7C1&UuPxo7~QI4qyvmtTIMlqr0@;!9A%3 z;V9Jo{I#5BxeWH2yN0R3HM74D6Qf>B}Vt9?&d`+7HF074d2l! z>1(iTXJ7Q=ex8&fpoUpMtn-xg){dsPb;Ot?5^Uxi2TJr7p#$e)f?J%IqY-zMw-6M9 z7~2o#0~-N<#4RB}5UCpU@ki4Am=$d}BK~^_&m2LyHqkB0tTYM-d;vnE%*{8A)kH=p zCuqi5W|Tu>yb>61q>NnPXCV_e8<<#vxb)OE`TcOdAYGQ<;?Ud516E<2ON-hnycMt*{-Q$NFBP90V;W5H~&TgOdi;CI}u8lB^Fa?KktUkaX}bo{pd!M z_t?B57UNj2Njjv`yQoS_w6tfDRDw_#_5OfeVsWCGyxJ~Xs{enxZ0A473_Z6c7Qy4z z(&2lNwRG|wSW7401J>f^SL$kOX{nybZ|{zO_We4cf(QwN6c6Yllr|l~Zbdd_z#YW{ z18zr8tg;xE`{kn-|0yjh$ zJ@BwGe_B*@^PdFKbt&EVuCM4mb2Z_Xib#2u-|UtX{NA=rifdwo*)l2LxzJUby@jQv zOk>R11>&quqgl0VZmBe-vv#y=_xg5!%eUwwY31#heJv5KtPCGzI)(akT*pw~F>Rt= ztL{}QeAuZXD7!N3L=>hlT9x+Sfid||yWch&X25l>#L9hw6Q`bic_Q|4gSlQFv+x`F`s2=1QSE6NmfxhK#Q*Br_g}&s=P{w7ij>X)G*x)Jx-;s`% zmW-Ak_Sv>#k2laa zMmDp1E!oU1F2RL`C)vHg`mox}Y3*KDiQ4H@oz&Yj#|KDoNhGeWE=Iyt$P9^N`BUu_ z$!N!__RnPfxm%F8eZGDX3`7$WK%azbTC4-Om>^Q~C&A@*C{^BH=eoFmy{y{y$$UyK zZdzrdfhFvUA+l=6{uTnJ3x4e5B)Zcm9H0xFC=gFV7ZkB&lgDp_Bx6)DGJo?MF3BKm z#NJ_?_qo!>(Zpa&j%L53Wr^g3G(R(ZT@| zmdv(6K4(~+w*W7z$`<5A@UrU6(dlZJS>8D z4qjnEwYeGMVub~GJ&Xt~H&woN&)_7a)1n_hDnhaH97rV)DE*b=#ao8imSv(>0zN@Q zH7&&N?&x4x!~q{)zI*as{!Nh>+|G|byB3>=@IW;@R65U5ji3Zd7wWufgd9`*HLB51 zP|Y-i2dZJAYmY>7>+e2Y){+G>lRMfN1B)6yTH3W8W8uCKB#rknYt zp%8jbl|?n-z*pK2bzAFwd)ZyBI!`ty=H=PPiP=!VJjGj>RfNlYP-c7e(zN4DQ)8+U z^stir0*1E998BdvE`!9fGdYl3t@vjrfu0BC0B93RnCAe0Z6s2XHP8vpW-<7hP4d>7 z;n?t4Z)=kWQH28IIVdVlgf1Jh zQ16ZHbt0tzI|tLWI0rCEP1qw_N_P@Cw}K+^zZM=VV)Y-L}H+DMK4$r6nd(E2};7b#!T{r;-{J$1HC07cY4X zl*@6jJI>B*@*gikbhA8iF(ICD?X9F zwl+>eD!`S9?x}d~scI9xYe0+oPzY52PR~WPaVf)p=KRP084<`e<3?}o?lU#+{uYA) zppBz$4o<#?Lw}kf;tm!I;nHrDb^EK*c5_5f^Po%r$1~r2vvSd^n}y1hBs@^1YnC?< zsNB6+)6*+Q9LM$Z>>2rPj;*sU@!)08(QEPqn}QHN44zPbvlEfh;jfM|TR#)L6>*q! z3!WW+z)o!Wd-oZ7Mr%HhT_m^xyU+~`3SePCW5W&Hb*+AE@Pd3Q>RwwGpb6*|Th5Yx z99Xa0=@l6LdkPz#X)q&Ijp^6vi;Eql{fmp;;0qio2Z5IIhC`*>p55pR913u8p!5jG zeGUc2-P;udf5oH5?&|C{jB|*kQ|tp`;Yjm;`O*aO2#97;c$^}Jel3w95wsiLIEs~=ncSLTT13$oK zthQEXILBgg#Zl10XLXh>-j*(|HGM&&n{n?rcgnx*FDf2_Tj8o^!iB=kqMnGjVm6ng=-X0+eu;K$-2GkgUZUG> zk`#={@}GQM6`oS+YpK)zI+Xvt2S?Tv(>J>*&=Bj&!EOd!*3j)NyL=y}$aa<$UwcTF zcqM;Lmbc4fNq64%by7wfqUor?3sVCz2O@Pope4Gp>}3B07?w?C`(w?1eQ^NY?U@Jo zkNqEr|C`J{{~Il+?*0AqVY{pI%c^0!YR2g9ragTvQv1JDCbe}U6Ytp)?Yw1DC3$MExa&Qa6nMjy$!5cDzh z-O^RPeiLA+1vvV^>o+68w-x`S&z+t_XgB^Yw;d%Y`XD`d8=nZ5MZXgbBD{`h^U?))=CY7IfkwN|Qt6!_SO){Y7PC_t(R7Dcd1 zf=LlfvQ&_y!KyT&Y2Z*x!}lO@gii!X2Zr4ov$9MO7_paetki>|ZWK+PqJNY*Hg3s@ zP^y;bN#&(_8u;%t^{0(pe;Ou*Idkl#L?l{D>7|4#x*&DDM?J}LhNC`f#A+F#24tXY z)DTsq{4a6RMrqk}NA%Py z`W`)s@~zYv-q-YPo2N9Aaa&s_pk@m7zIg`IgFPxJ>zI?1>G3#tmvq1r5`QxCf>0BI zB(tt=EEdC{8@C;scwl&r+_$xLkK~|NhvyWv5{vO+oNqH(&v<>0-1ax_actVqAV3U| z?X|cwA6uFfW0|v)C-6PF#JAAX$W9eGX*ZyCjNq-Mc^uUmzQl9QNA}+OQLRP}i-~_k zDssuBf?6twReh0LX1HGH`vx70Jg?zX2w3Ch-NC9pjcf=@|AhpA^oif$;f?$86e-PV-MPZIU3sj#VI7$W%&n9>&^&r93a|AE@tcoo) z!OOvRV@d6&|Js`rnL{5a+UW$PY>B!^l`dN#{UysM<{up>FnO8-fq(PHK~GBh&l z-6#iexigRb{F9WS3s43BWaOQm3K3g;3ze5jNT`L;6{8>w!wi{l96H91VD`V8)x`8G zL{Zavris8pJIk3+m)yb=B7c~m>~?*X8VgeQS923(YoMab@jz5-m#t!8a*dUwOwG00 zBG46P*VWo3AhDSGs<##dDVS@QNy3DQ9lNvieWe^K!;+jt{`?Cc{!I^mqQ-tH_UG92 zNA89X{~iA2i=z#}Bybc=_8{DzU_MZkCz}akClN|GMi%h6h=U^&f`3`NFO`hOsaouA z{nsyn1j#lGW-IIW6hp*{@%v(TFciq`HcPUTMg=u8R=r9!utLI@sC<^(JlvDz=JC=z zI4v%kTu^?UyFRzGEgCi7j%m$X_kbHfa3AL6*+5XHsL8Q$$}(JD*!Ue*X{UHGa@@@G zsnPMi2JVm#FRV=mqEl6TYr(eYr>q6j!9>haSnC0 zP`Srza$L4>SevVhByU_p?8XkBDysK`{OHD|fwveV|1}mTEK?$BdaJCJTT0+$mEc(@Hz$C_`Cw~I&A@9_!Q3EON^8s-UQk0=9Neht*QbG#3X$}Z_dr$k!^hw2kb2i_9*FV85P zza$)Ppi}4NGMjGV^eEVBQY4;T= z!WGNYbn!}z{|g=&%$Fhh0TY+e#}gL;G?!r$RVRO2OONC>4!-xVaBdqQqlgmq0vZie z^-K?tTe5u%a@yVGvUAv6_V0(1C|Q~-P5Oe`J}-U1q8a_ z<&%Fyi1crCz0z~YbZK0rO&kneik_U(6CIwJO44PC(z?u-=zyfb`Q^9wpPnR}P(G{P zN((SyvJM4l$9kWoS&XXGS_wynFR7DNNLHecnmW2;Natt|k}Y`3PfgTDG9_tj=m)ww z!ZNihe4-VGEX7cMq0b{R(w^&Go9QCI$R&TuF@`B$`F`}f8rxJnU{C<)qaIjLk368V z2aL|rlO~e2daG2LbzMD8mMy%L?nK*sPiNQz_?Dkmd5u@t`XAqnpS&=^Sv`thtE{jx zRJ&~Udf}3|7VcsGZC*(iOu85zp;^9R3d{2M*N>H6sK&3rTu#*kZ_MBA^V3ck13iB~ zdAcwv2uId;ql_){l_C#Wi? zBP#a(p_yR%)jYhUaCD2X-g1PpK<-;91fSXDU?YS0@wNN)<^AbDPyMVK7lc+Y{o~tH ze1IB+Cg*?^LEGuie@(wX{oHeHF*kpCOe>VnEl~8b%;1j&hp+qgn~DLQ`+X9|7%#D1nM zttND3rV59eRD@6BJbfQbzM zU?9fibE$EUv7D3$J}}#vg`tH`iRF40$27x$LS5iW3B(1{vpo{^K-i*bJo(J(>ybLw z5JQaqLh&6^l%>E`oPr#eDfCI4Q}iijjkX!OnTTIXEl_fC(Ey39q&#LNa27SJSH=0H z)3!o+w0hpBifR|t&6(wS2W5XO=*oqNRJ|YRW6h#i_gUXGill&#^;_f+mtXrdx(2Y) zX6T%&4gyw3aTs9-E53$8o|Q~0e5owzy_jy(x7GyAN{mc_#*|bP7KLY14BtJoNhjv$ z_}PK`v-z;4x!S2L>_T9HgSt%&_=B0iavct{*V%c59L_P%WZ-g-kobUudWAHn3UYd0h!x zW{-ijIO9f8E%$5Kyz+kz2C0e>!8zK`b=3jVZnjMcd5$T`JGpOT-J6XRHq4o|^b-7RR;$ku5>X zE!%*8zj2@shsM#o*+njPO?OJcbLk^6WYX>`J%h!5A0M~JH(GyK<9f~RuiKAp=(QCF zu$P{oK63rc>4Z~|oI6z9y(n8mb^HdFxnzZAqPap~)MbttKp1 zD(SbIC@U4sxO$#bX6DmG0kCyxgyn5^?BV6{6bJ47MT%uS9?!a>owN0(wa3xPa~%5CArowlWZTF{#e9ch0-8(o^kjiXt*Yq+>=Qw!|W z#(uG*G^DH4#Hj$9t>atQ$gW9m$CE4#eL_3QI@ z6qDL%;X{9g!gie~AD+84vUB)Fz8D;SF%O0vrdi2oVaIk!F2l|?<|yy4h}^6}i#@Xj zBkW=N276R61MFctJM7uCcYrEPyN@c3KQAChUq%u*E}H*_xj4qo5QgiJ5idQ>m|paY zcYTinZ}U2sQ&sjGLX9SDeUgt@XZiCi&=@J7=lp*$JRJ1-(AiqgC1_doSzbl!a6=obyU8{*QNM>|h$xJPes<=q`#y$PNZ8ShUL3Zvt=luatDlJnQ+^datNzHK zlUU+T(`ErHzAQ$(?jK<)O9+KMho+!k998?Hv$!~F-<`!uS?d(=Z49?HN~SfD53R=GuyMPlSN^{U)HHk1Dx3EeYOwm^(h&Ip5IxjWo~n< zQj4cjnmHV8dY$PLWTrckAe}jyAYH}c{bZt?6|t$<*=NqXi9&f0()WW>{!cak*yw*; zPuF^6GrxhO%!oaAJ~G_Rsj)8cJ9;fDhOCoo+}+m8We-p%DDO1(Yep$4Z?1x63=|jI zVIV?WJKeODmEQDk^WfF10sCtMyl{U;t!&}#4!_kmIwe?aD(81Rx8LuCT%3JErRxE3 z`(9@XZrAnuc`JTvx_#*TaW`2cf`!pOL_L|YLvg>xMFL@J%QvR-azLv$o&?bMja-Z!3 z%dQYzH@84#lie}OEkoYeF(cIzxd83%M{5Wl{+n@${! z@Pl!OP6M=R)0$qsa-y~CYocV*p_(Xh#&SlHe!=WG-*m!Vt@>DEtzt5dBUMZ%O|O>u z1<9jg!_kavwC1*&SRYl7C>b38qX#>c9#f7O5GbKz{ejiU=s$r7JO2WijUI+Hi zH+VM5KBs3Cj7DOUAdZg!h=%y^+rWqSrCThmT(eK@T|n6r2V%4n_#3 zl^8z04?jP1E;W5#=mVT9MIS@ITl&V+S0yaX5RN|L^wofW@bjRY_b2}V zl%PN50LZj-!|(qbetr6Lp^zzaX8mvU^L>t_(acKYN&fr`AO1lPf1=6C+2Oxo>i4n@ zAO1D`g*MoKB5WBCgcT{=tr6yfWX`%ob|ityF%Ir_5<5B5l4-k6RdD98CmUd91;LDK zjo849;3ZKJZDfv!Czu6e699k=4%hgN>2IV5Xii@>_W)Ba&C-69J_IGCsrW`Pa&fgE z1BlN9Jn5UJbMYFXR7u^yr|9#j;2Zix!Hg7-Rwy!mh0CB+G~Q{=?~noBzB zvP2Rf-wxih`-7d2E!aF74zx^9RdNHDIGzu4IQXWl@Xp~SJ*`*S0D!GXhgQ);o%!=I z3EWA4nCEdX?|S&vN3Sq?NgUc7&w`8cyI;!4IgKQzr3yWi^_(LATeI?#_I@d&;jg5p zFanr%&}qIdbE5=#9+cgA+}*oR$XdMCyg}BYDXUw`B5~Y47wukoX0h6+r{t`&W+4BL zQQuHB1upC6RCxE<1xV#F1O^fTISQky-nz2+PWUyj?Z<6KPObqiI=fdPu1YL4KYypjT} z;d&zP9d?k8DM}8^q>?mFr-9@ogy8pnypwC(_`un+M4Zh>0`@9E}h76Sas1|Avkky6W}YzTO2#aGHUt(OB*|V$6#% z<@6afXciD@m`2qR-3FxJ(!=KtFt%F?w}8Xo*xR{>P$(E^*UNba2$Q?-qlyQes>BD*RziXo1^f1~EW z;Zv#vfP`oV4gON$uhcGZ8E>(?(-Dbvy|LgC*uCaFII%9fN}Y^#x$rzNa1x2sc%9jy zfw?-_R*@FyVt`yVMdVoYE9K%?*epe5Q3{*qNpZF0_DRs-QbcR)8J zr^22ZDW0P6>b1680q3?FTJUTtRAR!nsZM;V3%A$b@Phw%#@z9LwooC?QJ|ZxR?iag zH9@4WX7{H!xH$jF3&}5)8w-d+9wc>NyNR*UJXgBY(V^heMJ5ZQ#U6L zy>9zdcv#eR6-r7coK~NtLhjR}x(G0Qi(>Et-?8#=L?0vUXcPNa2Ax+=0hSSN>h z-_i+%7P{l#5dv-|u`lRJE9r`%AJ%xZerNP$e}AE=gF^C#p)DkPQX860`}>~O^UWA( zZfTWqW5ox5&OIec<)lcSd8E3pdX!QhzoT&tcQxHY6Xr(qF5zl_skw{IM`d*vqCl6q zJJK`Xn1d#SOI>M0FYDGU-KC4xOH>T|rn~)1W0!18(T++Kj#SA@a7o}Rz5N1E2Ddp<<0`GWzX(5fZ+z4-$IAmD*vtLhtnMH(j;6D%L#uP-#XI zX@19FzD?(>H+@r@|9_-ezzdgg@(B~SSqT(1YL{=_JSMlaa})^%e^glDvrW^T8d=e^ zh%xovIpE%MOMM}Rm&Y&zEYqd$hRs*!1gptY){w_yWYv>+O&t%i)ZM}+FA&Df zSDXWEq(iqNRus%*Sa^(rxnTxM23Ic}2s+GuZNW-~<;=Po^GuU!OCBbSf{C=H4%7BH zf9(?Gcyz-3k2vt|e~}hj4PLi?ZtGn*AKe|4ISZ$mQ6(vh%fegk-qx|y&?q@84x>VS zHxVi++a^UPYnb;Y%8g3ySH_BxZH&2&QLDP z)9w8VT2Z`lOu_XM<6|q*cykXTbc{|F?yI6T6f4JSo8aSftV3~48%cVWP z0wpzK9KuSSPo2lk7{f)s8`r*!Aw9mIgib+Sxpq$GQN)=*iRPsW3LEFtxFAo5wH?Yr zCJ&D~)zMHYn;TkZpJ|!PJUXJs$0yT* zQhZP6^gEWg(sX^3h`gd#AxgcuGnHGIkk146aRFDdf2d9e>q4h*&9B7`@*0^G*lv&q z3hvQj-XPydEryKKGi0BK@a@mvhvv%n?5E7KpCTKmZ~zAk#?_uHvl8_`09@bp=}6*S zvb|;%lIP>&Z_oC$MsQqiO&TM^M1GF}S@lfLta$XT&L2S;lPll9jgllKBUJT9lHilp z-6au`f03X@Af#<~qxWt8K%r@vcB~qJtyBJ-lk)r9s$_6pQ{e#1HBp9X3SFj!OWvE; zZlcHM{+d{_DaN%m!Ibvuagd>@6*ZiJGtGn7*r6;Fri8Xwg|1|x?yhrY@>FWWl$rXb zrB#b0q&2c|y%k8wJ&XwO>@%`I>F2>z^0k&|e_)QAwzQnpBeo>0`j)jzcy7Nf;O8mC(eDSx{MkS*^Ay+k0E3Sxxg>whzr;(E{i!}+r6pHpX6@=XwgNSC ze;)m*#4#6Iri|aELupE@kq3|hO8u)9S`Q*Mm9~x)Kz}D|Y7UR#A%L=T*GgT(Lt^-k zfwtYda!->X)^^t32ij^hGseu?inrTpDObf=Qy-unmkh_nU_x$M(y&NBLrtVmzmb^y zdlTO{LD{Ok?v(<33(r|#O1Y&hcey;(e@QEEUu>TiK4eysht~nF8T7DEhkC*(?N+!3y4Ha++e+JsQ#h7GWNz$d- z2H+;nNAXyPS@;m2U$klv9>00J;GoIgmnLV;YW==mL>P`L&>gjxLLZIBf@1o*EYB>*$zA!3F>@44Oz<;mRtt_ zx3z1%bTB@RA}2EFf9`I&?y!2UvofwQkn^;=`}W>13lQ1$Fl2@X<5#3u3XEZVXj^-Pnox3XgK5|6IdQUbl|4iuCg<${v-aY-$6_2VCEJdSvS(p@xv*#5^4Vo<@#DN5->V~D zk(2OgT%w(?T8Z2e-w{!;ev~G;6gVH7bv=z*KLSc-f0AbG>FtBEVR7r`NM~(5xkv}( zdQsc+(n7sqr4<}>yKH7H4Fn+cdks3%L>_5$Qdj7$%3Kg76N?u{}MpN{|~{R ztvvO6)9FrWKK>OiBiQazgkNxs=^gVY^}bwczY^G~k@}AId{$I7d{qn4-6j()XeK(* z+^!umM`pM|mbilYmuZ(51`cM|Vf?9Geu<*J76)D~ocJZDMZ-d$K+SHt0#g#`@wDc> zqNls%t6ejnV^6#NOij@9H?Bzj4=-G#m(dek6So8!6+s)9FJV_Ew`(;OUkEhWzRFnwi;endEn(eVK%8vbSoHhu#Wf@3ICmTd7^}Rs^hB3FOrZUjPzk>GgTJk_BJH zE==vYA}-CWunNr3n{#3d)8K>Pk!!3VW(I7<*}CX)2}L1NW|uZnqGYsr=KHl}KW{B^ ze^%+vFmjiT#MS$*jI1q1I`3Lngvs3VC`?9^OGbuhOn~EbKU^&mJEI+w!jHsGSQeBm z#BPwfW}9Kjjh>8AOb1;czpNq-xvXIHZ9L0}J8>H~=3R7i3%Wmt-a;_uDMl2eVqo*n zrMFq66bwG}8rwd{`e`m%mRCjMfA>d(|m>GSg;0yFSMmJZIoqSgL zx68kG`B+KMuh;DoW{P>|U$mOf6|vHQA=bL^e{#;+LDb-zX`@&FOg>emBZp?IvK^2Q zh;7A%+?7$Lx$|Fe^ue# zU+>e1Wu>LI)U((5S`V(ZWM0TO^59y-$b4m_3mICPw8pUd@6Yek(DLPep0|=r!1)Z4 zg&3+5r8l6$6o=k18th-g^(%*b${qzkZJ3qeI@hm(y*-~&Ug!F?Ksc2z@fFXNuyS5p zGHvDCIDXAR+w^QFCU1J*Z2Wwke{#jb*;VLSM#(eHEf{~uHY{f@U%~?=PIWV02n*M1 zejZU31cL*9ZA6h>atGm>xfxK3puQ<+9dcwW(X-@-Hn*2+*R=1~!F9b_7vS=o8Li(4 zE|2&+7j!G*7zDr) z*IG($ml%hFGLqMtRI0+$88iVNAeZi=)8LtV_$FN;cCw@5I%Q-sXNJTr3cn~ECKs$O z5g^bI1^{a5r(}(XR9KjE$uf&tHapA(*CvYQVS3ie>-YOFE>t>ReV~Em?+*Y5(DWHAsD0<8u60(dd&g|)i~dR z`7R^VgpY=&E@u0+m}$1M6gX24_wi`0bhel1m5%I1dFUO~vECh8r>rdoQz!b-LhWV8 zbVsZ;dOPV)U_Dy041rm5WXPnhr)^cYlF7eisan<^G@XDe7g|Wme^y9+E^UR_YhjG6 z_uR}L<{Dn^)fry5gMl?+-0qI&Adh4^cSST*h;&YQP6jd z1Mnp=T3&4Luz~7oN3FAw$0xOO;?-mj@J2!4;0%4p`TsG&0`I42hMVaB4FUi)3yK}c zwH$3>Whx}KHkXG!wvA9XiCze+5_tgBt)1YM?Dma7jYP zU>^Yq4r{*L*s56@C4(c@VEWQCfQ4W6Su^UnrBSyuK~|Aan#y@>KcW7hX#yl!Cn#VL zQ*bQESPBst)CBDO``c3<*QcCC&W(^ryufX4q&0v#(z-%YmRLdVUV0a2y4%KA`SoRm zIEvIG6Kc2Ge;^c7_&haJOuF98%6?uC5QfMV_>7Td#zi=KtgE=3U`s^>O-rj!v!xhU zYsIIFv~x{gryx*kKcYnDjuBntTwRr4x3&MWHY3NWDXHz=A`~{XUw(HGHMq+^>Z@~^K9oC)BqC4(MKjVQ0~*07BL98^y$iZf0@S|qO7k(ifTmrg3e$yl{IZu zudG`x1<-Ri>F#Kr@>9AKKZ8+qtltWHA4)khMs2)_3e2&We{$FIrPOTPV$DWcrZw1P;7s_sp~|Nc zHQk8Yy~}k@R)MfZrL?2Omu;2$S%Gdp8yK9%34l(=^(KTa#`O}TQ&|6f>U(7#e$x=~ z74L0?!P?HnM7itV=C;AMTL0>xbTOOwl)bAki!Ww~Px@3z)^m;$cL+%|F?!E?vcMoM=Zh44j!VE)x0_5i(1P6>r-H-a~{DY{lfGlo&kU0DL45q-W z(&M`FeN)AA_1#drJlyCh2%443;svY$G{W(j;CG*-*#$`<^XukXHEbdf95>^iryRg10C|GH)&H3d;=FS`p zczBFB3mTQEl+(`xO~c9gero?&WkbC+bSC7FOsIahq?wZQS1m^*{kW!+Nc-@~AyG%9 zk7M`hy3S1C?Z_pLD^YD~lfus&=Z{0o{{TaDbe)%h_!JbkW@Z(wfdnbvtTLAu=oMdo zW_1tmK1;uhZ$`VlYga5Dy!sY25ppluF7l#g%$Byk1Wg!+K|r1-F2|whUiTg;UJ;J! zFH^iyF)PHm46jg{VXOORcm+P?Y>OMdig2)9Ax$piHN%w%F7AEx3aER0nP1{gC|*tE z<9!>;tlf9V`1HJ7JNgoq`Mt1Vrz2lHg*a%s2x}$$kNDI9GezFA$X-N}8)sSXGVK!H zS}HF{Qe;|m#Zvb@qwc&3E7jZ8HYsa8iz#b8;3;c9EU{d9fw5e9=Am49~5YpC_V%xw|-F|!v=q1mz~zRSwN@E zXySwMEG-u@ZG?F@94j!JOhAr-*=S*LJc>01vuTY5K&h3k~W4r94Sxdf(orG_=T zoEXVZq#j}N2DYnwWp;m7;g~t+yL=E)H|;mpC_&8Ygn3Hdia@03-V&u)@_}wV_?k!V z+e?&`0A+j0mui5xpsDLUJM7(kq5%@cLkq>hcma<;%m9NTfVyXa-z;LIX7NnO=wmnq zkoQp7mWhKL546yi@Hl35xojj%NocJSd|>(b{(-LmN-HD;Jf?rxHZCaTYaK|U*`=r! znhILqFo#m+?3(XkJN4c_o)w&w5>lIE*aIjd^q6N%jOol61;$G=Mz2j7cw2{$&9>z= zv8{3%o5gK}Z}%`);G-oboju6RC=P3j(}IKrV(OZL?E+n?tZ%Px#cKDMRx$zI}_RjaUiYO z0TP$LNg+0Ws&TNw5m+^R{xJYQko*afZyFjbfG`?{&mY5Y-=tKAuQ$F>O0D^_{M+$2 zy*z7h+yY+tf|qBD!2dMxrP8;$@^#6--OF=$9_hq)?YB&k(i`eEKGD9kl6)C%iKr>` z!y^H13-;yr&tINoo)YjkOuj!ppZ@#QPs)%HTH^43&mT|W0csH1sX=MM(;fc$_wdKl z-z$YeSqc|^@#ps?lGX^PY#{mD?{fGTKm3IoYww2t#il=MH*)yT@DJ`_i?9?g=}g;D%>ly=r!LBPv6R2!1`Qf z`tf;s8~L}qB$k_?)38~^{U|^ixRV#g!d!^@DH!w$JrPop2 zBe2X2goBYJcnzw++6=!<1(8#aVkH7vLx;wvqAIGhg0A+g0@E)#4=S${geq9EC z8j2Ft<_=Tk@!Q4mBe&Jm_o97Xu(B8`F8j3CRYZ&tU{p_0UaMNM_hVt5@QNOdg|hPYZ4>su}N&Fabeo+Z_X zo*-!~cf$BU;PJ%p(>qf!%F2p7BZ^oVO7GRci(>?`!m!WMQH_izN3S8OlWS1~(K(*- zLzGXFNmAo1nmaedR!I~{(D$E4eK(J+iggyRt{0%=T&O@G>!zOK`!Xje5?0NZ@Jt~Z zSfr&9M7DpUjEekWy`b6uaWl62f?CjQaiyD0ZbdC<&6_CgW^6ZA3kO8gX&wWeEt)M= znY@wODgenoCfVe1lqFgg-o-Z!u+6uXDbEq?;+u5TPZn$-9hYHEAx3{9-d4rk8XWMf zGzz8F#!PxYtY3!(MSm38?CP9|tTn<~yBAr3}6y-?_9Ti^q3k>VYj zhqK+Hmg>*nv9$d^YRA&{a>kCOqqwnSXiS(VU_pZC0%U)ZI)aa-5OIy$-43gx zSHja6R)?%+UQ4h#rcG+-J3iBska-TW)B7|OPqX0sT+uY4acF|&ro5ehf6VB{p#6M= zt|WuhBq3yL*dFT}S(yfPM{b?~C?bAu&>h)jCGdUFUAw5&zZ!IB?1Y6e#&~lnWKuh8 zI{vtALh`~=8%=-145=A2bZfQ~>#b8-ewq ze?VdzL9;9MrNs8#BzBHWsu00{NMai$@e+*@f%jtG^#XsF6BQQ$YP*T9<#XGY2K=>tgRhW%TYO)ed~67z#Bjq-mqJJHV~}E z83ApTFlKalDf4qyjFHD}b$?B3pTiSWfDPLh|7#Pj!_(S;i=4oeJ%0dP285MuB}1{A za@@_$D-(ZeNNAbC3U;INxaQ(2lZvWhNmjUbNtP=xYJ7f8DezF*rFJTq;|OgakCr!! z^dRJUKW}kN`^yQVmMW3#Oin6`DB~}ud$Z!+<~xh(eBwxMp?P@L8))+O25+15FQCbT zw{FaU(z01AoJPf+&t776?DDsyomd^7(*{;5+3E<>ZQIFo>v#c|sZb#!e{g>t-f>(u z@RrfsKSq?K5q=CbhRWDd=2*5Ac->O}Y*#w{UvxSq2@KApqHG6>Wa?}Ka;dJ~tN)Lp zaT{dilPmEMlvRjYj{#a`#}dG8bkTwNY3Lq@VFO;5T#v`V>rnWLZkTr5h`+bBb&;oi zqbPh?gS;O6gh6$kM;K}$fBDk+H|65<94L|>`I+8{@L?o25Vpz1cnrc8W5Vz@1MdP} ztpMNqkYF?JK3^{1dp(HzVSF}lr{s*BZN1N?TgQt|xJQK@6e$5?q;Rq|eJ#bUDXhA- zC7bL>c5Ymc&u0TCog9(J$P=i<4A44M36FJNGzpWI;~Y%{tRB>GW14fROn;`XCTD~;kvu%( zEhGTDKt#W_@bINj=iMasMR!#^^W=ZhiH%Seg|)&<`4_9cwc(8zq`&4+c|D%d=5xv+ zi@54`Im2WhnA0&Rw3?lx0Ds_3ow2ubI(w4lNqFq7ybl;J)L4jp`>@llGYcX4h&|yJ z=rLDYs|?-8lME+LX-$ zv_enZjRU8D3P-k-x-|TKRjH}YwWs)gvqYwAt&dia@*OZUTvqxn3)QsFhaTp|Mj7%@ zw=jAx3!ePlgU$z;I?8MOQl{9pE_z^6me3De5w8n1HF(!Nc&fDl_alzNSm>$GN?xo^ z$?fY0T@Z+tVt)*B&YVG*ID@f3jBb_)^)#1P7*L?D5xA1iZcfA6<3P34XFz>H zM;73^@lQF_j2yaoye!p@b<|cMlbRilv2y+#6I5BfrM_W~0m(os8CYNxsP6W4YUMcMgf2vVyIhT#R z-OYm)-iqL#-#P+%IrsO`*IY6${fEAOhrZs=pcTfu6l&as@xlw{ElqRR zee3K^Ek%p7lVckZ+C7sMKZI-wC+>rg6AV=XJ@nO`6I|Q{(B-Ir9n(ZJRSEN~eREeO z?=s4cutjyzB~^l>^6ea8^3H?>PA-hmTpZ&zmmO*;7=L6QoC#OmnAB}oljobw-3DsS z7F6`j5c_Q_le-aL;iOKn!hKe+#=-lKOvAej+inJ}FdkB@a398l z3zwehG4J_XQu_P-`8*iE=3Vxmjri@J=L&u*x#ai3Pgy4HM+E<_g|nMMYmCPy{#`GL zdNYY_M}NixS^GbFdkMPR!U8?mSzln{=)JkaqtftHUpGQZ^?2b)>*d>K`ANOplGR`VM*GKWCY2d;jt|K@{H`r>?w}hF+&! z7>su0-86RTo;SIveDS`YfOuD_AEG*SM}+HT+_-*8qX|u zvn5w3b*~GmQI?x;S7*UG&aU-q5Kwp=aaWN?rm*s0I6ah4s zahU}tf9+d2lk2z<&gWO~4-5=+H?FFwsnY0;wrVrmlWlEedpGe5yovw58#j1Jq$tsw zynx~bHh{111|)~y2RZ!o^6~ZZmkZKhh11Hy@b%lE_=V(OCHbMzgH=ixRKwTz;g>fl z!SM0H2T6&@hvjR>XZ`+)%5e+DZxO@Pe+e%Ll|ToBGQy)7 z{`lAM+sj|4RC}nLVyL7sT92SolJO&^?gfTd2`cTSB%Tai_?ib#E)8A~e^!6~_ zfBD-_ZQKY#ftgZfczYOHYs1q~)7Fw1f_%tx?tf`|iqEP$FT$ri@$7L5A8BF07x)T= z#v~WJb9}wP5gxOa6iEK^s~rBxFMsC7=-u$&*z|ktMh^cT{vPgKTzg(b3)S;DCqB zfyadERR@>c;iPqNa2h*vCY$4>V9LxhoF6%2rJ!dzKh3jOMnB*AX+YtveMl$nC9!d2 ziX$-Pj&XjPWgMmMonNqBc-SfJQ7kMSrF=!FT$LQRjf!5wxtzhMxVC8zmj@(UR zo9QHHg;((ZcdkUlK1?0tT}ew}Y}L1DbAng`yGq!7fKhiqBx4?+{6vGt^o!@AvcF$`KFV-CY5F_uTuu*hF*5jX&1#GC+p$RXm2SR2JeUymj z{S`4JZu%6h0pHnhXR?jBe-xV%8JR_B-jkI=X_)pjwlrPrJjU;dgEr4PuWNX z${#n!2FyvcYKDTzb;vB{Sj?a8%wITXE35U*aq^dJjA+`6yfC7%=GpqI80&Y4#@FSZ zOMDs7F_kYi%~nJGF5C5Ds3VHHi)L#N@-{NW!6&ePnqs?weu|Jof4t0*F5f|ntZyPj z)(cXz-sHJQDe-fRO_EB}Ar_H3^(aM7rTlOv{aOppo~O*t7U>T)=YSG1l}c4**)N4K zDzsB(kiO81<+4)4UO`=X6DuB*ago_Ff)V<1guc10N0tL;i_=~!`Uwe2{g5ql8A)Gy zqS`n^9@Xhbf z)x7S`H3m*V1$aFTf6&DM@6iAe5e2aeDgcqKUPBN3T$|z1$tQY%JT_wiPzadSW{EMqja96XSe@A({}0voTpFW)42j2zoP+@5}o*fFuv+ zu}|0z4D9;rV$LSk3wdkA&lQlh`;iMp0WlCa;1J z@EA2(IC;tuHSu}m{v49q62$!sT46l9dZXycjJLrq@t`#))Dq?yM~&comuBmH_BEoD z{074!*2!0x%|6Ng&PF>#LG z2>bP*yylb92c2V1*SR}N@oL75@sb?_wm#_?*4nCEZ*DB9iB6Y+b%4`Gz;^?48*t@0aaRY`;X#7nP<$zyA3Oai zg0+xnS{_Gw%9FN3C!;E}Yq5P=Kc!V1WlZ4if1m|R<2pCz*z(GeEL@{|+Q#?&{8{0< zOQHO8`5t!Wc*}!ULQyS@)}=elMKfAND6hbbH76)(-R$D7acqVzjU<4&kO;3VF|PEr zkz2b_UE!8Z@%J&@a#Eg}?=(jG->|vqTeXDbL3YkkE zf14#><9gkGWLG$5Qp|n~$BY+%BlRlc+wTR^ts))4F1`-hj-LqZXO1)|6~s(>H0N<= z2lsT@g&$Rxx`q8|e;fI?8|M}N=@h*m!$0i=SeOMOGTX>=L$sw@lZC>fA-UFDH+@AK zebiEe%A$9dj%P&&XFMBuPc;um$!_G&e{LLC_(LhkJ|u2YWCg0GV3#JnaiPehq_$YX z62Y4>;3eFNd-Mvpdc4y`6=R#*MDoR5UCMbQ)Vm>Bff`fTe2glDKXqujXT@vgT)Ot* zUpK9NbP`()$?jRMpa&@iK1NVMGbR0_#_&LmVLyXb7_U+ge8^TzrAQE((Rx_*f2-AF zTt?YzEGt8rPOdH1@Qb-Q)`qeQGBQgS=_QTMj(@f*JdNsA$Vd(}qYuVcFMG%nQj zTi@6Cyqg~@e3mJEK1RVM3bOWxfap%s-WD%*V4?V>v1h@ z8((*GVC6rBDX2fhPFpF=41Um*@lqG`G1Uu$!rQ`Ze(+Ga%Ev{m)qtV3Ad4T zDd-88q2?1Ox1fJ1WC4FZeGeG&tprv@2ydD)Qpxfy&=2FPSg@TBbf(B0!AnQcwG`!R zOR<;a0*@w9U*K_@%y-LXMdm~TnEribPF`qYnUfWSw#YmnRAe16h{&CKnMdp)%c7U6 zPow2q!Iv`nQGeWwmdmv40xdVAMTs6|9qF{K)eXJG*G5V1Mtpxol86F4Jji;{2(qq7 zGOqhBp99>L+&B-@YQVxM;Da;V>S`fxbo=yis_9mHyR&g zLz#UxVz+yZE7*l)T6_?8Kth}UZRQr6*)5+Hx${*yx=dFI?+V!k)~+S7##u>ynM0>9 zkuB-4>@rHj&L32v2m{f_-lq0DP8NV%g+A$e+ssSeXj%&<6M&UZ@W%5pT8#RwR zwPR__0g_U1niv4$%ct&cv0Bh%*hlHUS^y(Fno=!vRJT|$i%8R;wG!6XVv2I&n9|YA zF!3w(&tKn$?w6lGjXW#nnPt&Y<>G5vB<0bl1Sr#wmdAgd5B{j+jpbdSVlS;$($Ep~i0iH)2|4xIi$QCagOZp_BmvV5q4bP2wp z7O%yp&KAZ>qhC2N`)s>v91|-jz6SlNR=DDt_b>1=aO6oCq=~+ ztc7`uPUC;io1oaw@(L6Vg|YhHP_W#jW#a4~jhdt82Z&D zw)wU|mYlsuz`hju7AEGJ%-TnVJt7nwqif>t$50c)j=Mhezf|q^U*m04kn16t<1CYcVo*dv_#|8=Pd);h}G^j ztzc!5ecglNBZf3ssec`--D_IIir=A|0_fEwwt3A!*3y3vK#^-PiH{1Ph$s+Xd*>|G zaPxman}eRrG;9pM@Z6MrT`72bY*aSXYo{xT{HQ(^}>D9rbT@ z>*wjj|O(0yZ=|^9)VPv;lLnMLdD))a0>wLy{6rU0SRYAfbQW zy^P|BSKS1G)SH~C7;*+^>XvM2(~|aObNtwd_ARx7dEIG+sU>{OtFKWkOC)-%xpK1! zasAd$JPBv#V%bGes}NxQoN^IaUD6Etw45Ah>tPL-ZN|u6kKy71F(eG^6*sOhSz{yi z^_9j{G&s5G45UXPL_S?P-%wUx?Jj?@%`49m^$yc zkFcnO$_NGHu0zY0X}Xpze>U$C1m#!QddIrU5RpCs9;-PN)6CqMGTJu&F7Hsxyy}ui z&3bgIZ$WcD<|>cf;77xqn}RvH0MpU8Kt^F0~gNEd>qT!>28c&jR1cY*{tPu zV8`pN!KD}l-U(~YY=>kGzrPfc zXa&%pBZ-o1DK;Ld{F=3=nKfu0O|>T2ULMixtmR+aDElBARivvArZl39-0HKe*})3X z+0F{`+ORpv@|tyvihkupPicP_QWj1jIrBlzCu8Ss_G{CtM>U^Vr*`F;Y zPQ_=oe$t;iQ5T|6;-~H%H~iMS89zBUp72!X>2lSEqH7w5vg6mxeNX1hR|`&7Efb}D z*kLAOZ3JnWoQ|W0_ZpiPcIB548e`dFWNdv{vn%hXvrP8nAxk=^pkt(LeNrDwavYhh z7DG@mV{LN)6B9I51G0Z@0@9gupnxOa<_8TTFk=dI$pt7$u{!9Ox}OU;!1M0-hsq1B zuxGC1wdXY8a*k@aj-3hNjwvdE7si@?hP_8RoaK}n`u-Es4xP1IJ9EGZJIKjt?dn`N zr7uezxq@Dj{33wmtSMZjYFF>GDI4|$ZNJPj`)taAkO=+geR+Rf0tQX~9|ChV@2IUX zu#t5%kX*}jG;U#Y+(MjbhtvYdw0+x4)FfTfhF%p?-?s15a!DrzSCA};jL+nkb`Lc( z>Dhmc2S5}yrK}lOnJe?z)+&YVn2tti%0!+Q|2ZKS=rtJSd*Ad^%%LSWPn);9sU#%Onza4u`pWjDu_x**NdbCt#+?GPj=2dA$e9~ z)e*Yb%F2MUgQnv|hvXcQ4nv4#7Mo&HH3tO|eEyUaW4WG+bYHTR$>msDSP)lX;Ve}w>9{^ajeWHW!{ zg$^<@%ETjlrhDXDZt3MKNLT4ssXG}EW%zz2nH!}xg1;N374#)%M#GcQmx_V4BwRAC zGWh)D!JzXwgAd9Bkbv-Tc|fKATp%O3I9YBm71RJBU6UkF*?2dX zqpbv0D(KJ+z2{bL7#uVJgseVdm9&4|;I5Dcj#-WenMy>)o%l4BkC@8c1g#J+EVEJ` zL_7c!2$^_q?Se{pbyLamc{TAke0%*OAjC~Udt}nDbNt*jFXqqdo4>K@Q`Iin7)_Nl zI7pP$#D;6taPv-@-bl=D09T0dVVhM45kqHTFcZ^a6%kHI5P@HtuMu=iM$LbeD-B__ ztw5PbZUe5IX6|-;`~cvbGZ3<9f=)oseEx`FXq6F%sti3R z!G(zEP6DbtxfYZ0Uy_v_rB|$bWWmyNovU*UGUaS6T$B5@jraZhtnhAQApcz66*A)t z33tSQ30MMqmlXG%;`arFY(#&i*Bq~;`TkLJDzYD!2S+_1)$`ewjW{jIYv>VvN`O&Z_YT%eAAMivm3`1eq@ZX4+&corQNc`?*%9ktxJgK&eaa)_+9sS z=U~U*A~Uu*^hlAp$fkcbwF%<0v%2K-Mx=KmvVt_mp!pb0K*^*oIdT}mB92L(D%bqn znFcj;Elqo0r>^aTi`Z&LcE9BcdJrSvW5y{UQye}k3=dQo_7k*1JdYvplZjVEIH`>Q zresZIy9li~j7yihhO$BzSM^1O>f22!2g=*6DPGrKQw32*uakc+HNTdk$G84h;Bqm* zuRqnN&&HF-2Jxy_cNL4E+j!p1$8Daai^20T3eE*nR(>k@0}8&MpcUe+55k{aI6+cu z@S}<|4JCp0!MD215@r=kO`&f8o)h1qK}*?DX@<2~o~(IWmX;@Q=r}h5^`byr&C6@Q zu6YYJG_xDI-OYc&3b!T(=+EUAXdoJr?U>dj+s;*wYVQhuvclX{jTT|HL$h;*S3ZJ8ne{AsTru-AL}S)pCUOyd~dm0?EO zw$5FqPE$0slr0WZ*jsbz{jahDk&NlYF%U`3YRRLE>8^jy0;oJ$ZN@4Qj7CPztM)Zo z1>RMZZNmzV$z@!(uwW~@_?N$TvpWNkS1Ocd@fo*KzMGmA$}uJqPhPd)f>4Qy*}5EU zt&Wm7cxz?@+*s31G5_LpXE%ixWtkhY>`c}|O|ze7Eu-zc^jsU6+>Q7OlMqvdW0V&p zv*xqV@Q{CB+fC34@gk-Q#}F@&IZ+A?HJk72m~}F(tVk**cZ@9iV z40aso#?R#a5vAEr&>HcYX=5H)ynDBZZR?f2SZVB@^~&SI=nX5zQ6n>TMGTrWL2vWQ z?=rWf+7*DW!n6~`B0Eigm&pamvU*(2rRrwhqg;QDizliK3YPuZy3F=z{+WftZdo`^`}RF0B;aFO07<7BR*Qi7R`uX=^N=p z@4rpMm4AGHX^VVzyG3lXZC)(d;fK$3TBX z;!$o6NSqaQ$>u!vxy!|Y2?c{e>QxsP9pcbBOz~o4(b~m>Q1-w)=>CMFfE%Cc{)Dsi z_V)SiPf*~bAKG$wuY`@yWhFCsP;p&Y>O{EK`-OE=w%0N0Nv^L_ltrjd^osl6 zd<9VxL*qkSfiV8Z4$!Lwn&c8}n*M)PsY0s~T&L}8qxZkk3RD`%Y8>P>h1N`P@t0$@ z`<+&>QjS@8$gSQjVx!F@u^RMWRQDin!(54lke9@}rpM54Xbh=5LQ1JaQ382el!)JK zo@2V1HVbP4hW%soJ~u6RhhfVC?-$OeZLinf7s$COXNHbaiQs0bL|Zn$?+Jf}5(-y9 zia~G$7rUxRs$wjF99Ep!R1b;2x3v@$OBJTr?%rxv>@U});_5LZ4LmpWid*rgq0+tee4k&EEP?GA(1 z)onvC>f`m*^7qEaUcKlT-tK=&c7gad~S5%xstEz2p?y(CZ6|Kp9V{bXVGZCq0{?CgtC+VBHT` z#;powYcUCul9A7BCCGELYjM$#)ZLL~+dquE5#uO7_xm@tLqg=fm)$`ik7b1@{6CY> zJxaVogL_~(gitdPmvJ#E6qh@bDHWHz4oxS2?OeNV^tKZ2{S3^_EP{+#&q?cwzP@Sh8)$uNt;$m#u$NzemM ze+8$T8Yd$J(;%kz@6*puoJ&o|i4Mg%03C*|EuHcC5rm}@f}RTT{AiSaNaaD&A?W(- zf9G=HZH!OlOOOEWDM{vZ_>x9&@G?n?u>Sn~%li)xJXK%NSv2Rj_lN&K%o_k!GN139}*75DFmj9tDVr|ag0_ECN|Xh*?}6nEy` zAl;-oBb~X+yn{~mf;3-q4+^@Z`-FtRbawu!43On3|0a^rP!~FX$jYFJN4TbU)Jrbu z<)ch@>8aA43>jtk?<%r4h&#a_Mri|m#hKCa&gd&-(pnO(7{?4gKY1|de9quY^Z+Cv zJX{`7<*y551Q#dMElmYAKuGr#$wM38=9doSB8Sc{z3IPW@|VF@f+`hs=!V{ND>rlw z>HtFd>z$+xgS$b0nsm%^ILK52Fz&>csl3Hh4imINys*qFbrA7VG66CZ@2y=>39oLL zET2~skHhQpqmaRI3fiNRex2iWSG<@%uW$avq))olF4Y)KOd1>{s%m1xy=u65C(Z68 zW*EQ?V!YdC@gQR8EDU5~TC5_%2?-+51M}JflUWQP@&xFArGWU_m_Av+ELYwj2NPS~ z3U^&K+sc+NH65W;DVfflHM#w*ooo%Gy1|wX?)NcdX~O_YK%Ivc zJT+b1^nUe>JXjtLiK2S#b=X=nhgn|pE~eN(CX!BnyE}l}N!Tc`8+>8(ypJIaH3Q>1 z?aIB^Htt$-x=L@)jz*4KWdimsxp^u$%t6fC8pn+p9QkD9`<1@rYJZr2Zzq4lKyMJJ zq6d8pffQ6Lxo`q`vXJKrXbp4mrBTIGQ4pElNkMRw(Rz%)Oh*-xp@OgZog3zN#tFJkymHZh1->)!Na{jr!v#ZIBGukSDz!eoFJVDh@m8R`aw>IlcBzC0DBsetlGHZ<;xeGDqRn9pe=AE}qBv z*x=cE@7Wxq;1pIeE%8giZ&2`Yf;NaZ(F?yX@jw<`df|>~T>@zDedA>jFuOP&hE8T zNe0M}Xv++l@XV}j+3lj*mpJ*<;c}`dV^gd}IR;M!Ws{1X;xU)juxpmI6?S2m-IrL^ zA$CVu*dQ09dw-0@M#GHy%1*e+VhN;A_>bQ^dVQw}!mob*ObJ~atl~qzPYvkUkl*GX~A!b%Q1DD+X)%E6oZVffc zGL6sT*7)3-*K8L*n}v#(wR-Jjav1RqCPj=Ej?rEL%!#kLhMNYqVS=s`4=zRv#}LmY zy;xVpOF-XGW!Ckyk`l(RxtIO155MttZs2F5Pksn~-~@B-D~7*CamESSA|9C$H)T+N zTExDjaW59Hi~T5Re3_l@bodf~o#ww*KCA>&ad2ug;Du%mbWVVuiQJJ@dgmaGPwKRgtQ(btzf$DO_()1FMNC&iQy`5L4gbaZqf5ki`Zw{ zyjXEv>@lOBB&j^wtpi4XJqd<^scDc+)=S*=@cEH1jb$^*AC7#Qnj_|=!xGy09;2Ml z6w#u)=O`z+y8j4AMw(e6Z|eD<6|t{of~=m!gJ#}@116McN4SuAV*9NCC5fo+t#N&j zSMvDoIP#6Rd;?Lkp4O>j48E|We^xGrzVnVF%~h7)kXC1Q?t2)2Z`TH1+K{osgYY6Z zSW5U;@EUH{7G8=xdwq*7`Lu|Arqhcx%G_fV4b-BYEJJ5BtnK;s>zdpY_gSjvM^N^u znb<$oT*mk$7@AW}eJi^$Bc)rr%msH$+hWeZq^$DXAtYMgG^RX4K&B-OrHi{=Ac@R! zv5?%RLZ_vQuw=l0pC6S}dGgstlNs-X!Tn4=-&4$>iFd-=`J{ z^YkHBxen*JERnun_NrC`k7xfBQ^2jPfKxMJu1eiilb#s9XY+DNkzTP*54&HHuTS4!1e`Q6l4*YW`rC=&4T}FViWikUX~u{W?DX}I(@!sya)qCF`~amw z;78+cgWvM?Suleo7=PYn?Dbg#i{%B!55wPQ_jfAipO)b+fAbcEeTkMSeq2e-sBkvX z3d35Me*NX^k54o81ZBWG8L(!I!NP46vas>pjJ<_7)ID_y3f2Fh{S})Ls5ak!M ziZnzZqOlZCnN;HF0GxRN=R~+nM0qu@f0&dtFpq(#dp2qg9z&fz!6P#c(y=2gaNqP6DQCfC}0d3{#YNfkhm zq2azBAh4j#Q9Wp_je8(qZt}M%@r>!~yJtE|p}w>DF+af4bkJGU8}WHcMCe+EAws zR_XppeQT~@-%$JOtJ`mI5IUFSE2E9d#RpOz%oN3?80oz2#<}^2j#Wc#PAm~bUSoC3#hcG2$Nc4&UO8Al+?y3Q6WWCjKXmr6{ zdGL1!peaQdvpZ@0 zh+=3$_QdfmEhh@q@3G^%v$}URuo&NyZW>2p-->lNjU%lqe5jXlBME-`I_~gNZUxa6 z78dXDQp$;-VgcHQn>r=Q_$F%SL&i3)EjS!(Kp8B^k4T zZ#i$>0SKV_P-;=f9rG4A8N$rKjY?@v*fM4uxG<5%Nkzy#Ga=f*?K)<({eeLZmzMIV zxED2hXZ2xOkfegU`ZiT-khp#8rZWsXtBsnpD?JlGV;-Oa=j1261vylf)lS&8T ze8xdaOSDo)yI^Z|e{U*r!UdyKb-iHsaguzdwYueDF`Lx)IdQVKHTwNU@sq`CD46TO z;AS+yNQfTJ;}-IlU%zv9zQ16DR-XWzgL(7F3(^?)!Ftx8!ZtIZ+KPUrT*kVzUVTbn zV3ciLUs!zP`ldJ-oSCXTZ&bEg=-VdX^;(bI>RXz{Q-iE^>}lIWKOF1=g;IKfKq7V3dECOtvZi5Q z{`=ikH*oA|)jq<%dluY$`O8&ag-a{)1+RevcnN)XY+;~S^w0N*`(bY~+b#DHkn`b( zXFQ-mCflg(7+mKe&o^5>fpLfkY5IOu;b{vI3;`%c#h3k}DI5WAml~rfDSth(Fo06s z*W(eiEP6#$V$UdbUy^@>*x-FYd+)exV5@b9`W1Xr>75w5d+rcV=&4A)2@AhRyQ&@y z5F=rzEtZ#YlJqf8RI$#r`z@9BC3$`}JtLdVfrL~YU33>+lqd_qg-(_$geey(B!5 zSuJIB%e(h6&s>dDtWQM?k&6^bf;Z&0MnCaU%dFvIt0-4c3O&jFlEL>@Y}(cXI-E;u zMTv}g>nOFDx>7n~o=}1J+&XAhItx#b!YB8VCp0z+hf-gUCc^so*ne5;837(G*504C zratm$8qU-xar<_sQNwg%H_agan4RxeR3mQmJAA^O+Z0KvAW z?_AcL&LU%LLUMd`511gpO@DOHrQEE%`{W)7>eB!T)Ci-8U>9|}7N%uzPc9O>W-@kl zk=T_MdpdDmJ%R$v&3|P%hcJS}Cs4QGxVDgB_|2;CRZlRCNL-k7jv!nj2SoCOWT7mW zjIYk%@1;p$&^Nd<`O`1-^bfrEBbIerkpJ-||H#$Q)4xuCcb+z|YtYx6T|tbvYM7p! z9I?@CF(EOqxP5_}P3&x$<`}ocb+gF6mA&1oqsgUx1sYd`DHT?7vPXSh*`enCKPIF9 z7j_yi&%95UQ>7^^0bG}Wr709B(gk*V zE{Z*3=9V~bm%ODZEPw4~Z5rJHYiQqE{h(k80@;Ia!SbG9IZe=jc#igkc@Xh}6H&6> zVX3pW%<-pKo*DPA!i+LPGRHqR-rR$6JVBk?;5X$0a`dK+MOjY63<;VBazGHnZ*3n$ z5J%0Y^jiKYt(ZL;ihH;}YH$*pSsp`3ltmyb$?X1J z*m{*)K=U4}(xkluC{YKKkko3Ifwz0&eD4RSnxIP`5++c3krvdHI%pMZ54bOtK<6cr zuRzTL+#XaKb$^j=HXJ)!IZRw`v&GlibuP*-kEW(4n|9xJ(mqYkfOZ`O@nZ&))RbND)A3v`>E3jci4;i5lOAH8Bw*G{&kQ5~?Qf)IWTTS^hB zd7bz7NWE7+uG@7<$DUYzDi&E;^_1y;EgU9$)w8l>oPRw_@4G#~?qqBl*#ToRDA>m^ zCM8i-Mm^<|Rf%kQe`sa@9MZ}^rf=ah>STCLCp6rpCCODFoT;)B&e@r4afrUYodiw; zJs=Q*!hH;Z07OYx$mg{2bS{XNL_xom6NgAlIOmN7Z==@Qc}bK8-lgI!4Z@X8jcWR2 z%f%GzTpHfY<2c|)1eN<3-68~0R@M?ad9MpFUeTRPm;a|J8h@nkols9hGJu)|ZTy&_ zz&X*Pyu!=k=Obk4xPKL`2@a-LW&Jbm6}|FIbsk}i;B-$12vVQ$`j^9XC)yC<7=6OB_Je#1PA2Pm~vBaov!~2fmJ(s_z zDI0&hg-t`h@${LNLU{nKt&rA=rR~OZ_&u^FH!Bsxh56E&4*xM$n|0Yq>@)!bVpY)R z#}dokE0YS1Yht0i>IWtFAunrrBY)DeMJI!(s$y?lu@Xp`t%|*G7fY3@LkLcl+VGho zc$$a-!7>Q^$3$$Yh&AF{$i63JPZKmC9>SMasVNYDwIySB5M%GkdcG?Ihy?Th1=C|7 z64F;v9nox#$*pb&$aLgF_t_%e$C>wK`o1XEazMS=iik=5Zi$)Z!*d@lYm4-=+2!e& zTxp}&Y~w!8r@0w$&ckBj;KMhTNDzMFV^rgXI_)+r79K-8<%AhiA8{W1 zKUL{a9bIhIsP1F;A1j#d;&tRqP~#6l&f?cM9eB@hnPz7|I^ZMXp2O$2TG)5m9f-S__ho%kul3T19&b98cLVQmVRU1k*rmuadg7?({F5GJ>$swvh5e|fv_ znRM?oG;)L&kL6YZL)=ifV@}qJJHq7_9MgG`5gj`x@4NtU(M(O6)e@uQ z*i1N9OWj)G*xzZkwS?Hs#eI&IPg(v`9Jlge0}XsR?oT-G{RFKL?^4n69O9i}o_8Ap z>n4DlSIz3iVK>Is@_PSJRv@yef2?>8L{>8oZFzUxEjL{g&}H9+9jA=s=x1O#hu;!c z$-DVwM`%%9q3MYqyo`>OO5|_dTF<~F>7yeOPt!hb<9s(aE1a89Q9OA6jb|E=aRbad zw{=1#GjJiCni&JP*6h1Q=ssg|3F{^HYtx&PdFM;gl8I()<8de6D=g|%e=$7Aay4c! z@@ux?Q&DXctYx8w=Z$()vw&f1pePbG3uPsMi zIHK?DE=%pJgcPB()h-ZG++e|}MntylFBJ3rg|L5rq3re-ihh6LEmpyD^f(Jv>t5s~ zhIf#K<<7hAX_%rxSd8#CS-BDIFe_s1;_6SKZU17lrPB=1EQc|Ke<$LMjL*GQJbR6A zd%};h>@W&Fht!W#X26+JujJhjx-8(@dUj@m1T%dJEu)RNQv1|vDceNa#EzVO?RqV2 z#;f*dvXq?e3%caWbM3K$an~)1M_IJD@fpIj*b#o&Udzh)vWx!I7DUpSEjpEDP&-N2 zQjF3OL)LEFQIY%1f7^&j4+1m3_IMX9@n~wR@Aky%y^b8yI*G51$Axh!<~ZdOXFVKf3tyfa|aC1`H(xbG434+ z(fC`EfOw$vL{WF2tlMOyi)W0=2z@7?`o!9wON|^0y$BD0@qW{Qtd<*b6Y5N!d>U&L zC464gtX``fEj}y#8to??ExxT?b;~!4xrI$5p|pVGGvoN4U||Z-*TUjXAzpzDT*@+* zqR#_^AIG6Ee;!f4+{FO^qp1;p0S;OK699`lU5b}>-6*TPg+_A0Y}-Q#lPB*K*tI8w zYvfG6plV{ea>a^sD?56)9M$64u%MrOe%=38^X#iw#C@fC*57t=h>PW3`K z&#ZU-gG{&Uq`;K4e6raOlcVC>F6i6DGLuZXLb)Eul0)2Y9W0v%EafFfizrc(t%uR~ zT0tYHX&ThGuej1^WW^XYYOm=tJNf9P&wC1|G5%OVHye|#(cWxkl^YMz0V+|2SDVX*S&ty-w-;i#3^*Zj8_afq5c464Z%!%H<0)o(6@ z3sH4RlRugO7f=)Z%>jVfl%NUaSgS47I5$x9X6?xO4b8o;B@@=CMHYV|xQ<(k-88y3 zT}%^7ctW`_VWJJz6`YyyPX_TXC8lS(f5i~Ye+e@TP+phY;c1rwd2vegI{)(w>#@M` zgV6GS6`$#?!x~@6vA4E`@CZwG`NhaG@YAw}ggaRsf~#dqPZZprOhFgOy;_XAgX-oi z2G`75(OsNUyPUMma0X$Sm2QsnLWLzpZY~!(9OpfFF|4v(z06M)I1Keu`PX8GjBl|5 zeT!Qw zNuXt0zL2(YF2G49ZMz=JKJJi+BxBUH7vw$r@!2nYd9ugFYvL;2l?X}93 zR4J-!@j?|yEQffk9<2>CPX2X&Ih8-(-e3L)c32kQm(k`L6Sus!DJBvcoK;(@lC-0( z+RXN3TaIk66K~*6{QGVI4e*!z$SE9u6W)MR-P_j=s6)~(NNTjEa{$63bZ_6fFCU~- zmaa2hT1rH^96fuwo8t?Drx8HC0LK@nfybkw3+VY0|Ce!Tw#mKflqg{Mz?3Cjaijx@ zktR_AA88+ddHZ~jynHEwjgRp*{rCEI`0Fs;jI}7F^WCrC4zWWc2=uB0D+1bo?)&fE z*Taufszaze5LD7yV@6PcB>Xf{4+3LXhRP5$hPG^IH<}i2XrnsN&d&Tyo7W$6pSF3t zj^hKj@pu#G!ZD&b8m3}1laox+@zg6dT;i4STHF!P9R~Mh#0VP=W{Q|XL5xulD-`;3 z@#%G*o)<`BggYI=mtSP}8+Cqvrok9|_jellt-eNfe|A5|BWV!!bSRN9t;*b^D?25E z4@|YEU@!>6`e6zy*QJzjLER@yJQU27?p>w>p$rmnODr9#e4d!ufbS-AOXM8XnVGcC zoD${MoHK*QapslU%J@@aI2AH8CFatZ`Q-KZVkNX*7I;Q!)6DVLJT{7deqz-yeev>J zi6mXj&OO>Arme@g8SutILJ(f!yEyDo5-Vkj$lCj4Z^_hDcvsj2G!* zd|c9}ZM$QP7k;iqpJaD`j5R_MyBA2Xm%1pKNoH>viT4@^tu3)xm~PDnp{?F#APg#D z@2lZ$2EwS2IPV?u`!I=>D+4cx^gbrSC?M{$g+HQmm3gD+@#J0+rvSzl^&y)DB&`fl zYtwkAOOJdlPhf7&GSgWgmnqNt!QH32&H`-5vvE$uqQ>oXOi7%7T|Fkt`e)`QmSal} zrdkQe)`j24LkBA?If73H#0Xk15hq(2s;bwv^2o>A+yrB8YVc@jRs9UCGgbk+9f1b2 z-Uw^dPRM#Mg02Q*2}JLp7tY-G5Gk1l~q~_sfB|~jK_y$86 zilJJu@MeZG6tr4w2-^P)^`9`*=7VoAln%mq`yS`}VG`?q;*Chw-1q697(8pB0Jc}A z>UvD!YYL!UBLtR$P#?)x7@E)dtC;AiazF}L$PC?!kt!(Z5=HHumd4w_dTv^ z)bi7(!)z6QUJHO45-8+DvH2=FH|Cq3DVd7asR2&9Vi6ntZn8&w}1U_tvOq?91nV#qAdE`~kqUg~JjOM8Oy zKBckI79+%F!FK8`KXt&$!*2#M0mR_3Ci{AjOua@{%P4S%GQ&U8*kX4x9EbTZa12+4 z^puAI<0erz4bN|U_aoqlLpS1@*Oo}azIgbwoyxUap;Tv;mio-att^QG8b*DW%W72v zpqN-wN2_4}7beXJ88BQG>c)2m$} z-cmFtv>LD$g^u4Iw-cj$En*X%8qa zA%N#KvKkLiZXUqTKz*x1ah(o1(HvK=pK4|q+3wkaK;Y5Yw!kg5SggJ*v81Nj8fBuc z4hBibr7)wM9}c+{TYOCjZ9j)tO|R#40U(- zaM6KI;yAPa=G4Zbbx<3Uv8b0JbjqOfitJUEp3tjz4l6&?80f-|g_w%R5AZcqSB~$l ztv}@|wCk(lUjrcSOf#|VrK~%xLF!8xv8uacWD!oNjs4;d#wqPZs`R^>lbVScAez)! zX!~SW!3jd-0%YyCA+iQv{kj4Hu!1qx%{pxF9jNV9;qEDH_wm>5#wvk&=lRB3;6D5} zw3zdvoE{k>x zarOznqoFnZnK3m_;_fkD=)8HZbiZ*T1$ zAS@z~tEbIXN_Su|(t*1OEvaPX#qaO*e?ITjQIdt!%r~h2zF3m1pu{pfNOPN$-X?2* zzvDCh3y%q5Uo_}B*I3O)p}l_EJ+}ZPE7%Od{~D@LR-Qph3$(0KY9k-eg9#@UMMFZ3 zXag|@4=)s50#-`%P~x!_=;fomxHDf%jQA_eSOf0<5Dz_m*sa8&TevkVe50%H%D4km z=Gc1~b*W-Gx!9=XS(+w#=#HCSWtdY>9zu?$bs^ExpPmdRh-fT}lU$5qLZAddM?{^E zvGt^I70rU=;Hye|-S+hx9BlP_P#?jZ1t4JsgzZGj6vendc7gZ~{Q1T+wc zgGhwL23)`zKtmFOB!e6;9UdrOKDH{2t)M05(KRaiyF1!PO;o_N#3L=Tu{fA^W+%S{W<2*ny0DkTQFM`S+Y3?+kRi#KUI`lpg(Q!0%geP$3ewX` ztL$!kDCurRk)TYxX|>Hi9ZALrf}jBdpe>LENH+Ftu^s zmeZp(hr$F7@+v5@64K*F%h*ADPPycIs@F76^r9WcCKliS>$A5pFL$0cI7Fj(P*_&G zHEi1yoUL_+ahiA%5N(hv)uriHaG`{UAE=ez+`fMDi9fX$c=k-CXq)}@q@yj579JM3 zo4@x3#vZ=f|6eRgASz&dyL^D@Cxl0zEaWcy4C}ScMOE${1C($KrwN_#*xYzqHq_8- zMb?~E+C*|n*|O_RcRq5m@@9PPN;Nktt0HL2&1G&+9UStjXUjP#72-oS;)Hw0oXeL* zW!C*B3sT%}??u}%6&=?a{hxWdnk|IzgR-_*t#xb~f!FrzsTew|XZ(&m4$jlW-fmn* zV+px7e|AGwninVy0Wd>a1}F_N0NFvFwRv*F%8lyKHbV=!5r|c5b=6p}aVP^-cGo&W zhD7k}(5f+Rll{EzG7;$BWDz|sir7A<_a zokRoV-IHR`rdbY|Crhr4fK=;z|A7mCsP=>ZQ*M;PLrt`E2SZ^v{9AWB*%^gbTTm)sL@__cHa8SWaOAes`|v(-QNgZUO3nwCU;r zhg3+pSB#JIpxj-t=&>4-z!YS+7--!oW(S2bfo9aI$d51zhSXoQjQSkI%$*qIiV(zX z7#7#nNcH@UOohe*pm-w!30V+z>a2oXmQg%2-J8201{ZbI?4e#=C`+!<kmib~Cv^16Bkz86? zA8#^aHqpu;mo+MPMD`6Bx@}Lrln4uts44p6TGTm;x`7Lr?-<^jjaPe%WjI(QDbL87PDvwQ&=A|H$AJJzhi_u{DA-P5RLYiuS>z-@2+V+Wp#{6H9z z9$gGJ=EREiGb`)KOb^6(e|)!pQqe$21AWtC86pP)@R|CjYvRc{hpuP2)`i(OJFh_iLk*wC5T*PDs|7GPy-WH6&EOD`6PV#y>$>5&yWKs|G|BTh1h@v z-g}luQk}CLzCqNnW;C804p|NQuyf;JAyBIoe4sA5E_3lAhs9h!e`RpOf$x zkqTHb;FX}I?dfoBFAM_HD|%Oi92oYy;YTL^>esaGU1V4}NTX1(;;vtm%(o859BV%$ z0gGY=vZ(df7|~X|@Y#Q7@;8fXa~CSl$uaZgCHl=?lqDB2%5{5E+RqIyJQ7cj6is7{rrQpF&_vM) ze(-mK9_gM?;+6hF+Ia%3#uN2#S^mc>eqc-$tYGtA7_$&W2AKfefl-n32jTnm=HH;pb zrj;I=He)f3V@!iG?QR|wto442b{Pr~DlmIU*^Q+td!wKm2iovoN>D}IPhA>{`r1-S z(_=5gR#la&s5D`UCR`*D2j;Z&b9H~mDa~&E#4)e><&XT1y1HenlcXhL_vjoS9U6CE zLb3@%>5JL+N9OAg*^9-$YZq4ox}Cym-#mtko@p6L2;Bc_6{y1BhoUWM6I^~Kz^FIj ztM~As{#0>WIjds)gZet_q>4zNHouCH5|Nmm^~4y2R1~C4^lgSzKFb`!zw2Gr*#FvR z6r~_`Uf|+58mXWOO~yO=6!>$LcLld5ol~(@%otiZ)5@1)q}Nci-vO~}5!R5GOMNRv zK44LNF*f$OTAzUM)O8U=0etaUTgaDDbc}bg-%IHhCN4*9zF_s_O~A&yuVX92-^1rn zdaJQa?lRqj48z}Sme7nh3vDIWd(QxTj!f$>%F3;8pmND>+q8muIOj7F@``ZUFbz&jadUEpvy8b!}cp{?E z9`IPoVDArI>hJNx4_!(@EC^jbXn6m!75FvasF&!ibUp|iNxc8=ugUA1oHW~K`(0SE zYNTLlFK^GqVim|Jy?-7^wm!YEb#1(0-)`-`yFKRa${|37PXc=4$9I+}SWp695h$Aq z^2srGo>rTuZ;JCDU8;6};otkK*W0ZOFSeZ|Qv3cYA>%$UHPXaBP<{x9+v}IXpaUbo zW;k`GEd(te0!bO6Hw>bY7ogz5W5`#+tUY@NHcqr?7>!B8C++c|8evg}4L*%^ewV|% z91X{e0{AWWa&3DeR@pLOxh$QMw${-kk}FWPYDtNvK+}A{VB9aAKCo0Wx33Ut<`!mTBzr|eF@!|3Elqg3Wtkb+_DT87(#iVV5Zk5BXS4d; zP*>uI2)l$EaeK+bLe$k{cj+%c`$};z@k4PS0@$-$9LI!-%jyFu(f(ZtXElCYAtSuy zBxO${oBgQg6!+KKBXyV>LSa$ouCr_sQ@27;Krp&5(H~#~mxGzv z0x&+$iEq-xdcP+xEk@R6BuXHx`l3PDxVpsr${hU=BX8162X*8c`r@e3%v6TOoD0rb z$oy6CEF-ZF7A8yLA!dD7qJ}W+8`=;LHnenV$-#n3!^l}NQk4*YCVB=TFn|xI{Zx^I zy{mC+l)C(|roa(zjPe+kT5{3ClUULtR+*bQM~ThBQH)O!t^o^O?=&2Upu0(8{9Z9d@S zlMw618Eu!hZjg5+0=XuysxwCe?gpIw@n*du+&@L9)usRAh1P z)TYDS;?P|FgyMAifuynf^2Tf}wjlEC`O1Wo0l&)$Ze>=B@(lcq8la~FopPBBJ7+QL zOAG4q9pksf7}cpuaUF5K*E{-={KZT0jnKd9@E`LXKi#MpWHtahd(OI2XuX1IJ}j*$ z+yAEo%=!=g{x-D!`YM4}WQUj4c*n zS7MU>u$c(zj(cB63&qCjm^)BBTl|*G+N%a#f#&l>I3*3@Dn^h^lP`GivI^tPt6=I zR`imLvYBbt1bq!b0lb6L>;@u5JQco1!%lx$=$q>)D@_#a{(j5Fh_LI| zvTWum`N`utGy|TP<^BBY7gp@y)cTbI(jRm>I~R&lqrdbw=1w-?mOyaRv55{33@E*2 z+s&4y9@iYRE1qn%)n@@ibf?K;|mqvFQcr3N^Zo*Oa() z>eV|WI@TH!XNYj_;Yj+1;ZpZ0klx}dONt0ELfC=jJlT_Ah9o))4;y8Lgo1tcK0osMJN-@5sasj+QE@TS^6po0us;%0`t^9RM-EEvrZ6DmC9FPsR~WonLZf2#oC0|3 zH=}tMr}GU-+m`Qqo~;hcK-v3h{TweM;pkATK%mw8`_GeMp#e|rYy4pIlTGr8IqzI@ z-$IYK0+DP;ovmd<6>wquR0^}uTyy#K6lk` zrOL#L`Vsb(5_uYZMwbk;QgC9OoGElVS9Ud{X}x@k`f!af(QQ88Um(AO77g}(D^*1S8{+Ig ze8o*N8gOG~3e-L&WRouZBzem0Uc7_%FF@sY0{uWEL;!ekfdWFkxBtG`82G9~I}b33 z@;`8hUEW_4Ah^8J!NAX~+VlWl{}y56&Om*C-GBZ2I^JcZ2iE2;#n<)wI2_)Mhk~na zgPKtso6P%e`~3H?3P&t_GWBlo^r8d4z;YvOEw?)o^m(k|_r|;Z839q$nD!l90C?Tc z=00Zl?f`to>^&y#V}$SP+LX|Q1{p`wpd}AHIXrt^QT`=k`_DerHRzLWSZ# z@Jj4PV_ZejFWJEmLwGJm?Aj$$sOW{YFClH*)-`(h8(w^kFLJao_ogt4X>rksfsy6> zfKue)FgU8M|5dgvug>Geqz1Ts)N!2@H9lV=pa*bHElJ(k`7L{s%!PECYkB zo>?%*Jn+{aD{ToBoAa4lw?A9XuuO3i${4!Q5>}hZW{b6MT)+dgtvMdO<`=0&*W6JS zW)dgh5Zo_HgjHB`p2ka4vUH$6q*>xS$jj3gP}R&;uD*0d*-;xt8Q9EMSZKfUWg}v$ z`VFw?Ak<==HXjebCe~hwzx}J=Isnw)XC@fiTJ@m61}j?l#)DEuq^HEEhb=i??Co>w zr|R!WDDHI<*2y7Yl_VoYs^%=jH*JH;$>*YFaq*exw^#ji)xEKAJ(I_pq|BeAriHo5;ieum*s!m(vkeQjX9GwS<9Vap>|2(X3z<&83dj zO;4pgmCcuThJWHuB$VYse84%V@iJzTws=(C$3C>6C@L?q9}*%0b&i>Uq98K5n^=Cb zM4O5SSuOHiN@JPevWbuWjn;(D?H_GZIsFfY>gn|rrE%#})$RJIO$V5`~Fh+ZlUA#J{tV{b?;I?==^UR3H z78LJvN-A-!t;w~>VML6m+-Pj*k}k>K z^{7g`HqJ)`pnIe;^V=f_E{~&_5ez{dCad+ASxJu1dR@IFcvKSy+NO@{7maXv z(+0yzMus@P<^i&%QT_PZjxmbocd;TZJh(!E4hCbewiUG=yR}()wL~pKbGZQB5>F}l z&k(dtI?Tgb=BXWrwIT9uP=!LQhe1Gn2o0fv#ndR(-Rl2j{V9%Ks{zO=Y)Z=@EF+mw z1VYm2&`RTQ9xe|yI+zHfm|Ry&0ta4phUy}|nsTKy!H|bil9(nK53_74c0k9D=9G16 z&mXjAd~MD2=})6$47_*kPpwmv#sr8#2oyq}#?%iVnb}*wGXW}#G^za|*q|Se?1P5vmuc{4bVZ}unXA<}iPlT8cXaYnVxCsD z&4Qvc+4RyP>*m~A8bUA>)U?*-+{N^2@4S|i&j*!?JEJWg(`*@J@t=-E1d-43XP^C| zpkNZyIHPC{INI`W^3FBX$>!-j*sPyvsHaW#Z8@C-zZz`JcmdYmf>Ebi30_&L>2lo4 z=3Wi**f~pc0n(%s1R7{r_?@cY#ms}3XwgYH8ygUlY|I>x#K#h|-jj((*Fi$yzlWSD zs9S@|PtrtYt5DIVm0FTbDURqE7E7b_TkuNdZOBi4TRtzYwx0BkS2N{*F37m*7%8e` zD_b$jg1Sx5paUAPwa<&{iMQq1{#Gvn+l(_F<{A1fr{qoAilc_kiD3Bfyd)%Qts;z6 zG{4%E#AMAk3`s0bv$Y17Y)Kf865P^=d@o1y|Jc&@s_7X@c*Si7o6cOrdZO&W)U1TW zOjxTnRI;(jDvAF=PnFl8O%XxCWn0A`SWj_)1{P|rzX2jj7c~M>Wg9?S^jw0MrV>C_ z{e4d9Y#;ABBe&Qfw3T53=^J25&``)0 z8;2ggV;o0=bBn7liRds`Rm|0G*-Ij%Qy^|lK{n_U*#(xTC#?x*?+nDdwi4vvRzV&G zBw|y~CQ?Yi+lBBwF<((jW^{adf_>m@z+A}%@DJ0@pb`EX(yeY|3E_WDNz)HzAOXyi zxQ!*FAjkyCCtAVV(PKV)hkNy~@`-{v_5WHbDuUybAYYIrOqM4V_csbuZcQ12GF0xQ zHZHsn3){COnSoTnO|I%^f#ceMf5jYVk(58gi<&OF-3xlbn=p@VD*DH0R@WRU^7nbE8*l``)nAsJxiP_1*`N$$v@ z5e-O$MxzZ$Z}>hGnIi5b{_+KwSAAZlk`sfc9L6NXK3wW|vhfL_VR zBRcoTA4Z6$HfE@8iQZOSj#P~DC=m6VC@#tCi8WobiYmwgf)-vO3WD53RsmRBE7DI;Wfb`HEBFvE!`WT*P=TBW{ll z8{OeEM}B{;c&Oe782t(<&zL!$FmKay0Q_1D*%a$Q@!3FS{1aOjVG25 zqgzxG+QsQf@4mG15t>SK3KEoEsVPXV@|1|#h6Ac{QD%QEba6um1#!Z&&Nq7+@bTnX zZ=qxAQWM+7*W%gOid2Bs>V@o2`Rf!@0yP1iKBu>6o15Gj>AgB@1j{ zd}^gRgA6F6{{aS~xfc;mN`H{EO^lzlt@)Z(RlqQGEl3x`eEEJ{cQSDwz94x7Vpw$U zX2SQqwD06RdGL+aHvMpyDWw0@vJ!YqMM6$3mWXHqucjLFUaIsSYh2Uzyd zhV2`&Rg6}ja+&(?=`^`E$ZXc%Fkc$`bygsy{F% z_{dEejD7n{6`g(|L+UNN&yG@1Z8U26R=4CaZld+MFBQqvr_+ItGGet%zvMTwu^aAc z{C;)iY7J~%a*tH!KiI-(Tt&GG9d^<;j>VXB!?9D@TejoycjpYRH(Z6`Y8YZ^qpb;?5#pfY!A`OU{BZ?q#U}A8xshj~IGx z-;YJimF@oQn+dOiSCt~~r*vrn2uXq%4mh6iPunEF0*QV~p58eAkRxbiOezRRQj1-d z(iZu-p_hjoyL>Ctpp_5H2ETYat*1d-*Rfj?9uS0zr$`2x@(j~q$~<3TxhPegBH`O# z5p=M2fU6U*Npa|Led;x;4U6tO_MrrL=X;|baC}Fr%@)d@?)jvALRCSAb@sP4`GN%z zkyFPd@SSDgY8)lg1yfvGq>%oI3=?nAMe_#fKJ2Db6uO61A*_E!_H#SXb5-`~&EtJf zxbOk>=!-2a{9Gj4vm)toaA&mmz3lJr`nO0mfQj=oskda8%e-D|H21%GH_{iWCFmh&uSo#4xQbsmuqe>R=)z!><#dl}gAr~Id%TR1A?yf>7 z-CQ@i#$#Y1)N!h=U@~+Xx?Es!l`PXugY(#+Jz1`cbazcCd-XUTOcPaOE3FbUFlQFm z0Ar4a-1n5<+62qh$od;Cf17pvg^6RVZ003bE&C0>*(!TEgyaroJd-}q*h5LA%qCgo z;7guZKIZR@9AAjWE~RFj)iDwZA=+a)*v0J!SqkbF6tronWV%g{D%0AZZ6Zc3WTA9- zOWs#T5U=riSWV+Xa=0`91F7PE+mwtCol1ps_s?kHnNLY5rcf;|Eu zh~Pq!(o3k+?)wO(=71cSZGyhHo!Oa+pIwZmKYb!0mx|$ z`z?22tQ@K@bM+dNWS>2s@gXi;({Yly)fP$85=$*0iOY|kADh3_%Xh;vl6xe9lek+ddO4vDBz8RS`&eW z>&#}{dBe{nk{?*kKhUcsIMAuj2F+M_h3c(gBN8U8LAYiiGY2r00?%zwK)Jas`I6VN z1Xj5?_n)swwI=kwpnLv*8??rxqU?y|lg19hO)(+xGU;UOkC-udnxzvTbg* z7+JN3QMfZU#6Tv(!q2RGAOQzT#eZ(w;tQj$28|JDsW;9m^3b^ZA;ft>H15A;5=pm4~KDr*Uir9jmfVza|zlZe$BObyhiW z_;za9y$j~fZXbT4XL0+h77kupjRxv0X{u}5t<499%-q`CnP+s}kIMMXRQ;kIgnNZ2 z+rKgkl}FQ+v2!nY0j?-2G$%%68X3wjGR$K4EXNY8jd?wFO`{M999)cLY*dnRVMvpr zQ8!rgG;$)PM(6dSRc)z{?j_X!U0OOgjSYcJOR4xDD<`;tEA6RD`b}C8X)8zkgqwyo zRz4i_=h6@K$Ox)?%Pns8Y17G7CT4*+qs{&pQpc1|D#Zio;7m0PCQ1A0l8S-NrWyYFJF;7C<7nebnd==fpmovQ~S41QPuDF7`ektGIAH) zO>gS*N7qMewB$$u{P@7yJcgs`POsm$UQOVm+CW0DQ%tW9=MJ?lUf>)j)GxU>0v5=OJ$-9C5B&{qn+kC@o?uGzCO~V0QIcmt3VO%NuA^20CvuYgSruYeLjM`NvAmK7{M^Cc^DA(U(tUx z51NAk^JiDMf0LwX%9gef68W|&&`m0mAG2i=H=qi+Q$Gz(G$T_weT6O+vQ3(w@)UT% z?l&_&lv90LN=$Xqc_XrkZ>yhJ@5aR6u~*h)1VvY(Xa z26+CkuP!*kB$N%6J(FKWyKdaqXl+lh%BvF91Ep4+#ov+ikZ2R8z4D(gwZ7E@XLY^M zlvyg%Ux=&Z1Zf4b!l(tx^Ib~s_sPYN(Z$uMGwSp+s=M>U zR@D8FVL*fB(+yg9G$xO)kKosXF}*k6t;do!G9U0RslfJSqoOF{fKK7+X};<^EZ~sX zNAPsF*?@JU+2O6afattLvBkrAR!E&i&XJfc5%Bf*u#8e?sFmXFlN}HZ@cr<3zg_fT z$xSp$SrqIMJjSFkC3_gxL1p^b{dWBiv|&<-&qz2Y?o48Geg3j#H22^Vz>2chw8P8k zpG3#BlJqhz>8G|gRE!6t2vi^lIQWUy9K)md<3Cxl#gYD7Vm=}PZ4~X=d$IF!IGy|C zL{HSgz&k*1k`pZ#lTG(T!kUSuAa+WoNR#Bn&pX(oh}f;`!N+)V(Ky*9qzt1+D~G|X z=eKX#htqkH13ZFO5sNB3w4D(%%*}SMxgG?)paHQ7MUg-ZcyP-M@YIzoz%WOavgwn! zMKhdYS9^Z>CT)})bxV}skHkmM28S(H7_wSSmA}i$(K_1ox*=Q%Gqoh%4NX<378A^bIjl+LqKivIL(B*z!Nj|JUnkcu!*B;xE5z6sSJRy! z(ncJ*S3|Jh6f|#rQq&0$+QCXpomZ^S{ZyI{K)am&37BH&Ffo7e#@+{6NCqrroe)V# z;%)!*!e#em@qsf&m?9$&Z=q4R5RwSt{mTgpKPxPsSWEMo{4r2$UiA+hA1|^EiDHDf z7K&T_Avb_nsnIU?Z?jDE?Lb(w%&7ql$3Ng78e1zqBgC99Jc^FLjWHOFRE~`X7V;lt zcyyz6gVt@DHH%VHMm6RAo&HA{qyeAjijAv^&3~p04GR`$>?6F+X_x>!$hQNQS2)tt z1k3Ogvwm_U{DFgGBOu2R@yOqT)g$m~q#fUjQqgZeU`Ojp{#J`r*2odXb@(^AZBrdA zp9fx&D8$|{dM7voOM05p6azhA=X#ldI75-}-ANm@ymvWxvzZ&sFC^_j-YcV&K93x> z8u)w%ZS&Z1c-SeDz8)GGQ{@W&yfKJ1BDPc4)(k~XFbRCqPshRivu_wV}CXWl0d}^ca>c>Uz45kTtWB|dwZpQ z$`HFj6nt;^tx6_N3nN z6eI6I_F(5G(^|6ZVhUWquAFg^DFH^LM+V&zX*=`wFuzP_J%=JUs#kN2g#$NkIX1aF zLvINO;mu#0%J7os)vPfga-ML6Su=3bu;@y)=FYk6qi)u1d3{&$Bmqk~_DrO=k;+hG zV3B$l9gUm1AzI14G9ITFagYLP5O{P=_?xM=eXHueW!05|pgj>ZT;Ee&vZt+*>t%n}D@&SSd;NYIHx03)9pK^iYMoPS76Xn# zZ>$jX-wE(uk%%Ig872+(idAvleWIPxUTR~ib+cHTk$OS5-q)jykH}I4t6~v0mIS$f zVKP(qz88b$nxKLKO}wn*FkZAQjrODnVaIwS!phI}FK%)#B^%>7K(z}dKX(js>f#b} zJ>l@o>4O%%9G+%+7O+Ffs^EAg=ktn%&Q6rG#_vNe23n7g6%9etI7vg3TB$NL#hFz; zAx4{09X@zF&a!9CDsGtPIiV0@On}}s5`U; zumf(_n8ha{=#YYQ#RH@pbLFhdIvh;ac}11hzqEVcbv{-?Noaio1&ZJj}Fgd-Ni&O+w$dJZ$l$ZkFP%JjtzEH59wc~zAhswaw}vE z*UzfGY&ekfQN1@TLsYY9*K-PUI_pB7kJ*#v<91F>0WI&LgZ_Vj?S#Ks&6>N>TF_Cr z$x+ilJ9I*ZoQ9nT#rU6lxIJ$yR&JXQc9*`h_O4O@?G9GWKDjdOue!!zF5lTgDkTYx z5||QNX4C7PNul-{9jg>i<+_j@Ukj(oRl5=j_*@!B15F55awy;DDv;{z#T9^yx~o!Y zHJ^jx6YG0Bu}_9&M-NUcC4!>91-wE6no!o`&V-wP!;TQ3n1dE>*Y+rzWJNxueTWYZ zZ`u3+rB)f-M=5gkj0nW6-Fgcz-`eezTinOV!$<8wndr2qjFkV%y*-#WR086^h8M8T z)i`!5zpfd`Ft*c`kz}VwphId_`t;0Vw=NH~>K;doMo6Wf7qlMdl3>)^`D1Xk_h%w) zUaoZ_YTEe4X4K+0PPJ?8=--#oDtkv>hCu<1&08gW#c4x`j3Ray!56Bh!M4n206ayybcZ&@|TwOQ}uS0ibot$JwR zTl7v5;`{0&Feca1Nj5{8Iq36=9Fz6BH5) z4_9M1k0K5Ih{2yx<+>^Yb!k)WLEQ67b$5`*p=rB@yh{>y_I6{uHBxh2PXzyDxaL_r z=~-~*exl)jDp!seWUd;~Ku?3>H+nu_e|1u+Eu)aV+OM%#%PP5PuDM~ zgM?K7CaLtnTo9L-bv1m0mvD>?t3RBhuUFBc0zn_DMsspYDI`{%h-Ruk zas_6QN;Jr70TNr*j8tMmsm~YwB=8$hD794XA!XlE;p|5A6YtKloyuz*o)IPYj9-1c zP0qd9Hf(PMx2{;H9SDGPq~Z^PYY4xFArMHd&FK&d-Num{1;7`c{rm~okhPJjOB7l# zPHd~>fGN>6szU3T5xp{MNr(17arCb)>nvkYXUp67TQ4zb)Dg_Tb*gbVJ79@aT}#`; z%N?%T$R?@orABxAh!#zoaH;o&BKy4B@LKgrVhcJ^^xqkXywmdKZ zVdnVQq)T{V%r1IH{|qCS)O)zb z#iTJ-@|IDApL1nm!+tg*Y6j`PAqAT{7A_)fCD+!~X&k_QZ{Z3h-n52Jjs;2rZ(}co zzS2-U^X<7S>=6>7;hVc>GF6vug5$ED*G9`WlxpPR-VR1mLKrnNE1ydlrUsURHU%!bitG8qVhV+PQix%Hy^;wX^(uAwh7RIQfSTM_v(*3=Qr zFXbrW)R4euHODEJc!nwCTzrpQ5}PYV-)@VqwShrDCyNg4O!lCma*&A)qhU4-XXq~BVss_}_&j|2 zSTyij^I}GDp^~H8(`}eOp65&%s-QS&`9tTDQ63E{_GJ5e{Z&MGioYT7MJ8 zVb?ceLZ3&PT$U9riWpJ?kQgTx{c3S5#XBVy=bizTbxi`+rA4N%C`$|5xAgmor+nWu^K5CjgHG47?Ixv%B$bX8t(^A$)%SwR_`Ok!~JxNiEjp~-uFDW@QO$ZGtK z!y&N{w|O0bb8dZR4qC#71Oe-PW;T_|JS3#QDS3JJ20aXHQ-te2whCB-W!ON+fMq2K zxUY{RUAUzQ*_>{S_Gk8uxequU;HwHxF*e#g+qYR>zcHF)A84jXWv7vv^{liweT%@3 znpM!3@J*sE0Ap)OjzA@4Lz&ZkvpSapaXsJ|EdGa_HQO-qWdZ$c6z8_Q6PLz_l-trn z;N277QCoeRo8feEfB?9+Thq5iG*W*lIUH%!(HX>cpA9`>4`r3(Qt`$O+Se$ogp5gO zx}nqOC+L=NhN);VPCe3Y!cXknqHJ&J!A`tH;v`#5?NM=F#7QD=t!0*So*Wsv|19kY zA=AAJsarGdYKK-UEKwx`CEr2DT zDY<*V4voIDrTSHCyMks^3~s)!kNWB*^Yr{m(O4v5a5^Df4-DgdhqiOve58C)iR#!^ zIM{ZuYi~E$l9!Ku^QFBxOTyC9?!!(f`Lz{JXLsI2jyE8X*SZ-YJ&+-x8jbZBKCo6) zz9o~~AX-JNbPXsc9GT4D${hGruwe(v5zT1(*~Y_;q>EI7$@hk89;0@JP?fz(|DGBf z;bMg{1CKe>tl&r@lB7R5q*)*>Gb45(A4%L-bJ$ zvXQrZKULEXBV1!-fX%C=B1cDUTxO1<$h-$zW|Z|eMWYESp(+4fhhqX)u$E(*5uMOIv!Q1&bJ z<)F&rsjK3PoDiZW4O-$O0sEiX^6q}91zHZ%+^xGCEVlpD$kz;XL0kI$GWMsy+OKM$ zZ|Sg~T-&E7_s@F?x+{`VfY1DGJAv2x>bXU0ffoQ2YxyhyT%1=Ew3JeoJUXThTmkmeJUYz36 zv5I5O+2T7nBQ)zeCpzo;_{T={L_eDE@RZWCe9k4xqu<)Ni?Gqz57L}oTer@)myOP4 zeg#MeO9|5^!B-7-R$RdU4p(8aMBHpQAhT#d_Qk2<80Xpg!nHn&2kPjl$xFd>r8>!Q$ zduL7>lVm&;=eQX?9ljC=*|mqY@k};VJ1ITf^bJZOjM=k?xY@YbUWKW&gvShWOc^4o zrTLPWKz(koIy0H#mTBVE%F8$cp3jt5hYkwiVM0!vxAbwCmkqvU822CJa#9mf)-i=B zk729Rf8-k@fdJMH1vsnmZwm8o4udcpxaY_I?O-NMWBgFT<50oeu(6Zo!*p!WEJ9lG z7@7t64O#u0#&*#wjX$|wjkGLK=V^pUqYHqh8hzbwY$v6Mo4!FQ52?pvDCLUCGLsiO z-p3JX9=wkOg=*TA(7hh54UEWBnTPBLmWj@0+2V@EElzM zGK{bDeADE7P$Cy~Zv!zDy2XI#IWGM>$M~ef$KB{-mMG^!w^%+*$6_V5`};rDw>i6) z(dHTxxAF-u*`Jq^HB=_I@u@Gz34fNFvd*Ssvv*R1SCSiX-VMkK&^BchuL0V6CRB?v zp&8Ff&{6zzQOHZLgwx`}d@&#cjiByc{0gWh!NQci+F_6(n^^9bSW^woHnWO^0;276fip0&zF&d#JWr@$TiU!30R(Jb%)ymd-1h$qgPo<316e~pC_PAhfgW#P=h zq6g|;{xu|zT5SV5se##zV}IIPBj@Dr!z-4$eTRRRF?APXs)Nim$4@S|4}#GDEMSufdGAw0ksj^75KZGJ1hKskz zo-1qHa4LQ$F9G)*UeTT7GNwh_MXui$ZYSO^U?Ua`DY zJ0p$Cz9reJq~iFL#4cAwhxp>;-={$|p5zQUqa7b8?vOyE@%6hw$?4}wPM;qRuMh7} z8Yd^b0jH+dpC+IelKurr53QLTfUp{-*Duo#AEZ>4t^-{trPg#g`rFgpJU?mhGy;xv z!Sj=UL->%!sS{lZql4x3M>Fy%U zAAXe6Kk4Q7G*|~e{WcH%5{F9>Oql*X{h8>OrVKC>MODH!Vu6IEvFSp>4qxK4=O-&8 zIvD5;p<@V1BjZy=PYq#)hdge6V$&ET~bl12wXi+shdH_$Xj(BGH- z3@{-Jn^_Xi5%#FKM)T{JDh)6;0iBm&4KNu2r8bA^o|72hM1}@~u2&>4 zKk@IqvEybaE<L<<-Hecfxw}_BUX)PM~&gp7p#n-NLU)iOF5E9%G_9*k#tE zU)Yl7RJeaAfbH$exLP1k#Mmd-oAzw7dX)@lXTEYfAR9pIIi z*TT+uDb`Y3Aa1;{G^CJ}Ha5S10)m(+h+Wmrs2u@hWh4Pw+t+zI5(JKjJN zQm$|xB*BPK^AKoD|MNca`N<%J+tlsm-E5#FgRo{J4OAldOm>B}Ye{TzmOF1j;N|Qo zcjM$hcx=b*Xh~Aw5hTbW(cJzzCIwf)?x^Eca35y#QM3Hx2;`Lhn4YWrywEJoNgU_r zmF9odY-)hwTzGvAcXf{Y(DWH12QtPUUUmo zcdW5dMYBm1ia|jwOK1LIeN~scn>l|ywNS+|DKM9(k%utb<3c@R^RkAY86DMhRga9x zDbY<`>p3vx(z$riXDGW%LS0>t(h6hBda-}sIIs5-X;;k3N-uR?&<9nEob(>Cj0EQ6 zrMw%}MkYjgd`1)#QoQ=9;x|jdaoYv56e@42MOJ<_LAzD-+)>7|#$|OTOw^3r`xC)L zUmiKZMj&*99^!ae8a_R%%LBXF9d(D1BHR%KJ%t>>VT9q~~0$W!Zji%!9cPGz@VLmhvoy32h? zD>T5!;X34$lYHVrHHuMQbc%`!eMyD>NcqSiF&`)fJEw|wU;>uZPIh3-FwnB)L`tuIECzm49I`P~=0kHzshS1{2U)av-k3zpE?EzqCAVG_^2#Z{JI}|E z74o=?)kMlO(LmF1U~0CO`AjK4IWBnM8i;3N%W*1C^Sg3Zd(1OhY-SYOf)s08ryYM; zew`^5n2%6$?zJpkDJzUuZTlxT%h7IETBLfhJJC|vs+qK-y2CFP<|-(6v$T@N47T$LC- zEf1@C?2+pw(>2Zv40@cNw0fMtUNnEi80<2m(PN%5=rPaOp~o!VW9CSX6<(sm)=BnW zYQT5^Q@G4Uahh+NFVzZ-IqBK30TL{!NJ&R_)TG?Dbiim?vb>ZLY6+$h}KVFd0zmVWjAPLw~}iQ3(G*$A*c7XC$KN)@B?Una3g(%+bV8GqT))VcPI%!c*;`*_-P$b*uX@RniYvU#ncz$$R zJf(i}1lJ4nk=PG@AM-eX10cAvFgDnL{ROlOm_xig|NiNh2c8jqcQSwe9G2E;1~3bj zFoOX|8Za|3qt^Ku+XJ@4j2f|pm#G)N1$+$Ps9l`<5@)P2%<9S+oI@ZN+*6*(rJ0bf zO)O$>^OD~liHi}BKu?IFKIM@--^BnCpI^#&;Gw}$CiOsgCUe8s0{7TH5f2hx@qNgc zoYEDcytMO0StGY5?kIo995OC*=g^GyM1R7EpPnD3sa%66ts3molQGXy5HED5P*y%5 zr4dh$Bg7NYU7*pJ%$X$l0-b2rgn?{ZJ4^<=M8?BSuzZ2Tb06E$=Y={T<~G5M{16?a zsuvF7i1#2FZ|KdTj_G+?X)YL0pO*rAQ$s3#JG3rJU|j>GVP1cfHK`kUB|g+uL6DL1 zQ8QhZop$;1afLQIi!$EQVB&lkc}n`W*&i`f4ShuS`&GILThbgmO;^`lI>SqjZ@hST6@OuJ56 zxoN`pSk}kurAAMt9RsVj{7_ww*%dH9&QYOHkF#q$I>SomAxs$g0;2vQr)mZkv0(9RQAf&-n{ zYHjE(jgnb!wE_w~b6mi$0=m#lEe+k&1h5DKHPL^4Y~SF+Kr6HqB{j?hu^2={qKb;l z-NfPg`}6la?kkM?(A*Q8MgpvT?C*d6R56+11i&2t$)&kv6)H{<@8-3mpxF z5}A!N=~Kb#LN1be@k0~8*d_+hEp*C@5-$3E_4N%G+W5O*K-rx!jnD4K$r>l~V+*Zl z^B{K(#uY3QdCk_}DYFrMVs5OR+mRC~&9{GIgf{kQql!4|$Q7mRI(8jba-KSHCPTC- z{)@VJA{e%f)6*PDIyHXvIf7DE54LljJXagXq&du-{pr^=%FC)dG~QqB(7{#dCKEvE zi>9!lOWM1THij9m&q@=bF|1t==-sM%wBb)lJA4-u@pg$7G6Skg4r9(4+hW$%Y;AwF zo5|MxC;msjixBblVR-tZ0O8A{l$L>DaXhxAkU=g|XeNSNe*A0s^6+s4H(B5ucs(|e zS2V$1fC=W-f=g~quz>IYaMnRHt;7Yjge$yEtN4l<2?g8u#Zx(qG9R*Z%7EJ!nA zAbBT?(%UPhmLFkqch6Q4XNf-foG*>o4p zpl%HFMSebut&IDa*=il|PhiNyGh4fsmaT-alg!9a*sA(UPRWPeI=i)IK8!$00x8!M zE8>1#^ZB`Rkk6D$Rv&o{vsRTaCUYB-v#>f{=WC9&ei_l*n%9?_=5>kj4lYbGXTT@k8xWLL9ASuks2guKOG{CR6(A?P}l=ihh#6xYUenQi4k|6zH9jv>-u1e&Y5);m^HO7@lxxt zt@tu}dkEfiBqY{;Mxn2sVHAJ;0PwV~Cq`jKVeDNzd@kfs3=x%N(&dKrS4dt+bjAD7 zloFCvI}tTjfFUvVkSbxyY=dg6N^NFisJe&l>W~q4D*1!>FCyNxwEVSLL~!FQxFTd2 zYdz!|*CJWVWs_N?r**~;x)3poEHy2z)N)3@r3uWLFyZcoU9WXrl@@gt~A2Iw7MkI_I3;1L%Lw0hiPA{C9Z)LW>)vGZsaWc zIh)L9j}{25*b*DGb>wa<9>2=gNP?=6X79TbjE_K{?H=^lMT8>$OJ;3Q`ai#0=qTE-Tc)iO1`n zLvu)Y_|zM9Q}gSy12PsIeND#fVBXspLdP4ieStnwcu9@CGv#bG?6Q-Ybo(^npSAIRN=- zwpEG1loS)v`)w;Z*#UyGHwA?XRZzQ0)Td21s*HnNU?Sk>$FFEmur5EM%5M(bH8?u! zCt8M7p!UYSBs;0fX*If0PQlvt7h)h~AtqPh{#BZ^{N??sG=wlDgu#njt28;1AE4Z) zOhYxAV)@=)rn!Gl5J;@kz*Jc?zL&a*txef<-xUzz5`?^CfcO`biX^N-Da<%Cf88_} z#g`1Y{^bRuyNFOhPpj@J!U5tP%2r;1nG7T3t)wUjFoAyTeV@7&$s>vAjdiP_mw3LU!OHO#Grh+S%sp~wKf&D+)wM1_CKcAt`wiM^rO@bz0OCb9n( zqqn|+)1NJP{nTs@(WZ{n3J-NmJ47HuA!vhWJTm~Sh|~FQzo~%4T8K9Y^0(jl@=tjA z%MwrLEPuwX-^(<35asW<19br~=tu+%Z-P4qm@nX_AyQ9ZD+r@PRI{r=?8GddUh(I_ zf(8XM!aaYxk%lE*wZO%sEGj2J_QK@5z;oGfseDHJn18E$ZksNX`@`*Dx+X+-ijo_UsPrj!js}1Czsfh+6`W zo9&B;NAlG@?Tc`h32X0fUm$0R5zre{^J)+~F@t~XgNyKU?2E95DPHZ1%63I%djUR3 z9J2k;&9lz$b+$b=_c@RqitbE=edgwN5-+gM0DSc(nO+HDrxqK}yb|}YH#@!=5|BWL zddNWP{w#kv&Z3(`4>lg1X^+3?<{Z20PQ2TC!Y7UE&I7+pXXcMhj|LW;x5q7`bN*vbRGsX{*}z(G#kA|odhN;l`MZ>h!8Two^aPpCTb46ray{o! zhqfN5N_9}?#A2hw6C^XjuTOS;a+gWyfo^~0b~(rFJF9`*8#Y~NTdN1WvFAeh=s7+l z2H!DJ_jtf9+`8YE%JMyopSVYu_96z9_ZNieq*)K3d=+yVQpmQRM!#RG?LazBr|JC> z#jeNoNqkDndsH{-tqLMo1s-yc!*O0|NnVaKdru{|7!S%0?3Rk>15|C-Nx^gJ7PnJF z)S+&R#BxNnD)i=kdQ;!ZyjP8OXC5n`nm5f@@mjR?)OSoqb=7pw&Q|R$o4IY}lw|jk zJ!CI={Rj*gFz&Y9?i}3i##j>4Cm{sQhwlR)K0Te^pMH6hYB0_40GvJ;1) zlE9=D18RoW4nO}IzCHb#DJ06AS^tebKlMl&&Fo0>>+gK{lOBGi&eGZ8-_Z3(X2XZS zhu?_7Ey9-ZKvBT0BUvN->T}t+k4>8k3UgiF%6{DO^RQ7mB=3 zfx8EKLxI9E%jJUxGQ&lZ%=Jk*US zHTJ^fbf#<#;PEZ5^u$iE3GEo2(B|IBX?2`%Y?LQXL?s;K8x0&$2cX@`zR&6+mT))D(CNx|qftQwLX#`jV|zw(tpWY9{Gu zFYMY2=i$qvVuk{A4dS1}&$91JmtO^Q)U53lPjY)#k@iDrU&{VuIX|&B21x zI}H5?ef#-;eP~*~q;PKf;hf?ODhgVfIg{}n@M{aCB#$2TSgrsTCko{ls2Sy8Q=POt z+E zC^I}GF+PoCO_n|CBaT-2VWp2S+N$Ntr;J8Ha1*kB9UVZk-b3Lv6?_UXlQs6p zqA5KCxl$Hw8C^YDyk^e#%Hkw5*C z_-j{gX(a>M+H;4tq&1X_z&dSFN2Zl-E$5=;FeVn&)W4v)1H3zhLZBs=&Y5lYHnYy9 zBNat|r~xI*u$Ly6;L~QaW`P2!B&H2z!Mm!Z&`Wd5Obj#4lp!ddv+8C8u!4cD=DHlG z#g#a2LQb%Ga9T5cCe24=lYk!#XjxFSHN{6=pN0AQG)jJx5s6afS zFmzbu%2(>{MuQ$W6Fg|&81uJ z**+JH3x$T;p>qK(u#B5=xOXlPzRcGUZOq)R*rasKz?2Rgw|R{{4y)itwGh|2vanvnB=W2yO~jj0p|>yX$imHK~OP&g|H;4 z+D|wpFULt5m(dMDU2hL&!aD*UNo+ZE0-lZ2Pq|{BroLkDVC=tT4=TRV4V=@Yy1*wD z5wU$!txny?*8Iz+eU(V{QjN*XsZDzTi}jDJU#^)|Q&BI;_Oia-zoS-@*5nQMg*sC9 zuSV8m_b4{kn=CTATB(-mP1Z4gAEN8dX-{O$iJYnG9444mfw{;v)(=d1b>nUCx*bj<;uC;Xt)^PQ%*7gT=S&N?pZTHb15hruyt z?2I=*N)d<@G}T&7Agwxo&>f|TxR=}V?(azmzYG>)Srg(;O~l>Yb()Y|Fv(@x8($8R zMtZlEYlV^2%c`C*ZLI0lTMhw|^fi!`@}}INm3LKLz(=@wSV>V%0cpZMU|B3A$t>^O zC>G!t7^s3UPDToYI~V8GuslVU12ktw4ndmm5r$K>boN>s&OD}n0;${Fkoj8zg@l>*XWR5eqPt$h(%Tj~8ZM(in}aA5 z6NA1UrO$9s&uCr>ZS@X_t@?)sXj*a@*`7cXk{N(~|Ih$h#Tb(0@PBB46-;w`&(Yk? zBvwjh{Baidm;={rzLMpnDWlC^Po3&Lu_)=9?=s$F+7SRUiuxcH-ckcy!%2h@E&Nq6kZNt1shC)hR;+?5MO@%_~}U!;Zj7GzNQcU z-?xva|2}axv;yHBOuzkjN)ML_;50Q=5lIrIVUaU~(yvUz8SQXncBmfg;}*D8k_D<;MS$05qs zd39N3j0mV;VZoT3$6PAa22!nA7)}(W z|I<5{8sRiEe(BvtyPrHXMu5;mPWE&- zY!1mcQ7G97L7CHm87yEpaUH~MO@sBqb!L$=c8NO&P-Bz;-`S1)wjEQ*hm{f5ZAZVu z6ey=el%4?{cw$gI3_ReMCDDQiX3gMBWZiGPX8i zpYD$I1Nlu8M3DZLh9JKIXh|lVQvUJgmth-ae{kv%IBhp~C&%f_$*9H1g88~S2)sJ_ zPIN;#RWZDSZiw1tw)ztauo87|(jO%EF@8&bCv=nR^V@Vo_4)m(fmG~bP0m>!)aKcp zv=br3&oJ5SQY}Vh2QH=4JdcxizJKRv_xpFY`V;$ihIzk#-_YI}&BP!u72l{CkXnF* ze+Q^0&j&cmS1cBbxd@MHCw&kR^IHpa)J_Hv%12JYC)frJH(SIb)38c(9Bp-zR5M^v z61`&0BwJ)+N;jqBoLPaYkjQD9iVQS{ao6{Dwz@GWerZk9tQwN3Tf^0`IbAf(pv+{u zwQiWneb2QKk*?c%c>X^>Ckn6)Or314IQT0P;M`$mm2n*s1GU5n_G=~5x}MXdim<4n zYN)SPee`x*tE2>FpX?#&=$Q)KRnjlJB#%hB?3Uy-U;$5;VdOMLe_z(1a7a^&^clv{ z-YCr-IDO-wxW!yRAQ}!cXU{X&V!Xy2qi-DcwwUvPWxqYb+?|DIA-lyqVshz**y2G# z-Qv$-+b&(RjS5t*zSCva?(dQOwV1E)*OU3k&3oDgU|2?-;8I3&lJ1lWjZZof@ES;l zruJKO+@^Zu!NQ1bb zIOJiqGutdDqi!>)gy1!CW&qvAN4AAV!7c|mSM}v53pmm!f5SFniguyd>dkIbSN&Sv zgw<<bJ>E?+tmu_L$ z_3O#@)1=!$8)viLK+u3O`l#xp}^MHU^{lfB9w&!Yh@JH)jZ|qlFn=!0#I% zgA96wA!q@+ zg0K+h{e{CIZlo-kp9=e6(J-RraQDuCt5p620=FWpb@x3^x`tvpArBPtE_4Ci&!^`v z)#d1ZfBJl_&rNNcGg;;;w#NR7LQYHWibh<-fDrGpm7^eTbdPit8_swKcf%Wgg^_As zU2Ryz7qDN-ftP16F-JaGHDmAPNjHRldCpo-F&wO?x^G_bb)Ekf8=Ui0S}E(UpDf0_ zDR`Y*zl?GJ>>pvLylBf?g`WkBr}{ILJJ*k(e`NfTcu;KBOjCxp6uu2tx|(}3|65m@ zSZx^PqfSK+>juvO$W2L+wXQMg#^%WST;k`M3Sq^hSxd_-9MWC;q7_A(bP^^>Z=THO zc@5LA_KHbi1h@Z7 zs@*KPl+hsyuj8q%d-Jzj>=POKKlUUJMwej|F%yTS=ro6==rxC>=r)I?=r^~e=s3?f zmxtR=C%2m+Ir#{G#bj%s1ndi4^jCpUF(!^bFn>1Vu>!N{U61GBY!p)}`>aA20Xtf6 z$Dx>rbzy|lJ=y%utN%Y(BaoXlUO`ej79#ySf^H9sXp1w3qzk|7qqSzeE(Pgl8s@Wq zDh{W&L(Ft@h#mxbaWD$er}eK~;U;nJsdv0JKd$P*y&O(|I(e=8tH)8K;!>z^OPnj`4o;&ot>MKGC+*0Q?32@TMv z57SYcx4w`hp{D&_I&7-%xJ3O6F@sW<@#9ewx8^H3$u)l>y=x~=?p+)oVFx*7h?Jd4 z22QL=VjEq1R79_5X@j^S;<%Jeo5tx%@OIa@RsKnMTK~6wFhi0;*e_7;Ojnd>&C|y8 zmB=$}!huSdxIhyqTlTZ%h6MnD3xK!eKY#o_t*-p-d+9UBK4Y&|QW;xp$fqv#rG$xz z5gH{fuGD`LQ4-^7Es=|A$w1ZDjCj0TYNDLYEbq>{1o)o+C<~s`ZmsPyYbVEtgL;3t z-`Yu|NL^M3vTvL15pg4ecYnNGPj?Thz|UXU&5$`=serm$rTddqu(*N}kvh6X9RZdw zx>0i4K#a&Pvs&e!>nlFF$<>06~%I}1f#^G|Kw;AmTGm6LtA z_pX$kJ1dJwTxbz-F8kfG7X8S*&SZ^6x^m=Eu*4OdZLrbLvhrZvF(W;)^5tL-6}#uu z0PPul+D6Z9h6+OfVAJ}&$xvntQRQ7HdAEOPEB2py>kSiFAM#CZ!G)h`c<`k+Q6z?3 zF8N5FbetM833!Ijq=pZRIN3807!c((={^I6lCtmm)B1{f|H-X-9|(JF|H(MkJsqN5 zGxaHUJu2d)L7{ld^fL;N6R+@cc!17}Gms|Iyaw_JreDiqddbpDymG=S-#A;gUF3ht zkvMa{FTEGR)K_vYZq`mcx7rXpt~CzNl#6G?KCMYvHgBio!zy)RS53iavA&ZzpmDk4@HdAjrQqHZa0C!2K9LJ#l=xre<(#6UStGNS-64SgU)dU`WODYP@qN*IJ*^*#8Ur z12*QDaVa_!mm=>>6PM{H2PwBrWjQBqmy(EGCV#z~$&%YP5J2zq75o7sXfzs2)znl; z@{Fr;OER}qPDz|gd`K?&{WOS$AhiI3#W_&a5OfQ8>>ae6{+i_U<>~nT^urtK$qGkc z)%5;#0v?e336d`wnk;}Y2-Eww>DOl|mEq&ahn5nN56j;jpXucjg5x`YM}S8FUOrh3 z&k)tUe5f}*PDze_vF16+;A@vD)Hy>OzVYXm3o?y0!YLbM{`#Ao{@}qM`DXNP`ftAV zmx$CkUkUqyF6y99hxnbB@YFdV5r?a_kaXqQvR!K(&lH|*?{k+S)j3E#zXLGH26uQg5Afhbc7ZhG64pC%SB%V6o7Zl`@*hOdrCvqL4nZ4~%7IH}gH_ z`!KnWGY(pPmt^mpjeLhpxS(P2;xqwb_5NZ&k5k1w4PM z7-JvfAC*+zLZzzi;Qha!e#d>?1aT!EG;U(@Ew&tH}`86$wR zmd&p!xp}Q6-ECPlEo|?`*ZY4rNKmwu1nb|uOQJ&ooOo>|(zrwq!Z^2;C_i6h!_Ps0 zw`b3ak!4&^UOlW-azpTC6n*G#MVc02UlEuwQ~ydE>uX6wjb6bFA+?@FjE zuNh*j;7aE?r~XyR7mGpk>sD%Rq0wvHpqi~zE!B0-ghEfK_Z^0D0u8cC3j6p*BeChS zk5gL6rO`NNd8c$hI_uQ?(y4Lms~#Aodor_QC#&H#HCRb6taUrF0-QZ$W@VEG<_7yA zU2|2VT~`bb>A=jdlhyE=ZnJ*^4jT^qPOPL7urv%yRdJ{`BXl}U#jI2q=^m=b`*@A7 ztHH|!=MMYu3V9GLeZitXSoNMUT|aCpxXj5WR);%S4X>%e%5qZl`0ig~uE0=|p3LTOPVHJN0as%Md@7~9k z)Idcs57-A4Iiajtu`-ofQRSX8kJ`1H%EjCMw(|Iz8mx4T?EA3NRv_S2R;Q|&lsVN6 zrfhnyV%OPJ8edm~7slwm53f+bkY4e!6)#uml-{IRr%gJ6cd!~>Q-hU?(S09QidYhz zu{v$GVY5Bv5NN6~tWs^SLno`@H8og4jO>qoui?>h%Y0>wuKPS&i9*{YE%aB?oKqFD zv9bYO*+&@be79kIO}AOOIk@gZ$}2(OJ{r{Mf^K69FG<^-5@!d3$bU4a;T5(1Bj6lW zcL8OkFdvO+cs*zBw$1r}puEOHmvJdN6o=8gkAh0jn0_G*>gCE5rXm+#SX5q9(k^*fFKghD|IJG51l7sZ$ z_so^AZAGyqOG@BfVB@*GBWk*5V zw&Ez}c0_f=mpf_+QujJQ|-2#)kp>J{&cFYhE|M9LCwh+d+SNNF{m% zfg?&j00CIUn@Ne)r&N!cmk!gvYknKOA2qMskAD*kIv)-H?6H&n^aB5Fq+P1`WFT~- zU6sAGdw;3+w7GT);sY>)qWB0nphP|+bcom^7#`MMNH*6Fjo!jI*5n0|7Yq4hfEHkj zs^39-L=?qbya95Q;xo2pEX51U!`f5chToMug8f#z*61rd@sRdZL?bXXafuOblY7DU z>VGg9*ar8u`PaYygM^fPNw(Lc8(v>r9JRe%^ULUBG=6v0>kk}TXV)C`rqjWA=xFx% z>*wij@20)!z{Od^-e@?*{CfcV2=lZW_5d%C>E;1;W9(Kuym-+Zj7R--q`@(Fq{sC(}`s%X{UHQn176}$Nj-%mbk3x&EVv`_w(p;YrTXo zP$x<87mx#|3qnq^dd^P{_^&GjvvIMDGDcKE0hi=$1xi30Bsj*7(?CZ%a|>u*-hWQt z>cyA*^X+T<|Hlv0>DA;fO>;8pPyEO0i}T(^Z+PZMu-;oqtt5Nqj6BYyl8Sf-j&|o$^|};_nK|w~&cACQqey z%E9}5HjcSm`4+&KEU2n6UnF0!Brsraq?3g`Q+Y%?hb=4}b_a96)h-&maiQhfC2k=R zrHo`-Z?!9uu&%Urs#~ypiU@dEJb(&V6_TpAx`rcrfDgea8E~?aY<%;wD=>b0n` zdk}lL8H2hg#>(p?eM$>SpJbh+&*3iVQsNT62q5%mwTfC?jXf|GLk#+$KI zZj2bE@^EDHSmGPf)t_oxS%g4Y z3j*a{-NRieBOMmX*RXIozcylRhd?wVe-bS*x&$1Gnx0Ot&(5bGu78hxe{|V^UtfSR zPtKb+um8S(uz!B+KVEEwGiM*EfVd!MBNb3WU2i8THG9yA$0$Tyuc$&G8$;?8T52#X z=@f2aq>tB^SGy;JPtBX&^us@{rmqn;<5R>jY}K4kCf9>W6Klar(j1jsLt}9 zR+;BHM*d(=P&#AI-!`7U$WbPMMuZP9+G97VES zk1bcub4TZPMYlpynd@}}7XX$Jbd{bVcuw*>3iu}@LRmnBoYp~va<693x_R#5Qau*{ zd|-rKbdv2JDFN`2gTi9&0Y(IlK#dTPszO9X#&eO7^MCi{Q4bdt+w)#oWDaF5=1}i> zuXI&L>8@FdYy{)LPS1BJZuN5E_)Jke?e51Awt(TBqYvUlEoWISQ;z_3Kx&Vga5e6< zj+d8WpWMUgVw`;B`QPf4p_cKHe!wEOi!tMo+8TjbkAz}&9i;LN5j z-ltYtYk#BXyNzDAaO)XsX<35Zb_UcRByd5sGymYB{jo4FbMRc39kN&cN{OJ}+E?g_ z&6rC4gPhUj5WY;yXj&sJw?DDD^LKXvUS}8J?N4lOgxCqx3ET-Af`6@^?ALHNc$9)7 zf9K}{NQ2uO-wyqgZiB!Bw;yOV&e?oK=)dY4? z+ZAz~+m-6176=raax#IO=HgN+)um|46!9&ZvfY=R93s0Sb}J@V#jXZ*6lU6xs9mE3 zv)LY`?1*c-Rvc+;*Q%o=*#-%Ya%PjrQK`i&sEZ+rU5k*^^f>^W> z3f7j)2IC3L2#+<1ZF!89f9KMsTwN?N!UjXCYIlVlhh)~^0uH4~*)g{n2ssvkOLD+9 zDP-58V~uSt1yV9!LWQv|NQx&)$gm*_DcbDe60T}1#|{XU=F99PHXEu=INAL0A=1_X zWteReJ4s~L;0VbW3Tq=sxxxmPASE`t0x6kZf?jPN%Gg*6Hb2}@Wn#02rD~j6Q*3)} z*Q!$`^9GEos@cuiX{zR{5`l^a6l|2vR+Po1&}IrKC8{=F255v$Sxstwf!mY9br_T& ziOs5*GyKWNd9UfIzCQlD3fxq}(K26NDx1s;fz4=ezH^*Z(~qcF#wn@w9t&c{H_ez0=Wu zT=)HWay*oCT{}(hG+t?USoNR2{*_a#K zwx8IxosDf<8{690w%+{S@4a?i1@sNBe9yrgA_B5T$YKTa%~tp3lucI<&7ql$XNshK2#W zM&?Gp-UMD!GLD&vS(fVUDk=M-x-X~lYi3WJDy;%(QN0h@+#^T?r;PEKavX=mT2hyo-zaL|BklnmqOBeFP zf$9S%LM>m0HC}w)0(_mo=KQx0fsnKrb8dWDhA7h_#2ZIZE>^K~!=umgx0LnfUi$9AXj!fgRlkZbPGV#q(DS#tkO&AYAQn132FamtO$FBWP z6lRhPt@7RBG&IAEW9~5jI-n z?<0UYtBtn)@?2?P(XTU6%`1^2S{agP_~xhs(xm4bAEC(I<3N?l3CVYB#PAwy_~6qj9~* zkIaV4V{7k)>>!~YAey_ow~~A-aH2FQwh|cjU>t_5vTgxJY?7KKAVdIE+_+eTu|Kz- zlnnF17|4p0ui^@juk;rZ7c8wdNUSf&lrDAS+D$AM{oO|uDoc}yS>@4%8Ym&YBFduC zBr5+WBCZz7m;MQ~=Nj$3vlNH(OCS*FeLuW%y;iSHumeYVRRa3ih`H3S6Cv&!6{VQfp_|&$sK37v9{w z=9LT7c>2O|eJ<#UN$XD+5v6%tGS$lvvc^*yGGz^6r9J$Fzw07Ew2zo&zYKirMsSVr z{hy3DMz{G3nM~mqGZ!-RX+xPZFyt0O9%EGm!i72Kv}9H35{Y3r$|^sKi?V2H7z<7b zqTFQ-`kcy2YgV=qSrxPL?A)2JWlRu#sW+j0UvS^irgu|~0mtA9q&S!)m|!SPn)39z z3I*TRA_qTg7ofR-s8pEYD{>(}(-N{Y1n>uuvS+KS+$15Cl%rikqOu75`|%0?X_Js( zpObB^|E_IhMwbFZ_0Y1@9k)a%dT--&YU1h0cm7bBIdqvh^zwH#*b>ad%A16rG2JY; z#ynGR)ILxF4Oe*8EMIc_7_;~~J});X&xbD6Y%7;&O1S zwg|6yFSY-7(b#OMK(DxFHskW~*)vujHT{m@H+2n>D*T4FIjQV(u+pYrL&0^02e_CY z&iSJ;?#6ef(SdG~VhvlXi4e|r9f00uW%mI_0P~Vgbp#Rx@AYni-dgZ+zgyr)s$Kg# z5J)hTc4~kOgrawpJtuun9bKy=ZkIiO!)Qnj$bV+KQ7N@)luof(pezaQCTg| zsZAB~SS?81=^NKmjnoCdc(nXm5m$8*-i?;mOH=^#1KR|LWX;qN@&7?AMZk&SWP1C^v9Xbv(2%GX5nlwBW~851cdKM` zFS2kA?+1)CnNsd6#hpg1xH!Zo!0sE;po9@Xdj+kdX=UyNRlv?#D0yM%lsg~?wEz7h zvTtcMbxhd|)G`m4sc}(R24W?1oqZF@|hiS&Sj0s%po=l8(`f#^%%zJsPwD#Q}d^LzF-nFOqCT zyHa2*26G&|j8o1=Tsp>yq(r*U!NN%VNxSGoRdP}s*gpr!j0X!Zpk>kIqT2AMb);Bo zC|q1iz?p`tPNp?Pr3#Y1*xrjKF5>q9za)9XA50~*mC;oTYa@S$sLH0QxcW&dXoMEN zp<>gz8f|3emL7j?$vhLXoU4*Qyq2Hbf0$f37a$bzu7#+0zcuO8W`-6MYFJI*AFI# zhHm=$L^8@e3uIYQ`M0uw;IjQ+^_3^>cEebEV;vQJ_WPRP%Uw9XN(#q{3s(>H_~m+l zUK|9!B=2@pIffoX1uo96#?6RqXp}J7VJXM-V38lQn@I0-mUREq-oCaGCbmwF%`=9zWlE~E?^g4SE6A&I+YTk>(og`XLt-b{ ze_d+%B0Z)~hGu#r7_`^LgMO?#*ayW=QLe#Ej z%ddTr8{>QS>3TPS_cbo&=E%f_Kd!=0hOWT1A?hr18aH`Enu6Mj-ni%gRgO=e}eYcm&V&t+h4vc)?Ypu z(p!3(BgoU=OUN@HT15)jH4}Jg-9HlR;y$^`!s&B$6EXRdT%ct{PZniua$QmXg6L5D zGV)AbmN>y%{19z|t%;eX<;z|u)_^xo&~k;azYVNjaS#^M4l=2R|F_9cq^cb++8?qdTPs7%h!Pl^&!=K3$%3_*2+JS#(TrOji8en=9Xq~ z5CePWXM|_2zr-Mo7OKgw+4bPvi9eR)g&bzG6TDST_1dRDaxFq<>10!x!U0qYmHqx4xE}+JoPfbi2{;&WJ5H zyu6udNQsFNvBNaB^8k9P;O1aE78G+{g$@O}WO^-=0f7dtv**Xa4 z5{ARuaGg(&b}`b1uQVq+q)!3ZD>b1inU8$sUQL^9{;f*D+bSE-7$nWRgE2QuRsufrM zQvhY=!q@?oj;-1tSO(5XHzd6#q5lm7lpAn!bbA{wtP$OD8`j$Jv~$;5;j^oL2UOdo zfYtUEQmc1|o0c0335<+P?7LoGPxPE&-qjh@0G48`jlnqxFHwv*Y|g@s>s(c57FFJMdu6wNkG!%%Nb2+-$^2HwR)cLm-u{uje~=wM*|Xjo{8O!%N(}qDE1#_cTc)%` zZhk!7l^`<+G4vfUAZ1(p-f>_IKr20M^4<;~17lD{Lc=i!XndXcIR)XzB`z3y-l`TP zhSl3V$cfg!XvL-7Dn7rjj??e9CRudqSldB-2m=!0YsM^NDQ~0rx@1N^c9@x-8BtcX|(XjlI{)k+* zaAB%hXtxcyEw>=Z$^XXt<-@|M^9w^LIDB|L{1f>>bX4mmZ;wB}PKy!>mD8F0C&YiOlvFTdsyNczaIcTbxFrOhSKBm!bS*YR|o@pWY zF{tp<$b<>dfQPgr)0YDjUQBA76x5+9?t+i^xBiGqU$HK1hHUsK)i-SbG=nBBQ2i1y zK*+N%TV&6<*8E3-wMV|Lhotaxov`i$0~>~_Q*DxjQ-4PD9`+J)#bp{A-maoANn4S& z()2ocVP9BW%Jk_MLb)trj0)Vkvb$QDAq(-w034304kDWn)I=Sy{sK(GL3NEPUQl%} z5PHG*N8fc}#-elJ%fg{8K1(Oy_h@a$5_w?XKdRU@4LBJ7~8nF`HlQ8#3p0h+cJJkhps>cD*zNzO=O5T_GJ7zI=Q3 z?hW00$K2?pwV(mjw#hpEUg9q7fc_rR;UAEHWK`Bya+ypV&o;Ze{FZew*JyM(%u7X z9CMYGH1IoO?loS%z$TDddU{oYEBzD{!JLWrj2 zOO7^$o?_Lv*SFPsCXTRDffwz$@<%<|1TQ!DEtks`+w_kyls#?&+8@tzU!F?@*|M?i ziHwBNa$rFD82MA!*qGnRF@Ev2F^RCg7=|NC!TzTjn>@Pp>`oanwt8W6{Xl!g^~wQ8HxLR?Q6A6J22T?P&w-a6CubH<8$K>v z7I0rf1JM9qnG-*}n(J4g_Bc=Q9G>FTQl2=%z!sn%=<{8`3^~B7Ub1(#VJivg$prpa z*3O}yObUKWE~M)k9vt|1XKPoW$MtGaV zpS#w6oYu$3csd3)HV~99QuOw*#Q_L3H9Mfi6I510*CK(Nlai1iO=gr7jy?TB za%;64@;f7z-mLL0-&J-|6y_z+w|Lh@FoAN0XLN8%u~tumnkHUYqYbWR!x$KdQfyUnE=s;7I3tf&ChquR^b^edRy zbh{tELDw4N6j|3lc~|`A6&ONfiw2r11z(lW+Hq~&&8VMlrf^fYeuwaD;gnDHgEL_i zi9wSfiu%U>1X?FjKr=`xDPz>2&`^8I5TZrKCfQk_&LX{%XrmPbaf^WwFJ%KkGxn8q z;QkrBw77`hKF$^A{fZtdBO#)&x-F~+wf}i*w4dD~xvazb$MA8QDYU)CmyC_IMlpxMB-3~^#joYL*_m38C;vmm)XfnuV({DT_(jfcXICJTkKbv&$ z(+7P09MBI5d_yKQYO5vBFwAwpNP*Yx1`^0Ug(cLkZ-%OVMKLu-#2bs@;{Igs=GN2j z+inUJ;|wIi1!O1#+K_Xp)TJXTH1NSX6;?i=YOateqp^j^0*ex}trrs%B1!Ai+8=;r zm1G7!B99LvT7G0mIpJ44D#y|qX`i(3fTZ0&80>WP2w1n zyQl#diW*~?H-m#vA${zi1@m`d=UScw1GWDv*JL-ztB&)7px-c^(yrfP1UnOfx>j$? zT+(8MA-6@m6Zp?!_g06Pyc;=gu0GLR;scTFqUbAQrJ7$wh(cm~DaO(-_O{S}9IlfL zwgcoBK)$#!L$W;k;x`45V0{<*#wI3lUQKEubxt9|#7^%!62Njhb7NCM^XRlo6$d-p z7+tRawbqv!lY9iPO7rdWfG}pWTff8AIwDX2nUHYcaq*vhOt$_T4iypgbN>)|FtWm{ zGy8N{v~(kHeOSn5Y_(A(*X2ctf*TA&O5z}7tLW5{@49vVq<|st-CpHWc$z)UPF%QK zooqi@5_^7!(u4S~AObzBH`dUAo8rWJ_Mk=I;a{}BRmcfM-DA&h=C0h_+?m?B1F(OU z#yY~%!F?r#<}7l{b@xJ5ie6Ot34BHC#Fce&IH|7#iB`F>#CwZ$yj{gLUoralpM_)a zNS8MG0WqifuQud3kQW7csFH=n_ZeL)4?1(or;%-6;32Co_WvOzvkReE{{QQ#`;C;W z?6f%0K63Pg^7Pu_(^6x1;~J>IiYD9F`ym6!;2W*5gRRG-8)6QU4~RQ@e5Vx(2$M<2 zQt)}8tf#x&Mt6-4vv9UDjqZoj@r@Yy$uL(S&=NUK(507nRtJe`M9~{U<2t3}h=f9Y zf&`}+E08=$V{(K9L+LG-F`}QsfvP0f)NA16dt+r?K_v(#*tBtuUC>?U6`;olMFfT5 zdfH8w#EL7Slcs1#>8gBq6J8A ziRK2Z!KC>teWoEEmVGe&2#|cx$B)dDhre_vlZQ{CUj7`6bD}XZ8y#8e2jam=Y3=L7 zOzM+Lh>V@^GUNO!?a~KOHN@cP#7idEOKn*JH3oyI4dy%<7F2&~3~Hz&f=ky`e#f zDhX7csI_zd#p+|5@BV@X9auz7>Xo|kP%dcyX)q_I1ELf}<^r+Wo8GyFuKew*2IKx$ z>0u@5yaIx+%qFm%vpI@DoLDy+{l_of4Fpd}r3)PNB+A>Ow(wE-R`#|#6U(6cBrhI1%T*zCmPr1L z1U7%F2}(`-_*v>@0GxTtyd3FU7kZlW_KIdd3LNjzq(5PpzG=w5NxH!1DR-zWS^Qno zfEb&;=Ia5Y4!D15e|u;F8VIeZ#rFNs-O|>^_Ywao@-rQUl%hWV4_1XO`#kF=a$scN z^`z=mkzD~h<7UN{`2vw{24na8Tghy!op_hx_VZ2jN8bSqJMhs(U@>*!FFzQzW16=9 z$ztMJaDQ>?+SA?9X2tH#zAVsrrOUHzyXyjoOE6jWS+PargK+G)(1WjIWgq?Kwb?_s zfgu07yyrfz)pIXD?X``}zo=724A_Oa2sIBk0pBQ7+nhXO`c%K0M*0c)Eh~Zi6*LpH z0%0kvv}-;q0JL?3&Fi{BPrU}L1kK1iBXctPng4_dz=*(LXUFpSi(ftb5d64_9 zP};WJjuuy62A;JGOi5hX#$1f;h&+8B4lHh2d>K96O)}J+zeQd?8`^JVwdW zq-PCnQDcu08G-hNnfbg+g}(&-m2%_bJ>h>0IqKSr1b(t*0G&YMR(Rr$ccQ185g>CT zRF5H)H4r~gI%PF&)1LWHcMkI-C0 zgeIRM0+-fJfsq%JAM2@xk)OHGEvd%wc)WC9P_M~d;KI1vS-h1cp}Our&UQj! z)fC+!LUq(#N2)`QiB>oroz7~eVzQ;jjo8#sbYn|s@r(c92VM2hjtfAV-(B`qSf2fZ`ZHvZ&yu?qbIpXti`BJ zfY}e{STbPqJ^{QLvh@Pm%(uT-|-{EltNK1rN~$hHf;(YTI8o;bVl#32EuEC%%M^1%2v^1eLu+-98DvDP}$g4jk2~*$&zK$HVaDdT7Mz}I` zP%nfo^JX~3D*7skjvDPxR*AI~P_$OJ8%2v`uO5Fqi5}JTu@60XIEBf-+#fueE*=F; z=5C;l+;#D^Of&M#Z#6Y8_m}pFq!%>P4brMog}{wxb++|w0knT9^>GDT@M+}JS{J}VBivu_cPNb7D0U>*i*^SCuSB~4neA(t z|Ez|P*HkwhvCy~9l=kFiN;bao)7IcMqw+`$+=Q&E8}B6qVYVyy%_90~nI)5wEyM0W z&!?B`M(;Dt;#8fIAtke2RBSgl$FX|Jn=161ndj0_5IKLx%lPXoJNskn%b5-T$f}_A z(r)O1XTh_2g;_=#HjHo{SSWulz|l3|mY%TWmF3o_uSlz)wcWT@NfO>w{{Lp8EmHs5L2^K#-SQcOgEA6 zgZRtX-h&VKajNdmUg7(w12WJAONa=Z8v8k^qb_}{K~fd!_)bUQvTj5e1F_0?|ZFo zJf7jnznPIIWgb~$Sn#lgM=ntPckqbCDnTUX(=mDfL&uh?7eP2~e)q-J;`n0$emOMK zwP;d7o(h&a0h)5wkRj zIe*s0{F2ZS{jZv@d`8<;SBB8%>3d?K9ad7;Kui`9q~ON{Nod{Eks%2>if=l*@>Dp9 zZ#rB=FNOscbSA_U)V)}QT2DIyVG>P~btn%lC5jl8lz%3g1B|}Un!zUu$_M}SZK!05 zT8^(xrhwn`uR|J9_jTn`6lnFrJLIFUGh|@s{6nZ&Z`!E`NJUrRzjs3t)J=-;!GNXx zy_ljz|lmziFtt|Itv5Ej$ek9m)`(|9>8eEJ8ZzZ-Jnq|GM6`SqiTbt4Ta2L!EXngVRWx zhv}nhPWon7f|6@rGTH1<9Kha%DG~Nm2?d6lbJtwh`F8~Db5}j=Ijai#waU&u*^y}} z?*N|*6I7EPWI`IO6ulA~5HEmIBNKH)W|j<~Pw6FGAK64P^4mau3?IySA?uf+1i)B- z|C}m=r!0O+~3WZVfX>>=<&q3W12n16oi6ZyCy z!e|XjU}QGtvkw140N-Of`kC=r->OxI@Ix5`NyL`koaRvjelccb;I#$`K))9d)fw$d z9(u#3$JjqMAtFsLb%#NNErOS?1Ss<;u2q7;Mhh5Fp6mgWT1P)6qkw`+3eG6OR+hS$ zB*q>ybl6dqESn_MEo^SfTRiZ)K^H6KGQN{uJXkplhAV=PX$&IWPXB3fo>xyHGb(FMGjSRJGMrw8u2>?L8|aZ=@Vuls?4Nl~%QQ zLi^)m@ib_m;*_vpVTl7Wvg@}BUZe?=&U8+b0-7Qfal?uL+!(i3LkUeW>@i$2NN6+z zSl}U+4x%V|VOya7+hDH;6#a0tq+X^4VA8%>>oesVQ7Pv5yqG*4ZZGd$E{@6XU1p9g zT6?o~)OG$GeP7=Ep1SS3a^r4KpfB2fZ}xO>zIfh#+Vq-a&Pk8B`$kaaV;atT`ns@L zgcRuj9~K*cEz$hM(Oqh`SNX@NcRP(N8d3&K4#%YC{9Uv8Vsp}YLAKfq>x%x9CFj%KKRzcXH)@#iK2&7N(SDTe3w19@ zzzR^~;SGFu@SXif2^WSjq11qdYLEXp(rGBmugra!!;>a(+MV5*?#!@(#j*F}HP@RO z?3oWZTc|=LNS76fEXjY}$ZBeO=7%?WA)sawv# zj-l1Zf(W8ZI-_=sA0eMtP<8C4_XfXj{_~}#qvvZccS;gk+s(zx!^677BBrY=NVGU+apL9twwi*r4Jo7k`>ynK0kJB&g-?_<#|)@#o{Z#)6H^EG?zCD zg$O4Q0d*Du)wkyqfxZ^`&k?lkCSlJ}G50yqX`_a6J~DBB{6^NO85^Dmzo4)!b=?&h z+f>`qofq2#6-#(!5gb8?mal~5fLUJbU&Lb(7Z3H)-KaUAK`Ap8=EzcYIsfaQRnay{ z)g{?9w1o@h?&osj-^@)hUllh+^JKL-4$L+?8pmyw{qC~S4fvCs1ux^efh>@tVUs$M z`E#rA9_6~T**C)$OrKH1Z-v6n5#l9~{Td$%1PcncW~R^EAa&;I%E8qPF!R&TSxO`v z{!)Nxm^@lvJH|j@c=Eh&t>Uzxdr+S6bn)OJcJFC<{s;BeaG$|ngKXQoW+)1~X7aWO z^#dJN_%*8uzl#j&g0Jz8m0v=gHYo2u&OhS$%^4o64FbDld=R{rI}NYqSe#CP9fc%a zaZi?sXnV=wmE<-F@>{&x@^w(wcdaUXoR#?qb+00o&5Pp6d||z)*r;@Aq~vkihs?yL zQPRZJO=~|A&8fKsEy{yXq3FOdz7B#SmLKOCH#t_hRFMD$!DIO-UNnrs>`ru4Y zeJNsGvl2dxa|p*x7*$}9$+*S9O1j91%elcS3qDD@CyO5#Sl_LJ+XRE=4n5gR)s~Cc zaBQkq8hZk7)8I5jYtl#BWQX$qRS7`$E7YnX_CjEY3Y1Tz(g6jDWO{K;|JL{fxm~P- zE^SNoz^#BdCJ17t`NoVA)*Q>n4?Uqb_JNR6Nfr|WMHB|;{R_jQMh^8C*oJBeOvK%* zvtG{+t)e@WnjSq&vG7q4$2t|1JOX?%y;G4l{e%!IKEbX)IqE#SOE9f6oQ(wzv>h%DK$E|ag9n8Dg#rF%%rjaC*MkcsLQJQUyHpvn9;c@{NvXuK- z#XBOIJINtG3snMY>gdNyZEE+S(YmAwsw3$8uvDG#o{8h1#2TTmB9GOs@u4g7`CRox zS`5r!y^?3r7+cQ4JH=eZCiqZ&HCKz%k&v2z)w$hk5<1A$#g{bqtW&B?ZD;fuqW3^{U(-mKzvvBhMO$m&H)@7k^`aecu8-B?J0S~|RlZ^y~{8|hkpV*PT5@o)KtP*F^& zO~v%osS{WdNWg@F-8fnVa5?P~YK-1meBvqq1m#H*RkF+J2}bM3gHMQ8hg(EaN3t#A z7?E>^4${lDO-?$1V<;|~g<71MKMZaR1s&ptNLy*#FETa2UP(7K#Zl?sDfgo;Y3okp zG07=dB}XrJtY}Jk3h4ksF&k32A|-!bltA{f;#ms@G@xZzMKPq(tdfugtfqP=fU=y@ zc+?Cu1VW_G3K%?lvz8+&q6q?PBx&;#Tdk}x&N{$|K%4~K+weZN3syx-3RG#q?e{k3 zke{@<7Y(G+5}`2@!1KbwKS!Y|lUT|I2fH|i6mx*yoVvU&b`4I`^zT|~7NW$hmpdl$ zB2Isn6L1hAe$QNk##Ttj!r_LVI-}K?)5h50^ku9@4aYG#%&9r@;phEsOdKWU$lKXKKK3hXAU z(*8+JCMrMcmJkV*<{oP|!~lgfSmBt67mFWJ7R=;K=OWlwYdHO2NeNau8pwy`rD*^q z9pEmARd3Fsg$Y}mXwwhc(StQWWn*Y13w+1JmafJM_r_+k)n)yS%E*@M~c+zz5TcOhW+)>i{ zG5|N>-*AeVK5h$cmF&hDHD-77C!L1vg@;#@Zj&7Dy`!-+BZ))M^2W(DX#tDb7r^fr z#*01`Yv*0_8m>+*UGqTbqtq{3-G|9s+9|WtNrStAj;s5t3cVkZ6=yx{lha3$djBJa z&W-NQCPykh=1=S<1#G*4R=_Uv7zWdk$#kCdUsKv?IXTG5K0<~#DxK>tVN)_0uw`erC(e46j}#&H%YR-k>kUl94QVHU{6 z*ZZ~ZAMpBw+}rqs_@E|mMbu(PwB|5kt)pmlujY|~|GO+@$A;>q)Wc-v-Qe!x{G-yt zrn^073G{2|PXS98DR-NBGK=T^D0?a^NVWyUeVQKypXaq<@=SAK$wpxh@Kd1>j%}Lg z>xCgvP?vaZJTo$~&9LoHU{w^`Jc>;qP-!O>muTJic&vkWq64*-D><;0$WG9|)+vM^Xrxo851h%<=oZ-GcYdMmmirE?N30lCap zxF4$1?`S0+HQ^0#aBtlrV2~K{8#L~2jGzoY$s;c*zVQq?uY#+Z5nBiyG3SfXyr_3G z50i7zDD9HbfzQ+rP+Bmxx~WhB@oD-PKV9$0W>Lxsu`yz`9qITxB z%Sd}iJb7FxFTxt$Am+&>$^ybSpXl)!`udc0`TT@Ww6`6p_wuyxaOA^K_r>&qR_zH7o`>^6KgxX!Nazz;|;l7c$U(J9A zxbq#aM8ufex!v!qo`TB6<|IbHc4B_$^85Jh-HuW0CZEkANqU>E{~|$CV>rX9m{U%n z^O(;No(_-lSH>=oT2;a?kczPpqOaGP$1;03K7luocX)XMo|hd(Bb&+dd0(uuxKS%y zD&=hy3l{&R(NR2!Y(Fn`UR6BNXmzI5PNA(dtCs0=19K5RhPVuJM^+X{>P&egtJ7$e zv<^2UuSca`VzPsSABJf+7)rMY)~)gY@uc@~b9R+1kNb2zhKZ~^Vg=!g70R|$>ch)7 z+>P-=5+CpdCMi^Id&9BxPdNQ3;>nkYU4cf*-%z_(G}V>QGX&wz!t`oIJoE&ER9E`_ z&JwFL0ylRtgYz?=w*ix{1XYQTe&|$4CKM^N<+oP@rp_>@2bpooHR>@$pdRe!T3|ke zDbag~M+uWF?>XXn2{f`NQaG&}Uh5!J6d%k#;7Okm(66lz+6H{uB%vmYWk<%|gpczR^wI*9wew2dAa`}Kq8 z5`ZO}|}VigcMR@+-Rk3%$x>CgdqNSt!N3VEeg zeQ$gLZO4O965&g<0By8JQ9pYzyp^I9QV}5nWKEvs@?mNgb(6ch7m1fxQQAqSQ%ogQ zGE-SN2pc3V3i)SKsVI|~hSKMCDj_a4?arQsEd$%(AwP&9r`FLrm;FOUt9A41@o_Kdr6Ta(Cxqr{qRgweerW{nM5?4Q^>> zz=)QyVB@eB3Y_PMzOIZhtq(N24pS;)i!=(_l0iTQf51H#((HoQI7UxeBG)0$uhDyK z3TuH|%XCIs`316lxnsG7RvyK@%}chO;L|bJtB^B5e`4spx)Vfm6)6-T{``k!tx}AZ zk*?_P`_8aboL#7^*ET#-^;x^ZH-AeERif{Nig7Ce;y5mg*$-$d2-6wnhoZG1Nlzn%)AXtH=Y5FSDbsWry{ zqMokhk}E;}e+B^CEE_sqWHI$INt|uSDQ0e=_z5g`6C#%sSc9CT)W+zNUtWngUq(zh za6uRdZ>4Ud_KJ(gvPDH;c#EMZDvH78j``p)V<<14G6){;g8m3h+_7t6sf_o+ilFwX z0r$d&pdhIS_rj0BowuvZ5lTr*@fZQC&xf-f2R&;!Mdj6gVB-4O*?eK4O$1t%2uKa9 z?A_kIC%2a`3pY{bS}&`-MC6b=J5zVp`+DY({4`eK(29cB-k5W}Uo>UZIr%U7D&8?T z7`b-%9nsP5u9-H4G9MxWHhHu8yQ94!sk{4|#KWQI$pSp!O{9R`aP9j#Hh2c@aN>~m z=9MMZ^zhxu#kn`Hoq?#`2Xl8T?gyifQvt3Nc>A+*V{Se=G5X;`X^yB;Jv=l`(&ZX z(;~h2?X;P|*>+10!w-(TtBk{zilM6(vq$gO@|V5G#mU{FXP3L!b-kQ5f$GeLvyy+o)m&7#D#a;yuT8Vmb&mNCwt155!1VDv?*X1vE#TYAVp$xBFnXB znW;76k*kZDso%|2`hz(aId(UeZ=nvjGs=AIYmN@$#pG9h{AI4Znt%+j3o>>Uu^bIi zi~Pq#IrxMkcB9Xpn?4iBg4SHHDK-JPa>qMpaE}dpg(JQP*30wgVe_`Zp(sP06C-(7qthX^*s6OwLH40Gqp( zfm9LdoabLwL3C79!%s~l)uJJ#}t8-mSkX&NiQ+iN_H&Y7v6jZ2=!MiqN1!u{7R^(7jWe%6;nyY)l zo$a?(@FZ7_U$bA*!L13P3fbOq#f+MquXw%%k#Ekimh3h?PR+tn(DDJOOEE`hfPHAP zQ`kNE%y_W5aH@cDCyOUBf3+y8e>@%#%KfjEVN1ya+K%VeTfXz5;v!oiwtAt^%1iS0 z3$a``&aV5MbeoF2qJ|3Gyd$uJ@9;_(y4++vKJqBreiED$++4J0rkjk9!TUJ)@_XEe z@5IX+b7ocPv2t;}C6ff-;~qXu5tbT;avvjOw_G^ShKh%p;*dyNKL=sujAi0Imous6&ELz_+-(0 zCX$@usAa6x9Vi&+NQf zI`d~vsgp-#cT@x+=2Eh(v{cFg(h`&3XXZQ8b!30opxy+L^uJLr5U|k+!G_O9xxQ*j z8Iai+{jm*9|7QCQ{!F-K)iI~FA4$ zXlK(Or*hf|!F`+vYi!-{%x;lsY%Suwl0m)^y%w;imo9{kpc%)uVSvNMQ7D3lMB=s@ z@5bAVHR92SVk_R5Kah*w5}WBQ)ls*`6Gnz^#;qECDZJZQ5<#9C3HcLx{yCZ-^Jc;W z&0S|E8#Ag$36mU z9fJQ3B=HpsMnj8Oxg;#T6P@-$$ngNOqsF4<3CQAu6i%S=-pYm+N+3?u!&#*Oh9xW( zs-`C;i!kb|gREkJLERPvoLxQ#I}n2vH@KOW0`H$>ADWDKW_fgKTRw>kFQlqjlFY!q zY_;^jFEAYHz=$RecKiiTCOAswHk>Y8S*Sn5khFFBI{&O{n5nb~Bo)YiYgsUwWLkjc zh6#t@CR^EAlf`%Cm&N1%q8E*zNYpBY-A^o&6;kcOfKq)ZFyAYWR>~k&Fb1j-Wuhnr zMH#9r!v8^KhCUl|hx7yuR+KKYnGbM8Tm)A0`}U(k5Nx9cIx_V5xf*+ho#KS zBz>^sAqB_*N{YgO=>9mx1#uu#vU>w~lbDw^@0J+!V!X}I6;}mF8#Hud#uOSCwW#L7 z<`~Po+2MwKX{I(b+{&RMAp`Dt_>??^A&M2`QiT_0s`;+|9b(kxiZrrMEry^0&I=vu zmSIC?FphG=E^NWbi*Cc|$WZOaLrUZ3ihRFvZkRf1>y*OlB$8EQ{bwLr<0F*2+M<7( zTF#i5-2-IsP(lq}Wv$w6!*3(5eQ*R2O?GC_OdR9DO1O%taJtR6$MwgLo|^W@2XodO z_6xVYvELkAkJnznxzDDLx(`BReSV8=mw^)|rj9VF5fp7dIt63(Jd3E)+Umrv$Kyk1 zOK?K%sL#c2T_k}l-6){Mh2mR_o50$aoo}XGP4(ACbC2#XU5p$c)6-mbcB&IjmQ<88Tqg?s5y5A#+C1ZNZC4J$`mVb(Up4~0 z_`DUubtrgvI}qgQeXl~@>-lMP2rkjcdfBk97A$p7x#nSBALz)$*>!IEQ#L4>qRpwe z<`hab!NQ4&0y;!i2W0H^Wz#GAy>*Hk_tBC z2zdovXuk|O4H~epK2V{4v1`oBd-`YOVmGtp;_dR=n$g%M7a6+8^;;Le*7rhZ{l-1m zap~#Jg5$c}VBMGDdpSi9wH+;>ZX^l91o02OQ=l&s2B$3|b5)kWoZk1U_1k|pDx-WN ze9f`GsVWju4O+}82^R9<%1)GE7^$uw)4NN?$CVaa z^9PHF0r)vD>+65xmgtoB+r{57PdCX8)I~8{;&gzVvmQe!AJka?*}ImaBmKfXyPXBj8OJZ^1Ww_RPg z!&x`>{a-7&OwT$gBe6l_;Q1$LTZ%a*q)a)05BO-l2&3UHmN(3$BiuKvPh%FiDo3?1 z8kK1%KE|YzV#~WMnPsX=g=KJPlLl-SkUvXIuHs4f3r*VrsXA{%FJ0ld*5%YEd|8;S zw~@f<4bV&*kS30=ASMdbbb?}oxJu5zOdUX2Tks~tuG@uD+RM_1#Ai;GsbK||2X@ouKr4%(VK&F0!d4@Q$P=w6dTfy2al) z5KFK!N9&qef0nBHlG?Tyf2ACsYu*zBe0C2x&Y8JG1zqG?c`F`awvTF>dO4gYr>_rL)PGWaus3cFX%-d&kBtw)+-<3VDmr47 zaKwqOu6&c{3=ofcYP6tcL?)Y5xPQCmF3vJ*2P!#T9k{u^490IP+zQZ!-v*yixM>D% zA_yhG7r&%2e-Ash@?~LXZ^3t?y6;7^^ws3!1Jid&fnIW1Ly#xA*@tknI!V{X`4eA( zFNs?c2bhqr*E#KlMZuMaz2N%-1c}aEU2_QSu71VGU51+3hqzD9ksW^q?!Lk*-=O5$ zIZan_^haE=)kB(*r>1+^D}m`LTn#14MqA*br4QuA@=GH z$K;u}8cY(7KM9?`Zh{T_=`fS8o5rbtiNBBdjgh@y=a-Re{Yubm6t@Th@I!||9E_Px z2KEP)QCdL;md#7M|Jm&~{RZ;rhkugg>v#hn=b`dH;2w8irs}VfQldpwj`F)Cyci99 zCK?*-_l!2w3O$~K&g{VwK0?2S{HG{`VlWzr=I7K@?Wcz{`8c+toP|&C=aDq8>3KF>iYYKYU2y-FcopMtjhqb*boB zK8&wfXvlDmzrUwAU46%igdsJYS<$*KB_#$TCl}qk*ph=PNriH`D>cXTI+SDh22^L#7?cC& z7%T%tY9X&`0QInK@}Z@Le0d?D&y}7+JWGbBgajC}Y+qtLMF~@S{*q$|ssdXdNn8{Y zq>imYG+@9xd7}|6Y2(~#*ci>t3UL&7qcKfNNL$JQcYQ^vuhepZfw#0omCPJpM$EKq zhRq3$!f*y7+n%+!o(ee=pOsUQ6^oTyvIQC~fK*+ZmnDJN()gDp9jGxN`5ZRN6eDm$ z7a3#RwLS#uCudSOYV){~j{Ly*cU~Sy4iw!Ve^wYanm-!A#)n4vC7d!aok9@Ss8-FL zxY;2aIpCrRQA(v*8;#KDIkQ>W`z^eJ3@vAB>4MFj8gc0Lj8&qBK4XY&0#L5%OkD-l zK$(dWnVW~mna5~l)=|%#k z*kFd0Iu(ron_$jl9k5n~$e1!dQh>$R!stqt#FnD7w^oFvK$aPGxoc1YnHFiXh)k#2 zRE@BwnBZYHY)qCus%C?4Yb;f>rjoa2_-%urf~&SNQc!t|Jm!Z5pnjeiK}4N)qaN@B zu^<^AGr9=SM5H#Vl8my}GBkn_D)DVFKxVZ;bR?W+rLKWi6sGU_>hSW3I-P;KciY-Q|bGE5O@lVpW%xm0}e+cgtqG|12!Dl(U_A|zz56wwK-c_ zH10Iy58uu_<_-#g9XKqO^Z>1l59(^`Q!?6n1!qerYiZZ-x!jhc7%ZH>Z1Z}5lYQ}h zv|!U0fBD);C6V}Y2m+5bE4;g$m^0&h?VMje^yI>A&R+`g#q{AI_=((h#WftlVPC*3;OUH>|KWIP{_ygq$%{)2*_6Z^f~-I4Cg!JQk`S$JK0)6?2p>zgtC z^DgeV@aN3>cJMt7j*niST*RhA5{UIW1A4yps=r?gxVzJ`T+IwQFtfn1d^jr2nEnB^ z@H3;#QxBQKaL)E+@c`JZ6C9hG zc-u~~d$=|vIq6o7lMHT!-{;h9Zm@FJC`Qh(atr66bI!0cm_B=tG}m5#jn%z9AYW*k zj(f(`V(oVlQm!*I-)B(H0>*e1UGJ@{&*49(hEK(pt;5eEudAL8Y}R1F zNuyZUj$#MteTu&4S^Sdt5ndULj2)%)az7vqB=t`-^8P$TX=$Eh;)Q8BnaFRB0OHO2A zY{hKWbNo5)o2J!;H;5m}bl;N3FX4Yatm41qckN1kGZ6;x3R8ma%q6d$CO@T%GFQY1 zJc&7z5zH^xCS)%x%+mtuS2|=*8U|S9d+j;&BdiA{hbcV2M0}{(YfY{oDbAb8*X8`# zD9)w2GRiE{%dS`|j#Rm$Hi}E*e)nv|?|_&SSLCHV^nl26aYVVbpd(P$Chwkh(9|lb zP!`Wt-|b5pP%T5z94V;(KF7ZQM0>Ic$$Tgh8dEpLkwaw`ZQTQq0`nBU?gXG{E}r+8 zK`rS=PA4P!n&;hXiQ0&l$3m&-<@{NXzvfYp^df#5LP;75az?8gl~h1xw-3T2`kn8G zIPs!Fd5=2&BX)GU!Z~YqZx%k0T~OvGTx%yUX>SU49^b!O@=Uy~>O?bRgh1HTG5Rx< zv-+TnkYKDAjI=>6SnD`l$jM~yc!hZ@Cx`sFc@`--M{MOl z|CrX6+7;z>J(&G&f3k^U`qIX(KT8=C*RBw#iZNdfhC052PqlOK{sGoZeC}Q3S8QKR z857I~TiT($i>Bh6PX}6Cz+1@6yMCgA08e&$P=PkCfCLYiq4I1~T?!LJ^&y(lTRcz^ zYkGZ%Re0R@zD=E6k3O&bN7$7=)i!L8a%JuaXV^0V&O#Hj zba`|da4K%Zk6cdi4>}@9RNEq4sk&YIwD~f+&U7Lv7mJpopZjw9PN+k~AK~`TnWQ^K zn?#x1;|h_Plo5B`0q<}m?nJ*~%pJ6xg2eASww8gRZ8c_xi?l-W+=p%;*-qdly!e(_ zQFI_$tSytRRlHgObJWRBVixDtSYcbj48`~hW+CUOze)DgIzEPKAD-;)7{&r8=sjsS zh!rcWX?otNNXf!D0M7sn{N|?AM>T_DkkhK=RS-giTh4KW>L&bjHkIlw?Gm_Q`qYz@ z?b2vH&s;V(sU23EGSXRx^=%6i1f6YV#Kb5zdZo21g`Sj78PxQrQY&Ub7mu;TYcTQrZkjyb7+j z?w7QOc(-(iogqH$wbV-lvcnlg`}}VNxaU6- z{e`iX7;1OOB|`xC*ChA`c7UKFb!H4r1*s{==M%4+8g)bp&3uvdc!=ocRyTL-JIBe) zR7ryOL8gk5`ItBqBfH4>wLQr^dlkOWxT`p}s&Y*6{1jpXTl}RWovaZnUQ_%e2^2J3 z1QnST<4P!?n22u0{TYrbQgTTlsu|9fay7=$It`Ow52Z-qGDi{|Zxk1Mq-;)nCT23BJY}m42ZIAPJA6$=8ijwghacY^c?PNGHPJ?q|7@s)bO8znR&kR;UW6z+ z%T9!WgXWFF`;m_YAH%0LiMy*KL;f2(x@ZMI3&eP>EG=Wqg$6{@NPr-qR7*SGm}%|z@K^*sJE5Ah-x^>!Lcuz>-{alLAszo_~2@N77hLwAxE z5nAB4%XND=Teseve$Q&r?sW@IoR?ojpoc>zPUrL>xS72zNl&R;j*iopvAOQS$ z+!}}>4?iR2DwP($ShDe48#i)x?7ru}Hol@@qwEPjV=?H%*TLIDjh&JB^7?8Rn7G3W zqKIs0139z&31ZAv{0P5XTCS?Mb79 z*HZLxV&M3l$=yliU8e1aIJ>a$&Xv;UI@}|M4Bj_m2}Pa2@WRPe@7E^*sB-GwY!DA8 zCpX{rcaT~D`aKP#Sy)rZA7V(BwxadE`q9Pp?KAUDRwH_r+f}3aX*uj``ftFO;oao6 zQPU~*xgC!vWnOHlgvg=rllD8Rg=|XWCpa#c_a%J*k$e31@>S!ybJr@ZUdwC_kBz=F z0s09^58Hxc8?uEaTX>UBN<2hDy@g5wC&oQtk`vLpV4mP^^*;0AC8h$ykQwE9LP{uh zuB4l*wBE>x;{^3Vx9``I{$r}-wJ;K3_4C;waOGt~zl6TzD)IO|PD!Dk;8veOWj;XA znmgn$Td+pV0UT&10}p#7Zx{C8?t!4l5+Sfjw4-Rh02qE}prD8lq2B`Q&jK#3oB4PS zF{{+w6!D=(tWRGz!CUs`LOe&oUdG4EKIiyGxI$r<4*mf82V)P#Z@|!K^=MFr)DQz(}jw&t}X*r>%{-&rq4V{8e zl>KszFlIn)fs5otm84pe=dKDJJnX9ri=fu!Q>4MAsfI4_W;7%EoCe>(T1R99@W{gO zdF%Dt8q0afY&#+Zku793(K6W%vX&y)4&e1=r*VF-@_NvscQbC^?H1)4!~>!(S?i8f z2IhA@Oiv5ZE#o8VU$h^Q4>IiLF6+qEgbg+AeS`Wv>XJF%Lm+J{mPPK89i$DG6^`Zz zrormuXRQsz=vHOn+2xiwW33adsadKy_})4GrR>vb#6UC--KrINh4k!S*1(ELLp;$t zs8d!{&Ok$v)%m73u8Gv_TVX-~FdKaW-O9Irg0$!28~?qU-w>f+7-H8NR&>OM#5Fhf zPVAq=`F@AhQu0XJcTJcbVDK;sb;RQ#BrdHKrPB6X7 zwhy#5QcnQwzTIewr&dz{EpqDGfN3SRT%_B$oOwvFv1Cl+wwJ8K?TWy;kG>?LCUmP* zjZkac1zB+96HrPFswtjqQiCBGRIiXZnLz6m%}V5$YyD@2&|q?&@;d41+ue&G1!(@b zfH@Ol#@o-EwRY_;tY`%gkxC_I;VSs(lMt&0Im~l&sOxW8tyo%>b1g#*B;odg+z|R= z$sO&8t)m?_EfScE+-B|nLXU2JiV3)dpJ5t$rn~$F+AQ-4^mAh6=UK^8LsuVkNtkbZ(UR$2?T+c^Gh z5&TzmborpvR0ROBVv;o$7Q z^Cv^iokCnwDUFlk$izt54`EP?2uY-rGn#M*mO&D_vHQPPf~TF z+oWr6@^mwSHhF*@hB-UTQ}*pWPp03TH15CQH(E^?5z}5EF2gTd|LzJgTJ9|BTHEJi zE`Qj^;MJ#Xugk9Q4C@&omb!Z9Uv~LGlntX9Fb|GUCCmTCTqEb*M`IP+FN68P7f7$|#a@1w&n(M-3j_$0!|Vwry`&0EV&DQ@{LWKgAb`)XiJ` zh2ZB>aglo0D~#Hj@*w;snQBF^`9Ccn*wlVr5p0kM@766|5iAhEb`*InC@z1NGvLDa zvS$>0B-@!@eDKUlBR15hFJO&ABADDKSkEnb48rg+sR%=|bZ*@dpeQ>w@__6g05KjbT>&uBJHUj$Xmr!enaPj-~SIfO0WT`JB zQeBG~sK56AJlQg2Mg71hAAD(92y*m)-jB2pVwJcLUVU@B#iEoiZ%tn&`M;nq9bvjU zyV~10G$(<2AHlD44K+bfH~pBy%(jCPRl0$|*mqH%t6DjAUq1gC@o@GG%yYE>*LX3e z?bp%cO#|q@-+bQ&@0=O%+BrJ!yuCStqfWwr=lxcSc-Z^)7*JkuF~i%2A1L~ARW?lI zbDZhP5BBcN-#WbREAALO?C;jw(`QjN0)-_L_HTyqVN2LC*BoN%a^J(#P`gOPS z?){HxfJQ~K9D{E_{BFQ@R3+Bo6U~$PJ^(?l^>DCd-Z7RlpI6bdU?$x1p_gYJMs;is zbV3N|*)lY)+Z37;W0qK^$iaZ!M2JmbT3A{m;h%_` zKP?(Ok(AJ>>cE>-;41B^K!y(^?-WMAk*hR;E*LVxP_+;%5t5)%Kv<=AJ`HmcA;7_( zBPv)W-$zuF)cgz)0DDE)B-mu;P9z$DL>wA&pQu3>{Vw^%uQrBg+iqQD4}56h2Z&XP z6}s2Dt^tP7NH9GmBFU#kJENpUH$+rFLmz@JNpWH58ejz#qFUd-AkV_i&wbM*bb^i| z7@d_5k}(M;5Gq+F&xKD{W2Gf*1U$ECoV1xk-)4nb0o|h{OltAwW1s0F*Uwwcb-PH$ zjCt>3IzZAv=LWzlm`ek*B_=m-pG(k6aGm9tFbCuLF`^MDXwwC)uHEhmo)LRcBSKVo zQ2V~4gi7)DnF8c>u7;GysK;}gF|K95Y?*14Is%gDR%JPoyG%(CoP?6A0U{o0jlT)$ zeOLw1C-Dd)?=cAr+klv?hNcXtM{@FVc5@_n<6CDxi4(dM&?bLO)v(0^+izS#x1WSB z93Iu&_Ktbwc|%$fv;8D@o(gTJ@BzH0&nso8!OUN&4gSu{4QKXfaqVywDGP(Pz7K#qj!tEy0Gg^xniu6cWRe4dIuN?TZ4B; zPtHt05ic2HSNPJp!8c_%CNY&d%&4+!+{MuxHrqqF-D@o!d_x}f(FFt;4qri+0j^q! z;yucV+Ey<}ZBrdXrss-jo~R}G!Bj6nk3r8OXW@LbM|Ip|Gi7lsfDD*r=8BQ3bLOo? ztmHCofoV)a8!8@k`jrNNM4S1xzrCPygF3j=nT(OoY-n-i%GK|O0FC%mNg@nu?uQ&h zHtj;Ja>5(r#`*&RwNR4ZxiyoEj4cWNt6 zR$}#hI1a@y4|ofd8Jg<7x8@|S@av!@RD2XAWxWuU>p+s#YA%))!aRkPxvFuiviFo@ z2ifNcu~siK(`9F`*$s9IBjCg3Pe)}*du1d|mqk?eadY)H!1dFzOV)*t3!GVX4*Oo< zX>zKe*LCSrP3}2_uO&fp)jx}p;#~6e8Qw(I^$zFRpef1cstvO8u`CHHZ-d68gZ!fh zRB3A0`d})PZetiu{t46+8`t+u6Nq(An^hJ1{=_GUcY3x6ceHipOa=5t=<>gUY{dat z?q@(r%yniv09+t3ziIRWRmib>AoH76jIpg$S)tfFkoINRxE^t8?H(*srS=wr@TK-c#~ZwgyB#Z<$q}xr8zy<_Nov z*Db4iJ=^1WJ-wScX&GFdl0v+S++F$+2MWR0c*R7z;XbOh~@BDs-j3NxhJhfEzkc zr^vW2v3`vvqg@bfFq&blWUW-~O3x){bKZ7n0&7S-+QtSgU*6&l4@1=`IW7wCfuQ7y z1h~ZKAQ>dS_dQrzkOU<5J@ZTfMFOg!`l_HnSK=Eg%k!ZDC>8A?TQVrfguWQm1T>J=q4VW8zhY!+qV9wazmG|g}R+I6abd$3>T=;_6fZ%tk# zhU?;G>3{uo*@+&h4Lv9Xf`=O2+UX?dyoojUyfbp=;tVkJ3811~HzQ22dP2Kf$?z#U zxGo=D)OY2N(u?i@m|bU5M{yG9ehq_S0el1awXsrheS|hyR1x&%i}ZFirqP_AioF*EG@pPKf+cPu#*UCuz9)X&i)}_L`-O2iS zeKviNsXKK@K=0esyYs=9-qrbLwfgDG_xkxZlpC|{YFD!Z==lra_1^h({(Q&>IL&A4 zM9FnD+H+xM1#@`&sLk&0x~LQ9gI~aF20e3T;%gnhDCj$W;_XX?E&tr!96kLwk+WgO z1Oza6v``%Y(HG`_?gjd>Gla$j>lUyx{CyxQjx%cBeVrMxd%f8?@H)&vb=)}8WI_(4 zM;9l1ebPQ|9huU8;mO+Z5a`Mo9C(27K$F_38% zm|?J}N0~D`S@I@SJuWj$;h%*x3cG1m0F$;YjEk8GDMovL}!amxJqNb4< zkF)D8tha{Do9D_34{Sul=Qny(8B5$F_rtEK+)|oLE{kDQ$n?aO16rL5-dVBcVWmX@ zZ`m1)Ufe&k5fRSE#l%}N1#G)=a!%JpIfNG60ZD$Ax+kh>h!rlM`^#_Er1v2p6UZWz zmko4+RC!^XkV#MxQ&iS)`w>$X$0ubbJ*6B5dfWHZ2_Y*BBI_#mC-m^>3_h@L2;lBX zWPak?V7v8Gz%z|KgE7WtLI@r;%tX%suJ|tk?s&Jvht`vCyqIqnc=gy>#CMCEiUt6o zs9QXumbUD^%GUJ3&&@k1rb>7<|w12eEyCd)>xD``t4lJ8v&yME=HwVj+kg^r? zh2n65Z|{?gN2Mp3BkPom&8|3V%nU zH^m$*ukt(*=V0Vh|2E+qaDh+KRLHV<|+5e_3X9uMc9p z>MUS;&k#Jc-)GGl%Wo_swkXis|3Iv9dUIDBy-MD)4=V!x9FiXz>Df{1RI7N0xUSN< z$mg9=$3Q)?N+nww^?{+LuF?RszrSITx4+~K)*1rcgd4AhI}|g2p;&$>X|Y#O@4z2j zZNqCCmNv{GBj4-yxNpjfr>ZC30SV?d(7@oc1eaeDZ|`D)jK&$TkB`V5Myk9U^{H#c zuuIC!Nm5qDyRPf4p5TFbk36D*S80@n&@PAZgXLOk)#u-U*sNf{1nd~%)CTG35B?)w zi|QxaQQoAd+lK!;pP_LHG^gotm3v8;xGM9hcKe-yK8@9*X} z6fe(@tt$DQa;-8!XZag=cdipu?J~04KJ~m%H_*sQ=XKu)G8G|41dE8vWsA1@s}IjY zydj1>Fnu?dpWzBW!-A96R4YZ6iFP$ORWe3|4uQ)7e!sjU2%UDULak~DFEu1a1Ge_4 zUjOW>gYBMt$Bp+LccW5)@EdlgJTF(>r>Q%C4Tp3gyNf)kFWpBNBH{|TjDjMI_xuRm z!+O5*ry=TRGvtYi8qdB$?WxQi)4TI_CDrYd&|RUVuh2#XX0XJkrYnr1Yeja&`VASM zih`NCrz?V5S`{n84H(3li4#R6bhD^Y|K~?2=ilP*5Qp|Uqdv-H@)~zhd&8Wxl0d}0 zts!;w7+Ae`9VZNbl8)i%#9|?oXuKDqkv%4x1V!vL$jC_~E0rt}{l^g`sz1GvHJIAT zHf$>EHzwsRz8DOgBn=-qYf=J7GPV-6EHb$1A#X&0lzT}8K7g|=$S5x;J0g#e(|C?N zL_$szg(_o`GB4q+aZUt+nbOjz;8Ml1fSe^zOhE%G#{z|R1>gP8xi?q}@&|24KH#=h z&S4EyH4lpR3;nkwA3r(p@RKG;@&&Vv1_`%mUQ-MPcFS&KZ2cb13}muB(nG5p)k;4j zi_q{1a&deGD?q&`>@9*pSJK6IULbsy?~g+JbDmg|&rDQL$rrkEqV+ZgeGyo|uM%>k zRkM0Yg(&5S?qO22gFs}0SU4327b7}J3|=P62P_8m@i9}V?c+ncdD`S8B2ZYFVQ#tO7_aH&*NB8UJDOMTE}YJFQ7qpQih z^RYFP#f`z+seoB2=p;{svNgv$G!Nz>D6Ae2##g!};0oP#BMetlg_gJbve`M z#Vh}ka_NWS<9$2-G~@v3KxAnNa3&g7GPU-QRwXw?;bavvaIzHKil&96fgWO-I1sME zynL0o$a-*62XH_#rzY#KF~k+*mmFTJj+>Gnf$rXqK-U7(9+l9rsnhV^ z2dAF*sv3(v+}Yi^Q|Da+iZ83zq1W6jdD$dY#ykLV#un(75>zcm`BWoqKMgV))hF{> z?k=tzz`Gyhk4^VlPX~cNCs%H^^T)z#=X=|0=bJuDPxrm)!k;?>Xy>vWT}0TbRVSc( z-jV+=XW;4J;(4|4`k%GuW_Hk>xihl+{Z~=e?I|zl%BUYq*Yr5pH*(j7#(i67R`h!g zfMYK186oL4c5Y(>eOYxoZU0KTM6{5OGh_|`!ecK`3};VdzgOLfJl+lt71MzM7s7wp zliQQ+N}p**N8wTpu%ty9vZKmQ%Cm3d|48WkOwx9Dsh>+R(bsUV5}ItbFYAo<2y;Hr zE<#|hrTpd8VD%6&K26Kt;vq|aTuLDK&HUr9g-M!~+jXsI7ESmBCB@*bV;lJDcp(7< zkng@34SkUuw*6_F+xk6Abz?ACD1cpEG`KSS_eD}%<*y!>5}rgSdQ96o3<9Dp=e28@0cUQ_~~C;ITK z0h57RLWI*#jfhl@SrHPzM4B;9+?`||o6;9*lnG?N;~7spXe&s$?b7-MX5eEN)mEHt z!M-4)u%6zKKu3%z{gh`GA?$Y09oHZ$hpX7y6U_hyHrndK850pMEQY;3#em3Cu?BwEWN2O`#2(!Ot@->jinB@Y4nQjq z-37cPfdFhtL!GBYfMdJ{Uv@h`(gjjc!q&jka-=uqH*eWi)dJ|#Yz3pN7)EvmpR1|{ z^AeggQ5n-Iyv7Fb8Fx|aS2OAeD=S?kK!hH4m{`NGIgPy+RBr#&mM*Y8E5j%G4cTB1x}Tv$i@) z&qxJFFoGakiq8DWct{Dw8IlUn8~O}HUX%rl_A`;z?d)nDPg+CO1afqv zs^j-z)hA-jLfRAC{eF!++_mD{w^hGy-xg-;4&@p18qt2kz%7QSpwVePF|5*Z3Uhpp&0!D6|h6C-0C^CE} zjml!`OspS3C-E!Qv4YM$}wr$TaCn4RyC zNosjqVHQG0YkRKm*VawG2{HZ-zs3-tkU!z*r}45P^+LcgSW>NhhV+jn3A3#zL?|p| z?Yq`DxYub+R)DsO$+M|AR&lm${Yth_D3i(jhnD(0FMMYjvs{-GtV>TBvL+9--B zl;lrozjmGS{aNVVL&3`)QKcS)$CN&F2$Jj_td(Zlssi@ZCzfrFa|NEEw) zD7V!<96yHeq?#8(K@*`(F{@!9N1riVP$t03cTk(Zg5i+^ ztXoy!KtKVcU_Q`_YrWSBf483ONkR7&rR#PvuFPr4AIo7ob#*ZAmClv8l+E#iUZnI} z*JQ&;lEIq6w#4t9Fp zoBb#R=yf^-Ly_t3gin2W=OB&$4lPhxs~1JaI8zN#R4G%l;Y0}_Yz%O%HG5hI;6$-N zu;4pHKpgc_MPAjPB4Q z?|~X(KtUI=4pn_Ex{E5WBB%EPo({pRb>FHP#`n1%O(?b5l>IYK z__gWMn>Fp*&G%e59(vt+fsiUMKl0;v*ZY1P`F7pL%axDmTx9qW6~i&{{bZjyI)mut z8_z}A^Wq&KjERZYM|D)5m1XM8%n(=%BUVph}1drUXc;f4!8b@R53?<^6EXYCZYR8KU#Ou}f0a2@p$~&`Xlv7>;^~d`M;h zI3>X7aA!D^+GjDlJ$prN+`Q9(scb&9SX7JlaTN1G*SUsJ^m`&=7Cnw%fH@z25B4*? z4!fF>>A&BH(h~Ol@`aZ@r^(0Wu+HfBDQPVQRx$5|jUqq(1*f}pnR+xG4*Ad^fa z8mw$5uIKAHo-L(I?9TMEsmM@3XH^tHVXg@CAH~oHccexH%P>a#r1*r-sq%xhFo{93$ox7f!emNF?mn}(+0;c~kKQ2GXR1h-^Qt}k-5D}NBLEO59XDKO5 zc(;yoIz6Rs15Q7+mdZAd@qH0r#<*S%!TarJS*mNhe9D!SmILAeC!`$NGa) z>#3Lm&_Q6s_5sQ!U1v>!_dqz&La6@DVB*9oi4uSNSP|@(1}rHXL|PLREFd3o5A^iZ z2)Wh6A@`XnJWc4(IR}P~XxJC!lV~%Xss|e);1rnGmace<(}j8f8B>W1)l-RwMClaE zs>k6zYCk3UQ^F?6qOXwrK`%s)i2iEf#YU>*B``E+dU88bd|KHJ=~Ji?u}{O$Xkb90 zTn59_aV^i=n_sPN&A-l*o6g40W&)?ZPLx14V06pg0?tjj-?YeE{bU_5&O8cNd8*Kk zT&o+TXMdSZ0W3mu3i8*TLvtuSu1xP&mB#4W46{`n-J!}&bmOJY5$2nIHcUPBUCX(( z7PUUjt34Z5`d7`h&osp@wT0~9)JteoWy?82vClS^#Bo9^z%J?m12W|Pc|0iRDWp)7 zN^GY!EPYfQPGH#8Ke0*r@7-{^E`A$ALO>hHxFCN?05vT}X2rmDjh^+j+UUFXUcHg) ztXHoI&}1@k$>)*zd;Co6;#Ya;?qN-%*gkN>njj7G^)g%QkTO-R#jO4czYihb(A79J z`ZiqX+=V@KksYuT8F^<#m=KH8T!1IFV8|qJ8&7pv0oIYS!un#Tcds=?&t-|rD-U~mf z==zix=^soV$zQuDTvs+PP*?rm()^!`0?;H^*bZgsS}NKzxvMy`!*7(W;($66y#?Kh zOR~{faW^RL-sdMV%UX1TzaCQMBQC5%pKaIizCQoPjjWWBl1*lZkV2En40lw|DTamuE0O0P@%;~)hF!rAb72m7+IHAvT6 zU=>PB+R)Z>$S7q&c*_RM#zO6h%1YPU6d5ovNXuH!GDzFF#)lbB(W$mmV|}`Ak7qgOJP-y zM(WV6a1fYB7>&TM(3o3}Z50xAoISr{CY=~nUPfE3sea%XP(s2u?Vew24FfsY-H$XToDJGHtRkL9d9Nizl zuyjl@47RHB{2$EmvNP%M;>eUfqx&-bc<$`|#7Fox_}}*W{aV|*pE#zY^&s)p%jmfT z)#(YkQzpE7m`nUAth})M`u5G;76m^`{%fndEB(vFmoM8nbPKSv<7@Zb`^J!~Kl8JY z;m@As*CBXMJo`Uf#Cz$1en+qF_wC5H_dK4yOl)VPJrj0zFbCgHjGu!u_8$ExQvS%3 zbrion1aG|K!gP&X$G1+b8~_*4(KT?(k1KHD^Dz$azB5Ajwk`Lx%6_?!jiiU|PVTZH zV)O{fWP$|DmHGRDIrjDI~zY+u8X*VD_7 zhxR;xooy&R-jHj2|nI z=uoGT5ge3iaZ@@0@PRu}vntjk6#6d!xHP3??vX^o$m zT^8EIz&TJPoqaK+s2-p^`=ia%D({sO*XtvRyv8no!iCKa`P(nH&YvcU_9L5~IU>O9 zch2D}ZkHErii*WJxmtNS&+t?Fb%(D{#Ki*)`bPS|z!TMr$U4+L^rh~^1gvOc>{EO9 zZR-5;>*>!xjyCB=lt|{y%@{tg)a|&{7`3BdSMioovL>(tiH!!k6~voH`Gnw{8GmO* z<6;TP{8v90Q=LrT9dvn2nCtI(oK$PMO|!rhQ{A+fIyGX%&5QwefFPUB&;@4&#hU7( zV!cR3k;}ua&T@@kgCD)&5!(eyt$VmxBu}+VH}co6NMzgvq8t(nibI$)@bCJOn}@6_ zN>#(LtgMC;o}ffhpwdZ1xe4*uu{?{Weq@4R~b(*G8! zS3xdCan9Uy=K2?h6iEf178rV#Xuzre=v@??=wp8x_kOH zC)w`#`{JjujSd*69$vxHs^$E!0@^1xM2ovRU{aMJW< z!M@wJf55s`{TG8CNEVDLtGK-Dw_e~X6J{}l zO6`FGEGo4s5cb#=U0x9O2!)4-R}pSNrA){}KqF9(SdG8-z$z-4L8Qku14uJ#PB|K9@q&&4(f?oi3Q)+KoLX(5mx6pTefY9nIuYdRJ;jV0&sCTli&Jyy>KbJ7~@>A_V2PxgA1T?e)qhp zcw#LWY>@WHyN&P$L+9~`rch==i^?H1C}I}<{C>>p?((m^H)yt7b$l)OtDWklN0REL zF4g#{U*}Da6zs*;dqZRqxUFvH^GqO7NE^`i9bKa%Yavabh4~cdkfgNgV=x;DwuFOR7lj&K#up` z;7D0%Cht?G(9HmcPi>L?1n*3FF%Qz}EP<=Hp^E#@mmNB`aI>~ojbpDnG>I2;{c#Zm z;p{&kX5^?|e%p0bvO-lS!^>CHEkdkvvuBLgpayh~C1f!iln0r=U{+hx!v?4sT9rpi z$tnp-S2Qye46zXx{P^aPUM%ZNlNdiOjpu`JEv@1UgT@P!aiKMP!+a;I3Ald`Z(|G> zBg$y0q#8A}D>ze0aw;kEOxu)*m>ZVptZUhnBXVS!GRyd8VXOu4Sa~#bts?F=i$A(+RuNlRXHva^B zv1T@r#t1``3*#v_H5c!5m}a7dIH)zWf{kKpQFGDRh^E&ql}OTHzqQtLa-WVIg9vKm zM(^%2!15vcBSE*8re)k3RdK~X|Dn-mSqCT&hb7n~rxh&?hwZa8dDX#1TfW?aP%dl} z&r>x8xDV?q zwr%d%w$X9Y(aHOL{~6~$W7OCebKUH9vz~h9tXWk8*2!3K)nhLsSBlVIH=K1vRc;MT z?p~Eug&2j$v3Oc%EB4gMYC_ecX!HmorDcx_eN`LK(t_cY6T;HfP;CqrsX4Z&|3SvO z0j=HypcR$Ca7E`^3MgBz8roLDbh&M^NdoHL!t&&i4`CWr?|~wlT$!I}FI?L! zeX_1I6QOhOmkWCy0wbmCsnt6W=KbJBjHW8}-{B9VMa*Z}|H;c%06mCuaN#G+bGSkd z_HIM+jq(c>zMNGJW^$TVS6umECIBc}&M-j@CdhL1xy?Y{zglrPH?_S_zP-lHoCLo@ zXF71^Dp0wOdBS=|qIjCA5Y zp6?fQ-`?&1+JwN!ACp;)=l8}892>~jS`N-F1tDB6&lELA^*=8>1F_-%H3Q~pMrN2% z9lDdZE{|=5_2l2@qDJ&vqDS;6CG^>%J7&4`TRYhs*BnBeo#&#NN6*Lqpml=vx#BEq z1)%1mvt0Js3jL|;WAm^(K;TUYx&k8QewqRI9_fB6o!}SI z*_8z5HKf#w$5&hz7+${#g@hvb>}iGa0QN!p7_-Rfva|c$m=kRkIs#l1CO3OVf%+hc zNF5jX+T+_J7IzpjC$hc>Irg(QYL?X6m$MM&i3vbZyWWE0N0}ijV=wDt7)4)T`+`XL zXMeFdf*#EzJE(wuaL&^NyP=2xbUJ21i@}THQLBn&pN?61rI4WF8P9cdH)Lxgf<3f5 zX>Y{CBWPWxIWcR%{sK;Fqu@;=p<5F!CwXv2ygj=7Iz?x2wUO6`bG%8B3mRk<<)$oU zIv>b~k{;n)H8|cQKSJ#v6Fr`c8__veqtE?T>Ayp)|5(zVXGA`k(he!EUSX)BxC;*d zn?2^|68w5T{W!8S-U}q@&b@UkOH=F3hkNF3c1VU za0O|2O7Z57S!pg&w@dXGPOJG_!&`N|aX$j!JWkV5nc4icYcaK4JU1y{;WcHPcd1Ne*Sr)JEx}Go1Pr~!lpy932OYQK3h{Ex7;^QhzVf$k16&ccb{-8+bPncV zJLH3(lto^Xm<;i-3poK|On3z?R{gG3(+bmJV@K6dWbl}NjH*a<9n(K7-fpFEEqx@JE~ zj5nY^tP>sH;6}yy=;N95_|n+yyAK8W3Hgo?(k@0$g31{q7XYFW6Ash_4|IZ7HB=aw zP}OGTLQk`?)I&)aw9uxd6(P|OqZfwdvHZm+#9>5<5G-5g^y1&pP>hWsgob}ZD@q9B z{0Dso6F{XReL!Q3_l4i4V%<^gyE3pp zblg!DeQu`#u0r_%&>+7x@A|vikl7lvr{j@P=!7uFVl${QX`w(^g~D<=T_7ASdF!8{ zX8`z|Iy>Y)c^evLz-*M}2O!Y7gGy7Q`lL2EJ4dDD92l8@txM_eZQ)jXb~361z) zEhZIO9aQ!O_PHiszbqP8=v=qWO3;sB0LP-7g9W4vp->Nj~FXLEU*P7r}_IaWsC zKdaB*p%4B(_g}n!brWV+cTuDrB!vNe@U7zan5tE9q8>wD_K?^Z1)JDQeSH%L{cW3? zt#$lFP;us5=W8zmT61phzSNr@RfQ`Y;P|m7w+qUgzY{w7Q8+wR)=H>!e;B3ZvH-NL zG~Cam*XMJ0WSR9jgU`J4jC2O8*VCVxovw<`=XYp0J^tBfpMhV`Lv1!Awb>Fmtq`)= zB4s{;fO?=l8f$AblWLDJYKq+v(Isw0IwB@efwx}4K?tjvzsO?*ayHRoI!x#-G7B!vP=y&4iJ_meu@emsfX@eS(p(CQ$7z1Jex;PC3fkMRW&9w#v zue`Kqz5zz-4ZJNAJ1TAJh^f^VD*;`yo`vw3?=Q z)YX51{&SE{Gp<8NYsJnHUt>%=8%3i`brgX}!*9hqj za*efQb3ICj(L=3#{_ENEW@ulQ=8-LDVkgd6CvcIPp33stR49wi@v5ouCOjH)vm4~IUgi-A+^e;BFJj3dnTqlFM%FVe)Ls4e+VjEdfb ziHmam6i1qtenY`57Ju@kPGqbI%Bj@2^1%5lsbun^&M=CsduY8N`G>wZU8^#!4(%$E z@g;GHbM;k8Omv9~MV5LEBNXjyU>>&!x6Zh^9AH-Gkd;T5u9M!rwl1V!EYtf{BNDmC_zxvSGn>$}{)}FMDMi&3A zH@Ix{ni$8+OJ+%Y4c9=v^iad=fM=LTHb)R|vhX~62F7mLZ)lp6ViB&=^Vtg^Gu z^lOF&7JyIdWK=Ox8q{|$2W4~jX2xk!WC6M@G;Qy-norLLq2^hX8Y(eRP+8sEA=0sd zEnmCtF!rN$npzUFq)&Zie6F^k7X{=so=4dgeQSnp3j= z>(<+sM^Hwae}5_Z0F5Ki<>`2zhB6MB_xgJP_f`7l@XvkS@1mzmqAcp{@Y%rh6R_p_ zepQ?U`v#$i^F1r*uD$>i=d9`;4&(ZU{oFr*$;}Y?>zw1DUEtHqgFQX0>&8Mc<8(@! ziyW1Z6h7J)Hg3CoVEJsZ)7^>|O-K`R||4oA2v_ufN+zc+K0b$>##_w_r}sjen09 zz|D!{v*c|Oh*bMNleRT}^ia%;1Sl(-^UA+n^Wra?!y%DSj6f^#78t<-Csk<7bzk}E zJ3V_7C5m{q8=qtnI`fah-v>eqnf~1ExwZETd;y~t(;=c|9C&neD_IO%3?f3F3o4;2 zW#Yj)KW8C5f3CW2A?I4Fl{)%gQupN9C2;BV*X0;b+x3!_0MQI3=?DYpk_Cayzs=iA06 zR&XjV4gX~6bd-gXEhCQV-gZ(&o~-N0+xsUkf#I|C4C8+RQrLd{AG2MuAVfl)rVn`q zRLC(|9os0iZ@)Gd1$k`%Fl(uEcenOM@G&jv2RT91GEb2HRl`*DyrJhXjTUX(P_LfY zpb{RiMcKoeIz!49cNqd%T#3PhiI~a{o&kt!nr8N9U_|v($(7+~g)+Beg?Sy_c@=s_ zYUEGC+$EWO?p7|9iJLKv`cYQMqLhd|~2jXyTK??@S24HYDW zK~@XpUYX{Bdxa&0txCFG29H^yzWq5wLUgV6iTE5l7iFhS3@oLd+|AJ_3<&d#^pXd` z+!lQ?)m29PJ_1SrU7;?>2_HsCW3&0$)cI_O49RI7ss_?9Ffk9)t*D^)e*~JpZJ;yt zqZJrOSAfH$t9_t7a93o*T3fbU=%8Lw-wRAccHoy=s`{#-!JszeSd^`Q+BVo z_7m0x3lL9^fl)ks-bW9M?mb=J&;D$A`o5kX9GP*M^~y4Ure7V@V=?TGjAJ*lTczwy z1cR3haBzs`iepIsdkTLnn3+WBka~&BaCAj#IE)xVVlhTNr=z<>*MC z^3nTFXsOg5d6FFwcpHn-iDdnome-Yvo0Hdz2WZQD#K15vaq8#SP*bjKwUYTmSMdSK z5ja>Q&8hOVw+dn3FpIdX=Z1IH5$BD#Yv@*x6VgQsa9lRHBWy|{R<`b0a0uz1z+9)e z!Ccfb2Q$RM*Q+q^o2krQP(ea;%V5=l1v-P<8lbNBWok-eUP3vNq-$#)KC1_1bRRc_ z788&M6xxyDEW*tt-TqaqhHn%21K-A1%8IO`2FdsT2YqMRm)ag4Y+()xfZj%Nz?UNz zh*{x=p!An8-7w4rRA`gdl6E^6*It9rnh07SKfR|2G2n@4~aaCoqgN4Rz6B*7T(D~M6&Ao_AGT@8e)B(Fz!+VpKC$5B`G zf|DNl(RA+!*)8iIuuZ`a**%F`n*>^D9$x=ak=T^IKcX-POH!0m-8F!%%-pi<`U8Fldbf4BL)YrdPu+T_tORge?CJ1a-R@C_c^nAp+Hn1NID~3lsC*rMivq-1 z-t=vZHoEQ_07CEpCft3Tw}kKt144)U$jf#&SkiZ(Pn!0>uMVCN|9y>CAuC2Dfg6SA zBz>*iS{EP;*+?6SlIl~yn23Ws026UY3e2-uTqCv(es0j?OfDz>IloG&*pYEr4qucZ z60bf-ZJrO*ITNb>m9N2bXisq0avi8MY*Qb+7-d!O(VT1v%jxovWlAy0@qWaapgh}D_5bz~yO+d~c>y7lIMaVixUhj+>?`On zxa2gm9L$If^i(}OsdSUVHN8DEPTdXo8x3}6=fyZ{eY z@Q24Z*tt(QvpWNY3OYLYD=$0kP;%aVubona(`Sz4vsrAaN4RjQFH)$Bw~rmfgJh|$5z=cKI4t5Jia)UFtgB{*QvnF;5t ze?~?XUNLm0H{4Dw4R5xgy3CyxhCbQ|DrAQ!36oWzK?C~#CDzaBto>Hokfc{YZS6TH zk9w5;r2@x|U?UgCfAo6zr>%wy=(@L8?YB+mwNb%d)RVhv2B&OKJ%$Q7#lS zhFdK<hg(g(hS`_9BJopA2N5j#( z`6tVkq=@!qAAcWDJ8wFOc7hxNQ+m%oKjQ#}f<9=R=1)OITmrm2>sxEu>?%=~ zr?i3%xQz~>_s#z`=ASh*yH>0%T?#EmomlsJcAj@``<-92WJnSh`5T*V`B5F zUI5sP0^kV}L~Ve4GZa2sM*E(zWtk6mR;;1ov14bNpup9(oB(i!+yDMz93pu~zHj!{ z*M(1zy%uF1wU)AMp>fUAWu2Gg!kcAH5Z_Pm<6&8X`~~TBknwnid4ZC{Wh?36z`8g7 z;gG1?{(7cmZga=0$ho7_s7T&*>v>`A6JWMX9kTUJFB`9+_>62jcdhsUa9F1p6Oi{$ z$9Ym~nr%pPhukS!l3N#z-R%r7?|)wmw~~hM4qo>j+I+S?u9kkjy*+*S`n&uKukrEV z0svZ0{u5*~SrRD_-Y5#V1Gs%|=f7MQuL$IyJA#=BV-Q8MFNqd|xz@w+%DVpm;Hli1 z`{Qh6Olc0Te{oz3M2|F{SwD~7KD_)Az#|}>sh{SY>AyWVaeC_wW=j>@dGh_eckvx# zD~bl<8o1w&G;(M>#6nKwG^?B#_d~^dzwY0~b=g^#^>fi12V6GlCK)~WcI>Wf%CSS?fW13^~$ zYoT!AN~k~ubnw6FA9;#Elfy)@6~@oZbk!5*bBt*dS_i`i8#?o;O5s0I=bdRt$V;pe z$QXvdEvTca-ndm`lDK~c@Mj1HV*nA2mf>n26MV^MfHeI>mf=2@_v6;C5)g2H(S~~r z5TKskGax-IzcnM&wVYD{0pr^1jE?AZAjc9W;@7*NjZo#JEk<#vKlNaO(kirIT0L)x0Sj&Iat4p++v;|x6hdS z4N=N#(zzU|8Bsr0*pe0xvGivg;&O|dA%t?cD9=)r!eOPvQz`jdA-Q$z;Hy9qQ^2Hw zl&45IKooB*jNqXI{wC&btK)^%S`~%7Srrw-*+;w7#5gNWa`lb>FSIyUv?@TJmt+Kw z;l`X{4GKxb9!@G@@pePV)dF2hv=Veef$^}!$^qPr@iJn7WT=(Z@h&Jv7Vy>~l@=7y zW@2q%tm|XQ&yXDNdjY#d!$2Jsg{)Df(sSLw`)p4Dc?dO~;kF20r2|O-IHxv_i|}Sc zf`(#uDA&=Kpyi7*8!!G90YV>_a)_qfWZ&v$;VcjJ(fpqj>Z6VXoPA?$(_*Cu<$E47 zQ0P7B9$c}6n&h`C8DAu#-1AVRw0`Bu-9P4IZ*Kn=)LVi@ZOlF09yMsNie&&AILj4M zQumQlKkYO~RIxLbdZDsZ%?j0tHuJvT?3%vr4;RL(m|~>s=e4?~%XcV#VJM2p7Qh+A zzD%yu5|<1!ZP`^uPp!kMMoqP9RebH1@#N;duivN;3K~MDJ|iWKu|#>{z9AiAB1&a|GFSg4P;Zss0VM&UMR`juoLn1CIck`s>Dg8}G$3@6-RyE8M+EEhh)Gad zF6Fn4PCm8Hp$NT%H6h@jn6>0|CpsuGRZ#r5wQOJ z4`BX;13v#BSiAVDlEU3wwnYRuSCPEhAhXlK21oJWkYz{kS}eO@3!e~v3_vNn)6o3= zq}})ON%&30Xp)aaulCcR}O;8_nvoLT2Dp~ss8IOYf z<3{pA6`BeFjnvG&4+7XmM8aq%myslbp0L_p$8RT~=L!*-Z7!iD9gn^M-G0K$1q8XlXn>{RIE6AY@?gl)E68LV0$2VF41~scSb!F(Kf&hRavebwWf(0Qf~iw zU+ULOe=*Eb*r^<)q2Nkj0V>*CaGfdNu4fz$YrtF?1DloNljYP{CM;Ig<{XHmu}ZNp zZo}r&OucQ=HbPtO0#%u8P$f{u;FNMh4>8}$B%7heOC3ZwuYvs0ieGWyHQ}x)9!mkQCiz@B}`b; z`khh!8yVxbqI~=xYk{dFr?5d|WNfE>9{B>0up=;egaR(<6Rq+>wBn?__qU$Ct!?Sl zUp%kVDX^;@Yx;?zh?d)3do}8XjNkcn=PHke*D4M{zwFk2TqLjOtXnf8Q@iVIzVP7CRu#j5=OUP))OEwdX2#lnx($+A_R+W`Clc81E(^MoWuV^G#?t5U0 zUWn4Rf8iJRB($jt#Z*dEBvP9xR{K0n zbaM8GU^lkB`c-t=S+VOF)dH}kaQE#Th8lMMyCWoz{H%Ptuu+mb5--U+!E567P^m-a z4hCQwy3;klSuV}Mytn)xm10x*we`={SM$%+Do}#Y-BsnmC$E6_d}!Unq8AWujH;qz zM4$cT&{|^#`{a4!V)q%o*!3o4YjhX}+vvZ(R?1l8gLEA_@Nz6^6J3_;chsKi|e*=U(3RhX&hrzN){hOqhd23UO3r9|m7>oPw`k zjskLJmRLJaAGP1CBMoZL>CWeCF>3z?BW>SNR#`{ z$4rESf*=)959(tFr70M=faqnp_x~y!{Oj`(m(-f{Y5oixZmVWz?hyVsSzl?bUj`Y) zqt|2W+alcP3r|{z`qqWL{Bp1~^=h%DV7z*t-;&>I{|ETIV|pGjii{WklWmZjeYrDN zk&gi)QwR7Z^oh%$ia@9_nX3OacxdL*+9reD@Vm+UNG?{JYi>u8G29!TGIXpQ5HguE_Ao)ge>g?%t~y zB8k+2*YLl4LsYzq;*l8xtzmejGW$<&jZX$o?fBrJW&YWvnbGxu%ZYzp#a9GVbtRif zjR9zk$O6@_TN+Bc5>g7t1FGn&vVA?ix8_m=W2fUJp{Nc(_l!@)&Uo&oMCwR>G%PUW zyO#8WP}scwq;79CFUTM3d2W3$EAYx;361COZ@PBOkU{u?ZW@zXA*E~xgON|JvnvJXll*nq7o>Pe>|MNW+!p}OkU9Dpe(jSdtQ4UIZbagTkx>RHtt;s6m0u1`N~OtOlWf zlIx|Esh+(u31$S zrp(QAqglh1L&HVsy=G1Y=ekZ|Qq6?9$|fdNTl9Avlm}91&Fijaf$T4Y(+cexQO#-D z(?l*P+5%zhNCBL&e0VdZyD%e-V6c`nqtbl8$MLjJ6$u8KmhTOjPd^rcZmwKH0AKEB zLS}o;?RKQ)MQtkCkB$bN5bfDf!>i#r_%t7|if#p*Y=-Nq zdXe7vlHhGZ7s8N|`8$KZ8fW>(hyy;en6AlnJsvk-qJeG^WRlZ|wuA&G7#WakpBe_U zrf#B*84iJ-P^*cD`A2pVT=kyFpZ551P^Dc#OzyfIp_WaHIf|S*V3LP{2C~B|*-KV- zS81&3`^B(qOzy0hDv3t0l(dp(UcelV!tX<${HB7K7D@J2z7fc^_>H}Q21Lio3n7a0 z|3$P+Q?1D{7y>{97lIH1Cxq|YZPFas4mm8r8qTdm4E7VKE5YK3n4gF@4y61R9~737 zZi7(>M}p~CP6Q712HmT|Ua;fKr~CazPf577X{>w#1=JZJStL6tqsB+rM8yw zNhqNOcD_=<=Tn2I>!%D(nb}UX2PAxJVc>H^b}eSCyf6f5H|{wlenqVfTwW&qX_4{T z%)L{?BYP;K17|X?4co6sxxmyURQ>DmN+YQS(gd`9Rfk)-`jJVL3|p}YagjE4Rq_*h znD%HRxRss!oZKVA1%OxH0BdaLqns-gJC1ppiu^!5f3vJ#1t$Zu9&%y{f2Z_^)xuqi2ju2>_oau4;y3`^dSDE%LtJRkY`eM8XlAS zvY}Y9DCvD__0G}R$z=H;1C++`OB1Q()M0U27!Iy>YBPIn7MuDx){)vZ{M~(%8XGd9 zjdcmc6s;r#^na^2Euqb6UDVuIHcbS4_3@HW-mmoEuVOxFzQ1(|X z3umX*q?!@nI$TKRVkwuY!VwZ$~RBie8 zH6bYTV<;XWv?SVPcoNN7`GB!uosA0NhV&o?ys7wRQua)Hg|p8HxA*w5*OQ&;Z-G>d*tE=6OJ3;0Sg)GPpQ#uwaLR^9o+;Hh zOiO4M**3Q(@mjt|4K@STwxvIPgkwhozO7fWc-WQs`wR&XjA71iJUg}XHnw8FxOqG^@#V&eWwgMUcId_>$bs)60@x)L z_ND0^fUYafqH+gR{jBE5!1{I#KlXUiW#{D7VabErgk!~OTiG)R_aQJiEjE}n80(%5 za;b|co|ns=Fd?ypNxw*e({4?jr4AMNVPMu&LF(s;5oGVk9;g6#3DUc&*G2P+q1*fE zFykrKWDY|Xz+`Bia#hE_;iM(>g4se=$9qdl+zx!XdQ!?Iczl|526L1dqdD+RF08HJ z#a+mq@1JhI{r1b;;_Sp8H#F$2`&RvBDaK9dcuKZqspx>bO7eEbjBhg)C3yofwB+X+Jm&ch7eI0c2H z8dn1-M$OO9nnJw_xBC*bjP5H+%;hNOYWAuV`v8fm{`9Q@9y)N8dE8|;IL~n*^Ns$; zWeO6^jxaa*JzP)}9po^%R_8c6SpK5E?J3Lg3oFWeyeDrD+jUrk-8fq-i$|2V%$a`6 z8kKb0Lkn<#K++w8K+?SEOY~jhOaR7|mgKp#?Ehf0>Z4z@0RGLecphw=P1Cf)5O-Vv zo{}nfaKUS?&w>4NpEG=8_L8s;;e>jL!fqp1nJBH6I^OKZox9;p)Mj5y@{fod%MiNd zmf|9ExV}g*ng->-Xf?||_PAfs`DqmV4NWG(01X)XR5hKh9QDWCV~ApZGa7YT)(U$< z_tf;P<@KaeUH42_1?_#F%*1{UF9dmqjX1ZepE5=UlO6We>F9D9)i1d_?E*6S!GfK%K|ngXYYsv??wSq57x2@NLHmAPnY7WLlD zqQyjq#jpXSa)curd+K{IB@w0vpZK*GPF}DW5re(XoWRKL6@*>+-!}pfz!Xm2j#rGI zN2C36;RlUTXJ$@8IQB0A+1q~F6b|47TwWxLRHXUft%IW`j%VKq-^DXnHs(aufZv0W z-B5nc*gc+{TsN=1#3RLLJWPxYh)g}D?3Sf3blNMk(d;I?5_vg}2K~u~!f}4E305^0 zQ1ibhMDxp1@n%&YL1#@Jr?F;LeTK^U_ZL4Gi=N5|o6Bn0?LniJaIuG~8_FaO>zGmN zXvFdsfOi>a%D++6(}o2)+CK7c0fh17Pn7o)^$^gLqMirtSQBskPOLqr{=H(QEmmwN zTWQ>XIReTnR#p+olI_&ZeCEJ=Mhqq^I9a7Rd9y*5YjQkhq&59U^V`*I6iUN}rEGJ_#0b6{opZ zOFs6T&n`sugJ1W$DN=GuoG2zQlatRfa%t52hydzIyS-HMz%ccS0d+txm0T7QbjSAa z>t}>5e2`U6_kmlrI@`X6{F@bhbx{VkYs;U*FVG~U2zy6RtBH%nB+pDU z(9!YWm27<(bV21q&g^m)Of0>adLEMZvfaqluT#=;n8QL$$$>d#Hgyxp@n2*iHWS&| zL-4|@6#LyaqN>e~)SYtn`};N~-%f#11>|^`dWWmzT4*eO9Iox@LyW0LWL&(kF9qnV z(rEBb^-E@>nRMjkrIso&3fxqZLmV1lB=_KxyNk<-K?i#4Q*+J;PqwV-TE<-(0B|`YG8(5i z*c}iUN|qT__W@8Ps43FTryqjQ8`BV4Xx6&mSYk~v#8l<>3b6`JUWmvPuAvC@nleo{ z=-w&zAtq&o>oV$fmiBn;?M?k48)ZNwAY;lg6uh;S|2MzdTvj2m4vV1=;5QN@PD+dc zxttJ!MusXIu&)xCSbK^9WS3fTT(Yvu{d{P;@(OI;>=MJaHf9wxs&4V@&plavrv|+( z`Ch!#uK0+|na16yy>yWdgUg>}&vNW*CytN1WrZ<45~1k=a&s@ zz*@>k)D296(PZfhK?Nk9tx4M4XN1UWY$U4;`&OoxVBQxUvdg6aL=2!*#32rfa^fOG ze>Q6ysn9Eo2MO0pNu^h;1{MY+1$|hN#>y~blfa6>xZPaThL47G6$Kr9*uAXu0!E(K zur?0T{Q}UUD(~-$K0aElT*?JZ?_e^uy9b^ifJ*$J#hvWs6|HS~`8Z2h*)=ekfxdmt z8#Wz#8%M8q`@2VgTf6I3$hN(+TO0OXEiN6y&yS_^&fuk6o9q35QB;$|upGI&@M63l z7Dq7d7_9b;@w3>SQBfZsduPKg?#zY+h>AplIJq;1)f`d2pS@|W*l*^s?DQJ$Q^z4I_WOfz*V&ij3|1f%Sc=hGxb2l_FnTk5vukCSq znf&}j=*tA$I{Q#lGrIeT31kGK^DDr(6xTZOl_s3i5U2c4rKWe7;^ny}jM7 zES(=6?S$>6VO1K|D!kjhzWv=;x?$?&$@%hl8C_CT{BS%O9DlttA>IdbEp;OIEW~u^2oWu8Mo#mo%C*T(bm(ruhJV-ET2t!UzzDt70nt(IOot z-FyJ&sLp_^dq)H+o=j zAUF&+d9lpO9JIV^)$LJ=(oq^;dI!#woK`Iwk%a?S?b?9Mjva}-a)nQ+U#@lH9U;^J z9U~X8JfX_w`XF&~vn;3Abxh+LUq<8V0y#{hdQ1*0pl}Cm1}s}q>hM@3 z8D}_;Kh^&e9LC^=ycQ24t$%7J!jloNKv|shdvRPWk|>_XY=-!XAAD1uVEZRHdGXRO zGAMH8%1WdxUgS2BXx;0+^WRn{7%>S((k)s5R|XAjA`TyFBdNB7OHla|;-yQ*Txp0^ z2Np^t(}M6A7K@)YO(h6mxFnr}*cMfQS&|W8Tb%F>zoV3I(e9oDt_Kp?;U0T+YhpMH z(D{zJFhj~O)+^G2+%aablbu_0#x1cl^UFM_wEk~=*_1TOmuSz-A;|*6UHo8Ye7GK< zGD@U8ryb*9=L_Dyh%BEWc!+orx`QO8GueBl$M8hv zWhA4#JP4fV*Tit9nFnUZV)qC+VJyH~g~5npJRXGaT22@WkTX7%1^A|jDbp>EDdUgT zpmdMWFq;L{4p-uVB6EULavuSh_YynfEBr;M{40cAPB5k|>G8>|F;BAOP#FDs(rfBr z4>f1b61nJV5L*c3v!yefC5U%BfOq>MQGbyNVobD#GCQevuJw4pzc}x%KN6-$t2vFz zn@rqEa^kK|8wJj$&kY;Tk|d@R&eSK`u9iPk-tlTcYkpUW;cw;Sz;@r^m5!Wyo zCB7kzDjV5bwpkEmI_%%ssUPB+nxOY@=_ z|T}COa`S6=rJ61W|i`m63LD{eOps^DyF@a}Wfnk5(7igAa|M-7LC3ppoXKI zu}d8ifnvF`2;+NuzW8?)rSbYs?4jqV;$;=XB?DH!`<1De3uCpaDR?TB5NUWz%^1e( z>tvsjP3tjTxGyjv>1!bHa3&I=!G3*@Z30c|QmGjsCjgY?QRPjb6;WzMZt#q$i^Zpf zb$(fiQR;TS@Gxk=2y*6}F=doc@@gpZFoxf(0$dyT>AcPujYKMxKSRODW0nzAwAX%* zsx$xtOQeP3hQ99+x`;)N6ph2B@N?@C1j8+ezR1mPLZNNd!9xj6ZpiVAEr@c{!Vs=b zPIjlFCVVvPd+8b}rF#tg_(cxb3G+~E7U{$*c)){Ald?>h*&tc~bvlA8h!%_;ze{Mb z1;(c0)NkAQ-H=S6ILVO(=)5$^}Y}m8+Fpd4V>q(*wFET&jkYStWWP`BF+y zLJF>kl12jsx_Q~=acHDTr`!N!9qzPNZE6b~hHD?at*EE;z5Y+%Bkt7(+$>IGzP6OL zLcr1p7ojPXTfZ3ky>cb*%Qg5rtniXXor z{xqf!XaV6<=hv?tx1C*3<>sC4T=_H~7K%LJ-Vjz5&G8`%W>AtJyg8t9gI`c<-Lp1U z@#|Zzi|yCJmz(F_xdku;Sbp`sc(wZi08i#C-TVfhzW%#q_a0kJCpX)IyxAY?et^%x z*sr5vUakzHUy{Z=8Tdak2?&?SGVuqx4?xWiBfQxLC8tZ|w9B^EOxB;@M=K+k0Ty|W zc{AU1lnCCdJzS4WYxUw9AozJ`=UT5?c0xt<77WW0q3Oy9Bvgu-OFjjRWmXqBM zCr9qj7Ei|Q91YxC(}!2^9NCNj%d*LzvKJ)?x8Cj?f`)RI)xUKYkQxUM##io7y(5JUgB8pkcFb;+BEc697ELM+nz#5ETOyX4#*~Tv;jWa^L@^IWp~BGBUXfKyI_Z7(B|9tBLL;)_`4Jr zO{MDzWVg1`N9A+oVs1GA0VJDa0itN;;G(h6J?8(^{@+slz{LZLDpV=nV&H+_AMh2~ zbD<_m(4p>cb7V`5#YWh3?H`X-L4$*;;ckRhizJTBYo9=z&trJSz@KJn;N8XWp~w=7 zcn4!^R&&ENWZyDo4#31qluEeUXYa?re;3gzV<~`ZIy=18_5f}eTe$XMz%j#j?SD$R za7b(xQ^^&rQ8kiNxH4V+xGvpDw$v`;xGsQ<__xWBO+(7VT&4dTW`08d0;-idT&wjh&$4498=z7P3LkD?1mBKP(80j(+m#Wk|D`p>>sR{U`w2W|pf@Ldm zNV&v2nRbzLC-AW@CylgKP#q>k*`nb8D|h&70MRwanCKI+H;j5T=bD8&q8FvN@Q=D5 zXC9)Tyn=F#KM%2avnFRHq}#i(`3Ty9-lC zbG?l0?e|Ac>KnP|ie|uq*>Se$E_9NVA)0UcX^UNyk<~bcEuXE8B1p!j3T~N9sn;m; zLAK!78pA%MbtcfR^(eu(?2@OaSKGCd6^|s1|h$b9j1J9+c{3ko%VVBh8n(Y#jq?8c{_;N~R1sI94 z*>V|rbNec^$h6vU2UI#y9hq)$4A@jkEu|3BmDaz>*w&SPB#JemaPQkW!g$a9a~%el zg$#KMDVF3Ixg|HQkw)v;h9dlNidb7mSK*X#lC$&1Cum&Pt%)_YsWu-K;UL5qEhotM z%RzM?HP?C%1>QFak5|R${xkIAbm!b0DrUa{h;+pPD|((9h?B@*9DPbRybU|DVB%-$ z#NzyhX)jJ@C+3bC2_&?oKDASEFI)py5Je?HK&dB6S4-B53@n$!J~XUm??oS?RwH=- zK&$0QPX4y0^j@@aoeTM>;=nR4%W-^})3P&@(@RPGXKXCo ze{2cYKc`XT)XE?Kw$LQIw0PaW zt+jc%ystQYnq2`PLH_z{mYr)z^LKB)&FG- z)B>8mdS98da&o@ftpWc0xqfY)Cz45VKu0X1nUzHz<<9uZvmD|6U_6*Mu$(V6#We_lPgG8Lxho{@Zhw>--PB`=<~gTsR{sVE9wg)E<0LSaz|R#^Zz~*vW=1{I)Qc#ke!=6HWui#*o zh}^&$T)-)_<@e$5#hw%WG}_n-tW4_!X5E&p^~*3DgbD6X{}u^8V+j%9p`_%{h0D1a4d7pm6k$=E4gq9?=3P1YQ} zCTr#^2@cRLVNQeQ*KavL3Dq1peDA=T@&AXgw+@PQSh^oqFlo2?)A17a8pt(yzwJL& z19y&GGUCQ%`w2v*v9J$_t$orp(IbfXIzt;sk3=J@l}x`5UgO0rV6ySzhiue8Ur{@{ zf8S#;?u7(9mm zR@J>kn+v-@(=-X$dw&}blz31=zUE>cEto5c=rTpQn6*Yem<2<6& znUH6tsWC_Cy2YKmVI34bcp900ToB&&&1Th0S_YwWA2fx7M+ea6Cn4;A#k2UjHDEu^ zLrdBIls%_ScubDXWw<5YOnqLk?VgSui*W$_*-kF?mDa@WLb=_)W-lC|uuu^>SgjZ~ zxWO9?piFCM3Jz$hzrSuHGEU)PAM;svIQVjb)A;*=!z`F~`%dYphC))N-pW53ZTz9> zhJxm=g2^*AfbC7kiti&5Af~X)=3&g4@FG6L{D)@uZZU~$|4yfn(oXiJz`=0)bI$2d%gP}!lThvu0AqenYHgQVg3KK+LBTH_qH2&G!8(i=Gw2 zjNW_>AV}w0#xJTI=4C-ly!kWxys$V12kjT)LnQLw_$pS`RLr^a#X8J2cj(Ng?+H$} zhaYOR8kufDD6Dp0a=9&~|Mm7m02G)?08Q&)!K)PciJSOgri^n=Ndmqlmx`|r&^yZX zJ)Y=AFyq++0t<^;nsDeIR!ofZAd=-KDQx+NZB06=jYeQ~JK^N40I5`;sm78msA0W{ zn=nRbVt7kg6>_!n?0Aa>QR0_L59!E38e_jmt-tpWYpYj@!~zweWRU%S0c5NAk$EN1 z^PA!$PUK@&=~2a5&|SkY_pm$g^tNl@MrSmQYsm@`Wa@8o`;yEXp!fuE~bQ zcIFrvmPyZ}ku}nW#8oCJU|E^L$vKq3rey{FDrg1INOIx%XNcphVzf<2^5zU=W-<-u zDDq}<80b-ifiKDBTy$9-fF(v|)Rh(FX;vDK=s@amCo

zj+OetF5>+T`@5U(uqNY zWXKfSQ)CQ6(JK9=z>Md?z_pek?rj^lD%Dayq#wy^#B3Paw`C2fT>)^Z;Wi2wnU<(Y z6wB5^;=l!Kid7BTOrB*f=A_moMs*gvtSV6GuN0?VM_SZ2C49<10IM7e@;?q;@`F!1 z2n6az46F1;H5#iE{DD8qkx;|R%d1l6ji%rTNkA(T6RKZ$k<1Mc&tI!LhO9V&1|dW$ zaA6J)&`QZ>FZ5ffRyi5S)lc#@OxaGX1DY-8(5{R!xo}&}QqZ4`SdU#aYx; zA!DWIM;4}B)mR%$0V5S6!@<1gQ|L=68jqFb>G%nf>|3psm-tH-bLZV_)6Z0m{Ze_iaJ_V+!Te5EjZ z#c9NUA_+_B1O{6qSL>F&U1Sg6)OV5D)Z4Cm{GAe@C7DtE0BmukZ;FkGrM|DFMVBl8 z{ii3K4G3|9DUJ>hoBwfXF?fzA?J4>zna1!4pF$nBB0N%O(P?XIE-8ir>dN9L* z)yOWt>tF+3aQ=(7@2Q-jGp>ZGm=!U$q@~Qn|qJ1kJ}Ml^WXJ)yvrHy4b_kNH}IgU;N!kjNI09s zTh83w)fLPM2+AT6Lc= zao$5rM{z;Q2eDLEoK{v)RH~KcR#qr27eK+QzC)30*4aY-?U|eZ0R-Mu|(=9@b7@guo>N zit0Kr?Cgbs`UDgi)|ukFMk3$3YV8#DNZ)o=x=XKELno-NS($obi|^;Uabb#)tH^je zGK!#_(lgZ~Tq*nXvHXST5PwTQlMY0K@U>QgfL(DaL>i}cA&l3p;^{}CA&iTY;y8Xd z8T=2RXN42Q1r3oM9nx>PjGQ?IX((_+I0$o8t= zB8&>QbwNDFpM>2H(vOV{aZ=IIbZ-BqnnXaIhVfs`&zFOVk6E+eL2{ppul3!Dj7^}& zJdGoO_$+n-t`i-Tzfk<|Mdh{Y-ysl>N?ED+P8J7D*EVcDmi!31TMf<76m)r%inn5E-z1IgBKrGNeT9$)aj6lKUo@2LZ~9vig)GDJCl2m4B^K_`ncFq zYhymdI784urgFIKo4jy2?aF$0eL-dPWP!KuRYPUebyvUe7dvO`Zs|Xp6BV&9END?v zW8CG532i9K{yI>6BGrn~4uD;@s-GX)Pv_GNHMSHk7>I*|2BvGoIQWk*fTaRrgY$GT zDh*vG*0Xr3U#Tw*FEAstGdbx(D?s)BC`Kg*cNpM zbPJ@h17x*%)7aJjtu~>J%4$-}AyW#a7wS%y``)OoHPWKmdz7L?2zWLr2{$yzVnPmt zkb{LhMA`YdSi;$v&r$plXAtR1>2J4K+mEv@PlGl_T4U;FG(|dTn!U#3-%?mm+Z6e* z9{rFRvtr7a!J|P|z?3z;ww+ezNMR&olh&e`UF;Pur{I@{4vf3?EUK`$}Y#ERy8 zu($V8^mXUO{eNl@2`{5y)z^;}u79ep&v;*He5bm4n^!*M+UJ!q=%s&#$~f z_=Vufc*}Z|_)U`dpsb)3l<74zRxLlYU0ZxavI>(V+tl$E73m_=_i^Viu2tDEE_8pq z8a`+6cG3J^qL~$tdHu_mzfCU~XiFQUFalX%7gWAKX~7>D^Jz=EzUkp7=5f7r>(k5c zYqV>kIjf-#Y1An%Q|?ySUhT2+$PCyDS}?;huJ=elMd2^YxtrX_(o#Sismq9_khq4 zz!EEVTboie091#ky~gV&GnAVdGc88~P}x-NKD_7-`&)wLn|K)f?ZvC`vh6$PBRTB- zNazidz)ta{@%01`adMpy<@zK>HY-W;(HcfHyd<2(m4?B*oYwW#q!QU8!n_DJUhP3K zL>Ed2{Y`g!xY`brd+xaqMJ&f1x?=A^8E9nAnR#qPLNT4vbG!b_D56A`nT{42fWGu3 z8Rj!$`U_j2vup7lY&xu51ikOU-f={$+UV2*;6}&y4ZPDCNk2M3+6g-ZE8GC$Y0N|4 z%?TQD!cdBq9hv~qzFG3*iB21tu>D4!wkQ5lP z`xQZ}S$FRk(%d4dKr)aXy~LnRvyH1v#cJ@DgbPw?st)!71z?dNde8-$(&vk28Ie1B zfimQztgp+7(05T7{?j=fRskWG6!&@S=b+NFSokvD&8zV+bHo>OTI+A@N*u;0&6Sy% ze`n;x05k-2qXAO%b#*&-A0WDyVEZ8opIq+C;zZM@wxYPt=`<2h5dHPn zi_}PgygB(%1hto%dUSd(5QSIR7W=l`ZUpQDU1iyXF7 zSN}xK23d@ilV|SxJFYyZHjb|j+<=eU@z;GQ>W7DSdHKwO zT!9bKd}1<{A0_&>llSRj(GYxw+r12HR$po{Q3l5Ce5ohar#W?X8FT*2+3Hi#jpmZmL z9-Fa$)5HZoohxMB2F>%rG12LEo)x=SL!gU%k2fs@QZFQpb4w0yYZFMTkt3$5o5L~M z798E2;43;&$;6$PqXG=N#QzQ5{8o}G*n-vD^4FQPSbL_+wGcOT=6Q<9OKTHh|KO~} zU$h`Ep)gQTFpxJlK1eJPeSmB;VDe#1O(fHW*s{S*MYpJ^T<$rH>1BJs!M<{*tyFO`^UWLb0Hhxsli|PsrBRiCi2hr;r#oN=hub)#NA&)G-Z4n`&2bJcn+KyYD*zYrkDR-FXH2j{pSmGZl9Gv4O2E-HB%Lke5coX-A*R zWmzBtLwAWjK_@6MP|vGymxbrt9Et;8QH%hgk3@a0rXa3b%05w;Yk4Z&C^|#vyD5$z zr4q>;@Npa$RMa9Aaq;kt+i^JTHIwwazR-jMzOu&9tu(bVV{ydD0(Z_T)g0&m+{$%a zH8I3)Gp4J!Z-irrtP@h=^i5EbMUlbkCn)F{GE3GZ;B6zk2)cq^6!HP+p0I!#xQK5V zVFJTgBa}AM_DCsSOnX59zptEM1#;q_eM(B^$6?8RP+B89@a81O^wtJ@OI;yagCs9_ zh~S<_M6WM`7*F8>WLLW<_8C9;h+ ztKm{^wxR#6MAdkk^|AxdVV8Bzr81)?>-$`fX4v~rf z+sNZ0P0NfyZH}ul)O}PgYAo7v_Dor8kS4&i(+rdN4`D}!&O{iXiJ|ztRz@JE6eN>L zuhtiPv!^qcj2*m4fAy}I-yAh5Q{g` z;LGIHFo;|MFZz;E>dJy}``IO71#rH2=VBDn^e8@1DY=>{NC>xK4SjJ2#dW-^Vrei= zkb05~vN%)#5E_F_&XLor0^ZR-0w_%wqple31$Gv@QB_V)H0X^`v=w=Oabtg)saR;~ z&~$kI3-75rCm&waM(uL>`M0dF(uU7V$Go5HzKBK} zkm3As2wl=xlg5%l%JgTIH-(AMX!@M_D?}bA@|IN|3AZ3zB~XN5R|sV(#yyJ{Fi@gD&AmSt z2r02KB!@DjV8-(=tna&${&l# z$L|Jp_Li`gZ5v)F?$H)S%HM!wMv$D|v|BKh0QokTD%BF0C-P;U8A>7Al|0fOmQK57 zampL^6w0kvv;7jvQeb)R->)Ew~0sH`5l7lPj-Hgi?<5<{9g9iDmAZS`0nW+#a6 zy^2m27t{_|RG-OCXKN%d97S<8=q#iRFF@|6ahh}j&w6Kb?2wpIBSuyMIJNiR80gDr z0hrPW!`KcLiYj|cRrZGXS`}5uVqtTiu;Vevb&#bvcI8^Lfm_QvKvuocVw7P{kb#l* zsWRM@x!+NLbVDSKswi%Y#j*jKdRh7bluU{{#9u^jH=&B=) z4}+m0s$-s_eIGQAt>;0B{TU|;idp_ofOQsu&$0y(N*{t6@x}pb<{+&B`H*>2v7E0V zkuuIsLjkssUZocV-;d{2vxs(1dU#&(mvZ9ot!8~H(yIrC=&ejD-RQM7+*z2@hJN@% z?z%jvD2lpR?J~f^nB(?ejG#3_>h`%cW@oynuCC&!H+r~00-%(YH8YFTlM`*JI`F^fDgiVKQ;`%=r_{C#H*E}t~ke5 zwt5|FOi0%%p?!MreLSgoAN>f*x-&I3QnoezaQyn@?fxVPWw?|3&i3~Ajn7wnm+x(I zeEEzg2pic$2{X%}GBU70yqbBzTXf3S{-+JL!)ah{CF^bcpGtaf4bOn#0>J=EbJ>R zc<9#vZ>cmjF1XiCUB>Bq+{s$nLnvf;-#(tFdyM4h4?G{U)f=9C|L5xoSi`?vrGA9MP|LI*<60f?PMLmjdPfjRgjeQ<27k}bgE~AS@n%g*1!;y17yy~p7I|i-#w|QxzAVx#lI1U#{=_%( z%k!P+C(hIgpIYGq8*7Cvpq{q*&s(fZ;a@S;pu(xl<+Hn;y$VEJ$SKpGb%c6oTwet` zb4*MNRO${8E-!qjK6)M}~rxdr3&yhcG zHBvM*GdI>er-}MnH?-`1@r8BP=vujyB+SI3iCaRfKXF)AoBABR19U#t??&xEoc_{S zFb-v=gfT!8K>A))((JEsNh(`LA;c$ASmcDdi73aFo^hl&VNeO3>c~jKOuLOd2P;++ zYo_D${&o;|wu7!@WuVOpqU+_6|R%{?r`3tWzdE^P*PD)U%X!MPdF3L~>XFZrPcR1yCF%dH{ z*dJ2rCK`dNq={1qk6W5#P5EiOLx7T`C(O=paJnKW<&Ia4 zkpmD)$I^~J7)d!$;W(F;1fP8y7B+)I-boaYL4Lq%Rut|TNk(ema_iQUSI+-|(u%r6 zNH2vWZDN6jc7kTjL{DY-t?4Q463yBV(%J+K5MGP1Uke3_Vz9@z<&PYMutBJ}|ILH%tNf;o ziv2hOy-9x_@``vu1)Fb9jdar+TS`IIp)ayDA7jx>37$?$sZXd%ua5uf6f6P0)$Lk# z9KcB?4!Avqblr!OT|=QEf`VJ1R!!3VwF?)t9-Kln0BGSeGB+Ne4FhO zIz^LEBK^g6pR|YkaKKvPaWGI)RG9>JV!tSDmsAo_$L8vde5z8-oFG2pd7&MFMY~8& zRs zXs${QCg6QYiPxSG7FIxn|GEpQz`1D2GUNm^VS|XArxvR8#2cc@3z6I}T!z40Lw1M8 zl81p)kxC~uxmtm+OjwcXZh}7|!Sd+8jFj=SOtKzIOM=8@%wwba6;(JjVb;wjMgn)y;CV{SwPmLn|Yv5)x=*j}9c+ix%^+@;Ja5gB99z z{w3q{<&+UtEvIhHD#sscrJswktoBryEy+qNW4cazHM}=EL{HW60gDr)3Eqc|DF_dd zCIXpoO4G76wKx69qr5R=;qYRfA(dx_aG2E0G zkAZqp=X@~5FRGFf=U@IjTH6D*5rmjJSkk>-3+Ng3l^cOkGsu)ZMBQ=IT)2BFSAUKg z9;U93I<831Pmc{3T|R~WW`7YGG;7KEQTy5IGH&S?jEM`&`uS*2UPRI11FWCy)DW7B zscg!9EFBW#cDD&U>XwDvD9@$u76Q@ljw>VfSqNLvvmyCccAclslxo+23**)qk=27m z$6Uur$L=1rG|!4!cXF?8YJv73XPKvMgr+1?5+#OqltR(LEz(!-iC&a~KSr$Mh9;~G zN|{Qpj7NF+`^hH%n^1BKR=W`deDsahtSVUj6`cUR@7p6sc$YiN)i)e<{K59ZkzM3G7~}g&og~GMVRHyR6Jtp)8(l~%$sgT?%8|I<)@~8j)9S?=)}p)Bbc7#k`e@MSsr$yOUWCX zv0!V+X;zVw*w<;FfjTsQ(lTfB}mr$+)p%R;qN z*oj8e6_B@xne@d@Q($m4zxSlyGxHs|%TZ{njtTDY68JadRn_4RcvQ}_!zjcP$;)P( zI^+pHXdmt)Yo1zdC5F{2fqfBfcdW~$zrob}>`aj)K~m6HVdwqP6)r!Tv-+iRcvg_@ z0AsUspyCl(|2n#&$Q~mnBk2SHF#_RW0H;OSmy#@AuJ<|Cx4Lfvw=8w-f$0b9Gp*qQ ztGnH6IjgKa*B)!Rk*?Osf|Mb_YnWyOQ-m5yAEO8^XG9Y|=yUZ8QPX9b77b3lLhfhF ziky?S8gB=uRc^0wrG1QYXss$?i|CdNI-KV1XF?NIffcMP^@0Oh{}^L!&N|7heXALSPN_kcfX~6`cL1K>if+gBTDa;n2GiCU!HE?_uV-H zc?^3mOoMKVKg=KOy&hi$9*+Qz_nr~yfSiz`)WtI^ug@i#xoUP$RO8MurRB&fm*cwO%` zBRA`g`gDII-^89>Uh1!5-AO`ok572YJvh=`Q;aKDyd%s;8Bu={iyoWi_Zz1_p&ron z-Q{sxxRZRbC4BQE{>U3fvnolCVyA4P_;|Sq8ps?s?U3is91SPUyX-|BS&!J!L z^zYEQ5j^|lr>?M#B@_YYZi?IUHTBmBB23c`3KUcYH=rkQPJBP42`T1H{98ydiF4qH zl~1?0ooNn|tG7TV_IFiwii$l1C4k+4jg7!r{~7yR&HH668SWe3I-YzkoDrlMlwsIW z#1>L&&xJqVUT8cC@aMp{=d*xU6jo{`@)+tuNH5A8j7u|%4+!)rp_IXok}4%kQqaft z&Efna>xUc=$;}8j+$S(&kFL$%Irfx{I8m;K2C6V_+F0nZbcgd*#BD681dxD?pdKt{ zP-h({8>Ve^cKZ1{Oz^EWOMmVARymk?M@m1BX|seBIm`*E^FY#2OKVI{D>|i4`7s@# zC3>uQo5%53Pex-wib1E(KZ=JMdz2;UafMiIS%f4MTJD$>69o5bLCo`DRU3pY+h%v{ zn!#mju|(!g(FHb|v3WA)y$!dKNth)wl)Ud_ZJg$TCb}4g(~$ zw1N+MTa%B`3wu1`HN;VCb8{|Y+8D*K6eXkG5oFp?WmeG{{Si7>i`DoYIftcSc3)xP zYYV^el-SP?KEvOx7&r4_rGG-dy*eLLt;)n49R2jIFQTyoTbkUu+#&rC=#OwZO!O8y z)ZK7>=jR6y=ZT?ClK~>1X;AN#h)*)JMkC=;Ahv9xPWSnAAtGJmFN0l#H0{Kt**=5= zGTjw-Cm>m5-IuSU8ellS3criPwqblrUKE#Hv?f{<=gd4$AU_eC>Gv0i^4_aR9Zx=7 z?xqsj85c_6=-HQ7_6Bd|iL2HcpJ#j_KgoTHNC?)Ufv8a=q$B3$lKgVY*5-_h%#tlq ztXF~HO%acsnxtUh<8Pd)A+JXS=wWq~n+Qnkd?w9n!_C_Mx~lnRBK|Sa5DUZlf{Yb@ z77Dy*C-B=1$oCa8t!Pl|LmjW%KkZqzUZCJRP0IBen-bi!A^93Bc!!%x<|Q1QgJW-5 z;vWH(#v)qmc$~~Xb~@&WNG*9!@0`!#;m#mx&`)KBVcr?`0~H>dhQZ4b;L1QIh~b^H zWg*&;ck6OLiy1#;Zp5s_$`TuEJx6xb$J>5R6e31UJK#LduK*+e$a~K#A0c^GJpHZKgX4-rq*voT z3e$%?DC-IVfEca_(x*H8y8UfOf1DcKh}vdm@%)OOKk5omS^g;2W5opz1d3P1?rJWH zMIpk$bZ^O39&7O=&F8`n$8dh0Qe+uoXsx8}gkvtIMvQ!nF3@yG#WfmR(hT>qt+3i8 zx9Ox`53U-X7&8+-4?5ejoa3&3 zYc&#|b{F{@+GWR)Uek%EjbFJPKLAYwjRUU;&xoQ;YMpD~%u_zeTneF;LrRO3ubN?d z%9x~-W7``mtR~PUU-sqOYYs$3ub+W|ep34-S^lZ282Q0evUVv$gnsfJ}u>+r1ZLoR|5 zA9f~qbP{&-5Oe79Qd>649xVL1t^w}iy%nj0+1QaFB|R|o!7u>B5DX(QjN3s)bhet-5Uxu4sfQM6ppI4Mz`2Tr`F`Kfrv#qBcIhOzrFHb531$Cxwpa~X$;2|&@ zGGbXT0-O_=_3#ygC%S2*dl_X1OJzzrh}bzgP@?$i;t*xEe^gRrnJKU3#65V$(o#B8 zykFE8UcTN2ob()Od+FpK=G9$P3)0ck_grUh0Uz#AXA!$X!$OBbnd#|8>G|pJOq9tV z_C+n=Lc_v_dZ<9tsmPE;AV7IkJ{1AnQ1m+OZzWDBX*i2MI|~u&lHjl`(UM#%?kI{3 zS>+c@q@AcTtW#3=1Kht<7~kf&6E5SY8iBa{)IXl+C5qY>kD}{{7qOGWuD;1S3n9ZFi8)wQ7}aY zn5DaLF zF+6mm?Rf%y&FU!&iIl&GmU{PuED2aV%aeF+IZ8i!sZJ`Kgu_l-EnqoYtQhB?@mjc7 zrj;@>s)uRF)q*_1ch-BX7J?Nc)HL#24aBLPAkQ4?KLQqhpic^lKZ6@lO<_3lcY@f( znN##c$C1pEvL4hHJur+Y%RO?GZa6z6m7Oac>O+gRfJdZ(vb^Kw?2_NVWwqeL{)wsz z>`+Ju3D*22^lZf71r3uHW54ijokR?e1tN@A7*%iuFMw?1P623<&n{SaTShDF3z_BU zQE=dm6R;~Ozf{<`@&&(%TcWWcQ0`(9jDzgXUP1&D&o!k=NzUh&{z^q3?@_0eHeNI;Z0j6yFGvAFby;@>}*Wl+}wy!&I8tSuIvMB@YdBk(arvuG78 zH_`IE55MAZ1T2G_1#XQb1<85XDz*LD3kqndAHJgv+%OkP@AxH_6z+$&U|qy7o_%On zo`pa9Hf7_cj|O4>wHLlo!GgaJd?ebLtOf4j`=H9dg9jX?9-yRWz@XQ^ zVo{4{qm|#_I*83KrQS$J8&iR6K}P*sEzZ01-zoCCN_EnSD8PmNlHWt|oxXyDcK5mWk}m!+y8PUtTOY=kGoAt2>^jv_#y z{j7E-JdTd8sGRPTV1jg)z0I1hBD! zdDfNGGbIjQ)j|g(C{G(KZ4n?PY)6+3lM?NAd;^TP`s9kC6$Y@Q$^JAKg@W;gA{&)6 zYMuPIGA9-cq5p(ELL+U8K6$PlaieUC0C{GXsyFnwaFUubU3Y;MBt3Pxhk;xZ0ya39 zy)>1lo}{t4rvo)j105L|?Br4|8(X2DcZ=p$A~O`+G&GQhYSt0^XdgLZ(xBEV2& z*5Ua|(89=17*I)GMdCtUt|~!R73NG?F33h#h4oufIX})@m##ZLi%^5Q3L zK|nn^2*Xj=M=Jj>Q1MN*(dOh;LsmhLO@8F*m%;WHB_Jbe+W}?{lE@qhU^=WC_)of% z7&ewgPL-V%VrJnGr9dqu4(>UN!FnoZ8 zAch*%#Hp3x+=`Q9e4jiU$_VtB5dd75hYeYmKh>a0 zp#IlcRhfS%tf2Tfq6t(vk*u&%!v$Z7la!Q6#OeQa)K3}ZiaH2v%y~aVT78(9=za8g zdp5{25MwlKGBfl(=;-P}+l3UME)f^e!Kc)Osf|&x^VdfHbC|fL+UgGfL%G85P%cpA zWUmnQOsJp*cX{tB^{E6jM}nnGj1`p~XLocCClh#&RQ$SgW6CNl4vDyFOSSIuRNvUF)FpBSodG9{age88b&tJ8OKmS? zO7)|@g^|MLaT-i1A_D-4`{6E{obwTP<&?^XJPSYb%>Pg!B3RwR3pAaK480A~9`B{5 z5~t?K2mKdlaVDPi|M6lu)^8b3To6Voaz6F0#Fj5taYxVEDS0*oW^|S0sse4ufWVmE z4v|Iuf05>a{^h?wqxnC9c1+FtA3FlLLB0RQ8UALFe>}B^I4ehf4P1&Jc_DuOPZN=G zD0TTbmz`cPJ(ABZaj7n3O{Xw}JModE-zUO~fS#`0!&GSwnlb9S+p+#XhWvpuW5T0A zkz{x$|MP!1Qije!*+7NNL@qADvHm}X#3xxU5Y>cVmsXAk^yZbS>LGCitzO#ucr~p? z9s4RNR2M_>=mjX<7fI>R_+achIM-*D!W>ilD7z^5FXZA}K)sSFm|SL#9J=@C{(>WK zX2JNn_Wn=QY{B9l3=9W`KL10L87j<~d)DZ7t6Hr>m?VLBw`v`vfOCc>pl0jG|fyF1Ku2627JN_Kh_Yxr@S9euA{}Yw>-%(SD_uaOxM96f)X2G19FdtPVAr0nCQZQ%AP;Qp{ z3&J=YEU74ysDVlIo?m?(hb{BFU_c!IG!3o3l!C>)n|O0IKOl(k{CL59$88`iM_(s^ zU4dB?^~m_vuP*N4A9;?3lxyTpSRa}EBTzR1j)(oellY9$^pk9czWmFXl+r~~_?+A9 znX7Z3LP4?ef4{`bGB)Ain?0D-cDX>0$8Kb%3E;MPfgYb+KX}2!2yP=^Z-PtwONY0z z*E^YfJcFBSa^M@ODOAhKE>m#ZS78{tqEV_~ zZ@&PPS;EA6=#{NTQ6vAd^+mTM2vn~LdOt7ySp2{0;8eUN?`CRcH zVFPf(WCT;3QXXoY9JWK8Q6Bo392$Jl8-rRVhu;eoPD1-6PC*Yf0)$Bm?O;@Z1TDdz zXW>>P;E!O8fkbz~Ca$P?@PR-wkATEPgl`5cyPf^=5w?ODSap8 zz6$J`_l>)r$=a3XwF%>f5{-YARlNgXEYvwbNr-_eg2m2HNg*>X#)LT2B?dfA0?tqY znK=&!db1vQp27IrBmQhSm%R=W0PLDL3Uq#q`bU47szA2Z%d&^wg}%&_2NR_4*Frek zXycxY8?gc=Kd&tk@W4hT13EfcXlMbxTf@*~pB~kN{T0nc*T=QJ)C^~b%74%1D+gSU z#}gn4`UywnA_pYR*h`$2F-BsDu9t%V2!+n77U798e_@};ecoy&j!|gH~*uz?mS8Zy2CRP0>4W85%*r*p?I=8Ruit zU?j4r)t0E<|JEq|tYjy!4EOGvu@fm@fZetf64~>k`pmz>t|$QizmLj|ysWSs6_Psm zcWe)%kU2lP4o8}c3c_x(0~4>n4-jZCz^BS&IbxS10{UN3L?u4o7p1wx2vttVKyHS^ z2G$!Xe1$U|$jnPG1p=?iZK3SoSb#V!A>Ol)f)aQ~a3VmwJZLZz9>GIzLE*#T4blKy z35+0h2hs82sLZg9puuC34oK%vH+D$cK^Asc=P)5N!k@wVu6V*o!f>SU0EhyVg8`2L zkHOmkvQWB#+d-rOq`}w$vJkwm%;3z>%n&iS+by+$$w8(8roq%LovpKL7^N+gt(k#BXf|IeJvbLA7dQX_asz6EQ2hCtYr#*%4k8|i$Q_0|`)Ng7=m;Vo zh~ybYI*T+NatlPe3xoWBM^Vzi|Ba%KNt8EoGjja!V0Co3Aqki$7>xnQVhQ9ZST}M~ zehDaf7zJ{IQV2ynd02aL602b4EjWF0qP<|FBzRxkAuR}Bs39#F--|&lDBqPqEx5b5 zF!-bK2u0L%XixWGRn*yWNI?N{I{2eKhc7IwfOr!kfB-7p==L6e9&u#quB$t- zY8PPhJM3E)Q45ADD|CR*l=~wiqrUlQK5=!bl-Efk8tP(IqzJz@U7{(!7rUE{#P~`K z>C2XHK5>2Ou9qf~YQd!I=j@ShRYok82aXVj`psz$I>Ix4{HH&En0~h+spP16HKoy? z8b)iA$yZ$o&4f!ZA%*SLUsP+!WJoZf2Lv^jlYQ}T`Gi(GBvo@Y%P8FPX$E2@>?q6* zvcRp`W7Ht5e6aT%0c~nTD(tF~WsRfTT}j4{j5KGGxcaC0G;!Zg*ldvpqnMxH^j!Bw zTf&Vzj<_NPJhpAv@O9vLrzrjqpIfr7obCTjml)12+5TCyVAQjG>Yf(j<)OzH=>_dey+3$VGQ;3ISbIHBhvvT#=*gMn zdzlQvk?jx&&y^bOv}i_iVGM)gm4nV5&g^t=PK0HEW;tlF2IbAqi!a)&ZfdapnBJZx zP8Y^&xVXL4h0B@xH98GGeaSK)ERhkq^C0O9YUcsEechDf$1evvUT}@ww z4<4BzRhZcz=S9vAKoU`W*lSjOQbq`KmT@qE9EL22tNp z6_E+O$segT0k%RnzcAf}2Yr%AHHGxT&niHz=z|5)y` zSYQSCo3f7To42NYs)z&g$w>SpS%wl5g5vH=3i_u2q3|0e?yqXS@=Ui><)({aS?{b! zqUmuK8AqQPF+gI!@)NKWLB&>a+yn?!nb$ zolBev>XH}x@%-zTn8Vf`SbqCU4ID(nKv%n*Bdk@1{qtHJ==aAPGV^Ycm)2ZADi@4n9?Ea=txjQy|?0> z9ORH7{i~O9oLG3(BxFsAVpu?>Nhd?_hs0c@o+1Hb|f_yz~o2}t4@tU3$ZH3;$lG4&Q;RR!DoFq}hoH;ROGcPJnd zQqpng?rs$Jp+Ooc5e1~XQ{n)ENOwz!v~>5k_1^pY{?9Ydf|)%DvuDqG*SltH8&=lH z$`_#ioqnU}*V5Qc5H7vL1Ig^JkQMqS6fOgWaqbjeoC=tNVNH?@8DF5T(hS0j$NWiJ z5(zal*OX?lD&c~JRVD+N((BXAQa>h3uS&p=VHd@;MkI$VzWHSScbyy}&gs>VDn77b zAwRp7CTlr_CEcqLI6mpv*W^Q?OOqUYvDZN=^TPkT0w54sqb48A=bCiSJ^t7tXV|ER zClQZ3DUcHkn7sIz(&8O`PyoESKnd&0TZj18&R zJ_MAhw$QF!8S^Tm^Gu@uc1}3@)JJb?va(K{F>m)@BABl9FOYNk%GnT!Z|Bp4;f{rL zYxhOgjknV}TXxh$x9m8v-1q}&*>2r3%B6fI`L;aQb*Vy2B^ZjBgY}bSW;jlnT&Cpm zDT%IaI!P!ja+$K0MGOp7GrE7%ZgyLCy@;7!IyuY>m(|X3o!)?w zkrMltl!PmUJhEZbr^hxHB>^KzicbNV_YaK1MkOl|k57uL4^m8at!px>!zWF}f-*OK%GxkJip3nhdVZo_}%iI3S_H z5K1NWDJ+m*k@8IHwVyC-%g2Y*0Wy?Ldq{IZTuyfV-gW)B=z{o@6n^kUkTdq(`p4wI zvryFa(U#?f!PbMg24Nt&gd4IUnl3`y71yw?sz@k>8qy8!9w5R9Mv7XV8FKCYrxfTC zO!Y+!9RMEVA}97hKzqMR(1IzMvVop#J)iZZ8PVXl5w-)(lY(c@_^@vd+&Rr=)g!}j zZ|jqad_w)@F?>kO%yRKlf^g*3k(%SaaQ;#K#Al8K-u10NyB5zH?j^716RIH}MRtDc z!w#K^bKS$RiyPhSvobr;?(eB*FceorokKX8VFM;QTo?Z2yLvAwa%r${YM)urZ4lnm zt{co62!Xfb`Fd$tnjQ4(;8eyP9$-Ag^>h5WJL^ZZFocSipv`)QI>`5VeY2As-vpV) z8MJ~BN3rp*NVA?=W@gl{?cPv$gI$gE4E-wq6DcC@6l6DaJwK~ti_wq=i@M6+Az{V? zT#!YPuAE$KvIg-Y!Gv9m<~X$GKXMtlgm4x4CT{_>(M{XFuJcL)T`vfDlE!ToyYAOW=aIr`RYEY|^(EjCRA33t zuK!bQvI+8Fmm3{+^)!F=8!8r5S+e`$%~Azk7UY!d!7fSRvKaRjWYTQ3$sjiD2m6oj zCWHA`IEv8zyI(`z;k>1eA68?xh3;hs85?I!j7%6}p> z$eS>(Id2P{Q`S=6|GdpIudZ^H@i!~mgegh-S9YM}?4Fj_?j^~%!~ zyA991aL0_Q$iB3aL&hdlYlKs@!XNEka0PqA!Pwlrx`G!GB2I(1Zz$3JEB9bL~lq)|#5Md=eA_Sm*gy-xl($u_qsIB)+tpbaI=t7ca zvCq}@p}RAH2>ovvx#)CdEz#Crf_xG99&gLZj(p?!s-nI=!ZV4Gl>pSMRpCsF*RGfT z9Om~0d_{8mQ6g{sWicb(29Q;+=yF|Oo_^NIo?wH$vw2m?U{r%~z^w&dMa=wb<#S|+ zIPe5-Sv%S{LcZCzXO94#yGFE$_SedpAi9q{&7!#5CFHslPz)RU&a70x@vB=>^N-L9 za$e6U&-oEe58Ma2o(Vu4T8h`Afz7`J&_IzB}8upWsK~I`>{r| z2m!vi6p;clCfQNeGqxlgB55&K{crJEN)!5Ye~%eMKeRb#JUHQB0zw|xEq)$#C7?P&j#YQEF^1qzDlq7E8$N0P0u#*d~n z%J5e_xD^JI5ypjGjR+@K^hG2eKVDVXpx&gW1U+pV!=cE%IW}eOhA;gKUYrHY>LT=N zMf0C{#(SX#lbuXG^hjNMbmMVA_m}&-f&NG|iUwi_bxB`C-m(ShV%kDk+76>?loiM; zva`Y55!p6c&qe9BPdEwK2@cFtG}SCQ8jvqQ7x-Q^R}w1lK|Wx?Mc_ zJ=0lLK^7tTeTTYm^z2DhCPe)wsTo~AUZ|}Jfn8xQ4HGd8I^#Wz^vE7C`j$zn`b)J< zl+8mMW!0O&8NJzi)DgYX8#bigkxif8G=WE82S(Mb3I}M)vor_=7NomAogg)XS#6NA z*M_y>D&nn7&HT1;#)3(-p$nZ=w8`_*wV$G;TwcXxtkr-irC_pj@h9qyrgH|Xm3h1h zaOA^zqR#njP@vnp04Zbd@Z5sIeNXx0n*Ku>y-(E9xkYYbX7y#EO$rEj(qVcH~6fiHJJdA@Rj_1N-NRnj(HH((B%3E|j?9eZa5ZS0x!OBsat z(S0{JUM|tA=#jWvqKn>BRjLV zVI5X|5bL3u3|5T3lm6uHAi}iAfx0-9mEO=a5U*1TJ2!bx_K zD9>C5kZzGUaz!<)zx;vyE;iUKxJVqkNNg|Wu^l``vivDK_S4eCxPSB1J?2PG?4xc^p6~5u+c=SlJu+?&9x#IEc~o`pm0IO|0YPN`eD2Y{UC0(= z_!XmZ0e{rdha!7~OL6ZQcDYaL(SDNxz}Bdw@{F7)yS@F)B-_4cW>IJmw$9TEZ!Syl zLGr!Nf}57^+pUIUU$a5Gy{#w|_f(Ji8<5*BX(6XAji=2Hs*mr~9Cay1#h0a1Ps^Bt zeI4bhZ3$er$l2M*QE5^MZaJC!O24xAW)?nEJa+FgCs)FxBV-J+On~r7w=$gq_4c?R z!~lM0MWluLkgpI8{(jb4JO69E^sNq{ObVU zmRPfe+2+{L1<}+xdd`MKS8B{gb(gP*q@@cEaItClyqn9_I3OLx6rj-Vn7bzQ+1cT> zx;>Z)%sJEmJWD-2N-J^Y6v2k{)#a2`o97}~k_@hi4d}@CP9~6UI=YRCcs%SGkfHMi z!w{*dA=YrAul||&tA|{&jsV)2;{sWMO7)_+r%1rGlf_S=3@3}(a}}lQA%=)5=Qo*x z{qPdURC(S+hd1*{pN~owjm%ry8jEB;<+!FZby(?*IE4qh5;*?AWPTSGM4;*>p`=cS z_EOKiH-OX)ZcBivr5d8k7^J7fwWZmNLVzwHAuFcP@cW(MdI2O>J+TW8QRE{*C3kl- zT5*}=*|Bpb57ETueI|opc<19kQ%_bBGvL1z8OL2=h{Fsrehq3<;rBg${ z?nG)rstEQ-eS6a)#Dl>VGyory0mw$GJs-uupC|>M=XQ0kh*8x4mdw!oLq&n!h`?0} zJdWdgiePNQ+=tuAA@QabaQNAotXm@~I5i|w~P$Nfp$_P3$pwP{r1v`cs z9HX}v$6&xksafg?u?Z}p5keHRmJIz#k_A71N)_XxNzEZjanTRd+`EJb06T`Bq=)@_ zwg^M&t=b?JYN{4Sx}mg;l#iGK-!P4xvM1%9Ba&iil$IWAh|Vxk=%atL+*VA}!V-HHoko=WolngL8y5aI;Xwp|5~Zp(AIZyL76SAx&UKwK zcUn5MZ^0M|NQQJv8jl{JDN6qVLYWoNofGU?x#zW3aS|{g#)1!K19{dTueO(SCzU+K%^kMxk0xs3={z0Uhs@gT$qn%`;Vugmh6PJ=SKlET=UBk9=S) z4t{6cYH}Dn9;gATKTJK^E+y+p@Lmj^1&c9ta|rh3GBFy;G}U8xd}@Ee%V-#l=Gzhu zI8>)z|8QPE)^QhOcI13?sB`-Zp1+^ZLQXqF#Ci5OFxN6Ezip^IUm(HUPDz#N2=L=1 zrQ3kD8yr>7b>+lB};GCQ^ur*PC-@9Jn)J65VsK{aQen;p$#K z%J=6W#Q-9pOx#_2_Z@bLi`tL(lU0 zMQ#llLz%I9u>s#}J0^9Pa!S)pDnP}loK_&?#_u7UzLn%_q@jaeE7$?rR09wBW|o%l zuMXg-3LQR4Ih^V{e?QT}qn**hrf3kdZN6L9MXRaE*_yW+pxxL0gN686uMP(sx>Lo+ zatyVMsi6$1H%VEnLU_)4`xf!`XHO9mg5M0kViR~cb-9~d7QJu@c_mi?U_l7s?aofU z$BKcKAW;F4@HiSYhqK@H#HUc>c5zhR87RsHv#cPk(&2s6TM8pDjtor2gDqLUPx{|? zbPg;zqA3()kp?F~h zuL*6RkAg~eTISWT-u48)qWP>?czHwu@4!JWBm0{l;=X}C!Ox832hS)7tn&-w?F0=C zzSnz!;@g>PJ55oTS1T;OzGif@n1`t1JCs?9pKIyU?rdG0$}T0{SpTo-Iyow-wlhXR z2!;)l=I8xpD9;~wC^j?ZNZUNkU(Rv2Fps2Ku?cO3`P4dND_u5%1)Ca-Ev;nTV7Vl8 zi!IK%#^%N8QzWHmVnSsGmFT28IybQL(wvQ9$nDy9A8kX?zBOHW5hXEtM#GsWwkB#W zZMb#NWSC1;O@p)($-|}gzM+dH6cAIPXow@*eWo+LT`KpiSydkYkc07?fWig?wUlZ7IZbws;XJo>6@;0 z4j>BHlAF$7ib;8Pf!_bgioKH#2StCb^zud|hX*ATcJ%?qg!?ksl^rmc*W`e_451*v z|5Em+ysbYL)eX@}@OG7h2~wD{{V6E)MYxw<>!1dfYmhR5+C2leP9mtW@=5Xap^4Hx zZYuwy`B2o=Ooxw>IcRVM-(`%J;$=Za)j4lQhvlM>XmG7)hnd{`LblR5U%x0-5G{fr zcjL9^>oJKyOUnNkya(P*!C`9n!?3yTWj2{y8heaxYXl-J>=PZ`%(MsC~qPA&ULQ@P;Mu7rjVF^+X()cIrFQI~af@;c-> z0jypG4}~eqyM*u9no|K+a|$55hDYVsaG(4amk2U1v;(A3FCzfX=EX95CEvDr=S| zLwu_zdA=t>0YL7)5xi$_MX6XMf~5JaXTAL>q>aIoh~17-F+()1SpN26%s2%(^o{2$ zd8cx1sG&h=-7#=)kkTz!u|YIV@ZO;*w7ynn|4pnrVH|dIs330Aob9?Kt1cRmyIUH9 z$*3zMy!YG7igBW8Soy84iDokw+`+J$smxB|QR^>%PQYxh)sI7cJ;7Dwd$hF!`5>`m z5zg(}3$7rrGDKJ=^PO(LRF)uZswIWc>(#WBAi!{usqD$q83#9Ag=Z$_x}N1}i>NJeOccI$3d@-9jg9p+09qMNc`#g**B zxOsX#%QP(8;7W%(UT(fdX$9IQ6R>N_j`0hV6LH1;4Ajf6L`B|EBge+)R z67~fFtmyeVf{!Zbt+LUyAo1EmZ#5`e>IFFm$0^mUv`73t@YzdC4Tk?2;Ft=j)j9j6 zw>};8bQA|B^$)UxdO~7*=5fKwG{rLBvxP(@4_Sx}t z!>c>#LVp{%4wNi;7*MC9YC2}eKI25aB9ZGF;(>qqNQi_f98zY#D_Zt73IIOh5#XAa zT@P9H^BA9hDG(->%G3_<)}Zul`7t;9a(d`x>Gg3EpBBY~5TP@FPsx40!rw;;&!TA- zo_=<=4pJ^XzLS&X@g^1*K7pS?vr9-Yz&I*&qwHMR|S1Xq>a0V%62c!xa8l%tG4R zG2~r3d{gZ1=C0X|v^M|r-pO0Pe)D6$?4SxRMoihq^rktRsWYy1^Iu?x%x5=bOZQXh zKE?<(i}VwPI~mvSU`zKSs#F*kX{vX|q(WM-s?ctQ#a7P) z!h@{jGddRK=XaI5L_<2nW#{E8ieHx4GRg}ew+1TcEcF?V^#|K(qJ{=mh(EHb!}eGm z$t6ulF7#2ZrTX3*+&Wq!3&U?MHIx*ZG8}A{N*PRspjSw%I@o)I5$)wM^x`+$Sq_-H zI=qhc--e&(r#8L|EmdfG2bAV#ldUWR_VrWGHu>2ifYQsxcm1XF_5P)A=5A6JkO(|T zF?AQ5WfR6M8? z$_bgswoSp)rxqubU~O0ej-nOi_EpE!D>YMhXSu{d>7@ea+GPe-e|ls|$1s2`g(fk~ z-=iv}H&W3$GEGzBpg9qhU#D?hbDu+)BSbo3D&YP^n&X3@E~70gO{m^a-3Nmof5Bn8 zuATN(9XZBGNHyL3&fD1jNMua9;hn(K*YA3u%nE2xIu`?uR*d=qhYoegXc}evb!xB3 z`%t!ZI^N3jwkZuX{b3bFI00t|`nqyteP~y7Gdm9(3Y3024~;;6zPXy|*~ewg8Um6a zJ~eaPXUp1h#ey*sx=N(kM3ZoLho;jl(-Js(CaPC9vOw@t2j5MTB18Uv3PxRsvzi00 zQioPEo*F*Lgc(i9d2dR9LoAN(U$#oy1}g_?F=^muAizVN@(wUXGDP}oX2p_2SULD# ztA$0tg#gr;AZpXejKDiZ(nPN{4!b|MuUscGKKm&)_nVsDCNHd{3d%p@v%wmKi%)0X zcDz&JhqtF%mx~^Ffr!qBzX?=A1GUl~j1r4Ts;{;W)n zc4c2j+SO5%1_^5!NQ&jz{fhO153+SSGF_yMhMf}tX{dp86R9K2u4=8p0n9Svp1n$YtJ6@qmEoz{-4iDEr~*QoZPoLNg06IAnefzTQMsY zfd{ZoM$wqc-2MgUlVhe~XMGB*gJ0vIv9!FLm5Q645Gpi7<_U^Ip1y@~yLm@w*ZqkqB3b$`^G;}$T}~eiJF8s9?K3%>H1Anytoba2o^w*q z;Y=_^rU~`d0OTklJ&=jaVV_OUpQiVl%|hHc>42FR(8|u4TF*zPL61hQ%0Dg7P*F61 zLu#A$f1=FW3LEu(WN#|c3|GMpnHD=`AeF8SGjr{MxfHO4TVu~4RdAXPcSY9kJY*)L zP8v|GN7aZ+_~*xd8G-C@ZiOT`1bwzf)+XyM_u40grHPu5<&hA59!LGupZRtAS|0CR zCNR$M2~B^OUpM(>p5{w2**wib(fr3^vc;NtqPVrwGux)B+o`JEeq?2j4GXueYYOc> z87V2m)=7p`w@dzpqaBh;P-uCStV|V8z#eY9=lLo=J>{8J!ie1LTd@6he$s-^slq?vr$@ChpdC!6Xlp8@fjKqP6<%m@Xi-Qh0A(GiBMoIkhgt z@OkH2cxqOtGJQP;9>FraSNEZzUqP&V^1f9rF()AN3xd`BGyMkZ^r!KUpT>cJPu>Q* zg_2*&O*dJ)KApSraP_X`3}xa44NPC73f^d5w`ej-Ox@!e?9NPfe;Qx?6bH$apsk&D zAps%%*V`MaM+X9Qix-b5p9~S4kPyFiG1z_W!oG$_+(7|at?5Ym>fv!6zm}?ZfAA1k zI!)Z_4Zm&uOK=A_$avpENF-MvQFQ(D^nn%SAWzQ~4yt40(s&9r4WY{=u4sKI&Izaj zUkc7eKlD>Wrfy#q5b3hX@vF0WB|LjT|F#&&UZN2T~542E=VJA zWBL$(TYxe)duhI;q&{O~eJoGBJe!uMarphF^!xfxev0d2L8=`5I}*jLe(Ca?KdceT zqOXmS2H%`mX4TglP1-A`o&1(XFp9oDpKx>dX~qMQ>lAdQHLPzqdHCY>9YFxRm#Y@| z5Bdan*0|^`j5bZDLxe?*nGS;O9KIes0(U1IC&#A57PDU|Dwn)ycx>VxN({f}OnYBG z;WVSoo%|ZdP_`!<&)&=EAD#I!Jl}^_-e4i??F&lVUXfF--W(s^;MQou-$ppX2V!xJ z4Kw$J{Y)W@D|y`(RUC2$KHvp4(MRh>F>D8bIf~zmTS@)hm3SRY2q76>;=}9P8Xfe@ z=)2$a`MEl&G%MN%A6|*p=+#xDn3H{T65koOsQU7NSL;>#dbRSd-jp{#du9)~8>@|H%4V&Z2{Iv8>Dp*5*(;AXOm{fLxLar4Y3KmK)Yys4)TdG6P* zaoRuAJ<2{LSPpYK-0U#d2Yvl^3KTWIQ`WypaZ-sPK}+A*s>VS4mW!7~E)ekNpyEj! zv#5p_zk7sT-Eh#ZxXbr(%p&JcLc~egTy_$YCh4NyM2KL{N(+^|V!8;AvT2&w&thb^)6a$K|sK(1fGu|?9Jesr`9 zyWl8-o+{wHN_qxEkf%J2vHuS%S9R2OFDe#fy4wCSh+ViNonm|=#k~bJn*N+v*tIDo zO#7LS3tqZHwAFb2g(QU<1u8}Cu`OZJaK2-?ju*my$|S5uBw#lUa&FEGSW+gWblhb$ zJ%1u+C^&?_0`g+=4W^e)V59|$IjNA6x0%#@#Ss~F*h+XI<#)a4q%v9E1lg=rRlj-0 z=WQC2qn}62dKSH^_*Hh-{F;^FQFechb^VKInHUk}s&i&Mt(TextD`wjyZa%wZjsy( z%}A7Z{N;BboIvG=WP*3JPGEvpy-lEmH};Ew6BG$RhA2nFxo(fW5r^o@ylytN;E^*e z3C$$hFa1xPX}%!LV(UBFwMujPpWx971wVxwMl`ua;zZCQDdDNFRQ1fKP1HGqgk=o( zNR0?z*IE3c{qBL4%=(VKuP~@I-Uk{h!W8_G2~_p82(Uls5xFbx>N_ql%RBR&B3QhN z+-HEYySs^g3g{Z#Zx&B|oq!V0MehbZfb9!|%|=7_*TEK26dYTPI!cG-L5-LKHxUQg zBNttdZALOw8agV*U|#~Wy{x+gooM95GPe&|-NlUWK|}~84n^EKG0F35!W&BW{_)H3yZ~!DPTlnfSHkjCvGh)kdZ1MQ;P35XTzi@bH zT(-wmd8vc@jspIox)x5^lm17jyl{Fx-ncNvA5mu>W0uhCi)t5RI2vfuJg781ftSu2 zgN!xq4=cahCSBi|^nz}XS?~nceKvM@xJq;%`5!qN^S_iV9M}!Wy06>+%jsUBr$7(d zU%dcw>HpFC7a^ciO9F&=n(&&Cv>jT|iIa}{e$ayq=YwVY*JS^7q5tUTW55!6z4FN^&{t3pj=&!Ak2f57ZV>c)Gpzz}@| zwZY^SnX}`QZk<{$ocoW@F+MiYaWUbM{*jZ}bQm~lSL)?ucw@6I+qh+QhG5^Hv>=LHKSU?!DYuqx~pgpefQx`XsSXc)qY*5$4a zYcqu7k!JKdU-n-|N7VmU<%ZX0_lYfCkUD7*<8L$a9gLU7H6l;yf0rwJHyHxz+w;=7 zUT=Rj_XAF-D%secP?Z<6*aBxOexvweWfq&|FqIR0zJ@0wJ_Vb$8J*Em@3D>1GBgg^ znvk_rHBs^Oz8j}Ce4#|+MxyMrgp0n1vm$xy!+Ccv{qwM12klNOOHRDp-ckBElL;Od zn>})&qkYMhUOjB{koEK)8`?R2v@5C0hhmG?;R@{H++%|zm}?G){^zIqy|L>oyD|4I z?`)Tzqo3_%IJ3`407BRY7KF!EGd;zt1T&;Q;$rWyTlAGv@UU^imd=k zJ-KizOFieh;m?2;;eTWQlKv;GGYt2uhNT5Vz-;>{ELAa(fq!Chj8Cvl0w=-jD%dOT zt->x}&hKN2(d5LCR(`K=_TQK=A9UU!!YHzV4AkQSuQ(S6BNY-bh8$4RUd)hziKY0! zbV3be!cBrqLYCpn!ON&>Vz)Rh>tX-DCxX-g{?5d{-sY)%J>x2c&98Rr=*))UEVuPk zLel>tHgHO++$6aECU&8=9{=;FNJA$S%09VI6yz_Xp9JTNOI163`ywT9j~gr$_{iQz z6S-Dgj>%y2wn%6MB|)8)4#4Iqw9vxqgUZrPh>`PYr+=WyJ^ey|A}rTD=Z>s&I~rGl zqTE8EjhkM;TQV!w#tdu3NrqFYVGn~d3{L<#-m86YEO90TZ4`s;vW}gjK3HfJPfQBm zwqaPXa(WMRCqg|9G2WdF!J|~)M1UM+u3+Td+i#UAZ;){y0aV=pft*pz@W@ZCeQnUg z1f5~}%G87szN&)l#QNTeFMb&I>3tRVUjR zjZO8-7BdxG8}@I?3#PRGMpj;J4wX?7sRM=9Es--vioWh~VLkGx{);RoP}JsIOQ~?L z_7c^1Xt@}Pa!*hd)r1-z=A^w%bIASf-_{_R5`Rjtr%>Q|uCI{R+Pvm(6cg3M^}izQN`+rFufNPo1&{;T(11_* zZbDYXkjVsd%^A1#Zk+=3j^q$hpMLu6x zO}4dF-<9nSW$9KFB;>yrmCgf*hmfMVnb)V!KJ$`xmJ)}GOSip;?ZR%@txP8{KaF9Q zWUh?93h`nL}LQ(K@m%Aw34hq!~8?hE{%D;e6&A5y6~2?UWotBZz98 z<5NA2kBx(x_}8Hi&ipsrG1(s17 ztW|i$y5)R}!BXy`9s&BVAYw-N%LEh+cy~+t1xI-z&KGGa1$2G7(b(I=cr8Zg7W>nb zN~b*-*9zC(nk?M{&~pFvMc9e-lfE47!5S^BemFXb!Hf%=b`#B3xIJkRnvHar*IkDr zX)$s}27gjMTqXa2CVR;_!SSyPR2^JwH_kV9dVP3u?aa{THLp^oT!$0-Uuq9}`Sd5A zT)`G8d=d21*k?#wNKU30r}{pMgTq16E2F*m4IdbVXP@WUl~rf_+n53w3>li zI8SciF(=+T=@zf}`lezz7&Kme^G&s?K4?msxclNgy7Z(TI3JE;5u#bix z&~duFP0;oFxn0Y|i=fxfBB{}v+~CycEhzMi ze*^`xs&D?Mc82M@e)*5zW1)*8=_nZPJpC2h6$VVNv_uowe6HHqC?To0tZ7{PI!;X4 zJ@`qDn#K|~4%Bgf3dB1(L@Jcs#C1w>F{&ggUcX%5pNk1~}O_^47B}+EA&|Dt1 z*M{H7mkUY-MB#a6IM8arwOwcVYR#TP$0wu@!YS3gC2g)K~g5iv79L% zQG^ly@jR6xxKH%px2U@LERkNbe^9|jhQrwBw0k6>g(I9UG&@w+>0E%}y)1*af#=PS zS@rQ1{HHSHk2R60@CnM-gD``O5#vhSZ^*4Jh2PVnzJbngN)7uaEp^CwX8mTu{Agc4 z@Xij!bUIt(crQ;p-1Z^<_j?D$hnvqrVN4gE@`N+#VCGE3{+sLf<AIn~R^f>c+V8 zjIq>>FR1EcbI8v@+CSF&rot20x(_diNuEF_z)msG1{{=}S>6|>sr7(;emxb??T_VA zH}3=|RHpl54KWiw!PD(cDMPmP6$xL>X#BdL<*-EU|DgCdc<|&=?JQlBG@}ppnD`|cE7(|M{cZ8 zu(jHdWY>I%_b9Sh(7wLUf88Wk=xysi|9EWsCg2~4osIin=g!-ezLms}F%G5>!pbR5$d`*(rtJz>eSReAuaPnk*wP#Ck-bFY2~Q|^|B2ULBj5E$-uu*Bp?r`J z_p?j~5A?&(-Z+s)9<@-X;C&r1xEnKb1_K?rM&hJn078sN7t1 zhOpf~DSej7=!Xrgbhfgg;%^+SJaGa7yZo2ZDq??iN<11|>y)87e~U;maaZEoeS#(N zGAM%OFhLBUKrOnAI3>g{-i~-OeR4z%gHk>k?|-yomaN7WKkpw2!B<}av*(>ZehQ11 zqa60{`)GK<`^SuExy1rL4;0y4CagZW>+JU2z3R%G?gJp{Cu+K>wnu7@L&@;Remx<5 zNKjqPL8BV1{apETqU9kgPdvWVV_^4fR*K)}&EKI_Kkz>ENhv722!9XCE&`081ktfx zjrfLl<+yAj@J(2(MZc0bc0qrE;wSdmcFL!pYa_73Vt;+1TpOe%HvG09SB{I!$GA(LV---I4e6eaZVc z+b{u_t7DzT|D@_4>s-6!KY-EV<8#NB<7RH!ft<#-e!HzlsRAw|ewCTROYUo&!b^Oc zdz_JPd+vnLOotav(?Z5bJis(g4`8Y0H)sBm7=P<}uK|5q%ISjmcK@<-Y>~TCZ#H<+TSPN4PctmV}b-{n4g*2NQv_#OwSt;Q7Yms|Z#6q2q`hwaLu=Qs@DFV8{lej*_bK{=c zHYoZE9Z47OY?h*MS`T4G?Jiz7VO5=p(eunudJ$BcRbRH)c*{3Csxr5j%(uKp!Nc9C zEMXqS0^G#nCZRs7e1<_p2e5MaqiLg%T{Yw>wNyoXL0PEq%G1SQwx*IGv8J`}wk3GK zzTb>u2o|4S-q|uGIRo$oV~^HC{FNsX5QnFDVdxhc+aCnoW{G{#Mx0`o1@p&&wcLfz zPf~HpL&J(suN!+0F!<_7QiFI=WZ2=lGANWpBco!b-w05{b@Im-pkqiL;jQgY=y9tp zSyCewkz**n^p83d91{qKH}NvQd*Y0fXvTt%B38$lB9tP3as!x3@;I_Qw^ujaLZMN} zA6bsRqu?cpe%8x8?%Vv5>Prs+XSgqq77mkIx}xOqoJcCQOdh5CN1sR)83~FO6iW*F z?u5Yz%jce?!-eC3C?Rf@Wu$_P6{7SB3~VV9N5+z(By>UTv!VeY5y#Z0hI?oqNhmY^ zxCNVp;#Y5iG~gzqf=J8hYZOZHZjfhR1QWrocH#2jJVTYknQGSlN|4$WtaaVp9y&bN zfsvXwK2jO`*utoWw2DZl(_Rni&`Gg-XJD$&cK73fHljQtwu&f})7nS_1qByjrpl7CM!*>gG_~+7O=OOb$cg@AX=_c?DZy*BdN`NPWY}p#T`REh; zg$SmsD_&gwxXBz}SeTL)Ls=v=t#nQibT)Z%XH zS_`;lHhI@Ie{xe!TK@pf0aWChfLHqq@tNejBMo_^Me9Y@1Ac@bBvtYOT3|hzB3gko z%u$qW(fwRf$%?%FNdsRO=T90YCsA(m$+ixeCkDgV&aHYM6d$(VSMzgf)vgzXinj>K zA;w?e8pLVTXOh>crKX;kFGbG9_n2|`NdwqvRH7zS)QZvMF>2YVxwf2}sHn-=>qWW) z>WQf*^zZx0NaffgRxqkwt?Gjn(B#{TvW>fI<*l=55BQli7m!P+b*JW{aBlXDX*IZO z3y@meD#6LP@#ghIl=^m407t

Ctl?=Oe%d zvnaBNRi^T5T&{wAUq*a`>MH4qAW+}9rhu)a#vfV@-MBRPivgS_T zDrY5=5gevMC6^r(wL_PLv$3>)=_ck=P8 ztP<$Ua-_Nir4C(@gmN)F=8RYkzr}0tLM2{=C;Fk@`-*r!9l|h?E8=?*M3@@mh*Iei zO2_~#nB6BIG28s&364oH3zcE`DpkjzZrT$`h!yja)?|>Uogt-dD9XZ)_t(&)4{4>} zvZLD=VkpeMVW7%cKCj_Uxx0J(oiK*tNw)%79F$V7kLN`=;dXo`1S^I_26OO1>9X+J zHjIoxJ&@`(>s_LfR1l$aOyrxFeGHqLbCQ4zKtrajQ}?&NL^pkWnPN3JBfeUoIZgy0K9Z9{2J4?i=KwCeXDrzDqbL zELG}wCiL7f^_1(1H_2;&s5 zf(jLszOe_v!YbOgbFP-cFHsSXX7R-*rf#*XJ@Ed78TLs%vNR*736(MJMKH)`BMnRQ z{w^#<&5BP;9W{Og{QK}}u!OLQys!9t-S67~u7@+(5F9NrcVcI0rp&MfHEb^e!Or$5 zQFn5xY{Jh{UM;ZW_eV4rE6*k15r-7^a0nN=hY{XJ#t_{_--PE`|My=$F|J)m-%`TGj9_0=iacs1V4tg=A?<(@lq?lH)w;GZM zHFF=2PjMR%N4y&No74$rWypJLgtF0sG3Z5@enY>{D$7K~X$U6l3~0}N*oAS=0D@-w zw}PuvmG_2q%E)OUUV>?*)@&C&x7#giUNi$l@5z3* z==~k0!*qxtd3ZAyj)xH@IC5Yx;0WjQjrRaY9k#i5br^vUCByFm&$GMTYQc71Lx_?Y zWhl-`Va&*_`kxxAX#^~iJ5uFqt*KSZ^%`pRfd4GUyQk!3!FyFu?-wLtduX!N*ymC) zHho>wo@X|EW0S_;@u}teueLj^811ZlE{f~B9js63Q!7i`W56)bsyy+< z^Q;!2Fi7iG>~}e{tu`OReH3Ld2YB`7n-s7HGF#4gQIZFJC`b=v#nar};p3jD6EnJ- z0N$mB&3uEVg?xC5)kHIxp7CS^rP;5bXXp*(-j78l^8!|8qkx+$TW~fK@~aSPX>}fF zv!b=1AkIvBQBADxiH>%b>wC@WY|TRlI%BZAW03bK(*i#{?fiN_&?Gh}0AP;v81>4U z_R1RcG8q-Tim5o{Q(>N%dYC5U^yp@}igDv(*vW zCcXa&R>r+vMg?|Dkq`HqM>IYNo1227U_ryK$$mc%?9RxO<{mX@vJX?b+rPm3Q?|hF z`5kHp8L)TMlVaLyWzji=6c{Tj{JJ%pD##4)QrCx>fm_(ir!s?pk9hAiH{baCZwE56l zE&mpu%joy$;DWg|@SHMPOe*yfd|)7sUE$^f(qwz}(qg2+Vko?}Ocn^GUY@kUkIHN# z@wMnp&j*rK*+ zkVd*oQbM{@>6Gpekd%28n|6r?+)LlEiiK7{1?=it5H{l4da*p6p*tiAR* zGb`S;_6%vmC$1Nr43KalCywIN)yq8ZYm&8WSpO%=y~{~M>3>f9es?Y>eHdpW&DZCa z{brf4X@zMEBkGOsl%g3<%bqI0rFP|-957`@go9chsq95=f=#f`GGZv5^g zZ=J1gP@aoL*eOuC`&Ym@B~uA7qyo`F<_P9Q_iv#qJFMImEbsfFT4g>1t#+13|VqTfchQrX3itUmjRCIW0j z0i=a?TR}veGB+9@7@J3VYW)@m1!I)Pex7<4C4r}aUslNm#6)%{UDPD0@RWLiC|YsM z@7$X+pJzu0)}zcXOK1zCY?^J&aV6^dW2@!EJkq(wkM2QvC5h~)Lt^iFwG9b(nt+7m zjN?tWiw5SpNY6_tR%lCYbyWZ63x1}rLUF_I98_gpuXi(YHrKi8SQDZ1N8RR)hZ!a! z#enNbPoBl%su0zXg1xGN>qJ`obVki)H&5}+@DCeRDp#SB+pW30@jt|$l}2_JT=Oy^ zha)e|{_9!5$CN6x;HE0->LUB8Z~lkYy%Od4*MDZtbX4tk6-{{{33jXyvK?*+NNvg* z0Q_BR=qiMyhJiL8fM*hG9Ok?(eun z9k28dTIXGnYroju1Eq!kGVLPWJHpsd%5)r+LrC~QD>x6s2+}Z<#9$RcRl(Bu4b}PgyA!& z(*;I$j1KEEqfwCE=b$;<4SCO8?nK~3hTkFEsl0>8?Y& zitG++YU1Oqq$Et)Nk+NNQKV2kt z#QbD_jPmSNENe(2&3Xq)yog>RCQs_5 z(|h##n=XEa_Cp!|jW#%0`!P%K6{Q25JvZ~tFe}jr>)mka_3);H;xF;*#A=Ag%%gO3 zoENl1CXu8vc?hgH7ag=SnU((g;8TKd^$#Qb1pC{(K6>WBeeC2C#AeDN!7jF!(8sSx zDdjCjQ|-bNL}f6eM5=B5oe|~y=+*CybZ5$u0(*%Y;_;tW^$3OPC`9knH`BGR)3qi2 zF3#y=K$}s|RVB|$%qeJq#`>Gng<)22)w_D-n0o4%OYU=jUB>wP9@JStu#)njzw@6y)BY<#me+IM7= ztH*KEs+IW5im=&gDLMUd!~RX#M6JZlGmoOMS@1;bC0nw8HUj$MSH+!w3i{gDBPZow z_nSN}<;MhLR)oNq)zlBGCF|~+^!Dt+&m3i+Ic@@m2xo+tuh_bUMY1IzB=SH;<{1AAYObOZgghpfP|wAFF5v2#5u zGEQI%ayqqOmDq1ZI0n{-Pt=v?{Uug6d2TGXRwbJg#@Yx@uzy2~M*6ecY6(cFw0{3; z%em{v+MTyR>p~i*KDZzp;-Wn{sP66dP>u)3jX7JpbQ*wT(SuP|hHdn^RkwOHc&PyWK@VSv^J~uKXaEa!=(}o>3_O@~!LPh*%b+ zQ1~UGPt_)Zg6#bG{W3vD_$xs~>lKOwNtR{|$Pd3=TV8i6j_M~St^jR9hc1DcMKdim@+)KYTLRy3XIDt?^2$g#HM!v0^AcZL%)O zyQW_A45nUyL!h+6pJ7&#)#o1g^fKwgTMIXpM)3v85}pPQOt;y+F%UL^pm z`IaOtsjTP$3?C~{lRhkh-Z+2Zdmez?@QQmN8C;xrn6-}<$%&wLg1`Iz<^0j=c)Zq$ zuHpdXk~5s4ia@8MQ)|42`#VR-Miqh%C^T`(G<%Z$<@W1Pz~6cXlU$=m7qH!vok5y2 z6WI^UtipI}u2lNx8j2^kA6`)f;C!v3#+GK(_8a8v3Al2GJ6%R2Xm=4zU|ocE%^WdP z;E$TbU_ZypkSCNlJDDlORh8z-P$ZPNDyv@MH45Y@S;b#FY5L}jt+*^|6dqNw8Zz3= zk-Tio9O11La3#?l4!YZAAj0g-u6;W#(97`vF)Mx!-UB^tXVl#lfP+_(UNkgK>%>Q` z#uMkT3$Y#xQk-;4Tz&qs^w0cJZ+u;eiYd03u`A92!||? zjCfiIE=8~Sc?LtUh=x2x1eXq${pvy>3)mx`T>?v3ORyGGHdR8X7bh7*p+NQKxkdy=U)@LD zx>=0t_MuGF%VZp(yuFX2-{~E=v_SM908+S|0G!dQYOe`0L0V?kQew~B=`XVoUf@R!zsh;KFWTlck#ShyZ;br zs|lQ^)$u;6)Q$dz|GP$y*oxm}C}iP!SRnA(QpFOC#KQbAfOj=rOb+^05q$8-^D-lz z#6n98D}HsKAXvPjW<|S*N-&v#TOzI^pbE8dFve6eV_^d?7ioi&*MNkQK3?piB^|B7SSm2a1Jt5K%*mSbjzU zzj2`SQ5r8Ju-PsDWN-C1=xfiQTCc!FK|Ng9PVX8JNk7sq#2f^9#yN3?;}{q=-0Spb zp~;!FQj!If2|zt^qB=bBWc20R{HwS1D8E)du_B(kv6IeJnRNsi#9#jGp!^)sGzJ&_ zk8Krkj7HTpC^W1q#rL!Q&F3)TdcFMd+j=D*e~3O~x@ToHxEU$!KdP^Z>o^3mi}1`Z@f=k-fWgk^HL7 zP&TWdT?0gp)G!{D{iua((pZR_Ws(E0SQ-Al>7#Jz96165p9cO*E#hOY&;S zQTtIR^DRJiEAB@o&Jz<7l`pnXC}+AoPV93QMs<3*{Y1=1GKOj_AN36U2pXiZZE|w^ zzY`p9x97aF&&R05YOKErTqG$xL1*yqJ|@Gs|Jdi7GkUhoBX+GEBR-k`@G&kze9~2L z;ZG{h_}7Ozit+b{+^slCQlf@LbYm4jRSyM^lDP;$yLLTFtva^5$+`k_@KcD>$m63i z4Ly{>EthShW^-Z9n313PJm=fWV&KQaiTtLsZ4R+UCD=#9^C8b(U7Z3m$AFAA;^!2KnVpu{*-JYy5s1hF;Um!;^SvSfZ5ni^v-7R zz)a&mk&^%KTBMl4Xs9AjDkRVLCRM9}=_@^syF}**gwb0LMDHq?6gypk1Cc*xl8=(` z6k!(56snT657Dr#l}xv_n0qdhDO=`n9%rHvsYm-K6WGs7=Kg3ugL-6r`3>YtX*K z>{E|{HHLPX^9Yn(UT87PTtiRYs|04t6a-q2l}@%EBERxkB*ZEWD=oSj1yJ=n12 zRP(JPv2@Tg`9)^|Nh?=;JN%9=jmezzk*~sxQm4t|i%(U_p)H|%0E4-cNu$2AU{+*G z3xp{9DdTfaN?+1xU)}{#NOU!Zi0|*;gCi!47esqS>qmueK?0<6zVP+q(vW963)jow#Ht3o8xgHfBl_^#|*la{SM-s!| z+2{uGg>nQK;gC-ZFFC!Zu4^xHgYdMGN;rmt)(_w@l6|F=aX;FHT#p7SuX;>@&Hd*8 zbwPF9jtEe?fcV8p$p!&}w=iS^ru`?cNW*Wiv+d3VMPxsZl22RHHJugs_CZgmN$jzl6O6zw~Gc zS%RE%jd4C0RF*Jj^RK?7#rY0?1EX#4Bt8F$43j=vEPoR%_siV0@#=S&i=L3tq{=rc zs|tASRcI$l{hnn5MV8dzt-Z&cXaD&U?Jpq02ugW<`3w#UFCLg3q1M6KP6OPoiW0F! zN?gN~@xOBP1*b2j+A{3kb#%8;jv$HR(28@s&vfn1t(H7(A~%6pr9ksBOgK(*H$&y* za+w!|ztVe5-}Sn+aoxR92FNFude3^Rra27=A0xd z`D910NAQPUz@tlqrh>~hTESk~z+!?7|6oQOcOd1Szo;#G$I0S)?teZa=TJxQ$XQ&E zlYHw-5$oOOy0dX`ZLD>XX*OzcQ063`9PG`Y>g|`1z2`cOi32{|TC7vkLrJds{;4uX zri(U4WR1yGtouIHgOBI9kAmyJk5Ge=%(4TbWCLz{nS&=31*G)DB&NNkw`=+BB-*{3 z+CuwLf4Vjvgx9~y6JfdwCGsr0!0qDR56lNc#SVv zigG?k_On7=>#oyU6--1qlf&c_!sSGT)BVH<&I%VVyp%GjvsWMuA`&T0Kb#Z_8aE&r z8-x}het6_3;gNI(XNuC9Y`rtRl@yAqK>~)arMM9t$jm0;1W@X^+N0qeF`X>}F%ioq zDya3Thc&GNSrN5J^|1b-=Jl*S1fB}>*bJ=JkG*fNbSv{@n}sl9tJ?)?Acm5gbxStS z=hIaDC4+|;F;S5XG?8Pe!{|7W(e$_bNkDr(%_yb?X$ZzU-klEop>#$0!`&Vo6eSr8 zAB>4>8TcIWGKX#9I{J+ZNdv4Y8NLN_A9$0$ROd;SdqL(? zcqF4h&O{No!4z$?d()w~=v+z7#`B#%Fv6SF;Yv;`M zE=De~g9i713JMkKEZ`W*UIlXCgqoiS{@zI;7!%Qknj3k>)l^R=aQ=SQLD=Fn-4aID4q84fK__^98uB0 z*Zw;8*T_XO!qhF8!Fv0-NXYZjb9T>tI+@q);-0ms_*F8MJA5Zu1_Nyeau7Db~tm?ViL3}l~eB^VRW8=>R0ua} z(U&VGLcQp)4N=R?LCnDT8TBF{LD=LFFW&bPjA}GJmE(%MngsS#v z!L8Ik6g8)+LHn>$id0LQ@Mq_+mb=FjkCJdhb)0DRhh)l~@|EZD>(eZ+eL0@-*kE`uWQow1QxHI()I_N~ zdO`-l=Q7bL=uq8c6iqN)B*G_z4P9h(d2|z<;!+9r7#+R5u>whC#SSHd=JlX~PY8(& z$ei@9vY**l)b%xTz5?quLsE4*eF48yO7A^{nK@QDGI|YKLl_>rlE!(HNWQGSN&b975YSKniE8PZGJHf?|!3eHdR>_ixjaaI_^2HgvfHL*YChGDW> z+PpKonQ)2=h#E3fE!uUm`*2YyN$OkyQgy-4gptmb1e?6Z=%$EDzRTA#ES~I@G+M~j zc#_Zjq&p;Xsf%m^SK>mx_ej32=SRNG5kJZ9cKuKv{f;;LA{6q661mq(ycIxln@I}S zx+^}}?F$p-Sa+d~!SFWfU)z&1rA$7n&*=>lXr_i=jV23|G*?n6gH)TW10`vg2^PZOHKXtYlY)$P(D{BUU21+$uY9Ll9u*^@!j}$2ta|R5BR<$}9-XsVVhztO z<`DLlLF9uA-I8-X*!%9i#d({*Gnz-?F7z5_T$0G+Ip}Prkj(y6>0yLp=Ln5gN3vda zF1@GD{)nR5ftN`B8p^@{PV?k{nf%@5DlRYP=h-9dohezDL6gnkbBKsKmbK_E}J2=pC-H~*N zweuWWu16SxpKC$?(6a*qI#TKjc?bNw#l8xqKdxTz((E`Ycq%m-PJp$HDs@333&BT= z$P>Fno^|z2JqzrIj)042AMZ!mD>o-4zMHNh#~n|lHpBS^&|<;F-{lwle1oQ*la8=J zuw5i6fZWJ3rV`|c?l#zL*uM~=F&uXkvvo}9na{?8ujBlHI_Yy;a~WXJKPjC>bXucc zWbyuc%C_!5r?JI_!t7sd<5ULye1OshXzhu^YF5&j+t7k+iEW9hlDk3aWc3qCHh$Kr zzo+VxkdlDkZ9rsEfiU|&b)}OUnMB()-`Z=mVC4SR3Wv|j!$xalChgXUi-|2|N^n!D zJz3vD(}z_~Ulu#vC})__vIYOmgM0RQ^Edho65bj_3&J_K_T2r0hCXtcIVGDsUz-8G z;brIlg6ljw0LRE4(aU!6nOM743*NMWAXrY6L#Ur19O?=#ML4}WTy?8D|5SHj?}@eC zieR@!_KA(e`Js;+3K;SPQ95UMj!p*Vu*s6m8wslDR*W7nLuy%As~xLKed-%Ykq)9& z$)+4s{9{EZ>*w$?T>73vNwIDv`#@PQObF%0(gF~J@^IA}fJwm%kKWDEexgb`t15_K z5M$dhSHMy75e!%JR*RtTWh&X!bXwKh!TEC1bOoJ(T3g(H#O%tWBs!?FiI5Rtn>8QD zj`Gl}fmLlg6P1?J}S{Tp@v4`z=(RxOW9pe;m*LM4B{yY!%t_?N83lHiM#N3ydWP9Sba8M zKqN9$^cE>ASTZ8Jsj1;1@PZ4hEU56AdQlqEFNM3^7+asY`ZL`*5|)SaRS`{h_`o99 z_zvMD)AfWNUGLp|d)i_)>pD1EwnF8e!hRnZ%mq4yGpPDAI9JXDiwboDZZdTMNyCb;~s*l^1&+v>JeV|&3XtgEPmrLUx+DMk*lE|CxOVig_OmM6pd)i10-8crMfo8 zGutn47QmeT#K)$BY;~WRv}nfm{6HRr4HEL zd-c?m(VOqbCxs;Cua=(>;*nB~(j70IqBB!@eq<<^s2svwD<2{RD?5U{S2$l;m#9uy ze-e)$p@}a@eKP#SmQjJ{N3=q#@*&uMCrP1Hpg^bc_RS}uc&${o)0FkGb(h%t^$s`i zA%zr->k2C>z*k3&<9NT+^}#3XjE}hW6C9x{5JQZ2im&@+;9vD_&v1Zd>MLkw<{wOx>u7;U+JL@LNCbH4(arWM8kY5fTKQR;Tn zmi68u)0FWy?|;pzr1A49ZqliKjtow~QkpJ*7Dy7F?oXrCPqyL4SU*+nZG^S(*LSy0FaN{}2=SVrT>yaxh94Gm5v<_4jU` zFaqz4$SpBsP?(XJ+^LhccOeL(zh3n7`iu5{iv_an1a7l!TETEWsUY0e3W8DSKUgmM z3ASj`76yu+HHS!5pnKJJVbt71a#|=UHY#+&r*V_X}R25arBDwmo^nK()Pgw*!UH}Q&lM4 zHp9`Ka&$-4+>no5n1fMuQ z^(4UV;qa?omdiz!K(9D{X%iMB{nU@Z0GjVCznQelT=Rb?^C!S2ESMc=@Iof2+Lc?0 zU1pzpX;T{~9py`4FrPoRN)@I9VXiro%ViLQF$f51VT^aY5YdXWBhP~x#O04YrVUFv zVy^L%TTx$sDm&)xh)Q$6RY>{;aDcxL*O|jM# zD(13pr}uC47=yoHc3P<#f<1%gYev1VTDxRGV(3bP=zWY$ASq4}7=lau_BWt)W9;rS zLo0|Wx6Dita`%4&#xO|K%9(D;&bwG~p)Ux8cO z?~kbpW@B{wVjdCgJ~;^&JEQ1%2Aw8sX-MBCy3^U0OXMhZds!I8YHV+=PZ+FBvAnj|H<5rWDbSE1%xK?R3YhRFWAin~5E@+_UB#&=u92bdPq?nKk}nAj0H3f&IEcOk1L~K{TprD3ac=ay3q9=l|9^~ zxOBs&QTJ-u8c|7=pjM-qTJR%ln?v8zSZL&oq88{P(!&ukW7-dfd4xg#>9geddlO7x zq4FqtOAJ%aOeEv)))n-#tim2=(D*$zz+QFsYmdyq@6Y3_4!cFMWC!G802HOxq7`;d{9>lW`a;%_Eh@GNv4~ zSzCquWML@d^(HS*aVqLCw^Ne$x1n^aMYgO>!ji*7;G=cEB2PqG9Xx)z?YMH(YXjcN zyi}s$8k-^+*Jc_6UP#Ur30f&QQbc1R9&23m@6@ju`CapYRPy0@n@w3BfwZ25q3G9+ zysr8B$HT!+M1J3v)2}A{o=o}oba`R7@+P-?GsD4}{~7V^EZr&aEWL1PD0$Ocs+C`2 zc1;Pw9_!7cod!Zcv9D!$dGbPrI791yiqO z)m9?~XuG0G6WQ}G-7%SUCLE{YmkO+TQJn1j{!dBmyUyz7%Po1q-so^Iph!6^+5ARjV};T%5r zP@fj^O&<;)SKg`f2!zdd9NhSBaj7{`Y=tJ4_gi!j3F1_)#%-(!edQ%1OYt2#hyrn{ zT4VpuQ5d&AuHsYvcKoyS(cXDc$_&PqueRxUq=@wo%3#YO66NG(a*HF)k197ZvAo!L zAco(#ts+x;Qws%gxL(U~nb+yb)$pbSKqG8TuOr0WT^?fP;B&+l=at;^4|y^hN#t=` zc?(6z0oH&zY$Ft-dAKrjm(rU_;%aw>@?eH4y#EtI_vmo+LcNfLZBGz{)7OjNz5h;^ z#SM#DPD>j#PzHB7Bca12;+iu8`pOdmsYe+R7|tlbMR6l%P0zO;Ki88czki}qx;X@u z9ly0MdoWxaNR7f=oe>?u2qerBho#V{qk860eL!xS`6pK1U8`@TFCMnHGcu8Rf)1vv ze|Dzb^1PEiG)0Rt<3jtA&2Y!I6C;^jC{mW67%*`bUnH>_kahUetqa5>SZ?a$~icI;g0)A zBI}UAZ)cbmP?2E2CLNb>njuA`93gq)((C+=hqZNtWYoC`#8zd%*1;g&yI-{2c{0#M zw=FF>UbVD`MP$Fe)7mLkl+eB|nNUj%C_U?|k}5sZEX-yF`LR|2v>RRTiSw+k&nAnr zfxD9irW)sgZ6M_^;m&PeuH;_sI|t110>B+e;GPsSF^51<#w~c8#cu70JvArn&giwC z%%r|eoQXA~cL*M?LjK;#KZ9jInYm@`(*3ZJk8(W_huHTmt$5W&hj@QyfFROQfe5wj z`=XyMM?!F@QtY=`pwZH|EcmYogyEq<-<+`*!!Vo$7p`Wjy}myN1aah+xs8Hg=`+ik z(^(H#0sl{FLL+6*`*XScm)RPZ^9aCh24^C3G^r0|$Fm&8(XAYL#XYtt zgqKou8(5Y?#SunYI>DANdcH|HIGLHv{NX}xLMj$p*6sL92rAg;p^Mj8M+o+gXMeMW zbtB|m_IsWB@oEh05KCd^F{vPIbT{>!5ClpvPgN2XS-5+_g=XPunKO??*6mqd2p;8! z?PcwVA(8$u7ra#nuhjnqu%xPSy&BLrQw-MhOI;n*8nTlLFZt6OgsFLb z_4C$t{mVUV+Ey=tKv6wcPY6)rz8RAOHGX%4+w)~r4fi%-zG$7Fp^l|g`K8r+R!yzc z)!v^SZd*ssf2d4dm7nX=`N%B^~Cw0IsXWG`*IWRMjVT#(}9sS~iLcdmiCwIcP z6ac{BTwLr9b3p_yr-7Huq5dWJ-8e4>A1-Y$er0pdre3Ap<<+O`z%*jYYBQaBN?Pi;3Wf( zF-C02-8>UK((`5A{_V}HJww7agSg$c6*G!nMEg1-LyK=Stl>R6{!asXo=(OQr*k#V z%y;$_ePrjqw5}#)j8ZYua}aNSCBxdIh!AD^M(O;GK)%&=N*7Q#gNfIpSRGYiqH#OW zRK%V4N89hHA1wqYD%y^fUod}WVei!?Z`1-MO8_Ag!Ojhd$v(Zz$y0;oPiJKq&d;Vi z?^Q%OT}|*_Fld}S1s@9E@$cc&QCU>U{ms+Ws<+~O<`g~*5ZxLt?MDdyGHJSTcsM57 z1=rNJ9|4PZXYb{|6hL=T@h#LQ9Mgafi+N|!jfti6|>=MHnkE26qCVdxx{93ij2siQqL3={xFjyMB zGgjq;>jm2gg1(#cWD0se;`Q-wa>Le2gRR>B1WT5xlR|NgF!C5n;0PMcD~CYYdQ=r> zYM7OZ1e$ZAQ<9eAP|nR^>Rx+q0Ofqg(cDm!6IqyLOd&`W-R=E%&6-T^Bco3sIty+p z77+e1rjV`L;fdbr%IP3~4nTdYsd0p@7Fi%8#>=ky#W9wd;u-Fb3*zN77u&$`ij6!1 zQ^1O;%+n9sAKsahjQ@yKm38}66pxxIx}D&?m8%79YvsnymtkTTwjBpZ*C@e>v%xL{ z&67-Bs@a$#GUMLd3&v-tL@Hc3tDktdX%t1jJ?V|QD|MYYar8u^ct`}sw`!{A zK(pp%W?Vz8HGm{cKStUxtZo;s!IO}Nx2D|f#ksK1CY+W0@pY6iPggf7;|Q*6_;a2S z@=TST!@4_-{my98tq@YKk=WPaygW52xjmRTuQPC7_dk0cPRczb@BCW7(eU&rkHvAw z*&>{r$02Q;!8%gtc@Qc3kh)no0*_Ye_?q?U#DYCQRsjgg4WW61z2;MByD&*%L`q0Y zMvl$GQF%mD@Gh0j8x0LfRK{O{=a8*W-;SoF*hLX@ht%z4uX&JCUB0KVD0m+E(}KZ% zOsUr?Jgz1u-3XBcpShnWk~$6vdJiQOHmQjd_Gws!v+}&0dpzngRc%kR$VfHhYy&Qe z0!X7B#7lc7EN@&U&y&c*CMHhJ)S z;QuDf#xDC#ITKeFG_~mxs}YneqHrFxXaMp1GM0Z6&mu3c@cu+C`mV-2LMEG7s6L9m z$m(<@@BGyJ(|P;Lb8pAy&0hP5gW8$!W21~i)n@XWmmB8>12?{=kX=4flc<~XaJNfp z9}5Y`=Ar?6g|?(K@UWP5s0x+e?~MGl8qk7hd2g`!#p<7f;};qn9!peUSj z$|bbGRG{6Jn?&Y-^&kVI-<5-Av>{M*3*q#Cojg9tQ0jK&z=O5iT-)09`_UTc!^a(c z`+0n4O5Ha1kMKLjE?2;kVY!$CAt)x$gRLUEkmj(Y!Fko%&$bWl9{C>(T`m{*q97cI z!ddl>>2Qfuiu4p4;HtVMm_N&x1Lwa=179MT`tYCqkZa}f2w}D|7GWFSL82ty3*D#- zj)L&({OWVMzd7-sI9z^f=XI^R??+krCwy738(&+RZ(bhD^t|x6l*YuC{pWKPJDV$- z@6#QW^%aRvsrde;#{+1a>{m&}E;Arfg>_7j1#f%(YFo_qT7FV4O?=`kj5S8{xvtWF zXKt(W_B*D!+9OrFKV{h;D@<&c6!o&m0^E25`f^+O+G|_2OL7Gy_>Xg(_|!{dH2f2G z^R=i=um4Pd&F3X6)@`)dYX(dF<0co8-~E5?%^}9|HeB~l0dke%Z_ne(VvPJ9cIV>A z#0hiHTqy%!j}iBe(CBiyb*_=FZ^f7F6K_3> ztBuk1Z{DTX$R4`kfOEah^Hx0Xp{5@cPXp7x|K-I0`tyWbW$WtCW8dFiZ_~~f;8-uG z+TY{=YSaSPteRcmdl2`Pvs;_mL&Pi3PYPpb{E>DnRF^EAUQoDj^4)I5^yV|QXNYf} zg$b#YoP6z2XLt(RWd_f}cY9YhgKPSp9o%1rtJ4MMIh?Ss{)^G4hPbJH9D6s7L z3rY@Umns@qw1I&3db`OCY7?N*1@$JwT9-!g0Mi!(L!8mTJ;%&}_^~R{gHRSSLG+tk zG}VrOlTKL(ih9o_2>O!RkwJHk2IaVKXXQyk*MrrA2=n7YzW%H~AI%&8oA4(nXB5`t z%*40(vv=g&8Ha8Mbu5+)hp>B^(I#|z3kGIgsu0Z;@&&OOA}_K2(NU;VY;-Toq%P{s zds7YJjt#J{KVjwzaC_sBBl#5BfMJ34Zd$wKWb>$3$Dl@|FcG1G+bPkzY{+n9x{-@- z`d%iv9M_b}I-ZQW&vcP>OlPx3u}a&k;*|qC;!y!z_@^I#Ade;#V|9XSxbx0Q1Uu?Z z3u|$aW(Pj$B-JRkolDx?4vc##PSkuVO7vl+SNzGE@Y#U*V)3wo(JK4xZ$5(FhMBe0}C$>olD40an3Rs89m@Oh8<8J|?7Mh!^m0O z+tKVrhYq8>`7+O={U2}+)!f(aHofhm?6)dY0cHSVgGvzu>Mo{bb-P>e@#v9Y zGBvmbgrMsd2!VP_cnBdEcgV=8D8Dp8*jnMvP`D)0?j0dsrZWouhWllM_3t&U{z!MC zMH?W+(yJ(BEMjj%F2t1rZ(3*g^`u_!I`NUFbeGm5)`dAYezMOIC^n&XuwWFPXgJd` z@Y71GU@777z<>}7bYJZoU)@G(nTr^b`~13B*Gc#qRv-CC0SYHU@ngiK zEsq{sy`Jg>YLt}T7&u-}%vF+ZuE;esIadiwZ*z9=RSUNyUf8a=g*>^g$3T+kB90g-JY;X9%Ug*+;}0K){5nPP2C*Qu`WS`Ak_ zl9DY`3Q{>@CUzjwg<%}P$ zMcwxO@9KaFykjIUGG)X266)gWJZoW064~UeYQMFu85aUkjA!ybRDjls!2O4o@{HKo z<b^|zI6{g0 z*bVOYzC|t~S$7B>6X~J&$;&@o7VS?uYSHC%K1vp>@CX8MWPc)JZHHha9kpr1G(p|> zjcZ4g^6|p77i&i*jDWIWVEjO8FpauzH|7`W34I#QcRg!=rG@YJ<_>dq3vo+yokAga zdpZy;qjzuS%6(6MM1D8CoEVOjt+?sg!aJxstn;LwwQV^u#1pe=Ar_Cc8S-&*dQmgz zW9mp%H|IkxlqWWQ<4c$4Vt)G&(w{}1^bW0!ali<5E;*~SEX_^fvWoDR@ICb^^0Bx%UL zM~xNr{?U18YaVrE0L^ufx;8J|INS?FTr9~mG%ib3t-5W5yj7W=C>ga7`*|}=GEc``Bs1+%#^Ab@+Ve(aGNVv(^xHpu5q|VXr(|;3O7bag zg{0e)P+h_Rk5+UjoWCxu_^5%ejaoN K1{pP3^#2C}Dp@1| delta 239971 zcmYIPWmphh)0UQ2K#)cyrMp3p?oR10k#3fh?rx;JJEgmk?(XjV)_C5J>*CMuo^xjA z%-nO&41||GK<0zL9#s%yE^+vK(ByGs-#L+iI&`|=nIo9qV(%6hc4%*jZ8~&)QojfH zKz*y%B(q;<`-qTxO=a~DT@{JD{AxW>N0Qd}w>qK}ybYwh-*oKfLY%<#Xsyf`UuZ+b zN66L{aTzR_=kEy1|_31=tvp}lvG(HP(5hg5&48dHe8OCMCT{97!8 zR(*#|X2yaUZWZ!xVQ4TEsSI!%WZo>IK+p*Wb&og6br>o0tP4V{HvG=lI9Arv|xY+16j~(r{$RSf21w``{us|;{ zQM7({0^X}mcBwQBU6Q66xf3P7o2-nUPXwMfwG5EAdAp)4mgZRV0&XZ#UqmBF6_Ojy z-KlI{)U%Zsa}v3WaMikmOav-k^YC$|PLo3{&8SZ0tGurr9l-Qoa!47r*B`>0=YUYX zGTAt^USO_jlhzMm!q{c0=`QLap##)^DDM^s2DkS#PtJPBx}Jr5L^z?B(J!Pn=Jrev zO~X@Kc*5_057S~<_2nNP58!j!`h>FVj>}`A>0AKal5B++>CQyh(u}MzARTR#EZDRT z>uKTR@bfkFFYS{O90Rg+pHDFOdz|svd2EJM+&}XAm_GK#02y_em>9KkXGp-L085*& zb@b94L#Dy9I!{YlDa2O&A%$nswiy!Chr6YhsmEJEPU9-^Czt20#d?|&hZ0jd#({U} zx1nlkEf`R9E;;-h#4Q|>o15?r%Qz^nJurW6(<|aSad=B#iuO`F6-3jyhczWaTzlKA z*seUpUypnYoMOOlcbYmoM?V4NNPfiVw&$aT#mSizt?7zOds_$P4EhyU|kE;P^+Q z)brIY4Y}$8&3U`Pmnk0XVLDUHBJ`&_ft<1|$ zRYnhxhXt{3lV&cJVt@Y##rtb;p(x?S0JH>ir4ciFJEJ98;$md*C%P|3HL;iP+;$>u z4LuYHDRyrVFzZK}qfp_J8SF`OYKZE-pnPW@{I>YrfpvYWeUOGuJ*py_#b4L1&3(o! zP8pd3J7hd6Q&IfOQ%-I!0PCz#sX*gF=z_OnA+K5rqq&RxzW6EhXJMAmaXlxbrLZia zGL)t8F67Bov+@g`U!C|Qw^cHIISsY7>6*v{V&pl+tu`e0$KHXEeG=3^ofv;fQ_>0u zuq_b98;xs=d}|B#6lEzhBWZ-p{+23jSRXx@SSR(wq206n?n(%f0nkrr^_v;|WV{)X z3{gfJ-en~_Hsr^<%=371s_b*LdRRL8=7$$N@)EMvjw~I;SWkzMGfMexGB!WOJLK+I zojLe}aJbm-VI4y71E1E~vufN?itEa(#rzGwL6hTh7{W@*$G(#(D(*bCnODjBNEL~u z8hnD0H#&3TzkZ%~@)jt$Vt440ZADFz?%47zDhMh25wspq#(KkQq^OP1-Yu#(yFiRY zY6tUCy-Ph=6S26srP^%9NB(ViJAIIzbF-uIpv7z>CsSQJ{*D&s=Gn4a82@V;>RLGLpzp=)mRnJSuA6>cvD z*{VprM3+@9Z3|hQ%JdV#=G%FrsnGhK{Mo8vvzak9P9u~{wvR3-wqytjck(23VkZy$JljFczXTiQdL}<$Glk}{m4wpPh`!K zmc6hj`k_YhsxgBgrp`ldEA`S?`1E^-M<^P=rXFVBERO#GJT=IyWk{YsYiamXsZ>($ z9@Ug#O!WlFuyA3KYoSbwuabK)7B}g!*<)C~>-4tczVSn%6dholtQ%%(%zWi-VP`7z4Uu~if{6>oE8arknl zHXq73OC_4;0E^ZB-SO=g?X!g=GDf>|a#W5pV-%D=S>z8qDMAys^<`CLku^n?)sDY- zMnxGC9!~kVijk;Yn}V!qE-5k-$ zh89&uvVcS4@b97;vREQP*ZwS4>~-NKMv$27ZksaJ_(5hIL}Vo4b5UMF)Q(pHN%xwXJ#E_Qmn1* zvSdq8ZD>y??`}{mN!_}VONjORnfhycAoAJ3839%jg;P=~cADj8)%{W|@0tYc^wUH? z+4fwA4Y5E;-j3#qy^(CxEEAA=jn--TIqV*3OMYc<_4w%}ejy}s?3>p{HYp|`>utS9RI>9mJKfE<=R>jP3o(fHaDUpL#mp#a#v#i!=Sx zZ^T=kLSs&O;k?A6${R8Kh2H}eANnnQZMOv>uwVz`@y@QA;1V7|Lb zn(*o)uUd`h>s)-VSc9x5K((+XEsbZ)SUQ>s7rpG~X-a@z68!p5cOecdEMJf2w$yj5 z?uzT+Dw5a8`!fzIG46WjSZCG_S{$?k&)mf{>|FLvqouj3hRPDV;WJ!|u6CRblrnnl zmJqbETb$00JXx)NCo~=$FrsLhJ=@)!=#HdR7Bgl9(A4yHImi0rzP4SQ`I@l@yFPj{ zCs8L~P26;7X1LBAkZP2%vQ~zfcL;GaXFk?q2f2XU>E@y6FZKLRO&x~XYg$X~9-?>= zbrj)*r<U7N?NJ+kXzFgwXf!%mV}#S)ur(_`9LTv)IMHuG{*bX(!Ikk+X(G z>}_0OMDag=*HbEm03hxtS5LwX_F;`-9N&P?Jf`J5P%SRM2JiJ?4>wFG6?ExKc7`-} zTc55in4UFk*R^v7)7;WGbr78thF<<)o(LJiITAVMQc!D7>Z~!fCfz@R<4IGDk{+01 zO&;Hrm!I;@j+}RFpNeM;MW8w(wJg{bEB>;0!Ag_16EfQeJS>wDSh^=t+*k|$TG}?S zuo(Gr8NH;+@g<$i_vdtF$JX1?CB~nR{XDL)Z|gC~_GG=Lr}li=q09~? z^831+iu=oEjfb<-`v{$SA^G6T?CpE`;o(Ldx*=oGru??k%0G1pudKWlEKBO_jyRQl z;})(eJkCJy8NdxeF62;x`YJc{xUQbWnr5tk`mQ3bQ|KLW#a>G{kYT#DKBIDdvxm@H zYKw(oQpozy1WiP-e+scd{Hb#62UB}gYEp2hnf;9e)c04)qzD7&pKT#8&7G$sxUt`; zcQ^cML-`^eBzLJsEl?^1mkH105-ya>CaODZw(NvMY7MF>cMoB5=d~|UXY=! z(c(&|onPIrs}W|s8BR1Zb$jwe;7L5QEgr$X^|O7Fg2WZ>vX>{sXoCuYKb)E+NxD^pZw?~7oGm>_9{rgATyp0trmQ)9%C+uf{u>H@B~ryIR1N*A64 z9Nz5f5@Ly4n69qbL^NM717L?YLC zCYEt?Ld+1lwvowShcDDfylfc*90$4!oR>w~ziHL5_(G0K7E9vtB^9cuN6-atPkc*F z#S*~5csF~zOwW>O?h?`lMr+-@&KwSjGu`sS zyP@+hV_HtD5Cm!o#qW=*1kubO)Pt=|FC02QT#%1`uTY@pe?g6Y(*b7@A@(AJGc!mR z;i~-mk&2mgdCo&SAhWm2@oSvta+Kcv$MCpE|3-ou+uIO`lB@jlw|86YZLX7SoNn}) z#FV_=2DcBKBk46LQT2Tcu*2aZFJ*Aq!kANr*g}{;A2XTC8qQ3&q^h&03XX8o3*QEd zk2eKtpTR6JE_o(E_I4uO1>JTI*$-icf01~pV~SXzwJVsE3@n^vVHJxXFjq1f`6$Y$ zbzMrUgqHO#WUKg34OqYOz5G=juPfbhlI@diAi)2Gy#1bARgj9WWcRiq-VeYp_N94z z)OMP+Gr6!rNAP!<4PO?wvQiQ&kHFtT`Yg#O&d&MkV=>K{F+-_N700M*ZWcsYYHpEa zLt1^<04CPFFo5f9@R_~{O(}{zb#3lFE|K)-2U7;Vt|EO(Spf@*`0A5RPBtPObV^Ep zM~!`ITUg@P_Q_(?$~Q#Nd<*6*anE{uqDS;W(k$v!DFVF{ zNrz$Hy~LfokD__0l+G09b2aq-C|T7u#w_?pjIAdbhb~~tJSzJjzI9HY1|!ZCI5ypH zn}dWmaq)^mu~%WJe@4s(!w;uR%p}A1)$SMF8>-jcr$zA$_nUhhO8#1$N|a_RpJaNS zkC|V#t4g-7Ta8XyNbkID*KiWriBIEWkXy{JBxTZ8T8f+8tf6b1Nm0 zWT({@J^TzP&8N^+V-Ub@$JGq386*Lk{q@5aQBVOu50xPqwSIqUT@?ckI}8 z%}61y&jsdVJ3;fDSaesZUcZqD7-GY=Z^!W9&q~q35mH{RyPoZyubGG0LAyM{xK5GYnV6$_V(IW#Yk4PQ^3#Wn&NDJ=UfUim}d9umb^bF@)zJ&rTm5qW_9 zqB32VgzZ%uMhcy?)K!GlO6JqVU(NFfvmJh76w%pBU4_N@^^*d7-#d(T@{;KP*d=Oa zm?s=j`*q(5x)_Bsdp0a6Q>CsA_08~H`7>>6p4Uc(7oQ0v`;XYCaM=4p%M}~&vwq;a z#rV8C{tz=eun=}y8VTP?q7$!oCxCkHlq-RkQu(#7xFytp_;4f&FU|c%2gc0Q^^3Pm;Sp@bBBr&#GaNy)z5PX;)a|tqwz8s z*=TBq(J~n(uTDAwvR0VeX$^2ihnrr0)`h#%VU}MsN6jVdULKbDe8+LFvs;}w|07@##ws$i_7 z-H5yaC{F=i-C&L0+9u2>5A#?t(i1J8ta*JHCVE+XL$pa<$bv`_VXr%>u5S$*$ny*v zGD)A^^GLA7KUk8A{=)p0@Q_Rrqfl(cz)~w*a{8HrdD=YV)0v$F&Boe+cv&GM982&y z`7cV@^l06h@cyB>pVi~UyAQocrUNAH@yaA)g-uEy7y~!A%~(xCf~H;vpLDQWIpsgB z$syzA-LSMoF+QV~d+uxfp$xT%)6gTZae(0)(wZe`7&rhOVC_;W`DNat?NJ=Sa&J?< z>0avtyY@YuLj9LbNrShtG6qK z%|o>I?aCeEYFt-HU*WzPW(1wtqOu1GNG;Ra^EI)!N!X|jDnJ~CBfe-mq4QVxt)UE#e-qT*GHs}IUh2RsmQMVrt% zKyJ>`l}!A5w;l`^VxzmfZLD;;v#z)2Lo-NpxnnwxXQ^~>1dQ6lY^#$+$PxDFE4Kta zM~8$aSA10i->nT96w%cf5iwti2AOBKXx%{&v)Z^~iynEol!cwh)eV$>Yd0dT8M;Bz zt{pR*fpIt@U!7VlzNROhrjbcM$ZDF6dO1bsysryg-VztN1>FW9Q1QPPGFu%mUC}|K zblKWQX^yJwry^@8$yrWGH$cYSRB;Jq@pXXpEmIP*s{y9{wG#a!9GE_x$)Zuhm12MG z)hHZ=s_Lh~$6ZDJR7MW-k!<*e%MzQR@O%khJ$0wSO=`B`M;6}bw_HKW7bHuyA|u{v zKlQWk)!w;qUgc~68{1^=)b&?Yvv`h_mfvUh2e#Stk33@|8w9Kb`uKaCZrMk;q^L>s zQo5SYcQs~vy(@0#sV=j*fM}G65rz}-jer_{h+vx~fY3p2aUhj8K+1Axf^IAZ=^lR= ziM(oz9nRsN+$xrDIW^(J;oJDnFI&7x+?<}Wg64~UR3&5pX@3s8^p}0T5c!xdOwSYz zcx>8ZW6&70_}T6fae02i==AoZw&u-> zvZq{(Uzk+dzvzm5f2rkAbxvx&63EbYI;fQ>0JVLejd$(-!ox`?0Hd1>vT zihYFpptBmJ(U;ttS5Om`Q#F=C6lJ>oZG#%+N`cWL2PjF3?axgeTbk#(JCo9ws9MOX zdvC{B$;evydZHJ?GGL1IfvtDt$EzKKr(|sSsgmSnE*9PZUnsrgomW^D0Y`q1o3|!I zn7z_dRhb+Go2~UaTK#W+1W5}x{FIJ*xhp=FKs|Mx_a>K)%#mafHw3>%=~+|>2G~s} zpnKNo0xE4@e~c@!bNmP2XNV46^EikeIrLiC zJ!s+jILLD$(m0z;7;@mFsJ^Hvcj+`Np7G?w`~BN;6-9-CE#46Gr%P)$;C4$gsXIu! zt#Ipc8urAqvz6#n+z1zyDEa%=qs{rcFhxwqeqdaLoLLi>JBnj%DIpUy9>fju&wV&c zqL9{6n`eZh4y@u20qhs3E)^A-H#;Yk`pB`^Xxan|wPzvaW;SCheduWGBX_u`kxEZ%kIY*IS zQY7(?d+a40_tij*){L{8QO@Ih;5SbW;?E`1S5xTEXor1ML*rJ0aX{umfyBl$zc8l? zJEX^~fl2F&#UTM`&NsHyD)>$pH{D84rQdDcduBq?VyFzu&Lt)}nHj{{%Y8LS_P3&9 zl?t~cj%xeym_{XkDM=9((mo%7+$M2uFGOT4gwxdQ{!Pw}nA_Eiy7F_Pze=FthHM{E zLuy8>m~np3T{TPhuMh7e_6i`3$lvZde<+TP7|=2G9^I(}Qs|0}c%gEbdypnj3S^eI z(@i1teu`YAh#ZzF%R_N{PZFKrP*@Sjd50SwOnwltYggkPw}g?4!JG=iuOZCuM$CNF z%$ll9^PEi76Eag6H*$S?Ks z{rPC4P=&=X8Q<9Nbyz=s?@+ZB|2nWDQQYMc{^Q}3XxwbPSe_2Yfk2UR`^T>Qp?6c9 ztIdQaQLhnuUeEh|+FFF-tA-+&w#2SbgU22enMSDq80af^rQv4xaHApiDS1`3D5y@$ zlI^s8@Xu;L1*94E)0BqH@|WllSO4^9XjOUnq*L{+<`aGy6AbHG><r z7F92;dShtOt50lSMpNFD6eHRolEXOEF5>bbobmy0|~gMEMA&FSsxWVpXw$P3`XrLz zE0{Ey*O})Dyw8R|V`0Ihc1IToCnMfg(o#bSa zz)4<=TPNUNid(-cJ|3{rxb9G3f8D->lrrQFD`6ITe{cQeLT?d8$l}L*TMS#{d|Qfh z(>&02slI%;0{X?rsh6_HFs976*lfjbk1YG?+fXyA-q%2nt9eh*t2LfO`%m>-d@?TH zarY4Wkm1+-^0(h+F!$geveBHE+v8=jtXK1}YLBNagsu;BErqV{6y8o>Rzb9`9M!~el3a}Xd+GBN00Dk&7Rl8nSvR%E7q;x)>NOrM~ zkkfQ}2f{Ojvj;HPh5 zx!*Y7TU$=$Rdkrr61~hICa)T=eiqC5TIe}J>}~1+Xzc}+q*)rKI}I1cHI_qZe5=|$ zGb@)LUvG+gGjm*0gmell*6T&`)I8_kzZUgvv{bCOjcYy*v*z*l-wbYR7EAiLU8Ql6 zAyq)3YvzoS*5G#b^4XugWh|uI1#srGEFVxjClL)o%B=*FY-}?Xht<{dvZoRKikL=n zVGXb5vo&xoA3Bi_=$7By_Ps9lel4_XCm98m$XUW(G{rU2np#>v-Okong2J0#&z)D# zt7YTIUSJzm*a(HA_2f!k>k;6$tVE4h=E1vjE~B>cP5&2cW##BGzp%xeEYNlFGoMY3 z*KlSd1ec0QQ@CDfN3-U;Y)F+6F#bx8M(g98r5vLw9)-MQGSBnaI3ntaV~_G{N{&J) zws(fnm{R_?JKOjh^uvg7P76HSsjqTB16oxmBb?w%EGhrl9VoKS{trb}x4c`PA3~+{ zLd;sBBTa|JMRcu)73$~10B?EyVdjbTb!~$f|8MP9WemoSjn{1PLrdu2$YHJ7^&Koq zo^P)P44@g|)8yLWGzcN%$alWQQs>9Dg{1K6A}KlPvo1B+o96a#AU}%YB}91r z0si^)m38kd$D?E32f8xE1ofXIdV#N!KXH;I@;(tKrJb(Uvaua9KLbObd9Pjd&(+UA z-`R~r>QFT?>I`O;W4M1(VX0GjwNE|k>C*+t{_7}7v?vPc6pL=mP2|nzn)9E1vAo(z zyS#iHz8#8(>ZBS)Ms7c&XY*)SgaSW%+H>&|l=`*k5PBb^(n&Z;r@0r<)JwL8Hl|S+ zFNNw1BzaZh_gQaSE^7ga2O>P7Ci%Tw*m`z~}YoE2~{%d2*lEX>L!@ zRx}IasNWm4L%lu+*6)60FFMlM>~`wSCm&yA5**t|7Sy*oiPPfgI9}y<7ctuE>Ba0m zuBT~DU@&qEu3{)l-|p=zehJJnrjE1j7o+J?YK;|VHz0}AsZ}4yiZ728e%&(7K#^Ot zAtz8){iUB`zYe3&mL$qrXh5$ZqnHCqqqwOx&+Q8(yhHKBX- zM+TYjc17(JJSa9+V|6A#ifJEOm8nB=n6|Ui=FMHe@^c4VI!fd}tS8Zv3yIkdcbV$97 zVUc@neWw}AJN3CRBr?aZda7f+TXLdfz+sE6({wjg$13QOx|B6`JzMl*{Ib>dKD5@U z4#i7y3Xlyy~--VMo%|T|cUphAzbMI5g=TLpA8|_b35EA;XRA?ZQ6tuCS z&rc+MRt3Yr$T%@EaY{r0?fjjq4;^)lkL%?Hl2arZL8rIls~zk!VredaxKkqT&o4Jb zQypJ{A2`GIMsa~FI=wHD!T~ZTaEU+ME;hK`?C8%Sw7#3Uq;xIbG$IVGm#X*E43kGl*pjD&~3;<^d51wYW~ z_+I?uXTEZ&W*7nY4z@FH??muhB-ql^4jPo_ypoBBxK?#NV0pEWM(aXUT)e}3WVQKv ziPLTm!#j5c{^iS?iwWu7zsn9Z7&vV&axayHL|BYN2uWaz@#!w${wbEaVRC7F^yOJ^ zQrH4Bg++AqMmC!d5w|`T?vIL2k-0+|F^dsW$J;k)SM0>(Ja}`qk|H8M|0oMEf@YZt zq@mZ`+lsbdHTIr*jwtd6ba`eXZ~vMITwk3bt=PAPD$0Hvq;jRwQeb`^FiWE1I#Z*$ zj8Yvze)8K?piM21y@jZ+ZI$pB?s@~9A6Ywu=4%hH#?z4_bvQNmA1wSz7A?qT+Rs)F z=WA=fE;g9YR-^!&4*mKJ-$@9vYCX9SMZ6jYZ^h(Qfc2%YSy%I8Y~@M_2W_p#*p7GUVk29h@TiAKf4TT@96kkthCPe+dEVc zaWK@k$jp;3KRriJKe3gnK{(RU(3EWLUy4;d%2nJPX#w{c+dgro7iqB;^9K6*8>hQX z=fj+v198C9YMQ&ddk`kIbNPLo2ys9_fa5DrN$TiMt*Or9hq3fuT$hE8WiPmH7FXVp zsM|*sDQ~-m9hoZTH&_lOaMIF_kZ^G|S#S2IaM;b&Sg42628br_24|+GrY^hRTYNo| zag7to1lm9^1Wjz0&ar{sXzatoy{U@3()Mtb?q4gA&ww_4E=`aZc}YKBt9HnGcJ_r- zDw)mxU}h+Z)!}Giw(9I`bHHN0rdU2#s@n9IP#6I|4vt#BTy}-QK+9=2?qY)-Ixdsh zl*G%)y3>Q%N~6K})0NeMILqeCsr}Mc&1PrdGK}YroQH=16%v#}FbW5cD2Y)fSB}RB zmn(jm0F+;>T&|Q$!)r~?q^c}fEZe!9?7h32VxdyA?XH}uscF6S=KJ^WJNu)fqZ66U z5EyZ40|En`t$9=mm8egD1`kZ+NZz0J5LVjb6O)Q%kHeuZ3o)Bc=E0+ruKd0upz6zb zhgWuqmQlChvtGnno9pEYD5tnm-h%{ci5NyK{oFRp$@R76cvgVbY+qj=TQR5W&9{#4 z$TsE)xTpy3&yNnMsHhRr$4kx6_sh>~e=c5Tk`)NE+AVA*j7WlqAsAFfU1|lEkFw*4 z2i8-M+OXpS9XIR&MgVm z-rceDu2f$MQcBs3&Z%PcYpxu_p+whIi7QT)u|Eb$Y|Bv_Zk4V9?4-G2A*z zp`t9SHYp@51J93Lsa+X@K^3j6LUc}N`k4nj_Xmvhid^mwH|2UgP0h_+I6B<)>KNk> zm(yBZL*;rvkNxhrV3DnZgTuFPbj~vR<0Tr6D=XUcnMKN_1O!>qzg-?hL(a?m$|2tf z^%>D}t?l7DUAwDau}eIb=82H3ua{euAFrlaKZ#bXS?(xK%iU?!s2mJ$bTTP@Et~zR z;siz`93v8UPFjU3O+>ySXY8E!Wd7&~ZWS$py|= zR$rsrYz^*?W%hIipwoV-E7R>lSZC$n@O?l)7ET>~`f+|~7Q>H|l z?co5p92xR6cT2TmCF1k;xF5;fF7`Ady>5?pcGA)#cKcI{^)^P2cb9**ch!l!vIwWe zHXChPnSXndF6c74yxb}l1AHu2tKM6vKQAn8*;`xFy}7=Ju82xZ{1_o(ovd|nD|&Z( zoA9;eb}Om=_8gHMWfLk9v=R$2HX^U_qtd}zjB)$i5y3* zxg9tAVVlCeB>xw6AkjyHWe%(d4I-0}NpP#O*!L&(h!^O}Pz`q8J%S zS>YSFTsc|oaJhPzr@ztE)U?~1r2kkU7=)Q~iO*rnX0sKnGSgsJIFoKL5Ub0vb#P#g z1LX~e3c9~30E#BaK#B@tn$_7xA80kV^$^zJesn}IB(Q3@zpZ$vtgo-jm+N-TRhxlX z!+EKxsL(L_qvA&jiru!3${pLoxoV|iHOWLKr~TsE3SJR<2=mc&J}`c|9H=#$R0Qsh z8jk}nKYvFmudGDJ4Z3V=Yx{d8JlM)3fVjrJiQf5Lw+mN17OLsdq6jMT$M`TZU>byN zYX^ss7E&fA1r;jLRf&lOZU(AaR4Wbn`1pjlu}4-(x7^x|Jv}{jXXob|K}ggc^7iYQ zPU0eGx!K7KlPJB$9+{?Q1D=|^y}jd=x8hO3Fqn9Ktf2b1; z)t${U-}1g-2{)n{Tc{^k9~ZW{H(feLK;7!{F8Is?pR|oRDBN#(Z^K1EU##BjYpfDrp zYS|Y_;wzW7$rmF=VhGreu)`q#35|0vC3|6xX07h(Aj5jr-{!!i0poSOCv2o;Yo*QG zpg($S*Or}&Jlg1D#bMd)`gS|*c(D=m!%Wa2)7WitRA#HqlnDt5*JDplPiMJ}IpFf; z@{1G;W0R8RJ)z(_uVX2dkM1t_N6ymY*)eG~7ua-wPH&KInP}PuoXWB0Rv`)x+4=qU z-JQcjjeI#09rCE}4R-sa64xuMJcG(wZoiB(s;a6$l)&M>nKLWJE|n!WUT$d~^ZpuIiFW0rxc5?DxlgZq~^n5ZeVS{}d@ zfQrvCnJtb*zt80SZ7f5uJ$KCo=z25)+`fTVvIcQ5SH0gG@j(|eK^)b7XOvGwbz#2Q z<@$sOlraJ7KW=5Z)Y#=6yU&-20B+1~JerQm`#{&Dzjt*w&--xF@zWEktI7O#_Hd~0 z?CcCCqWSWc$F)vogAjOl*G>-*2p{k6QXF;K`t^k3qhGU_ z&y#M`P^Y zyRGs8&ba2>(%yXK2JY?Ms;CznmCLLIRXC`D^*`kDUC&-PafytK&Tp9P5(rG>R&2^n@@^@JvVi`r| zgemzywz0i0-RA8GfP{Y@q`-o&E{B%&zTBA}3vXPbw*TSAf1V>-3|i!y@!AQfKs-=! z-IQ|eY;D!RAta}{-@$`RwK<&(yT!8^?{c4?)FB?(xZ=&YxVc@hbnx);T`u>2&5O;} zS$zPj1aIn%d~vbxp(mQlgH^8y8iFcJ1_p*A;B18ttX$gc&nAtsx*Nj8P%fxPcYjwe zpZ>@Tfutt6a262YqWtD$r0aJ{WAR%%x;K+#jw4Fu>NhK^myQ3587D8~O%pnD2kMaX zMAK0N%m>t-{}!~9m@LEIMwY|ct@geIt&v{a7sZ7b5uFaWl_P%Nn?N|k25tB9g2gG) zNGHO6H{N!Ol_R_972)qp_*W7sGYxK9knV&utJk4I{cjI~p_F}k8aJleQp~##ph5o% z2q{F__#tJ9c73iZ<3t-Q5TKotxcVxI#z?xw7n8?n@TlL1!TsI?_#+6CTY(r0AkyEb z6*&C)xAFgI>D87lJHVZy2v>`lFYF6eWS}F6roz1YpHm4Qdj3!9C-u?v83taR^&&WD z{J-h@opf0>7doJdUVA3&tt1aki2I*1Ta+NCmIn##OaStMTOA$$o%ry9ne7vcQMyz% zRYlnETJeva&I2yWwDb3;6RgGrZ~6XIn7{4R5I_2C{|-!4_u9^$xHmcaQtMCmr&H&Vu`Kja4Kn+z^<)$#3* zo({~{TCTTojn`T(FEzUe3klI^Hq{A*;NVCOpHFJEx-Tv*Elo_wQ{nNta}g6mqe3=I zrfwtv$7ozOGGOhAO{mv2TP8^spe%=is&xC4f{P0eb<1~VW@fD`NLZMcgMtsF3fD)A zNqR|7kN08toGh%@-{Cx$NTtu1!l0!I!|UCWuxXi#vFU89QqDbFoxW)ZZQfA}2(Pv^ zeFITx?^j{cR}Oaep=5T(9+u1f>FcvI95&$F3R#+Kh50N)ij?2q-3EL7tlDYCz2GYj zC_lV^U%+Hal7N3D;#H`)*$^7fVWt^@JR!$LZV2e27&lOCxqT1{?k$%Di!SgGo0XrQ zV0Bjvk_73%aRD$ze^e?`xu&;lI{kjrMWW7TWo3on`yPAHN8uw0G#JUi_AB6<%iw{h z=yhi5!#GHl6KjvZ)ZYRHP4@|(AGgl2XchAn1X(1qiq}>FNCo{;lX0PwMicOfX@aAxx|dlSReH-z2koA#_gM_Bd?+3)p9T z*w1UUW_no9+6HK@Kb?M^{DqGCi1cOC`W|Dq#5Yd_f1?oK>N_VSu5*ZSorQK2N>u#* zyYur0XGS8@t+ylVHqnty3z=d53uGSrX3g@B4_~{8DPw>4NB&?VkGvO8(Au;FqcQUo z{{Ld0N6>2?v%A!;+!_8qa4IpL`JZ5_Xp?#C%FkId49}jLM)ErUZJryhoji@vH3d^c`a2E& zjSORkH6=-`L<&RW#D$)J{ zP1P({C2^g;dE_&P`hObdT5RP@i$}Nwi_X=0{%=!iX*V(5gZ5R?`({zJzt}l3bv8*t z8S&3hzn95V=wTr#;xF-i|E+zqB#>GYn@dA4#bOk`*DD42-=Wo9c4GDB!#|^=TEhwc znmM<4Ghe>fpb{=8`HpbxAMVeorGltDp0J$tP?NUsFV9#|k4W6Qy=$AaX+^{N-{J&p z7ikWgPjj~)h`;~6V-qtcQ$X+7Q1pbK$m;($oZET1d*N;p7aH~Ee~a^*0r9;#+D9=u zzW@I)(S@~=_^ti-=>MH7J#={THjW2-)hOU!mIW=KApBiC_j=&woZ)umZ;l0}-t(t> z$9EYb1GN9U@2YAp#uBZ-gei5mbB9RqVfZ^q%P3Ik1gpc0czDx{lGli!IAG;MDy=@i zxW4D>ht?!T`nRK*#0Bacd}5=D)^tzi37!HrG%e1+Ehj#E>w=`_Xpso{Pqz^Cwi+S+ zlXttpPiiI@vMYSRzfYOv+~*0`!6En+jVy*6D%ifPlq(7F_XoR#zfW`|fc4%B4>Lbn z$s)J+Q~M6bYB8q(Qeyb}pTomP-63B0)qi4d;tVhE7kSNK>oJe>HKt{)6Cw&BPto*# zK=zJH8Q7$%pFPWt(*!g8pG`6E6aX;rd>9$OD_hRh=<_=Cg%_8)bJXw^qQKOXA)~gu zSY2IhbT}R!iWQHeQT!MKsteLJcxj5gI^)@eHsGsu>10NwzGQ*E_tjWWa1g&Qthc9s zU=dsp)gKa3g)zzc8KiYN8ZRHdW>xC9ueK83oMfH>txxM=ydr&Q05`e&5lFJZrZZ?= zkpHw-if{tN`vr@e*|yY;%EqweHPA<cG;#V`It{gDnwE+xxGJy(?$X(9w!+}?@iByz_jV%+EPX9z z%6^CgaWr6|OM8QXx!YOw>T@(E47(PW( zQsH3lSMoyraRs}QD?y@WsK;n(;TFsjYd3s|U?o?hoF}6L>ZV(7G?EJDRo0TQz(6zt zs+(t{Ke($3J+|;D4>A?8QJ%9Z9#n*dg#}IL-E7le1@Nap@$VdC4R#5^W(9f}1c)0T zQ?y9Fplk!F6+`<7*nM`ES=ryGgsw6gA($v^INu%tYfZy8Ub8=)eoP8Esk@+r^sOby zv#PJCnE2qCj2j6cOt;#v=NRJi~g0ad;lkpTXT1dYLCnH(dPchuY3&au(AFWapVSxZcvZ#eMyk* z;|98?W|BS;W7qQbI00&6SL#)IJ)sZxKh#X3Cx=Asdi_pKE(xkCD=A|UiP7Nyx+NyU za##X!f+MjXToAHKjmi1e!=2gVx%E_jB`v;@s~Y$pSYPTHSf|M`5dO*JSaUq1TC-h+ zM^I&XEy$zM^X_tCwMgDb*oU6SqRm?n^N;y}#8&_tvbr5Pi|+OZ_!4p2MWZJ&EjNp& zG<`0+t7OlFv-^LR0u3by=gU6^^yYm;R_AD1tT*k5t~v9%9;GiX^g_8NRC z2^P_XU>7M{ET%v<^Sf0@Vc|YFulYTq05>lf-H&!r>ZHN>As$R7&1I~+2sGHC1#AS- zw!CGx&g%09Ic#lh?ewng-(WVue>=H*YL?qmnm~%#i;ntqITE3Hyt4AUw_5Icwjmk? z2S%PR-tj`cH<(jE6DfJnP`sORiyn8Vk4FQiP=lcor06Y(h=>ELZIhD<L-CtUec zY>a=FiXbC!#RNO}N@+Z97tW9Q^0~nTle@OMk{~J}Z*kUOpfY6bVxLht%6UU&F~S)i zEfGm`-Qc-DUQUC}*?PD8tIvKYZim&=KHul6024hUqgpUQ zI$hyKd;1pb-I?|2f&BUUe1sRPzp~r=(@1zOHeOzz$P63h*IyWJ&InFxZ42mFSXh{t znE3b_{v$Z3kldeBodj~_`s0FS4^HTI7{KYA8r~mm1`*X}@e}52RV|SL>XTYlIv(md z@850qR`jQqN z5*ddXG&Gjs`PPtbj{Wr!;*qopSPA4xrAV;eU+!=3?Ir5r{%Bq8@WaJQJ#Hi5c2+3W zY~IuZTc=pq*a_yVon2i4x7G~t@c9a2FE=Pe8UWnaj1Fb4(-rzLfn3FC|Ei2f#1Xbm zeGAYcT|rouOHEF3tx-vqV0v(wud$G1<$Zpzad5cC3IEmExndu>L`+TbiFvQ@sp*5oSaw-?b$+{H}%%?6l z!eutC0=w8;OVXyMdoh&CU=F_Op}phnF*L2_AR&SIbLGzsMIdbK8+DdGiKaz}r8%~5TJWJ( zyGho20O)z=0pM{ouK&G^-?0OUcJ^1P#5^apX$q#}r4Yv6kvooMaIy?V6-926Y?X_=%>i=PexLKy zqX*#Y&c)7dH6q;1%xN_0b8q9XQ0g%uubEKX{2ci}m8yCu2z_5WaqWap)rfI+OAfZT+sl zFSVk>q{2K-O$;abRA6Ob{s2h~O`=obJwROYLYrg6he_j;q>>B>sTW}fMzLzhM>2O7 z8Y}!{@n*=a2jz)UrEZTr&H}7bve0jvL+KKfM`E_iuo<~KNq*OpR>b?sx&P^&r}|D z%bIs*Ru*&Tknh$>w7Yf)kj z$V}6-GiMi(NN2*v#m{;oiqRwow1zplTUv)nBrSIk%T^Py~r$< z_ql{yz;p6q^*-R$J$6Q1zUQj4Q=Ic_mpInRvfG^PG%UN2jJDAXjQ%pqdvkg=$nDiJ z*>AQpIuX4LHGGrwEuf^&7QC^pdD;;Vri{(1knK9PkF{)!xK$iKr~N{Nzb6s!Nvk(?6rS>ZoZTXZ8&#;IYZ^C2Pj z>3`nNKtwDx7$>5YCfw=%&AX@m`>~3`o!{5mh1tjDx&HlFO)P?%{L1T}Dy|(V%1nP> z>Vj3KDGx&QXw5R?JDf<$9A3llpTK7AS8e}iIkV31kvYb}++o4!YnD5zNUd4LE@ z1B46S>J-d0jK!!UD`MN@mAQe1-3@W7OOikx!5_fIv%Eb$F?a@2Z6J{6)xu%faKVtC zEo}yhGu|l}(G@^E4C=NN{&_%#`_+XHI6u5$qR&o$z=4zapS4uHvzHniQ|G1>UXNlz&mo;Pd3na?~WnI`!v*8Y|EF+bdJ1T>YJ=9G-id;w_lvT z40OCeb(FQQxLCvs>VT7{5 z_>RJ_&D|gy$0z6eg1(8vTo>d14$4u-8OjKQM1bi_Tjt>7St{O}<btv;B}M=TmoAxY(|7m|qH( zdLt(ju|HHzw*o9ZJ_JqIcPWHe{?)Qc}ww zNq@4l69^z?9bYz=V_>p?kJmXacJX^P*7@o2#NNh?#LRn{V9J4N1R1U0-P^-WpXZ=l z8@iLz>&`_qo*Y2G<;vG3f-C+it$RN^cv)GKm6E(Tls)E{v1Tj&$Dp_K_M#TN&sRX& zy3FpXsR4IE*M>r;{gB6!#}LqnvuC_eL2MWje?rE6@7|A@QIh>zHP5z1<|6GOBPNTf z(jrxG_q2~a#6;!rSsbo+H)&nX?zKGS55iOD?D7#j&$ytkTEeanVQbX z=0{;+-ISGmb!Ls=Zi0aIRmIrV5Eoxm4ZXWea(JxMYk%|4-%Y*T<%9DAt#4}zT>3aN{BLuh`xdKe6Ot~`|%@J%K-!dh7aokFFQLs+lpoYzv6m< zz1S3ph*V6XL(PTos7YK%xP$x~f6aAg0zGwAc(j;@m6er|aY5hMSBfw$2u+Yle)yEc zoz)$2+RGO+s;b!uxs7{r-NtEAoLe7E&&8jE+X=L{2F8Rl!GRSvafgh1T}rbe{`pXl ze;MC^ZIAUws5&Uuj&nLg_d09Bp>E<2^`%3cfBz!iPIhkYjbve&&s6i(EQVuR6@UOB zDNBKk|64{bcV7;mn%^eOZl{nxAd7XT>2u5}Y9qkLNFyZwy^nIcnazv(yn{PnC()Sr z*#G`PuH9_;=yJ8UUr#Fw|Mg#zZ;}$xh%VXz;1!w{7m9$tkvH{@uq`4{Z&-ACn&-JCSP z&>+JR*~aPf=SPb_>FqoW*);ua7lOEdT$sVS^*3O2{J#1`i_~wok^A9>&Q?$;3fpHk zx(WYhbnZRV9fN`z3h#LSm{0!<^Z^Rn$-NKDZjAtr*M--DBEw@3b0o^!t{sozd^fObogS`c`tKaL78h33Ezo~=Q)(4HFO`oV0gU*5TR*ie1g+J|v`{Z(^28S= zh^eTQ9080!3ECX4r?Pr+7I1fNn{JX)_pnTr?OiL=QU2fGJzVR5HpgR>Z@P(M_H^>X zb?C6zCxO}0W0H(v!fFUA>I6|Vw46ZJ{4{em(G8z#5g_nG8j0XQQ+$M*a&4m% ztD{7}4~t7u9xXXR2g<=(jNlN$@d)LWm>pa=!~HW&h8+vMU)%9^z8~}`fH|{ODExcH zGnCV9To5DzC)FS(lZlNYD<*gM`?EJXev6rLW!XNzVwFU}o9EJprAm(6`p=a#N*E)F z)Jhoq7H|bN+Op7B#AA@_V+IDNna*0D>|!`V2uIyj#4xrQ6;Hx2>3|nL@f3Y4HIzhO z_6ax7fnEsqK?;YfYRrM%sp}rUQgKtt<<80dE0K>KHCrB0w{i)IL)NEK*~Ys5y~l#& z+Nyxf&v8D(;pev_qy;?cu900$khs}`wPk*5jWZq&jejgYJ}fIMtIvASYh#IE;cDP# z;bjNT%=UWkZk5b#k^z)rJ4pCXmap}RUjEDS47`4O`~G_5`i_p6k+SWMbpCq{c>yzh zWY6>6%sc*n$GqjHn*2_l0RQgqYcb{9&F-gL-W!YkM5_CLJHDx|78gx#74f_QQ+5Nr zK|uusnI%lNR%Uh5dem;BeV2X=8B-qsRYPME!AL~P?*07ikz)K4l|GCH6i7Xpj1uv` zTW2{l&{<9|A}D3Ab1WxX+Jvt?wfQS?_1N<_$-iHJN$uIxqe6$YZJ+i#QnmlmRej~t z1C4^#OxY0Zf9EWEToPykh6Ag<9@}XQ?k%FT<0jYgJ+DyfB};x|`{-Gnm}>dGok^I_ z-6L=3(myNvVb+6-SCSRU@W{wcj>Wbx(qAqA2=a#g>f`-t(A<$8RvZ4aUfSC!lBt@b zIJY;oIbKg)NjQ8R`#b#wHc1$7QYY_8_*gR#cT-h7ggrj~quu{#?d)D5uHk%UnM*_x z=AROXynY|-JQ>Bq@NJLgX@V%_mCXL-YZ>0i??66xKW|WCqpdAKEH;joNUb_|fl|pS z(j!olYP~W3_vLd3cL1(FDW7N8$nU zalBEn%32OJiIX>2O|f=W&2IQNi~KsLf4OD)%vq&ZhudN26>g&(jb4G0D73Xt{r%ySqkzE zI1)$#$RKtls-t+47C0; z9R`FuDdG$oSxPv{W{7fwGDO3^$N0@xad7cS@aT>v_8`{%9p+up*sZRlMP+xh(D~5z zZ!z20b&7lP%iIqNM#O|V1Q`x;mD63HR#^9xM%0SU+fqA<9eeNS{rjMY?yC9CilOm( zgRgYC_}uRjtOAGF1G0)85^V|oF|KDpR-Bn{EQ>qBV z?YoXUDIQ$i3N82MnD&BG9?j?Cm^gjXMtppHubFS{l;kDv`aW%;l6T6S7A~FsJ4vzm z)O=NM82PW$cG^1i!Sy?QpWocdZE-hOiMaDch_wUA#P`10bfEYKC*R-wDZNp}?>a{F^ z^T951wlO!f+O1RmDTmXue-4QD}aOz7}BZb<)cQXWXJiQ#?{(JAwZ=bRC(?J zLJD;tpotC$3k!2wGcYsD@=6szvh9w7e#E;7drmU{DPAHXxFq^^43c|lGBW09esU#H zcm-35L>nd0N&5v-iS!jCi;Ihiqy%_hzkdC>)HU+vvE_@aE0w)#-@0pRZVAz&p<5<5 zIFqb~NE|V1yo;O@V^vmG202)JL2H6-mD}ns$%%E)dyTp;_{X|l8rZ3OGy?~o zTL(C@&GfXiw2X|tlr7(r#5{0n0*^PBhdzc-w%k%z?*RlY06CfvwV(8lJsl57HlI0& z(1c2%-m4{DAttc7`fxkp^XJ2&Y*ZUMq1A|j&XQd=yy(Ixi#DQ9>)f&Ac}Z>Z71A;`$c z2=~$YF2?XsE0y^NuaV}EO$>ZSR(W4ybj=cHF@r7c2J32aMDwj_mU*e{? z7?Jw+_&Pqe^k?_2gM)+GLV)4av%_~oh##y<+jE_TDQD9zWfzKl1p>d`tUC-l zLmqB!ByaKH-Ite^ye1n6yK8*#e8)HEx-;-2<)^^t08M3_4s1WRou5fY#4U6ee}2|( zi9tf1#q}4PcfXN-0dt$HU!8QJ<$HehQTgKu8G9~LC>0TLS#CMpCL|Ri|YE^ZVU${ROs$jD$njeV7pk^<0!59PYDq2V}~CLG0qm6RcOyP2o?s@idFhx+10 zDRR!lG2gSKZAhX}gprr4>n_v)UAODMxHtZaGhV>@_lV1=6Tsyl|L*MUd=%~iYPfs3 z_X}WT@yzQDAdF-v!^w)?;6+o69S$<#&1C^iD+FKATZejkz1x>oYYmfD=aLx4=mRXcSb== z`L@>rP)-JNKjxNaa_f1}B9Hop7f3VOx;9SL*4Mw1u#=FeUZf^IT>@q;8)BmSQ1e<$ z^?DN<aKShYy~aVzHT*8bOU9F841Z=+i_dE^XUlfWnPoO*mqxys1f30BUe|~(C{;F)LCyCwS%cJuPfiYS({XUU04`Uhcyt}*M`R&cigi+_XTeRtfc0-<|?m!0SFq>IvdZJEx4s+3h41Q82g%cOb9-YiXaepsGB=L{@2?dT^z8*f#LE-E zWne%nG)c&fPkhYpp#p_2P^AQCoCBi{^*SP=g0=N+Fm9-fsKz_rhN z;D6)a@6q9Dh5WjmfvT$N{rj;{2a%aMAM$D$%$-FS=XmbmepaWs>1)yj3ghsB!(14H!-ls|Z^eBPNfG2CXdGOj!dlX}Ap zyiIEAgxbn#cb+$i!yu9f^XW@#lX1n(9I6`_o@(~$K%h} z6c9t6>mJ*S0GU4Q|M1Z8B9lOc^HTi%YTHrq0#68}I_@7Jfyh{RLvb0*MuGG5Bfiv5 zA0fR*un5d@1mb(YQ@HLyfE52dn|dczMk$Ub9m1?(QITnT0H>RW$1CFr@pfc0S?}IL$ngTzpXj!$tEE0h-=821~!KV`5 z%y#LAil+Rk->m!b0EhNwtI6i{#<%ou($xWThk+3gk3x(L4QsEw2bK@2jqrR8$G-YP z-L9aU>aWGcgY{<4_IUmUr~qPNVSyU9pH*HJYYHG`{|x`CtB)bSsI9!43+QI`t{xLp zCODOs9@L-#`UFX=rYH`KuG{AsK7~Lei(1|8`7Tg&SpBRNszCAb@-nF;>AX{C(VoCI zbZ2%nISA*PsE2Br`JDWKE#Thx-|Kv|dHp!(7t|Q7t*&w%(xPwY>tAEQMa{K)g*9p( zc0Ssl_3hw!1l%57sXk6hi1?D#I}f$v1zzs%!Ud<%8;lI6|NJq5r0zy0x-viJojmrX z7{aM*OfjnA*UliH@T+$6S0B%G1Y~`DB6C`|cjW9Mqg>a=5iw&^6b{b|tMhyNZyq(3 zG7o8Zx0pEC-7B#UBi_3+F3niM`FgPm`Q#~jFsGZ)hHf0SJn`fFpTBa4qYicxub^H0yB+OKyg=Pn3!^XJA`Ug^KyL=12nlF|5akkAakDf0;!TtBS&Tx=2HXyK}I_~Eu)CIEgYRB zDzb;D2@|5{dSZ>p$P86{l5Xbv1wtVL9!8u>$ZuFh~~t#clk$TO~M_Vhm{x=89x zpRec(1z!9_)qe4d3cu}FYUf8y3)^QHv7fR&QhfNZg0(;N)1iC`it_ULiKbvaDKzNqb9)2>syVoqr>G#9K5eBPHUPP@Qt5&(rs(>L4yUq zPOz`SugPq{aN)+|+kBAfo5WFj*&+oxAqBN4+P zgiNZ$KPP;C;HAPQt`Sc#KI1BVR?{2>)=xc?7eeI1>Gm1+H_jncKF~7r&)NFZ1#rx}=+?SX!Ey^%coeIaU>-wt{yQh}j*$EPq-M0k-*_z|2 z(uRv2Q`hxpO5YBpdh0Nu5#N*T4BAokvY9LB3|`Wfi^E+7!EyN>0w7%g@_z?GhWa z#r+?jlerRDLrsb`X19=!yR`j9+;X~G{0C-sR#U9irbH8xY)PM4rl0(P*WY?m{9S9` z%{Du6QY^iq^LCjlPeaMc8!zdusA3j<%0VeIJj~?D=KbnlJoUZmnWN6^_-n;ke2pKW z?^-k7a3wpen+pf7w2*OI;_)!EHaR6UAF_O!Q?OW7|1Orl)FeO5ZSqQTblh8ok%#-u zTYK(~EgkhaW`i^ywJl});RG30b@hg+Y@&T{bw|_4nBU&lp4M)BY_~dyiW?t%g$RW8Nv%9h ztGHh+Jw))f1Mm7wNolgC6n1xuv(ZpUDau;XEGHpo8gV7g4yrY4RS#n7GS)x))2{!S zrj5*Fmbap`BE44pSHH>(eI~SfL;v~11x<$<=`+1l={SKTZ)d_eX!9b^4-6?dO}{CT zYba9JZ{wehX>?E$YB#Pp@M8atC2vYgMAR|$U^XUItK(t6*X%$FGAi40o}ukdG0c)OfH$@oiqSf8~Fm?6QT!jpKW^x)ARpG4Hf;Hid#|GB*yU ztZ5#;S9Kb1=S11;%U>iI*innohtbL%adstQhIx5cma&+_mH3=7B0Z!8lJRxr?1jZ# zh;fL_=w4iqCYj+UZqhS%D*q|UaTjNLy^?x0g=xkiYwY0ec_n1hq=-Vf_*~xVnaf{` zdv$5r8qRi*Y@YE`>;2q-YfHmB zX{%dEY3(;>{h4CU^IX`dfbjIlHs)tSHwsj`u7Ce=NSys-w4wiIpJ|%sp6so@MeFoC zT_V!yzF*AK72B*mI5w`i4FyBz@LiAv2MvjbHFj4&*4&uCoBc($ zaiQ>Y`lY)4qD3)3<LYr8K@ko|50IG0?GX;DB4-aqGQ#`&nt)a0|5~qR4jrG*6TetT1 z_EsT(RW%J|T7QljlXSh1(grucg%asi+8eJWlNyMq(VzERe*Q!>j7by+{*c9s;YJT# zwPPCfu!#}$HPkm>W5ONL*NFNHpN4xy67ZZRD9nHT1l25UZ*Lz{79<-fzP`TE(a|hf&cZIs03FKpT<)=cBFc!9 z+&(H`y*P0OVdfB5)_z2R$c|MtGyLX@d{&7duk}u^N@ih71G}@K0uE{@nV_q;&+3^N1?U;Nh_4=cMXx z(YsZvDJpO7l1iTu(#HPhCh9kKH(kp|YM*^e~U`p6YmfvV2_4p9h+vm&H$0|pB zGH*VjVVQ65M25+`#3mjejPfjhGOh@>+0j2LwB>u~knsNW)z$|M6KlU}Shs$?AfSOV z(Q>1DBshXeg@^1MpMvWJCkop3dCAbI8oT)D{Ym$@t+}~5OiWBbL*a0HFYCs;QJ-4( zXomWp_u4C@t;<0b=PkQBvuqBryG`4prCF;S?4S^>nFhZ>ub@`r;*(?uP2vT0e>Y zX@F^=sQ`(GCwWkGR1|24Ctr#h-+gwb%zWs0TIYB?6*ro@E# z(9^)U&n=(E>NJ673F>y`7KK2@zza_?)%4xcRY#GM;3zka9B3p0I|lUg9PI41Y*3%t z+S1a~+dBlUM_kv&p&$dka0q8hz<4MHtjGp#=<6rrL=L)w<{xTsX%xJx`1tr1JKlT) zJXYXQ!-cgi#P^pZ?2JrBc~#ZOg3)NNuS=eZtwQLq=v{x~>y*mh z^>Ezwp;r{erAz3R832p+_unrJZ=QOWm34vl?vSd)QS=AR}G_Sjcu8w~{D<~)!-VVDG%E}1-EKLy`bCc*? z*jS04`sQd+XN`}>QqAP#m*V-Lu=r3B_4LDU@ND|E$IUu-0P`Xqk$qzI|&CC_I4WP`Dl=3F6}E_ zm5(Q|_dp$%4sa_yo35^IR8$lTLAWB~zP-3N+sV+Cx;R|ME9&o#esoLCXVNeId9u@gUm@3Y;Ql&`+;$B#RJE-BIo-dWt7+F4hH8DHM}kxNzfe1<)!hYiltvu||6voA*GG!1TC4QypY$UV}b9gpuKD z;_KJw?o)sXLAehg_^-+*0El3dXdtA%IUG6L065_63#w9^MasCYo5CEF^d^>=vIdK7|W4F`W7WW*s+j-#`$7 z1_yec;WIlI@O%L@9bd4GIl4a;ty<^vNJ~_Mer_Q>6M0PE2O9^zd;A%hVP$5%pr2OE z2a30z?(TheXb`nkEyTef>R*l@IwN=xC7CIr+<3NHd!YU)%DB%53LI&8r(bdJq8XZd z_cDpiA3eIFHwy47IO+)BRN0Vl{J@}~+b&jn>r>+bTmZZQP&hw38~Ui0dJ(i|B_$<( zelj3hWSI&(gPcBn+HeRgJAxm!AcuCTx|$j|hb^Hd|4J7i?x9=IV<1~2=h8rIF0wgG_-FhC7akRnQJ7AO zm(yb=fAxu4rRALS^1f-eHN0zXjM9ol5)vxP%cJ#(2ni+G>mKnWOCZVzjC%R``81T2 zigPc^{V3*k2vg6TITL2Audh!;L{vC!)VS+jfNI2so=t?uKbewpg`oG6mX_9i`?L@@4{U}}F-?mEbA4`ZUfkK5(8H1Y4%G7Oh&Ie@KzZ(ue0>Q}hdQ&N(z`|W`b)vpHxLx?y9PG2#U!Ko0^!&a4=oH8g9)@pqwP?2Hx6ORPLr?5;q^; zrm0we+HInD3AiVoU=JS`FMy|VslQ%VLUXy+)m7C-RE|&3q=gLO;NY;eT>-*6?C5oA zseqIBRqn8ijAK-Ez8fiuGtfUge2_q` zC?{vumpcHMGUTf;_q1ILX`-{^<5HgT%L>%hn=3w0v-b#faCivCYPa3PrZ&+vWG^Ed zQyCFP#+sA0iDq$IWYE5k67(d-yR!dfHD%E~^zK+=1QSFcA-i8+cwT424m|+o4Ok1> zLmucVIL{u_)6+x3rg?!Epy4ZAT%numSwYES9s0c0PmI9(rp2O)uN2kk9-&U~}Bw*G!^@~S3dh!Av04DD3=^rJ}g+0 z?6K`BTq~K`4IQ1zfChuQkw2d3uCC;r>1?W&&z845lWL)VO{6(Nv&3&RZ>964b-QGn-7wDdN=cJ{fO#ug(D zb*?hO-51R80^nko!J&;8o%^$nMxSb)e&3k4=gC=S`BgK&W&q9Nv{Z_)gD8r@3QK1D z+vL*q4&9MJO69{Q&C76T07ChO;@Z)nioT^7Y*SIg@l14GWb#$$k_h=6lH*@#`f-*5 z1YmO-zu8v}_+7b#gvv_nDWaZI?NgHVt?bIp_c^SDmX4_NIq|V|C$%R_jAkfN5D`Vd zdb_~O%7#!=p3gjR+1cKv7IC)vUfTmax9bJS&b6E%JHPocSv@jZy;lW`K+^|RuR?jO zZOdPP`CV`$^_#XO!j}J0OTXaW8YG)tKL)OX&zBd~mwxcz0c`poJMtsCcvo_PHySqnj@A60_gi4|RGIg#6fqmJq`__V!!``7KL3qN^ z{IdK~B%}x?U_>^jrsOv1v#qas?2?CdRl zea^tXYHDgig2ZHr0B5Pl5$We@2la40JTJaw!wx1Kg&=o(bhX9Qq&-PVHzyC;*o?nt zz#AEPzbGa z@GlZcv>x8<`{IK>t~Sy)81f`$Oo@Ni8(H^7<@EbtP1w{?E z=Xg*or=UQTPuJ|`<^~KU9I;tSrlCh=BnoO@$>9U{i4`|4m~`OP^;HmZGsr}Nw6_?j ztHVB-QTYpWg0BkP1a_A9$Y-B__0d?VfnC^Zdtcwyc!%fWqUg7jI}tJ@WIM8S7hjsR z#C8G`1``Bl4l76)0b0@_dBE%XEEQFwWa(2n-_t=BD4zl08k&K1_GLo&vbYfd9+_=*Y-8!UG!@?R2?a+J42bJxu z^-TtUDE^&eoN-n~uJ+8_Z~5}22gMeTAs3LZiU!6M-RccYUc1za?zOnZ6u40!P%Uk3 zX(%WvjOx#?)qz*l0!ctP!l>|G@AL11$;yr=PcR-U(8j42^&;#-!R3&Mx@}BDK=t4E zgC?x)Q1b>UD%|&W%h?mx!4~3wFSg3axX<^HzvT3)!ItZ)QRAo6+9DOppDSGY=DK!V z9H8WUK1~S&?Yw+ji(KVvyaeKyMi@oXX+@b|Q)8{tBJ%<_lJseb3(pHh4AqC<{)WaQ z(9!zF({)GV@`8f!Uwwa2 z4Q+2FpfbH2f09EbjCrHw+BEgTyV!fA)asPz{*`w`L!XYrazO1!mY+a3bU829`4Z?sTV z;+B-uDJ|)v=AIr$V6Sf$_Uzsi5vjn&CpWXSj6k+}woFfsz%xJWXb!&FCDHwo>l|2L zH82KkV^Xtg%ljk>L6&1vF*#kY$ju8H>gs5Z5&g0Z?HYvEpa2%sJCB|^j%JBd)r^dI zb*0@lB=Fw&C^23Iq^y6;_lZrA2vJ_Vc$Z{_^kj7y+ABMT9P5us3dru3Aoot5WY5Vk zt!S||+?8y6n2Y*u+IbFQJ?!R3l4@!ZSsfKv1Oy?FBHfjhg$$w$>I&J|axhP0laZ16 zi;+=L;hz{Jqtwv?ljHtvPnoyHOJt(=FB9~!AJ0jOC#&SqK+*uPLF2RV@GfXrrl2pK zU?oj`Q$Yb?0|gvA`y%AmH%$!*c;XcQcyu?sR0i}(=yvDbPqwQmQf_u2A%jf9nEJ&g z7F0pr;HapmxYzIF?(Pn0$)7_#jY3=B{_2?Y&6`+v&T)?Eu2q&7ibWh}?Z#_gf?r-(Sb%$jjE_dxkr_9- z*b_adTWuR{BOc_~CQV-TrI$r>VzLMJrx@(@#li-mSkm~1&rR#3bk~Dj?t(7R2T4RH z{+7~9aeY(^wLYL7J+> zQo3iQVsF|i5u>JfnRY4ZG0B%-W;Q0q$GwL!8k*^b9+{ec12}YEU|wK7R};6cGHpnS z-5-zi<;{BKU4jIz&oiN&IaZWf?9qHLSfr^vw-@6A0s`K@w}D=sUY?#+Wv!s8iw7A2 zXhESgKdL;O42@aZq}njFTcpsgvxL#ENT;>k6f`*HQwfNJxCA{{rW;uRSVE*mWJa*N;!J-Q z(UyOEBrc{W^DUBuK(E?c7o=ndOxb(2#>S=Qqg98{w;DuMS!ro}pqmnYee_ut-2!9I z@VS?tBUf{aI@_xY`>#0DuvO9PkxLygL*y8*S*sW}!e#v32cl1RXD8wDZFU)5iXuJ` zZU7*Qn&ZVou%3bP4i1lAE1fcdWNYx!PKSZn+2%Srl=tcy8yZrk{ZSX6))>%Yp|jO< z3-9#j{mc`u47^WoG6=eZ?D zdmZ9KNzYMiNSFe~bT*8v;@BEY8r@?HkuI7?1@}Sj=O1$HcmOC(8)#mPOVQFOI3r|D zoh7~IKcn;ng$Z^5Ms)K^Q~3vp5$gi37zWhCrjEV0=uIkMbsrQ+d3n}wsLxKC3!)H& zo_Z?Qc2F+>vPyvPm)0igv9Yn++S&k>ACXCFQ2UDG8^a^h#`o0TSu}I-=d~rm4X6c2yv+LsMre$W-5LIOHx{hKmSXFT zBF??0$NzaqDHd<{}+`W8i7Ulmu@=DDtsbj^e2^5+Y|fJ^`TbmQwv#^8gsi>bt1|GvK(oYK5Jqn5eiR6_2x z{5$AdZ4vvwE`BqAa7X6dS3fkbf&s@hR;wf-$;`_Mre_Od11SHwadxbm{d;PKA>n(W zt#?=dy@hYH8ro_&Ppro0-;cjHsWG>RB6BsvW%Bn!UtIZTntYqot}q)?{j41};$Ur& z4g5RVnNm|Mtm8%Jg&`sG-xYm?W^zu3qMk&rhv~2)yxqx>rr?k9pWDQ?D~%S=Z}bF* z&=Yp~fOmdU9wbV_s`5}z88VyPA`eXD9SB2bCL;EgY5_1kF>yx&}m>K6Jzyu`wLmpYg}}&v)sQFW|0=S4xWi zGY@a4(4O!9vzIG`=l`yAwwc?sc)65IY)fW6!(}v|6(MtSPo|w3M!)Xjw}I-lr~U~A z>R8|;q1J$b81I!2J|f)OFRC3H_4Gda{m@8jlD&$fqvH-H!hAWNZHqduXMonORS{T} zQ|BofznoBHFpX15fq{X}59;{#FAQRObI>G3bT2Qws)L;SKVKrj)Xr>mGNHP1G1nvI zOLyl~ZtFY!N+IiW`<-)+&rhRAgg}T{kMzI}Op+TqD9v{1!>!noU0fu0b9hOV5TfNV zfqji0@1LPZA~K5c*(M%`ZG%EXiK4e-Lghk-y{SrPA+5zh!K4AvXAPX#!9>x*-sm?| ztBM^RXTx(X}64I5q^q-XQdo|rJONFu|$5L z^8pw&t~^77NqPlG+vd&%+=6a+MIuRYOh>ayH^o06{ z!h^AIsKSbw;+y_!sYqQrr}BeHgIcf{tjU97Gf?=RFBFACDKwK;U4YK~ zFHt!g@;raI;JasF%Z@z8<6IM4kF+JYn3$Mof&6$s@?KYj9{o!Nci7M!(2LF03JGAd z`JHXBm-`%VyE=8#g$ z*|L|SBsD%jGNVx>H#88Q+D7a9*QV!L?#Wq~wAkncJ8Y=D!FAIx`EVnhj!B)Zs*8RZ$7cBe14;6U&t{8x-fK5R! z{C=o_u?PbBEJ&RHn#h366?(55K$16I)> z+I2XXBPJ#$7e~=QvJi-RdAad7G?cdRhK9gs?LyRH?PsrO3(F`{XB3QNs0Q-5(=uSq1o9iOT0i_h`TK7?5(sJ za9veN%1uq(fbtmVy?=NE1zjQ2+Zurw1tmcw?bk}m>1BTQ(IAM%AjM!i7t!bm+#WOw zYXAB8%M;8r&fDkAjEqt8Wie9iT>TB{Ui~WwuT0|gUs~wDS)Y}yg6<@gPyH$B1h+TFm8mnEaZI$kZE<5 zQb}+WU)|Wq(XSQ{lCkW`y3@?b(mt}YG=wHy){>!RH5ejWQ4k2?fhBJEin!Z>vVGEx zU%VUq4y+vI%lqO{Xj2)ug`QQUmh7S(!FC8tAU?Mz?1k2WV0MW@FK@n zCXgDSWS6(KgKC1{Wb@v4By&#l^T_=8CuX#mjG!+Zm#W{MC83;KB6d#{tdOUfJO|Eayc{slYWVW3FwOIuX)-rU?|FXHy5LHoju zOfo@hv0p4J1OUcBY_h@%(FvekRO#)h*yzaV@=zx;A~A92S^bDe#|pNc!yF~jRQS!e$7MRO3*@6gs!v7r8cHSX zuLDGX5^4CAe->$H3rv*loT{~S71e`Iy*FrYAh5C;DY?0d`{&Uy54=GR(L+h<{n_Z^ zC4`h)EtDxsfM6NQ)P`K1phFP^v;X7jt;4G7*6v{irKKCBQ>3Ij1f&}zrBk|l5h@_v z(%s!9Aky8abR(d2O8w^cdCqyy_x+)lmmAhzYpyx(9An(JhuFD;^^h7AawnjlDmnIN`ikl`PL@+RzX<33XoQ#9`tCfOo;E5?oL8EAd70_y94_y>|! zXrLx6EbR8b7ti15@Dp!L?QhR402>~A zdv7(MAHta~Lj+g|a-c}0^JooWZ+C-qB?qvV4hb8AohS72rO}f8JY*vhoaXqk7Iz> ziYCMG^6(gMR{~KY1jcc|f&s9@HL>|f$U@E;mB@hMOmIgA6w%s-hI1B4Kr!3Fp6xIF z0Cr@!;HLH=OE_3z505P65W#>tPvv1?7}ZqsHe(xLZXhN~P*U;+1O;e?R_`6bvPd^0 z=A*z)LBCjrI5OdkIAqtv;c$Jomp zX%YAG9XlQ?f zc(BVJzFQ~@zik*^e2Z)9K`~c&;~5Q#gUEl4hQxnv^IJpi*PTc;Tx-}*=y^GSk|{7z zFp+0&?p{w2_JNgujzJ}cH9@{;Weq@XreJ*$$w*J1{<~rQpj>`-HQ5h{{KzMVZ?b#` zgZ^DBY0nH4Veowafe*ePQB(gkcJ3@Q&!3d}=V5cU?_eAv5IA(%`p<66TcK?OxnehL zU7Js{YHE%z%ne}qAviNKPcY=`)1xnL$kxPRt4c>h6QA*phm+F<0xb)Gn99ri2bqYH zVKHzh+Uhc9Cixtp2K?-648J&V`Yo-jkV}2#|2oS&`mwJUW9+cSHxiNt5>}jZz?1xa zAStX9TomCa7~#I}L&k;irh)+Lt2+o#ME}0ITuV><>ZwVgq-u0y*n;JFR1HH{IiLzQ z2mBd;gaPL8hxHt=YT+QsB*&6(%nVr#u*^i+?6l8dwKg(3+SPbMiUITZ@(P>Uf`W%l zOeUxw5OaK=r6CTbu@aM$EA6@|v{}P8+q85>PZvDT$XD2U^qj6-EDZv5$KR71PKtx+ zF<|q>0WZA*BI(uk(-I=?f}eohuXr{aEp2|);j+EI9*aAG9e@+n%j*TsM}e`axp~X) z?_5@+#;p;$AT-Exrr&1KU(C5zPhcKX{9Z27VP4&^c{<>XpY00Ry_;eIqE)5?v48@M zwajI=@M-t+&r(@`gYOE+j1|^>f~0JTe(y!ap-)>evUSHhTl$Bk1BO;7Loz(uSv~7f-+vTC`wI96 z*5%E9B#kXO0i8h~*E>O9?(FA8&?$-tzJahZCuqy&d<8nUaht?GATW&H;fD>a!>3NX zXA;|O*jQWR;#RE*{win(LZ=I+S5c`4%5EYA>H6C%;RpyAz2e=pcYWb#}{tT)%|Bxc;$ld;l2w z|J<7x0N?=N!BHmIGbMo87SRFTb-znGnDJ&MWT->bF`evd*=3$YTtUAxFf8z%~H58D1sj;{yE$o<+J%dFCMZN@)Zg~+3Flg<+1SV{q`-%gY87_??&FD zZ`GqpxAT2l-gaGyxQIP(Nelv*+3zezD16^;Kx5(~E0&t9GuR_{HC(p*Bn+-3IeAu` zCaX1IdRrZfhw_A=^fl{0m$HzNkzv1HtWj7#is%z)tkKIV`1X70c7^z@cZ?GBQ&CMj zmPca2`=o?|ubL8qE6vU%`M5tT0H>I4;VVWtF7<=L2Qd zDpSaiV$sM6ta?Are{Idmbk z{RhvCGL5=%($2?*>6zpEFNm4?0#`!Vj90mm#2AWE87MX zdj1bsdN&;IC=MR}f3E5T&&tTZXp8I|<*K5C{lE9&6>x<|N*E$IA^cAsn;zqOOdYs$ z{{Q>WRTO1GHV6H=bIH%$3>*LXBIPuG>f(Taf1elNucwKAyk)i*CnPDfxa38uc@h1e z2NQMN4ev%o08NAcJ{5^FJiKkMg~2i2ktgg5Fna~ zs*U`AE;soS)aXo3e#Hg^$itoow!at@(?J4A3lDFB`}v9F-)n+P!p#uHFkDO|q!1Ir z>InZXQ?Zx_^1);StMR_RZnr$_21KEKA&^S~O6aeZl|wLl&i>;{CUgfdlmHgG4uW?u zg>>2VLnihRe^US`FS7nZ2QT8$#}yc`6@Y!gcmiWk$^oGQ>J#Q`>X5K7IUu_pLJP1w zpvkqfxd~9q&1D=uQgGmvFZvlPj$0KAVSfC3OQB$H4F_a3Nn`y3!QHss^BJkRu8rZ4`_i5{334 z)G@JBRKm6()uYF!hF|~#h#kb4`?|ZQEA+3u%`$t8i;IdbudktlY%nI)(%hW;nj;J% zU^QnWeEdRDQxpHn688aer|FA)Q>CWRiQ!ybHQVy<_oSmk#?(pxLVts`?gSF3p^i2H z!eqn%1plkae7Wgk0D=RfjZQ|=DOrC0sD(*;K!?fz3kd6Bw2wuPngGD5XfGvefLD;e z1jRCwwGTPURNRk3w`gI*b7;ooW`T4AIocw@XB-7J6a`#fnx=#i<9zR%{r%nT^f72h z0%g4WGw$xkrnNwN_r^oSQ4d%8%CV3NpBkLeNyH7k6CC^vDsYdEdhsi}yZj!9hO!Po zv^qru60W}kJ&Wh~Vb7xpUKoDy2RDUuznAh681gxOwQfZyj^jToY-(m^_4ciwZ>UAg3|^tnm@teOHhu-EO#lI!hk{tipSkg$o3s8H+grhoMstKu_n3 zz4ru(!@uPm6jh5y+VYRtVfn_twrA@aVOT8V0jLcCt5!teD%C$iwNH&eLx#Iy3VZOs z8(ck_|K$BcP%gxw_@~Z;mp6*k`~$^K6jt8^2l6n>coufoJltU29tKAUP831^_nq&W z)1W7xM#Mk;_qaYT=IHhZz%Y=t82#Th#Ak>IVKvHs?&Xu~7Am~C83q4;zawy(2vqp1 zAKKD`=o7#CC(@Ju{xG<4^-q~NE`Q=4av1)-BJ}sRa;B46pM3h51?%1YH636Hgo(z@ z1@{gMsLWBQK$GyFiq4e|@M?F>Rh1F+5l2w>kK;swyoLJfTJe;(;3tSNa{R>zDw+AUG729@mzV{b5$#s+P<;qe4NHyP(-i5!S_~->dv74 z+B7}1&(Qbk4s($XtlP+_JUgj9?+fx{fxmBnE7HGyM{~o00R19&r4eiJ$mjbtl;mN!@$f45H=-HIbMt*aQ{?( zJs4Iwc3oguzVh15WtoqQd4H%rhr=1kZdn}hW`p4}z?Lbkg74o}c`6E8)oWs*@}XfZ zPcW#)27xGr2f(lWCbI)A*SPb8G1#jZI*iS!9rezi3#Z4Xd3M8qn+5B>E5YiPPEl19 zjUGrh=aLZGb}~3&pu7zuDs8}AnlhH)uAvrLdj%=}kO9 z4|tU>2F}C-a7&xN%ds&646e5e(LuTegEPTQ!~-&1)7p=f0b88qa4%O>EMQv{RzT4H zeUJPRg(?%*{ef*S0Y(6%6eXT7?jZCfHB-zQFYNQK3I8Ve|rpYwhO z?>8hBVub(k4mpqrYtFs*z#$6d4}!tCX|WF9y-&VL>%JLoUdeRg%KqtKzKcyG+R!!&ftNn zo&i`m2&6ca4)O%#BXw?*`r>1#8*Wa*cnUpA+=G>AZ2`N1@So@G(0zIN6%Ie@gfi-> z_OGVt>#|E|aw${V&zT~CH`3#GD4_1XrFuyk_Vm^4XMtD=FVE0#Qv->n*JT%az-2jp zl!guw#{wac?`7qYR7AVnf+Jsepp|Sa^r6}PDd?0$$-Le-mOdF|qMHqtISs+3RE&L+O?}u$0Od#eikr@z(mjv# z^?(qV!#?=cEUaK8-EZT&3KcAaFT2b}R)oyK=I>d*n~hMI=jQ<@0`x!E)C|A?op|pE z7Us^iRQG@nM((g@rm*llc7A-d(-UaYw#AlVO1Eh2*QE8lNjmc#(%5$kl3cP%-6NsZRbJacqHZsjS}F$c(()g)M0 zXZ?w*!s$`RvlzQ`~?P^2nK7|7y#V6%FC#kKvj!#5Uga)^l;# zrmcy!aHMBR%}mva22e4yG1({Pw0d$;LaBfD9o9;P$iM36Wb)&>uVsAy{A3>c*2!Wa zH3)g4P!(*F{DmQDj1l7wXkb95pVjc>(R*>L{_)X)H{KntNfDQ6{s`fqWLdj7^F2=-d?D3vG;q@NbiMCSU1=Ax^& zgO`4bO|W*k-#PfL+i{xJaXMfS?2#gawIcY0$ImmQDPj}Qp!)E-YqCGNb%+BB8n5)l z=&FJcp_aWqCJOxy5E+0PlFM}{Ktx<&b$<1+yCPrhEzi=NGp}>)wsqEmc2kz@EVEvY^>`ly1JS59Bpjk6E?1XeD2J40Zr9Powq1lATmn z?wwknbfKi7gj7J(w5X@VL;_vKGoa?5S5S~xi}Q-~mFY#0Vp^4Sp1(}WDf{nc3kNIY z6mpX6l43eQDP7&{3KHQLRJE>xH(5ukQHFe~lf>T(6cd6NVU~g_JLLYL$v)C!!M)16 z>EaZJp5RS;9nIx_&9-}Da4>J1_bL&|j@t7k3<9D7vEjPHLZi})Rb7GksCX7X z9|>OWoLqKwq8H60J@mXgxjmKCw~`gY{^`a<^Cg8TF5w%=#h za^vlNapa<|M}1P`;us{?+X3fe&dOiY3i*6NK;mU#uDJdaG~gwM*2M+IBPPwm}E}6Jc`_&w-N-Z zjErMy)~rhj>FGii6M7oVT&`W{yK}^fsXWIXf^{GagvjC%BqV)=sVPOMJ~@xDcJ&2R zJ4y}i#(>^S4Z1zm+kUU(j%ju!?c^vjvUoY+kqZUZ{>UrqcKgc9!qnvj1Ck?$v%S8( zrFZ-tP<8Hx%U~Ssdb>SDcJVYbY3w;b3=%U2eK42uf>O^;n3{|FCsuWEBBYcEgZ}3I zT#&N-BT3^utSPKz-!U%(cu=rV$AZhK@*lZA@>#}sEh+4J+3T}xZ{IykC^TjqZC2Ug z_l=#0ljDHpeH`oc_4V5bE(QUX%0_d*0{dH#nEiY<=$J2X9ICaqVq<;usxmv5r`Zb^ zA3w(^cQiikp6sHneQmwnQ!t|-TXP3eyHx@=?)jy%LVHX3=uHUZMX@ z`?GL$D$xL7;2A&NnZ?!kLaZf=V+38R>x*9*F);xRQ^m{BH{@ z1vZ*n*5X0yfs*_`vqFRW+xLJKe=`m%R#d&1Wip;XrOJ$NATwDHMQ zM^X}-H~hypC$y0*l^xI9-5X!G!G(^AhRvo?b<+j+0iWd=!F}&}H-g`ibY?d>jWyT& zt*)vG+n_wuiZ*j=EOIMVLgFqjFaNh<)0tWS24vgkj^BVAVSFornFjq9u-rS*2Tp~&mIEuUqq40f?mCB@2XdWWHrqM;*I-u-I; z(AAlW7<_YYYWJE)$=%Ak74Zpqnb2(2Sb$Ma(9{LmzGZg3({EWHCD@rec+DiHy{8>j zjIigMYw%^eapJeiY!Kq*@0CtjpZf3HwUxPV=()Pkt)UiT=!Q=a$ojpAEIn;Hn0$#q zMMcHG<32%bk=0t3I?G9|@$~HFD-0RkPk{Me;VjaZYk#uyru5Q@ zw~rU(^JH`)tK_ZteB9N0M15hxQzHKcefHV!TJAN|JL}ho8jTUQ-fw@p+>A{Og7r`J zxu-1H-{({QMX*M!0e=Rl0y4T8*XX}qbBvGc{#YEg^}pLCv+jKg%w|?HaGzN=p3$e* zgt}W*KIt{A{RdvL#vKQ%TaYjPN7Bh1|Y4{GQoHfIeq@@JwU9{a~@RP$=iu6}{Kc@a$Yg!dG=5 z`IV?!N%+F+=j6;#-uUz(Ae?SK$PwRU`5?Qsp77`9$D6{v<_A`Sd1}haY>t0uofZa_mN5hMY^upVY0Yu@ zKp0qhr<*I6QqS7+@+y8d`|edn{JuMyR_iTc!!HgyDaY3Ue5KQMI^?13F4K61&J9bA z{1HJdpFIEC>qTA!9=ZKZja_Qe6erGJz&xKS!j01jj!V5`)-|Y@cak(YYVdb>CoD%91wyKIMZn?gkHOs@EW2aeck$*FIhCMPtZ_2DTx7VBP zCJEOH%KOGYH`kfoSN6=9cyAlEY`qeBGC`$J7}2h;m?@+$GG%N5KwIn$9-lbahoRa(b_ z&P};^GCv>qPe0Mn{I;*`mG+|f?3md2dzThm_m#8rRg_a z$Tdpwwysx!h_$}W26VSVVdbCktfa>yTp3%5(z-5@4J){|x@fja1tk^5>TQ^0QH2GS zM`s6iyDd-e)_p5OuiCGC?j}rLZQnpb?q`2yFvtV}2H|fO7;lczFvVWXVQ!l{N?fuY zK21-^GqI!PJ}yt&mZ8ceS1(OtU0JL%=MNus%eUa}w7lOTH}A6yFb6n5Is^po_P3xw z2037PWGfQ_Y6cb-<<06Nsm-I6%4fT>@UF53Iud8BT?N1WO7GsXLXhfGW3Mkxr{|c6 zpTmsyQPaVEX%{O?hqt5TIKg`RTd#KeX`;W1ru1$(H7A^8soIkdP3kkBm{6xMa8-Ux(p+_1F77P*Ie!G{$P)_sPJbE6 zZLuc?;oNv$62utXB{nbhSE-~w84*C4Kn5>|5Aq)%^Gf{mslIs-DE$GlOYB{WD8i?wz);6uz4-q_mT^HX))l!94<@@Wn(x9 z=m{6;Hdb7glXF>511W+b8xuhL0?Ln&^^b4g8bK>3;mDBwmc?we>-o7M!OUbJ({|Ir zxWYkCN4Jd6LL;G7dj{GrnkY<9rHlr&!e4`W?R_)QDg^`E5`Gkbzm+nD^Ao`k#`2t; zV}OnS>~RD@_IAD>Y;MkwZ}xu8S}AeS?UVRgrUa$-HI!d3CS9dzkrG0yWY-{Li#a24 zqDIA9yK0C3DZ`T--e)t*gic?PvUUC8A0d-RC~KXd30+)rH%|b%;((Ozm23;}Lx(q4 z&em6ei3ysEH%qy^YhIB@8?2J>-p>#5d?R#A|cZr1GiE=dp`H^(LX%A0f!7!5HaCEmEfZ&c)+-U=lAE`sa$KFKw5)NAthvN zCJm4WK(lnvCby!33>Q~|84&?tcXwBFtBIipfThZ8zp*sF@dG@g6n?e8kb6)h@yrqV zl$7)h=xQGx9!AjyZ2`gqE1)u)r#h}fy?p%qszZPzpUiF|wJF5#5|F>ZUiO6JJEsV6 zc>p#9=rW&PEJHXLszOs>7_yb6r80@2$Dx1IF(4lyqLTvZF%hl8KQI^Yvb%!d0t|r~ zF2FJXaE>Ry6xD+{FV>(-ux1+=7+3%_27LdVuB@z(3&!htLD3%fd(|{qUx7&UCgMxw z&M_xYIe$md$=U{p0R3XBFd^TuYIV|$$sj=OaCUW-j7!7?d;RXHk?~Ls2wfPIRLC$) zNk~WlUJn(bOf}d7pyJ&Xbi67C*l(Oxf9qDAN~^G51b}RV03KKiSS{-ztj-7U&sl+N zfSv{bn`p7DfX}>fAUQ(;Sd2es%SoJ~aRKxIG%hKeqLIML-+*zb(Ls6Rv$H^<-1n-n zu)>8Iak&6U2)WC(^8&0J;QH7xj{~?T&KrX^kD+~a;fZRsN`#db1Oh`vb$sUjyz*+4Q zrrYMl_2Nn!K$Ji}whUxqUpP-=!#`tWWY($@Ra0{Yk}62D4Gcn`%>H>|NxB3Y0fAJX z`cHraE~q7Q>C@iQ!e7i5B2E=e1C$er`8ols#W5iRB|0WXOn3#fHCca)O+v~*K?Zc& znQPKAGM4gWaL};h_4{A%1HDq}VA&VWTk=5qz}wr~qbha*09!zBf)8lwfH93?DxstW zAg#0cp-Q?HP5Bb^X+q;oV*raANCgX0QNgLGe*j!p zFmw1g0Wij;@AK85LPem_3Mjdz0XK4IW}-b5@80wYKtv-p>Lrj#(EfnPGzNf5R-8IoT7=rb7U$V}Y!2des~Y9x z<^teQ6`&#l`e_6ypA$e)_DfKa3Htu2Yj1DAgvJ0Js7$9Gg>e91o-XclA;42efj0#7 zlk?_ZR6c^KK7?1kPoSirSOHqaSoeHDW#uY$H=kd-#uRy{M0p787$EiwgdeewD0Z}& zn3%%uX_nc+B=P82w3y^%nP&~TxzssDf}p2kA>+uZ0evx99-#f`cvgS`Qfi0wP0^ZRRQgE(?CFsp0MOZL`2+%8J^dd z56{lddS1hHnID*b4Qg&~UcOld(IZ{lRZwfK)^qMueMO8|X6VM!Gzc*EJ_8x!2i6Nf zqJj*lBIPHH11xt=!;24dt?rd6Da7?+U}=i9q31w>1PGU_fzzExJDkE5HV4B*10Orx z3v}*z!KS!$1X#pb@CQhms3`%uBir9gm;49XdbuS z0`E~9P<)cu=K>Qifq?~H73h-^ zZao0^eEPz)AMoKoM^XR`wX6978rA&}Al$~9?S9&Zynup06=+U#b93i6{s4+bp6>uE zcQ6P5PrFDSK7byGdI`c%)S6({g3{*?r#L-iK>kKhyB$aydkO*||L(U+C9nAW#_EO! zIwzoE5|2p2Y3a`c_uzs5DQrS&NEwW8=rIE1`+LYt*$DFxd4M#9y|5tw;N1V&tDJlb zfY(5-;L4}{d$<>^G6ek2g9mvdK_G+8!-0T&Pg8g}8h2_Ncv$n1lu#jQE#N6Z+yGGI zFn#Y$C)oUjn@h*t4#4sSrg_ib-yf(VOjgpo1%66mUjVq8ygZuYet;vVfq?i7E*aRO z6zOC%q`VGUKwW&AC=XaPpmGLkv^hCcZ{P00*t;ar`;-$zs%Hk>;b6wOEf8$hwl_1A zEI$Rz(^<@aFphM7K)wx#X+NRD4lQ~ZWYD$h@U^Q8u)I6m4UCm0cf0{t-;)JSO-t(% zgg!OCetyEnh%h~7GDK0wOOcSSyQJz?ah%54as++)q#bKax<>68gb4&F9%o%yF*UvE zsm(GHm!T|L?^BwSijdzLzr?U|QxX(dzjV9V>2iNPlyYdrG4I=_=n1f5HScwila+4` zIFxd3s!J|Ly zzsazCbdHNW8H?q9Qz|rVK&_v3DCu_Xf117Z<@Qs-H*Wy-wv|}Ya=J0XcP>Ey|tTo@T~>+Tc`K4dY3U>+iV>pj6zaZd!(- zB_BVFQfBJUR|rc9(^YJy&q(%O_^!`sQG&khW)(a2yt0)>^_=%yMs=xKMjbJ4&5Fc= zhvW_2!pBA3wVO4C9*CVQ2VDg}>NG=JvR!_0xokv$?qzY+Io*Dw`UYZ_Ps9yrgQ$`I zbopWKxu2N0*Zc&H%W+oqzUPr<_340sf}hJ{N;Ork8pV|83?IxzoSxdboSpGVfknmz z%u>B{!J_hc8D{?{2YPfno-?hu5ec?POWmV*O3NwtE#C6%R*=cpA-AYvwqcXCjK)vg zsuvQ<-`n1b?vNp`TfD^?t`oN)l2aUtKtAuG+O9cgC_psBFk6_cJG_`M=Wi0ML4Ezs z_0%mOT7CFqFwd%aOe9CMP(}m(x=pa_Cr*ye5sR-a!IHl~5G$Wn|4523FL|<->$v5# z%^c>qx;fAr~$E?rl?7}#cEibmCwFK1ssHJUc;{; z===k6+<0GdCBOf9tvjo`m^-lXbR9EI3&l6IJo{4Lc{0TAXi>}g&+)#bJ+oKg z1KrSrl8qz2q<|9y+{WD%gaFf|yi5@~s7+VF`2?uTZ@>PD@s9R#Bstu|nBLRke3rX0 zU8sJs?NrEx_4fL)%%NH=?T{PBN1ITD0Yr+!2d0;&ecgrRtlI}k9X>K#+FP7j?7sKH z58GER33!D$y=oo|OMhyI6g%1-S~li4EPXFk&ie*ImpFA}jpNHwXNKSP-RAo#+y@8a3nCo`cPB3t z#hts}u}_KkwZ9{fg^N>^H>9l{RDkZ@{<+<(l$5|9Nk+{)Jcv>(Fd;P~HaWBl8a9B| zr$ml6S-)#}@!axo-x8%bZ`Ehs2|>3{H&5_g5kvTSr1sEV4~K~Zz6!;yYKRLNW@8H3 zPUd5xo{?pwzj=be%Os&s9ZMWDEhvb0sh;aL&DR*FByXLo%sLmRe)H6aMm?3$UD|qw z$jzy*jAwj0Wp$fAyZEW>3nGO_A*ExceY@h)893YzcS52RzCTLKqomPj*(-uV)%=AB zD-uutVAIlX`aI?npcE23dm^1+?0-y7+ZcY)=``e#Z@RKNLH9u3GW6>cwOKrz%YIbx zai>X9*^cq_c>N@;Mi;%@6GQmu%_CsFnzR+Y(mdBv~xPp864dbCIR5W<3fXmKUgQTEB_kfw9AcWX8ZxQ*#h?m@ z&Jdx;#nC3PYCgEa$&lZLS|?DM^PTY_6uEXoD->6SGttGdEE=DSsjMU(FZaO#x9f?= zqpsU555tuA2Lcx>rF&7bUwAAFD}s1q2`OS}u9-r%Gf(w@zq@3^{YE*<0v$yaik7t* zN)60YY9_BV{i?jjz$6bghBr=?9&n~`>z_-1hPgLrE^CHbV!8k=R0SI zKHLtfp~`|5%?y2{jb_cmu~6RHhHl0I|ENXDg}C_zO60`^9(mql+@IuMF)Ui9=DJ^7 zJ^a1F)c5em105;ZBhob5t@XirUJK5b_;`zIRgKQo{c`s2(@(HX^9w{59tEURkfr}Z z_&^nnY1i}kQb!+5!NhepT&9G2Y3~wp`$2=^ zmG8`t6}9QKCY_(dA)hYV&twJ5W^(?~|R3$AMX6-;y2tY=R?7&o2J5y2v=7niE&~12o%Hx9_inY>xMQ zweUuGW{s6A(}-j2N9b^Rt<_pjs_LTOFB%^Cw*tCk4q7DGxp;~;1rceVnkCDn12SHX zX06NJ?Ikkfot8Ikm{*|v=y2mXD2jHLKwr%hz-Foles$_aIKLkn*(m#+uL9G#%|mg& zFmSB;JzZ~I5Rch|q+00H;9KnVnD)x94M7#C0NZdB%_N|w*Xex!ckVhzdn65tp{8&e z9YSG%+$U5`ralf*!3MnQ-&)m6PxHVYi*YkBv1*p*xgbW7st_GP?{{xXvLdvfIO=?lW~pK3oU> zp2WhHt~f-U2REf-IxY4EK104?>KIB&^?Li%PWQ1-Xb+YKo-(n&e3!MXpOV&;!#2-< zU}4Z+e7sXqvBn+?WmP8o@lq(U$!TXen9n0rX$)Md`x#q8lro_wjtUxMTiiq(u`$)` zk0a8^xqq+!R2O&f(DBw4jgpf5Q$V)t{kAyw+re3qBbov3QLaR^g?N3YQnh@td%c{} zZm$Cdg@6cVN z+u?kD+-Z?>yB?TZ`_`}h#TwG?oXbY*XkE$NB6E^59IvJf+eevfsXxr3?1$%Gj7Cb& z64wgbH0?0y!XLGmUbn0-4o-@CB3RRT?hLCwH}z4q{}^vx(iLW>rT(hugl_#C@=}RC z>Hv^f;l{_NgV506)QAkM4Cwm_GJTw9B!&oi5qA#R5CWR-kxE?Gb~27 zJ?FUgEy+e13K^uQbm-Ia{a%tri5=-B@jh%XglqoM)2`YRb~ zU)HEuZ-%e_MBdE=a-$}gM0t_CTWl1#=6#z*&k_dBErY^)N~;+>;BzJoLxNN$b=tHU zKUj^9H;wC1tjXh2&fee?_^4fX@u`MPb58He2uurFv9NVLm*jbK{@v7_gp*_lMdk^H`fuq_$lz8KM9Qw|?&`bNYAmizsVF zCSkO23-N|B^-UTo`+R+`y^o2`ZzdH?R1h`ayUA-!RD4YHPr!Nb>}0V;n{Ucs?h8p? zd1NCQLqsceU;VcW_pv)%P$q4v5qg}6JZ`f0^O1*uQ1)9*pQzY)Gi=ksyx(z=L*9jq zgBaM25FYJLo~tq;>;50H=_=Ql5g z`amo8)IY9?9s5`8@p1;d6-yzM6WM~Dzk|M}4MPiZAG{cgTeMz&FB=zMEx#sD{>7*F zRE$%@H}HdjtteY6S(3cA0KQ(!YoDmpN}+!u6oXD zt|kUTs~amLbq#*Usn@uPXRqk&Y9r5ScnGl|IVedr9?%4~UKywfRlTNAAi5jxfk(%{ z5=DnT&EBp2pd92uB*GvhRXJ8Ue5r(PM)%#_36Xs$+zj*5kxTYGqA!nrHOy&*3rEzQZg>4~m6CWujn%8LYAatunqaXb)So#7ixh=^OgyShCV!Cz=eGSYsC z(@3F=h>V&fm(aKj1kKuZjDM4Z_OvToQ3*w2p;bQ@Bu=)fI^4OADk*6Ms?7Ugkx-683e;7M$ z^JTL&>_ZQGp;+mxxTrLp!0`UPhcv2X8XqO=1e4fQp4E`L?vRA={y+*D9?Q(KL@k@I`PGmms`%C84Z(tES-4Yk zcwKIY>Pj+C*a8Iee;;B>4u_TCsh3z634LQzi)cB#9&uffZLaoY zOpb_oIzC27E#lG)=i9&`s*ebCpvDy}6hq@|GIKKFY zC1PB3{I)mdd^yG^cgZId{bIRW)y-7Cap3-(r<%@VXorpjU6bmiLaJrwb5^ReL}t}5 za+;q*>ENh8G5f!*{)j6k(D9Cgu__AQtHMKv16?TP;yzDr-{|#vxDm?dJ0z6IUAl-9 zCsil0j~e)=3eTWdPH+>IO*xK<-0T$wPLk`S+Hg-?(Joyff^DE=*mQH-J}Q$ML z*sUF51!5_4%s+S@%2*c|Qjnj!Q;r#J8m2e%Csga8}j zO7)iccX<(3Sj|nvzpZ8Qy@oF}Agi_=ZYDciz1lUYW-g|RpDj_(#&IA?>si%=(8Z5K zUDThhJASnsr@f)nn8E!m_rhCoAo4wXebsTXf6 zF_X>QPr}9_)nja&6g1|%HB(cvRJ1l3gs;XnWW; zqlN!y`kilGSpK8#OS8AOYQlK2`7hw7q!pgpO}u^|3w@5a`^c(B2;PUP9I?IOq0+YIs(b>a%`%s6J!9e7C{c6kT^&n3;>MkcR!o$Mr4;N9x$D zjHslZgHf+FDb+Tzf;D=$sVn-j57a%@uiYj^SR$3#5uUiatQuv#=qkN=rFKPliKd_u zSRALZ=?;mdL9ZCmxlQ+Nz0GVz zrAizsgY5Y9P<|i>)0S((FE3UhM~wPWA+FKl12iY4Z2}3cQW;CV5JtV7 z?fToeIko;$7ma|d)B3Fy+^4>*v(PQujkjmp^#!Dp7|8j_dT6l-Q?c*Pa--uh&f}c?amf$~gN-k=znCJ~D%h}mnAFCW*=E)zM9Y$M?HK+!6T6g4kNrR`~V#3v%j_#xk_JS+59O|2y|J@kXo<^^zl*WR(8rPH^{@TgoY zV`E-&azTM>ZFy1VOJS(X-NSQwRy!^^4m*n*ke&%nvx)4W2-TOyz$O*52>bpOZx^?^ z2om(ZyfrjWtl~7UUnvyjxv#b@Tz_*`^1t_0;-SCwwa3lTwW8{D{PjIDL%6w@6w5;> zq*yFD$BGwP|2C?>^<-GsCVy))HR!|2#{hh$0|a$wwJ#Tea#Y^dJ?i1Y2Vel$Hr4 z+P_Z4rBjyr3_sx53|AORO#PAigi{tpU%EhW-({bp`?;7Z?)qS}y>Q|{EOLB@ZVBQ9 zX?uIH72Ic8bY8EJB?+FN7cI7ilG+2fO|K!UQ*yx_O&$O&n@vrg4N}i0Bc&+)gxSz! z^WzD_;Os1JPf-3FVa71H!eTo{#+w$^qZhlcpP{_5dq}=x+tJnfE_zi(-i1Pkvb&J_ zM##VZG$Q9byhUOB%1kh))TBA`R|^Mw@kPpZp=9A4nc{1XZ9Yk5JR7TKQ|HF~rawqf zgu1V4+MZ&q&sZxS=8{R_pxP6y?ag$HxDa$Ok!Ud(|$6c39S-)Q5 z-JCfHtmGdNGA|WAv=?ESx@Vw{k(f$l-DC8am>Atg;juI+s-nulvm&5|V21=cjsg2ZpPicDYk8&nesXQdU& zYQY&f$Bus?u>Vpi{Xo51%utPy4^p}FXu4UOQ4v6 z0;1T(G-j5U^m27GF_n6+h8%^m4NpA^m5gdTGz~Wr*!1zUjZ$QPInJ1+gdx#(U47p+ zQ-56Zr~q^CX;I3Pq%c`y!;v%nKE2oehJzaJ)~)k~-<%rZ-nUmT#izx`*jE^-V%Ye9 z*65-U!-#vE`)6d{g7zmR3j6XK)U76n$f9u;^Jc6NAAR809~?r6Y{KA3rg>SHh@#m% zWJ?M`x)Kpi6RzoD3`x%&zG++E>w{kj>w%^Xy1|u8{a*(0m79~RtGS2-k@#%V zQ&=30suIq`9~BsNdzKcZ*FE4qICYTC%O`ud>`@sv$yg}g=g;&ywJ7nC3+jw8)VpSz z6j}6V_P{V%sXDzm!K^F4M?ajj(A3B@S>$43j{J?cTtXjwO5xrs2k{rH3lDbZkkhgZ zKbmVz8{oQ+WE+-!8JuXbv17`(=Ab2()$ceh#qBlQQ2mi~P}Ixwn^A?sc)m5Z)wI~* zz#P}*W9@uc(d=WcW8+fD(r%A@U*dPjgAJk6`Edyc`7jmJXBncStVA5hB~#}N}2AP@Jj6gzuyJMWVxj%NnGNsf7ycw_DWs^%erBwDY*1i z^%qyZl@67Xw5)B!ZYp9lTr;Tq*16ZqB6E1SX3|e1AF8P8M{-q=Ni?;it@Tcu zTo}G)!xiS^E#g-Z=Xm?}58A*+YmL`FrqUQn=NZEhV$RY&L|HD@ll&oJLy66z_IrMX z5QA~KMW`TEwTFQXUHm15M_xSlp{?bUI0Y+6m@(7!nkd2WhKEOKggO;JH1US1E+(i; zX-6a8CDn;?`yM;rn-1eWn*0(YZe8c2+~5u_{D3b_j=_o z&9-{gW`>0Sa{gt`5Zd6XLR7%$NJ_i0CjM%%NI!Bw=^;ershp4co|oiv>;@#alcRIY zT$pxnBmn6@Koml`qV}KCzdBM`wv4udUnhBpfFRh|FsxD{c#aY4d#JwkxzJBJe}pJ6 zYCLLRb_%02COhRUs8qEEOtvoRX-CesG^{)7G-g7k_oO`9o`pc)<$Jf?&u*Iqfzf&A z_FLsLQJWZ<07Nl)t9Ku29Fm_xMa(xBZ@Jq9zT1^SWam*PkIAW%r*|oQ`d6<+fBZCb zs57HwekVqbKIY7G&nDjbswOZRf8*>-49Tjeu8ZZhb*b9zla$)ld!{A^!w^JACsh?| zTDb>I19f&Km+Eorne6NOv7di?EUg!~5ewJsLvd)JD$t5G z+Sc_(EUxd+2Q5u_#;t;xJji|5id|z!yobP8ub|Zyju}3Dr}2kF8c*P7k_fK&;y_#j z;~6rrXjzBGDmNNsDQq+-Or_@hOFzk&9{a^XfmONh@K}bNAJ6R`6%U$SJ&5Mbzew@W zXh6}w;<^k>+}r!!AvG|SkhMYokhMIguSDR&I9`?1$()_V_WDcXSsC$$+h+N805w_x z|4V7v62@*M<#Ox&uX}26d&6i;a0?HPjC~V+4(piksq6$K!!ZtEPCwPrjCy2~&Eb-# z4&hjG<0KEcm}Pr#FlSkqnw~O!jJpYw)P~fnb67P?w0jxR@9{br@zShOea3hjA;cyN!yjr4?o$@cj1Sk^IjlLu0ZCZT)g*+2~x3uf3=jX{4MmWZSg*zC1P09uDsmY^iP!B zWz(|d{Vm|#xoFUK9wKsTXv2_>L6n>>OYesKkj-sHF$-{_a-#I04dxaKxI z@s&QL@H6(|egGQZf7fL_Zp^|lXJ&61FnLI#v<&SW>4Cf%-GuT5`}k0dn_`20ulNLI ze<#b73+s6cK7nGHta}UdzbMMC)4Y|-TPbG$P`21yK%TEn-aq&JYd*=5HHkt}h_^Vz z@V_VNw_D$HNdjA!6x)t2DM?5!ss76H@Fj1ZH_h&mEGxOF*ShPW3=!g@Kzz=_Q#R|G zy!*Mx!FB`r9K=wt#W!7Uj7qhmDJj#ee=oV$I`uk?Tg7BO$!*h1-L@DKeVz8baQ@i7 z7kU9hQsaJNSEvHif@v{46Q|e?n_kkDVbe<*dcGo?xC159kGf}(>>oRV%q>^>74dob zvklQ%0oL!Fkk1s7{|}62mzS|2KNFYnj0YD1GnY}t6eoXMNt5ih4ZhE>&>t9v3&5pn zYO1>X&A7_9By)55evLC_6Oe+8$D8V4f;(@G3q--ln`IG37^I~~BeQgj&lZRw2fuS!^YLO43a z`>O%rpZ|ZP<3aaDd@j6Ko(&X`4oP=z;f``|=_yW!rYE(Dbm^Kf{`~&y*Uv9JiLiA3 z_6@+%+yMfZLlI8)9J{|irk_fHGv5QqN^|9tuTGk~PC z%mNTmtN{WNA7wni5c_n2E+cV|BtQ5wVSywGJmP;DA3>s)V=WmdA}(kU{fuKFC6lP= zcVu}gH9Dr9I7@2ItQfRbOd6YoRys+7Nh*>MZb@hM{Z(q~L7pv~7v(@lCvn>Ba!d->4`0>##)N!rXRj|Xqz)O|DT^hBKhkWwUMKaodu}Avs@T^|^^0D#4V$bwwiQIVP|0Lx~)cg9ar}P2^BG3S;j2 zM9woWl{z_*L#~;oDrG&9Ly8KVGS+`n6S;2q>k~O}z>L_C$AJ$PQl0DZ+R@K(cwi+# zi5t>5@Nq-ia~)nc{9o$uC@1zm{i*-2kw2H>N|VRu&I90YfcIAvPaVZJaKoSf9)2g8 zJF0b|Pt%!HEH5N8 zr7jcB`R8t4B)80PJ;zIJgPMzCgSGuFb4URk`Ba;{nS4d(ifl)@+WJE}Cg=3OU(Y}j z7AB)C=@|{>XsUlYr|&-9<@bLSk+P4q`+0K6985+bqFjmvohMCoe9iH}{ebBI@We-R zh4`RZXy#_2l#YrpJFAhFucdiR4w@Md6AGK>aj@fTaX&uG6=fDmPWTb?C@ZSbsoHps zGW~hX+c9Mhdfj#DvFgJ*(Sb49L9^eaEY+LFbxd?t&dKvcCm@P#G*^Eb8znz)ZBJ0` zlb|_@WC`tLQ?kUQQLdWX?-Ie&%j=*6) zn&lj)eY&0{m?m>5q+HT~Ni!%_m*sy~MSq=g1gb3FQp#d?D^yv>?ARqcNueFp6BOD} zTv2GRtnTgdW|i`l5R)fM?hDG%$L9N(M&RIO5NpJ0P2%RKY&|wYHSOnZjsmHVkL!_e^E2s9F+F`@?yh+?-k? zY$-$cgz2rdHjHGB81I{Ys2n4|zn{cL&Lq*$u+mK-{a{b`X)i&94xZ2EeZM`&$ZtNI zl)1my#XR2;i@ByK&&jkr=r;xU-zwK1qezWy6tE6UwSs>ZcQkYHG`fY~lj&xDeNP)e zU!+}5*`|U8?M{5=Hq9O9cm)Y-LfvyR5-wzQzKL#3ahnRONR<4YUl6XkI5MFU3$<5} z0vf~5yIWS_IxN--Tt+jL_9D0pr7J>Dl8n`CtSLsP29~iK-N*JsXdUUph^!#3k)d`M zAx$ZzMN@x}=9OXQ_10U{Voa<30dJmh3|QaubMkGzXz}mmvV0ZI!&0xHiQsz$*MLdc zqwRXMA7hLPK;Ba)WTqlm@QNbYX|VX&@~*1wa3i`$QCI;Nwk)6TkA7#LKHhIL4R0{Om}`>1vU6Cstl z@?l4@P5Xco^nu1B-GjW#c%v!~L-t%1!o}p}8dbD=)`DqzD^Cqu(3O{PjW2Oy+af5> zZ_~#;oNMh=r3(0Pcqvu+7{3W}qp= zWvklsXdqS_AwCSn3dAPnGS@(C1rt{Hrm)%2*wm|KLe-0-w#mBnIK{Z% z(`C7ykEbThBs<1b|DxYb5;yd1#Q88DD>%!TRa}F!)I>?tKxa6^*7Q`m;=NepqqTp+ zxkb0RX3l0GbXeLI6om}in65!F?di?FAFG9w`r`}y%TPQl?Fx!K<_6cG$bo@T^EDw#9PJ&&48i)8(3+=lN?H83aJ{U-M^ z7t(Ir@~M@Ld#v$3?yx|UO8)BCjDmY-T{)1;?NO}W??mXX!SamnGbZ{+b) zS&%AxD*GNv>ax4)qn04N^Qb?TD4#Xu;6)J`xJ5c#;i|(cT`BXK&9ycrmPREqJ?%f!65|7=JUB}P_ zW^f3G)`iFHh0vTTUfDyH0&EKr?cYb;J)aGj1hHB?QuMi3LSK;(3#ICHTGe}YXng-K z_}XY~mx1#J6o+HJ2e)Is2nXMnCZ|p&myn$aFal<~m%^P1A|JQlbW`JCgkV~U;p6-8 z^HfBdeG4 z?_tjuU6Gd2)*}sKf1JBwnlR0$tM$ah2dRXr)gr6STSP91hUvPjcM-Ez5pMxUwx>J` z9nr*2mFTk3!o^vSP8mop&-(JLdC*g@AS$l5P#Yf;wZYrm{3~qIi0kT_05FbaNzyVy z=ISkagRloovgany%3MNvdW(qhJlidglAl=WW^NBEj@&fv#srMQ^swmk^R2s@O~TM`O#^)rrf54L0>90jpT3PNXn;``-cuK%%f$0&%bdh1P6_Qx+yFe~NWnwPUe(f= zTjEt4VoIn%6l|M2HLrPsb_$RJbv!Jrf&|G7OgP>SV9#)7X%&>%%b7(+pMLa_pgBcjM|h;%ilI{z9$#m9 zR1~XNm|z_u*4y#9(J(!Q$Ct+VOB*~KAZmyjnbV%?=oMxKBkw5GM6e>%CyZD&vJ_0H zf06-KZmtz{&dh&#r*O;CG8wIAT|1{OZ?MT<0Z^n6SS1AoT~5xN2b&RD*V7nZ{SlE{=+2pai*MLVuLDahr^!ie~!Yw zazJ@m2?zOWQzGiLoPv;2Pb;OKYg9OYP$WZLK55NH!hKq(4Xi9@l7gOl(Jk!WnQq}% zJ0{8gJ!Wx@WT+R`){H?M)(Obgx}9ct0|>NCkvYFJ5RMs5&XtlLQrzORu<`@t>?7-T zNl5HiV*n|jQF{S9;W{nW23%k$f1ZN}!9`)HhN+9kDu7t6*5bT^l?rfCL|L6z-(vMz z#zUTc=$=Ml16`l`JA4qj#Jsk}gDYMsV~SWI#j!~tU6rTvj9ne2raQAHyNXn|&^#^m z2AUEXth?+_peZdg5{i+-cu4N8f$c~c^nT4^Msj73tvPHH$0eR%s6-ZaLBI)Q3{K;KtRkAUW39dqptxL-6L-{ls z8z9>lRXhe|3n59W&g{|de?=E;I7|79&^-;q2D~OlA&-IADCR~Voce4al|`VgcDlw; zOb&}*o(WXj28S3=nPbI|K9{kHBc%Lq>Dul@_%sq52xE*y9)qx^On0nA?S~k!jlca_ z+~XlW4aEk;5W|zlK#Y>{suYJ~T+_tnExecXRL!I{x#t1gPS{S1f42dfG9=-H0&od} z@v(%qU|M(St6VS%eWG)Bbv=#G2JSM3QumH4?@hPxD`G72khoHkzKHSAq^h4>sw2C% z<+?$YHt(#ioR?<T#H8DS}mMAw4E!<1b}w} zd0OBN9Bqsq9s{J+w85t>%2=JkH|6frK&qV}o|bk4MH2&r$DnACjS;k{Yb$G|R0QE# zkof*`>Un`SfYL-?s?Qw$944{vyh~`y?0STC$2L9R^Q56vf78a|NjV!=ZP)Nj1D>rL z>ekLC&z_)bU`kFp)--2^g!(Hw)`YK;sp9Z*8(-B2eWY_uaNinP%=#4JgrEqm#}P53 z;^BAr3Su;O>f>-NnB%6Og=5%>_Ul;7>>Gk;YZwaI`WH(hH>5W3(yVkHna`#GtH?RD zj=diiAh$8~e|%g@{BW7)pB$5MFnRBGpT3&3c)qeEPWLYQekRw^K>2y*Pz3|gF?T>U zwPr%g31{?P>O<#E_MC1P-*arFgwtDAGh6!v=K6yIs=4w1m2L zvwr8cgM%r^O_?Y9ZBiR(OLVDc)VHOXUT$8RCHp!}e`TPw%j->(#eSXo&g$a(D7WWO z&UbIp=Vb^_+4dRyav*& z1(T+@WQwbn&ucUYC$P$!x5p~iFVqCEW8Kk?2`(Gz=^w(iBo8o5P9^*Y0zJc|N)fen zjZ@Z;2kQjBox%=$-!S4aJp&&a2s@pBty!`E2c@jy|D%2+moYh06Ssw^2@7SHAw5DT zmcldy4z>~9>nr#Jg3*n}tLm1Q$qfo413^D2m+uV>l3^966OmLQD3@pa|rkjBOD)v-~6<_r1Bdwin&x0gx|3Z{Q*BnFN!<23Vwm`R$s zMa&|t!_&YosN(`F>6&;HerN7Po=jHMaHC>%bWuB4X%H6SG`UsXljT-@NeXN5Nt;U~ zq~6$Dwjf05uEXB;?%QF7cYr`IoK$B6;iIxfDItBeror|_KAW`m$Z=b^O_})-6-ZAA zfg0KubGQrF;bnjAzy(e?q9?(HC_rI_%a-HMmrTb!08{7_{|`O=muxw^pnu#(+O5pbmfGMCSgYJ;j>CepRo@Z%Yt3R_fp1TL49Ge zBi?;z9$xi*G_^Ov-*?$xKvPP=hqD^FaI`;0w-k}QBy4{I(h;A`=YZ3ODTGW;ttJ$g zd2?<-P9LPlm%an3OK$sYH+Qz&s;|{TO8*=;r>zs{&C<_dK2FhCHlVy5zw8|Ij@Q!w$TZqLAmn zOIpwv;e?|fIQ(<=3}#{id}Ap5=mg?^@Dm2r&4R;_i}S@IAXo&QuS*gy*+GE{pLHU9 z7>ON(RfOKr&XXJ5wwL2(M3J#uwA{j9zCm~xH3oC#3>ZqE)wPyYUWTo2na!-2|dMu1tXHjg$SJiCwCXnje# zMICQ>yAJ5$K^W)e(owGJ!gC1lOI?78iRKLXs!$8*=brt?kv( zfnXEcw{NxdxL~Cvp@_CvSq^&%B=mpvaR!hVK#Q5S*r-*sW3$m^RcGl`SlQ09$I6*b zC$h2&o65>|^cpKqzzEqI^3|)G<>VRhv3(1yWQiYZ<~qyYb52S*VWWa~y7b*;RoNNP2%-32A-r zn%_O(rt(p5XWKLk*{QXoYle7h>oM}un!Dh{nL$cwfv(0f@yJ|Dw`L6HC5>I3qmIuy z;Ze_L41q0ftgslR_8VW&0VU@U8WuWi9AW8VoHw8UoIn8ippvt5=`$=IlE}%1_X~Z; z67c#eHK!_^3CzAFZzc8UckqA7e97A?)6laa#4#)Xc$`5B<7;v=NyTK$*`o}b0GN-i z^{CSH&f3e{0Y>vD(5(+U0%I5YlqS2L)=gnOeLkQgq8Hw}P90H^K(*K_t;SPFr3zf^ z$^o6SYwXl12Z3{)Hp04KsOAjJRvaDM*U3A4*E?=@>)tq@0B+cS0@iB7U>6Jj_c~ah^Krh+2ySppX!8 z(0AX7KnyKVs!8|~O1=^5v!D#I0SgUpwE;GDS37COr{v_7EU3j}#^KvIL>Z;;NMQE@ zxrtmTSvDZPc5Jty<8^-{nn$p^w{Wn+vui<=93oW0=lanqh4~xO;#s(dld9&^>)cR_ z6#jTi!Dwm7W1zCDA7vhfHF7R%qI0VD(n&g z%*m*<)9<1J#+6|uth=>NHw{gP8@=^w=x7}qnEEa<;LWt=3ub>48Ssj4a27IbKS|A} zuPvk0N3PgyL>vf|=43?L>30z!r+O%5lF_e-BqNtmQ5~qT z19#(_P2jdsF`@r@7EhFpO~2Xnlw;Crjf)Q~pQknjVjauJM3MSBckF$X42K=Ax*hP_ zC~+#c-}QZjI~XQ9D=Ca}pY{}NGZ1tu

=1nTj7l$jcpo%gj}sj9lt z1T-t%4t~I{in*hWGkiB*VoHx!pETth5RSRnE)Z{bTJ0`vKztYLwvkPHA)TKIEd{Wz zXv?9B=Ok;Ut(}xWccD#-#**}Qk96T~YF~A>QIxq7>$nT9D95YzYO(4Dsx6`sX93ni z^JUJ5vD8>saV9o77TpHU%c8>n0Cr8`mm%a06o*C^3Wr7)3x`G*42MP+4TnY-4u?h; z54T1a5Xi`v4;@4%f5lt5j^s8F&F3rh152}5#S2(8Fw;A;fHT{Z8IF7<-oQ@$`!1fM zt`=LL$5z_;ZlM*Qb~Fr|;g71}mHftA_VK2H*#h{{_i|Mh_N17=+>d z+wk*eDV5>tg)fp4kuS@?9pClk6N2Lz;Q4~fCrc3KzwveDf9H_q#rNvmNI~Wiy(zJ;b*wb|9X9Y`uk}vkkLwj8h-uu6vhcbpi_h5 zhh7i={675g^uwHJiP@SBb4UVc#;p>;367>s~T z>j=Nss?vo?X(y2Nwq;T#Q41y#$00r2G^1iTYZks2e+-OLf{0p6(3x(LE=WuKVan2x zX(ab)EVy^%_c^9q*RtZd@1|hZf>Y~G6jH<@ zGybhJMo~*NA|3RZ>C47vUPhmQFKfQApF*_boakwuL%;}+=EFHeJ1e|}Er&14ts-BO z8g-fDdUD7|f_Ta!Gd8zkI9Q=T&u8~UfRyGQf5o)Zg0Eh#ofk_@s2fJ9x(u@B?wH0u z5{WfeFyn{Fx|uOb9c%9EzR8Bxt0m;`eAohY-@6K_nm4%Qb%q#mKgyYK*;PDlaaw&wlT%@P5l!@ad!ntT+rR2RS@g0#s zYsPyiaj1jkdNeRj@HKxUM55XPT~l-lagBX(t&Y=dP1<1_*0&9{0i@*IQqu%5uX98$ zrI6Vz@qq8p+*d7L5m)}~?(-&z?;eZAe-{d4C+6bk9RFUDBuj#{4j2s?JFKp2GLAbo?d95`dKeI~La35{NG>2^PfPRQwa~Pqmj)ipFePONXA$JBENo(-zetwArOe zP=ISET!+Qlfr~pRvi2mn;(c7Zf9NhwY6w|3u!7xah_~y4eRL0_u!FAT!Ux<*=<-LL zH0{bzHAa(T^K&ZHvqAcdy-G!Y!mcgo^T=vKYkK!RG!ILC8%^{i^zC})IGX6WXd+vK zoL)=p3)hw@#no0STR1?$Qu%2RAlrEU8r~~)X{u zyjmp;!8u70trlMSWl~h8ZKQK8)x@yTigp_3OfPExW}=ayf}^Gh*|Uwqxa{C@jxgpGHEyY)?L_%78apWKRD+y@ zvZlCFRXX$xULU;Vz)aIJf8=AWdgJVN=Q;1(fCP^J!hylRS0&u+I`qgXxJ9x@lGe68Vx99gZV#gueQH@GP z&N-?pclMvqsHD);iStoB zc3`%tf;k6gYXzHRe~WWLbJ7OBRD--ujc{!rW^F;EHwYbAb z2AU!#ywpcF(B?aJ9mhTu7#2oNR!d*z=cXoG^^4K4rqr`3f8QP>h?M+zY@(D{?Gb@= z@`z&Iy=Xh-q^@_g6ytXz50xWVl1w%?PFMjrK>`1;DH8XP7o$IZExxcojzg{>XXePQ zua@MaJWG#g_n)_Pgqpoh+QpY_k zUC;?U)~5cFlAUd(=0y9b!hwKd_L|A{q4Qx~bp&}Sw4HrdzCBJbuenZ{+xN;!au2hb zTMgt0FuUNEm13sHMIXg~{Vz~PzbA_|DHG`Dv}9mX==0XI;D z5fZTm9nMY~igJgmjU(M%l!(;n4ukXw%I731kN7?O4!wsl^x+;CWKjTB;Sa(RD(wlZ zR%8G`@bhJKGrt$p&HPG97}CF3XBgoikhmsN=&UoJe_84%Eh&@4gEakFCLKwdv@H8X z&uaig9aCYX|AtOBvU?IE>2*-a-&&*^6vcC?d5$GY109<^UAI+Xk;R zOjYoDf4F#rQAHRLT47==dxUF(ZG`mj)K?&NMyR(n#hg91Yw(856@=>CmAxE*VvRa#L!#~%vX=u ze}-sjDXGd!mWG-9JK9N|Ol1RdWw|a4DEdWjWbXg1KpzHV1!&>(o!8(jG%?bYI43l# zTKt|h@=nZz|RmmGAf6|dl zfBaLbE59u8FD+rRLm{PxJD!j!g7A9NQv7V%+iA2$eHQKL={8(wZ%m~=KCIKyF@*2r zMxD~gC=&zAa;UD9{3nSjOx{&aG`NV~Sd9sU_v3ncUifW`X-Y%IOHYM)K$p5i-g(p3 zSn+|tC+ow74 zfU^BqNZV6*M&`8$vh;sE^VOA7x=InIx~DkgLY(kGja^Hc6Gxbwml0JF6@NT~v1yJl zPja2RmZN*J1e=@?hiD1ql?9K)g(1>(bLCkwn>;25SMV$VwptHI^XaPLDI3Tp63l>K zXa+{3pJN>wGiG2hhiS(KD~QK_U6xD}rYCec&-A&Xz0yh4dH;sOjAddDqNQE3Ophfi zv~7=NMvqxP#mO@i8Jp~p8Gl#%%Z|!(p^38F9uarWpnb-iJ#t1Qnpn%xJ@hT%9+#BH zhR{7$n)C%)%dPQwWW&vz)>1_PI+=`mdp^raSr|7&j}K^^<#cMfXQf;yiD%K~ndmDq zDD7M)j}$HDXYx?Wyj&#+D+s1VXR3tVBsOwpI0m~HHNb=cj4nk6x_=gtQ`djA?bxU9 zyx)}nXx9u1Dzv_{wex=*ofXtI0wi9vxGuCLz;j;4U=!*xjBGG_>_lHpqOT4he;A<^ zzfvb1`H#U-Cq(0?%+xSmcJol=kd^wfWCLqVLJl6Ud^R()N+{QcHEIr3j&P$cfJnreLFN9{P3RCQO zVG+|zaV#;@6`^lT*~qqE-Mc4PgM|uhl4pLzL+9)j@7gFD4}ZZ&#XiL4sC>nX&ZhtT z4iLZn=H@px$d6l|kB&uOeuVQEjFlL8@~KI00!uL+>ts(E0XeQj)26}jh&l`t%~*F& z-rm9MgqRE~EUg4UXDg<1hczj_%C9$NvCUKS;B&kCh zu0mR_Rqjf%xqrN0N{n-L8WAZ?=oSP4$)MSBoC#u^)8Y7?qIE?ObYYy!0);`}6`_=e z)N%4oS@vj!>9=Vm>AX!T6aG=;k);IHWU32TWGkjys($~$<227n`?#?Rdko|^I>FPwW+<%W<%r-)n&lT3p+?Jbe^CI+) z4x?MdKm};2P1i6?U|PmiJ6e40e{Sr^Hk6n--Yb<@mDrBp`Q~d&Q6Hxm%kq}u$BZ_H z_F6mo0NC1)&dd1h} z(S{K!ITU0>`6DO>8BoRD;jNl#0*^T}UCNrf1Jbl$ziL0i`Ag%kiWh zd?K9Ggyi{Xa+%;#FsTXN&&QG_4!clt7U&d7YJWQBd>~m;mqT&nGJ+|LY{EH3k<&QG zAaa#i<`{ArEGdLsWgt0%EU8u(K&ruW@k0WUEWZnwYt$Xa>(<1TXerG_kGP=LK35eT zgt(d+f?2UVxW~~(-&sFpCgL)U-)E{F-7W;I0iQEBMX0&m^}ZpJfa3+Px-;6Lgv&plS=)aj#%#Je4hh8BoGro`%{iztxK4 zk=!LktonIpf~s33m!hNixw!YD8SU4fpN9k2Ws^zE#2Y7*;#@x&NlRhzqG@B_xMGG_Q(RX&L5rC@%cY^T$ban{&-cTPq8w~%&Ridz&PV}(0PWC$``G3# z-X?B2++TDE%88(22Zw@z>#xmm=ym0|RxnF_7qr~;rpm3yu^%6|Cd=uqKkeqehUx~* z_$szg?#XyV65Gy#p0Hu>6dHmTIE9wtvQubA_fDZzN4O^tkNLuwYHj2)=333@N`Dpi z>`)Oz+g=svDM6;4EX$G{jSS6!@lJ717?yVXw$0UsRa4z)Sf9rYtC_`l!>S2hVOR~t z6~n4WZ#As_04hl+6I;29rBf^39DRI*K51U9D6cWEMR|7S)y!`?O=pOPvUWC2Us{Jv z3#zMzQIrWs)VOBRMQ=X08xV-*-G8L~kHWZD_75aEvHj5Uz!v)t?ejN+$m2E%x47y) z3w0pniK?=R->fPJ_wd7MF@i zAtslzToEvT)antbB6;e`VznH8ALQ`E%iH&tzkMJLRyYk-4c~tofEy%#g5-xr4;DZe zgyH)i!_Qx(REDoNzDP<$zAS%teAlmE5FGaa&lkLYu>_(22VZw?htw~=SNlc^nlHsI zx7dRIYwjiaGThVHL|5nQ_WH~BA75l%0`MK0`}_BQm;b!)=%gZB5^T+yCQxbgLNY|hm$dDKwO zpHvplmKi3hk%^Pg)x61Sj#O5^#PGySYRuRuNb9UG^r8T)`Wnekfr5za6pzEOY``sl znF!EDDk@PhAl2YuM&+K}NicXHTdo5QOnpbt&>8}nD>( zn6*oB$R#jquY@72p=AbdAH3wiOkFc1=pu|J!^qI0Yut5cgME-5U-|~5HpME}K zce3U%gd40eDbTrwHC76%^z*DCJ@@SAu;#YE|8CYChH!&5Iz>&_uttZw>33T(*rJDQ zx#d<|+HK)pXm`STc=;Q!k`@~L=~33%bnARE211tvSsJZy@aXt*l2GEcqm}`IrEj+e37c?h3!M7@q_o)!hvmMJhjomir@M1SWlqqJp z21H51+cAAvaM5E(pYZz2P&~YU+I1Akr|{wu6v>m2Fm8w->%3jeRWxZxP2dl~bbL7* zFgYtMZkSvpyeniEruHm}t(lb^wH10jaw>Ui*%6*6t~odkBk`^OZ((5GI}*A+Ic}H% zR+Zd%N3sqi`4yqV2Y>tX_n~|8QxPw_EM5$Trhy||F($jIWU}-m(f?3?MinoEC)yDy z`HAfbKAasI1_EY;W5T4J8N(N-m5(^c}y$f#fj zkX!@;1Dv>oL*~s4cjbh^YUp*F`D(ZwDU>4*i;0)#P8_nU%=uGfNjO=|EMHqz39lHDG6nEYUq057fYOB;EH- zT9B{jWtqSVunV$WSNgFby%abaOn*n=foAe}#^Rc0Ml7L`wr4amTg>SwfuCuEu}dGp zh2#&-sGO>gOk06}?#Fnfj|v2_iuE%(K_8Xo0Cl$3XZ5jY^+UwwdD*8CGfwce7cr}Z zR%(t|kc2B8T8HDhLz{M#>i#t>alfU6qnZ zq9p+UM|KhG8z;29LWQ5%I6X~b=gc&FXhYW|1<@eiVGPWFw?dVYh#yrro`BexLZ7*Y zCF2??V11jKt#g}QeqVaN^wy*=t-iHQw;5sop}=ttZE&79PmJM3oYzVyKL&hy7w7L2 z&Qm&MImr2KZayO={~yjD=FkS`*>7@idJ*S|4J1~(4`vtVDalC3ee)#uk8$Z-8*v`@ z4|8dQ`y2&-NM|qNJ~AacW=`yG?)w?{=>*-MApaL|e^UZ?bN?`xHnbP=Dwa;{@aCm|5?r- zjwN<;{xFBOIIje_Pi;V+q_A_#C4t|8GY)Q|h-x=~@CMLZgG;~1P)5hor}jYeo=(K| zj*=oImy7B`DR!x9s0W@V9oywz*c^YpwNFbPCyrJQqLX-R{hmaT6=Q6Lr6&BIizefb zMndM$d`$_5IDyHTckMNKr_>12`zuo2t%p`wE7D&Td>yOO(|anNp`-j-PlA=orp7Pf^SV2_3~4;o@>SzpN&> zO=;Vo0G0#lr^ZKN*!%X>mJ_{z+)J6hH@+_(j(`UNW9i-zyz^myM+xk4yom%y5F5A_PuyY~vT-d>V{@JoPC_(4Q_!=qY}p%po6Goj6CfTw&+eQ@kxR ztiW!(P`HC%hv1qJ??mSiT2q1#PVov5{n8f2j=hPp>Qu3tlHAgmGbd11-p#4;$0=NC+yrUUbPU~#fr0L7lzj{(GkUOm9`b{hfCx{{#CqkieG# zP!SZD%4QK2ml5SICx5+M$!;{a5x(mw`US+WxDzl0{4}&o*YIaO>>G>U#%>XqSGG}oql||eZBnSlZ#0cBSEw2>-P!p0mYv{@k1pi4L}r! z>FfLS%MX+?g|8dF1f`tgOXKeb-{spY2ZJNP;tSqhwE#E%6MtWKd=6op|K2>-Q;_&# z_~e^^!tD=n6vdaqkxB=;GQMtazkdDnLZb+jSml0oZ|z?nUoZcAX$6wh5+%j-+xHju zKyV=3un9CJT*36`f2QAG{@Ic(@iKsTQKh7;@M1_FAymo|?j8laIDLCnlpXoaOGN~d zn}7WI$JBiC^M8+7AmmtpYG(vl;nVRa4dE!%dH!lnXSzVqc*LZHCW7lkSFDWUiU@7e zC<*7K29#FumJ*}eQaAIW6$`XV`Ht^smGl-Y+u0ZWJkOI-1XMQ*h-IFV-s;ixzKj@? zM1q|;$AJ>PMd-k}7~mG?ZZbiU)Fp~MmV6mLVZdBe zy-pYgnlO+@g<*d{gtAM*pymr@v1kxp%yE;GmJx+emnO%eiN)|ERCI=WG{+UQlN>|0 zX({fTo%7aNlFvDie+1W)CVYPmg5tbN1tXa6Th74Ex1t4!@q~8hNFPH=E*CkJr#a-5 z5l;CD4mn7d<<~g$w(@{g80XTWvSI7gqG?ig@AdSI2su-wK z>(RMDW2-?TnAu1&F_PfxDAvZ3-U9}s!(5$g!ksG<^gigoxhQ6Gw>;$LAPihkB5m)p zvy#Mp92K{$2HX4RLq5v2A;$Dr^JV!A#{j51`Idjzxl$l)s#h1f?!}8*pVn;%7bo|l zU9rv{iA^<&uKs1P5=~+ZsK4R+a;{%DuuR~F2%|e5R_0HOie~n6oDF~Y2wlVBF)~z(o&`|=I8=(RHxCbYBtwYn$lT4+O>Oq zyXAjd^pUjkcFf*#M9V9~N10Bc{utLW)Hh6y@Nb$gBqXz8*^?`q6 za{Ro~J&+!J#nYv;d6T77cjY&;Aq{JM$C7ZtCgf#gXLhe8J9CRmaADy|b}z6#EH-m$ zyVpgcb~;rD^)}4$4ia1viL0xNk#H3eSh}8T^aJd~yHSe!;o!x(47H#`vJ~7irBo#<2OQ*F{&7uzxfT9WRNyu?=YVCyi+C!<5*iK*{rj)Ox{Iv zSn3@#DI-eCC!tBhu3-vtaw)BMu1!ONn|F7kg##oknXQ9>(1qtO;k{6o`nrEp#U+9~ zsDojwwspX5sDZA|i&xW~`8AYiuAh?_xe>WTvT{-pd_aL7hCDi_XWlR7fChf7~DM zGGSThlMBnoz4*bjJr2hX%rbuzBF}+YF#@^C!y#9UTmdIN<%ucTYa@-xP_# z{rLE!Yq4<%cT~eerSlxs2udJ#p^mFY$Ue1SqZ<7L)eJ+pqZ$^GVt+x14WDlY`Ed36uAc!^M`YP*Ux--8t6hhCbvZy8;_(J=kY-@e2FT0CX z=fUR0xIEi9F&he)r+5pqif}m}lv!WBRP8uZ)tD*=J**^O!O%LHgNY8LVpzLHhl#%F zRxAGRgFuf1vIDdUCCq6lZC6JGH4nPCZ9K>;juXsoz_yROxa4PG#xiaKk{0yF`=V9T?lpF7s;c6tRy|CYjvXBx~%MPvFl zd~va%w0&{08GM05%|W21yy8&lwr4Z?0*3-z94Otxan7N@xO=;z<1c$u-(4NOhH(tB zbc(%0EF6DnzC0r_g~>&kgJ#9FA{uMXW^{JOW#iWpXVu$j>3lkh#Zp7v@5}OH@#j!` zUv*<}N1V0os9aElCg~L}V{>Q!Y>^xtxgm0I9QXk?W3{z7!!Z_FtA&5T>exl{hFzftfI+zMAU11=P97PZ{0-9vwh4p)yZZl*5WB#%ab7BBKfgs2V# zi}&$ZUejGmDM`&e7o)i(Mcrnpt z9voRxOrLC~Ktrr62b&pmUPITjZ1TOEBI{WeeC;7w;+6a*S>7*`CEa=3)=3_1h^D;; zFHAHI9EjBO0WHy#We58wz_4t}+aF8z>x%dm%jlJ zmS0Dg0Znr#J7eS-(th%Kt%}7d> zcS*E!dF903~b$gCVmRaYSMo=!4S_G(bN5KJel1FSoCkzkQ+{46_Q1 z7`}cRfF5xA3!H9hH5dS<5r(fH!_VJ27n(jd`bf?Z>0{`-rK@`VhG3}$IQqcrHzUEf z|D?~Imq5Q03kC>!@-{v}mr=hHF@F+)p%nvK!axpx{Ac*>xFy;Tyw?BR# zsyqLTkXl2Ka;=prAO$}5p|xY^9|cGi!J-IONiZpbNtOzdG+32}ng$NFH1QrJj__fS zbYR%cF)PcEz=*w!W2GJxb)#tV6#b*jv2jaIgi^IcPbx3f)4+eHsXuM((tj|C=FG8| z5(UvxN-rf`g$q*0d(@L0XE^G!My!?*Y7h*R%^Jv29vPAG{CNvK$j{er-sJo>Jek^g z0~$vcQJ&q^ag5UcGX2_qkN+i3+9)lX?uedx6~0H0qI@fLhW9mn+vX{aWZc%)2|_a^ z^uBop(}O)KDC?M$lj-p|c$a{{6A}!v;02*30!e0F-53{_p1>0pf5OH1M4WFkS#Q@$o5*?nU5_^im}Yu$rJdVT;f~kX=JC0oU|LzI!5r;(mal84PWB9 z<|BJ={is$WhsDG{B2{q7q=H&1;HtiYTV}Xk==;PxXv@f#oiz`ow4Hf)7=4QjjH`R7 zaO#@RO5*3HA?LX&e}AFw4{IaHx04%dcm0r1p_mbiNdUdBj39G23-zC&lJZX2o<*fn z+5wY(?>FhPuV?2W(WH_p_f5Le_lbFsngJBkAR_G1cS}9<>u!506jHWkD}n8qKt3fA z9j2ZUDY~UJjFtoI5Q1R>RP}=n7oRPtRQRKx3MiRCQLCc1e;vFOj22O~Djgn10TVSO zu;JH~V@A2U)A#3Ch>FtJf`%jQMBs&r6in%3;!Bm3PgFEaE3Boqx#;`!)Om)7WuM?S zNElpt*|>{@z@&ByRi9vCa`lxWw{=AlXDdxQIGD&>QQ^sqNhw+gE(kXI2i!I+3Ul;X zp!x*Cg=FBwf7t{tr5+@>dXC^_pH;D?CV1KS8G=`;o&=FL@KN)$ar$WRQ-$Lc3 z5)x`*bQMvM2*V7Sa2&db9l`8>H>-*1SBRpf^-L3ig?5%RRF~(%6C!^iLD}v4Dm50Q z?yu%1%GN+dm*at`)-GGcz~mY$Ntv2!wMC#S%&x1oOAy3j>Z{&bKvFQ*E|Y`_6FYWi z>HA7KRE8xviTwE&KKz>={zQ%aQtZ#M>5tqEAO1W1%NIu*f=S>gnCt=Fo?t#ulqZ`B zVkZ#_9U}{PT*SeVAu@k!_ob52I8}??t^fKZ5Rz=eV79V;PcZ~njNcc#gP}lfw^@>% zG%Bc(vFcT-ft4V9iOOfm&BHxeZXPeqgVT7?h5bPmPY>=6vm&6d()Qr-DUQ6RvKx_TfTD;X$fv z;6jHCrz8l?ESZ>G;7olqf z!zp=0mrcYITYm+2*MvEgj!9>haZc!Jp>mJc`O%F_ z18*E7|1}nemMP3BBjU7$HJL~&5}<}M6!;?|`8<>k;XtT(Udo2`-54swbbboWL6m#Z zXn-t2R&fo=!Z2mr{6vkiN70oQ^#2dtZWtQyLdZg{fqxe?(_(&}qp=4#uMo(|QTQhW zsx6a4A9Nv>+)XOIhtF6E`H24?jUwGhG!W(?6S)Rqu9(*FIK;W|Vw2}ygBWKJ;||1l z5aMnq_8}(27}JwWAQnzC!$rNU84GT56W+J@6jzotBBl237;OFOHDI%xNp(>IE-W%5 zWy7@|;(x2ya0&H7=WLJAk52=49a5=la5sV(s~$)kni<*ArA@zH4ZKvyh0euGSVn6G zp@CVUXPb#jTFFQ&+wg)1s}=p~G+>e;nYjceMZN0zfwOIx)Do(mV9~Em1121kl1osc zp*wD;^D8?jofJ~LwP}DPLSAu=iz2j~Jd$;v=YN{I^=aS)Avw5&O<o)#>ek|A;_dfhF*#qW22+%a4Ww|ubv(+@}kXc=Ph zH9#xD#Pq@%>X+We6B>Ww7^<%UQId6=>7@oWJ93j=YAB8kbc1-*m-i~$z)*xBehr97 zk{~BjzVbS4Qtj-Q4Am~1yB7;=uXA{aaU`LF5sr@!}HTg**flh%JCF1)75vj`JuPgV5~Qgr?t&J_6g z3H?l2T20`}Ocf3_sR*CMdHOz>e5BykCbInXH#z;29{xncCiv;UiS&CFBd32)zr;|u zz}SCNFc4$%xiqlHSWa35ADHdT0%@UBV!58hG0h-=&=Be zdZf-Z#1NyuQhbLLWhrnqry$2=3Vjmi6n&amgKdUxCgPV;3zS@3Gyq~NDUVsHIEy0d zRdGJ)w5?Dct)KU)qS{6En5&XJ?^GG9Oyz$c+xj}z*DR(5`R*xOk*oox#$)$q8&$Cphm)v+0Kg_e7A1dP zcg=^y@RAGgfD0@eYwx&xYixCDxbb=&hKQ~F-}XE+3|qXsLaQI<&>c+|0W_t!n#_k$ ztyN-369r$d;hxmTf@4-#E~R19UWRb^-LR=}u|&T>1zMnY6n~&(vbS508J_yON;hzFX;6C2j279N6fufeylww~qDK zmei>in!MrJYDyVeC;fI4Wu>AS*Uxjx%zT(xlOrQp0I!4BkrrWeBGAfFD3Wgt{9lOrdD$j_0@pMgS>W5jb2Un zwSK-9FQ$Gl_w{&&BzHDB#`x~sS6vhZB}$YNPG5}Xx|U*hHfwCTI~zxMWlp85d~Q~w zE7Y|M4R)y$->Dtwf+1~W#b@TF2+Qr-g3+vTM@Y@gz&6Pt{KHxT&5FQuZLocoZIv z9&#+HhY(~m9zK95)U5|vDAEHcG8!5vVrfu0T?s{A3bnTD{|kzcDhBW?8)D>TU?C{7 z2cal?w}m41>k^7aF=>CC5k6EXY}bkQ;kjEQJBMH7i^1U+^I+Ivnw5+ec5IjAGVE+) zj`seF$jutG*fVP|!XBn?utx_RU=Q2bVb7+$15{z!eN<`uc>y{4GLpb?(fmi|;ut$a z7_LJ`y!13|=;k2|K#ci^Ep7b$f<) z^}~2DTte8bhrQZc;mHS|bJ(kc5i-F3 zVJ~6YS2j%Edm^e$5Q>I%=1@uLl)CLiRAZpQ;qfP;8f||9#yh${SF<>%S%gAo_Sw=D z2kiMCI11I^$*-F*dvh=Lr8HriF7~1&%dvH#)pxt?mwc)P`n%4*uV!&Dz=^HdXZyfj zpO!(G`JJU&<~GMFwRkF}nS;@$*I}O^Gu@E{>F{WRbQO#DlZkd##HM0rAD(s-h4xBF z-w#UpKh=NyW219DUF(s}{H7dbM(DZoaprDLjdh9N(Q8pLWSv~&?zUbodw@DYd8e^o zGfGK$a}_LOpt#TuQzFE*(@jfBu34k=ypz9Q_n-u7x6<7ns(0gA$Y7PUhbbK|7gPLjDDJlCo#TTKc!1*<%3n%jrc{S%)*>$_sm%Ir=Yk$`~ zU(0{uU}zItxzF~2WmkxdVN73T) z#!;p-h~I15O(%{<_`$eCrvXN{Y0WI(j4{UbHBmC@P)(FLLph^JztrqF-*m!Vt@>DE ztzt5dBUMZ%&8(LB1<9jg!_kavwC1*&Sf3zOk7ybHqX#;b9#f8>5+GH_`V*^>(SHIF zcK#1IFR;Lu!BY?ux3|#~?Jbwls{|&0wOcuJE4dNQ^(!XaSFVS}(T$@@W)($=DsSdz zW$R6R>?VGJ*Ma@>-8cupoE%aCMF|5m`uNb-Kz#UZ;KTdV%g57?R|SJ%7KM?+$FGB+ z2b_KiPJ68*CAOwu}eDiWKhF2=hTQXI&yYl0fAc2X{M(ot$aOv|Xnv zICI#O4KTBUV8*pZY+y$4lBkF_GDpM{%!08A06+$ZYy8IaH_`(%r>~lOfGL+|X+KII zf)dhHd?OgSxY~~a#ODE?^i9*bc#Tl1q;B9-^m$b94Sk|uMv6x(6d7`VL&TAB?iz)X z;)L2M@?qXKWCqTRmY*au0OMFhh8smb%-V*?$}nTpT?hJB5<7hukwpVXd|2-+gLTjj zmZ39R%|#N;B^`BHA_tMqXo2LO(BmVWD#SPKU!mU+>*t zvsnayX2gG=MF^=GN}bb)j_e-qMduS?K#DTLs*JyUDk=*_u7Q@7AHV-LbR*y1N5&N~ zOq+I;CGRq*G@HC9IgoC$ny^6wFEI)9hV^Ni|D95`o7r=eT3XxhNameo&ryZ|YQmq4 z#tm?~q$B9RU(=C)^#hkcaiVaFaZ*B2xK1lPB{?3bl7EQ!%uA1RTDc?*XhWh3H3$m8 zQ3K6Lt%1x5g&wJk>ycg_mybl^0@6_*9op1@j*$_2YK#0{a}I?s$8FbfE++80g{tJh z07XwVNAONwNdeYyJ(2egJ4nYAB@z#^LrZPN4mWF`LX|LouHT{4(;<6y6t9c!qS&fk zftQ=5kwSWBxxMvGL?u!JJ28UL^TN<9XC~s`10`V@r6rGoQcG>ek$ydXq}#pjwL^wU zM-|qObSLi}cA(&`tZVEblipw3(lLY$w`>bkAvNwOZreiTkR%Qr_M($^-%#G*ycUIF zQeeO0fSWIWr>K+p?KmD3FsbB38eDesAejL%k>-G-@d1CL7O~*p&@n@$Ucc?@U2p`a z8K@eKrOpv!UW_TH&!|DOfJnnMs*dP3ApMpeK6ikz-BP#(90teU&OL-e!9crS&O1Pu z+T}l!9-QO0{ATs2MP*z_yy;@H?MO=VFUo99V$wr#`uXSUMgLrq?zmnmHci>%4Nc`;kTH{g*P@PDg5kaWOhw5>)y{MYI8)8tT&PAQ zxAZ68gMupe2Z{TXKc268 zD05YCt^stM#{#I9dV1fpi@yx8jsheTTvPPfFjLn3N=TV_APUkAm zoV)=-&CuFo_ehjdj7$6YdnAhL01Nkjymh{n!cM*@f?F#-=NgHUk_qkReRjMQvgHmG zCS18m4-dvvpnmNnFXPLh9Lgc>0x2=`7ZK(iO>``ij3HjNs)4R~Y3_EfhGP{VbpEY= zTUErgU9PZk8{)W`Hq1}BcksHI8oOj$nl=f{)+Z=i zEUywFUowk50bSMo(AufG=yhJuc&y^v`hU_Zh!>?A3JYBX(EI9t!mylwmzB~VaAV~& z?OQ;FwsXzTiX_cNu(>8t=w0ak;#y4Z%V>Q9s!LtAvSL^P)oHA*mZhC4TjdLZ0Ueh~ zA85y!O1aRFSBeRa!kE<1lxO5eg@Zv@psXU^FZtp8zb|PG&aRQbs32?C{FTDQm(`sV zFb%3*^|vp3ZY}yYGCI?L)@75{Rs)0r{7coYN*Am*R3e=rm4ra5r0O(c%&creGBoXy zKdftmP>f2oOaAobtFb@)XMHP$OeoPV{Nwsw{(k_VV{f14on(eXf7Y@$8oft__KfJo zzTbYV+uc~7f?(T=RTnt*crJq{f7{ukj4BL?*hGa2D81mOQ($doFlLd~>xrN!=KP#(4rj?&zP)^1#vTf1{~aY2!3n z=(KBBm-`458#9k-GWzX(5fZ+!4-$IAmEK`0p?7-sn@a7ji#3lvRGLv)(D9e6>74bZ zZ%Xt34^k|^3zxxD5EHjt2^2MImpW}qCbze96bS}@!UV}iO?PT!Mb9F})O+WEd&@2L zg&1BQ!wj%Ym%bY|U!4=ICQn&I9*dDxPvSLoJjhayL$RU%&r-cW7&l*W4zQ69-HKRI zFppv3F$(5}87LWCy>KAtF#ELyD;1VA>uSt1O{y($36L)}CORuL+1_N%HqKcYR2d%FFqt5mO)I*jdX>Mg6OK^&(I zfd}MgNP}dc7yYuHzcMreXCSIm*d$j+L#b?TXq|ngWiIpRh#nuGObbf!J)P68Kx<8nHDa2Z(h5J9-sSbV#%f$ z*VY8n6s{fz8Jb#A!x=c!Ja~;A$}(X}Xp2?oigYPbH4I&@yHG zE*(l!T8%t_6j174tgdTR!g}m&YJoF^|)j>E(Q~F(~^co`Wb2>h5C)e^i~{@^Y-!-+W6FD_}k7RTSNfMb~xYEm@+BTf8| zi2HTp6mux2jlur@;DjqmGjo_c#cps995WAoSNi`P>^|ji%bKK%4TCUn(OMdB2UGytOs?iwSje zriA^!<;w3VmvOul6t`i16g-cU5p*V(+8z)Jx6KU|W(j{LoLhAH9+euBF4Z;wH*r3S z$2!cyhxq)WRfF*O&D#YBP4>PtIcrwy_w^#ea8!Zrs4W%jqEp|wKsY|*EhH5KrM|LH z^Dv2hTT_9oTqpa`)g0|6ACfw5magWAa2e0F4em>}1CK_6I-gHN*0O~q*8#w7?OHD# zj8CJ;i41?byPK{%te)$vj4Mnew3=OgDA!c#!QAe!KRq(ljs{=qmUB75w{&j}hWV#A zIC5$>9mP(1jSc7kP;S~d6ZYXfmuYKuv8CJe6%5zl;|%3(#o}BNTU-j=mQPDq)LK-< zfoeJI_7#3{rQ?O1@oU?$?0RHcmUEmd*K%l>D_4IV>e)+sn#l^*PZv8M*I~1HcWB+y zHsG3BEBevoveEJ>91xaS>F!`X(`4+etXRCnqpP))K(D$31*J#1prrkHJ;2mHTec9# zE{u`&mua^v!`bLOqI=Sh@{5}WrC&TJs~x!#)_hF92xI9CAM!H|IdblH^fl>%oGU)y zeY}6@6X@6zy+r6w{h9j`5%;`rS^B79&`Qwlq;b*lJ61w3BXtF3IxcPOkV}Dlh2o4f))$7>7&Awj-nLSr}g~>{+*bb{SjzIB&=I>WEk5Bzzi| zXy>a|BDchML=>zarAaOY&c|k5Povh4fRcZiq#1j9`=D%C+`2i^SzAvo(gC?%)cKa{ zg2XF#QR4R~FG=3|W7c5}!@$*@D--0hLUt8$#!7y&V5qr;03ZIp1Q7B6L-1!SPyOC> zx>K5uf5poPw!0MJ7aU`H$NWjXFPGY{1a@kqzN0;#6;%yi)k1W)$wUj9iB2@PYllgU z8E%jzuAu&9+U13TgV}W$e`=RsqG+$hftL#>e#vRku+S$^vzxBKlmvP_t$DBL>2CRI z*UabG({4Xg6ZHIzE0X^M+qtCJm%&pI6SoN(6+j!88umXXw{JBSUkEoMIjQ2fbaq(j z&J;O0H?=>m%)oWDYs5s74`vtlQ+;VAF6j;(YaBZUJ3NofLs8YY{#iL z0$ONhX1`^U---5R60*tOszn}pD~!F%8pv#=cEMX&0(>QqS1Wu0NSvkD=jBQkd=a}a zwdabsG_%4gFhg(7i7iZn4}wRov4WTxuoY+PqQ@l^g-DrQ+DM6#(dL=&*OvXfwa8h2 zr8~pOT{aR|@4GUxwiM~SYh4j0bI+qN8BH!38KN-(j??{cwMguYc1#LC5<6j8P__`e zLF$@qh9x(8GDa~Sbb!I-BQQILv(%|Dmk zW|2}b_|R)?`}}r>c{4BVOSbc~MXa2E8Mjc~y$ywchh<`B^p%1y(C--CTuFBFS>@j@ z|1QyQB|X1hw@a8Q=AD1hYCc!QN&|*i>%#xZIco<|gKwsdUi~xqRF#e#nyt!qKt3S0 z6&G?>Mrqf0>_bYRqxY?0yUGtU1&HBaXIB+vM;rNY2jURmU8L2m3P=wbvbR=$g?E3w zPa~FYV@YYijwm60xFXlc?K!|K03zfVKUm-~6%N-_cGGe{O< zs7jRHfC^I_ddFz6e+}2K9P%l96ackhR)*_bzXta9d`fwp>(>I|RKCPlJXgZXd2z|K zm2cztH3x0evz?f{>3y^D^L5I96$@uqp=TK-&osAS{2|-0oVk1n50p67&3GX!T(9|g zL{$(B4*0bZMRv&@glpzzKq-Ryrl57mk+DQilcTE5?d94v?fZ3bU9Z*!xIAY@>oquU7Uo>C%%Yaf4s*e^$z^pru4biTp@iWJ&+>(5*-pn~t+=5)t%kAQ z;%oz#DbO$8X#&2~0tCf>jvCU-jgw^+pB5t~ig$~|K)OT-2C0Qcykx#!vj9Rh&bMH` z%g8k0qv5HG*?ui%nyoAa&eX$wJX$NA?In7pBYROEdIxo^cZb#~Ym33uiGH+Dd)YDF z5o?X!PWlsAkCrS$VAdQNGO6onTh*;(@^4wHmbC{>C*aD37SghR6;hu|TOsyZ7$fUF zH?xPihL?MF##l$}iwT^Nc*ululN$s3?H5mlFQ4lydLmzVfe@w8z`ze~?Ci;Ja06@)xVh3_9 zN848m5okwmKK$!{`@`S9{UR6!{F_FA#)CQv#EqwPNe{uM$GFGR5D-Tk$Mad>3JG1L zn}Jgvm&eX6-=>Y0jtOOa+x$q)h%g>8rX3$+l%uZoDQ#Ps3Q4Wa<)M#lW0~9hl&D*s z3SE(uJeDpozKo*FsB3dwx?D<%SLN4j?Z2$e$Z={)YP+`xg$?bO-yK8^?y^pqiJY!~ z`E^eH+)Tqf+j#~xfW&e1kx31d`}Czn3<55Fx^iBB<}rsT>no9>8qvO>GgwV!Oy}Fa^c+sQJDR8blQt`;BZH3Y_3lcjv(4V7YlCp^73CD-hH#vv1 zbPOYzLeLvVM=ns_?waxrxT>Jrc~+CIS7o8+exxvgl{8(@Ft@yXF)Ilz&rnT|+XQ{# zDtY;TZ%lgjZfpF_cI%TaUXe@W zecp_nF*V4S1j@~>s4F%fx|E=K#n`;vDy_xzJC~*1+4;|-!~6w7Nm#0@>Bf%kfo$;E zCF#5r!YgnNU2CeGBhwbEO45iG6fjJT8o82x+_iiuH5<2Bvyql*4K^7#6TWV!@~K2k zH{y2ha-EY^AZ$@7?I`hOTcv(hpxe&|2B&cXpwn@^389N|y~OAg)_#G zdmCY}wsSF2?)ta6ZLqD@zd9&g%qBi%?<&mViy7jRK2?(SoTJ1YLek1;t0q{cQ{MD{ zqrp9iuN(07{;dv3{?Y*Ob{qN;GLLX(d4!AK{Iw&#lxKkUv*3jq-W*9L&^2ZeG7tIv z{khjuRHBZ%uR-D6Lz$Ob9^#oW!;qf<`S}OI0V7iPqy9SoASx^%iyI##&b~f_DKM+_ zxUPKPRPkJWH`Fc0GZT0_a*5+gRGZqQ@H5Bx;}G*dV0LtuVX7$;w`XP*uYm+DU#&5h8t4^Yf5F*3 zy!$NuGQJt@_O4yAc<}05&_u|+XuHUZnlW42`Vur@90mb-p12%`qI=zYq~!R-JrD;?7h$c0{}G=$V5Z1h7TJqPa^o!PU8Y^aTTA5y zNs3I1u2|~6XVjfH!Nq6ef*D<3jh|>Qe*tlqpp%!e-4zvwO6e7cO6eAdO6eDeO6eGf zO6eJgO6eMhO6ePiO6eSjO6eVkO6eZAO6eaFXqUq&IwrS)Q6R$xe=>~`$w{?EE|wRO z&JV`3v|Pxv5$4@+tiWtC0XYU{qlLxsDAqK2(sIT=$$%xW8zY==g_k$H=|pE^>R|tf zSCB*}w7o0Wd9#RZ>D?$6u2Z&~%7(6&Gb=zbR!8b)%bcs17f&!ajO7~T5}4wZ8rJM` zVkAG2dW6Xv*sk)Gf7w}uW9FRi@YfFDvxtqF#WNwJkKq(R z-a}zqCJu5u&_Z9rE(IIJyB3lf^$^qH@@reM23S1Rk<>sztfJ*E|`V(Z;q z-uG4!8^cX(Z@vGY=#@j^o8q;!cd0b!bwadkCR)Wcqbql$Yu(O-HbMDSl3MYsM1D+& z)LfRYo0&yfDM{w}&)UxUkJtFm(F#30w}gy{n=0#cnj9{@T%m0+YF3|KDC12!+n$CJ zWz2u*))l*QOZNRAp291*m(fQc6t_THAngj5u|EPPw^L;xBm@RAWChX#8@GRHAXWz{ zAwPtrmS+cVi4Sc&&4O}9^0C>`Qfs}$i|f+E7{z#!_s_4lzX4r%a+9&U6Soj?Ag(+_ z!g5f;JDuXUwag}xAnb?1_;TOJ4r5T>mi;7(4>id^OoiI?%^yJ8; zkzSx}8#*IZGwmz2k6f)Y?Mx#)W96E-&zrau{Pn&2x2W_;DZ$L$D?QJ;fjJ^8y^iW0 zfn{bOJs3%X*Psfl&G6eKvhfBlb{0Rk237|!!zghd-}uO4DDNMKR)XD`8Tu>Z zpkTuK#^Vs~@7`z@T-@mXK8jB8HKTv1mnUSEVC69rad~V}9SOc>eXHfZSv^_bv!wdK z36jQgCyWmS9#0HEy)zY~tgOg0qFPsm!o3=Jag0D#81`8@s*&;J=ru%jaxID=I>%Ff zi1JA?Not%$bLWQGDyfAg==)EjzMDr@#X5^u*9*{bE>s{i>!zOK`!Xje5>}V)Od%Ur zgwhBi+rLppMgFi}K=yy!jP1Ul7LYBjbhF8=s0BpcM4_9p-Bc|c5KV_X20B|bTdFd7 zBehikl6_3F$>S(Xv@E=fZyI2mZ!1%tBiO|^>8PJ9*gzPUVND@Mf1lYF8PyGg8HwK`)f{vn}uew@C4h&BNJl zQA_pb?^xRYAGKp?dpTpr(ox*lv9zuC?^sBlxnt=#Xzsk+r5wtxrbA*yIRq{S)we#u z6{=g7o8!2TV&2wt6j#)3F*_Y6A5gc&Bz66+7_cD0a{)3*e;vWcQi!<5?QVzFwO7K^ z7*>a@W?oCMI;Kr(=sP~cNyt10+39^6il0?J%+RgbBCUn!B$UxFoW*p=5-inS3!&u!qnkR!X@m)O?8`p`ch zv8@5wmHJX*`)(3DM;6Eg>ttIgijS+$OV%~9qf6IxAivYD<%*NnU*!Lx)4^Qeg zR=h)q7U(RxWw>Y4t>bk}1l3~}7aj6eZDnokm|Bj?!R%YN;{)CR!tjRO;@Lp37H0&| zDq+m%@>1sKtQaGY+v@(B);@~pDwbr0dzWOn0;9&~*OUSerCn;Lf;o=R2J+hSW|1C* zJn!eN9@GAE!l%xVQPvqB@^Al3QpVp7jQryuH!4&G{G5KC`lvy7-$TYv8BwhY$^10OZ~H5>GXfm={iYZa3&RHJ5VGOvkl0ly0};WA4TIf z$jT>I;vp!j5Valyw91YpfZOP52j-`tdmM%hcwKTm9s{q_!dG;|wBttny{)Z_Jnb7r z;maE2_24HAs_Q($Pz!&_7v|rTi_deQNPgsJxD(;SNNgZ%lZ){fgsqMV!`lqJ3wX5x zeD6bo&A9t~xqR>SAnu3p*}$EWGjg`|KAUbGuXe&cD(s+02^b@Vldb7%DQ-<+)wM0z zWJj`d<9d8P8#rNdL>?ng8U&1C$hr4AEhVYO*fqY38KsOplxKgI53{VeE?IyuUs-YS zqpZ|+0(}^e4WLzWK^_A%hAQE)&Wk2t(sG=miGbCE8g5K;E|uxe)YasS&?b_HXS{_Z z3J+fjb>2;4UvyW+Gf(~}o!AIvQMy)mDgR>Cw>G>HgY?%NDzC>g+I&tqWD!^0E@znR z19Lh?3skdn6aas`sWbL=PG?WjJPD7zmG=STg&GU7Zy$Erb!H(XA9YW-1$xZY)+&Sd zr9%>vJV#1J76Jaq3z@|{#8s*-xg(!VjI->A8uclRhhzFwd@guzU#k1ZFO+EJazr5R zz}5&}-M^OY0_|UlT$?0aV{j#1x6Vu^=ESy*iEZ1qZRfNpVkx$mu~cq_cSe1CaD&tF zrQFd}rc!2LOCvSwMAs+kl0(L{W685ADCIIBbEjd>L#v|9jsK2`k$o&7yd!khMeAz+ zlE9UJbU{gfFP&wm#cdWmxgo@VJIYh9qOz~^piiX+p^eaqJ|;BprFwtJSlWIhUb4RZ z_B2Sa3C+YI!Q}wHe-Jwc!q~M@w4%JdtG^(07$=bS`Rw3VH6Nm?j349zrmN||52$sk*$C%XH!;FHl6Z(4uTva2>E$vE&$3pwTT&v24%WXmA#SGbL zPPcZ0}QN6xB$ zQVZEqwmd8ZqpP2@Ycew%7#K%=Q!n39 zB`zoN2~xw#Upjs&{~m!;&}Q6XA6Ga50m@Y4_3h^l=rzWaUu853QRo}?P;63P*WGe9 zCi@qL@#jKURn~NAqiQF2U(RopQ9GWOd@F5q{1*^ECGCQgkC=8(2S>fdv>>QrH`IsY{R;5CpX-ZlY5Op@=<-K zDh&P25d&v4?a?R1SfxSYe__GtZp_rk=?6B{Xx~}6()-roC;;a=ok^!{KfeM_p1{Gu zH)1sw7gViWC3KoI&w(xM4c*yKkeh?Om&3Tek|k8L+3Nu!ks(=sx!xfq5POlFpN>I$ zryxeml0Mk-)X<&NR-tPIARu)=S{zB8+DH+>U@P2Uv*gFX2oxb1ISFB!01yA^qlRjn z1XWMf!fO?IDqw{4s_^NS%a?I)x6Z8tuAJ)IyG|P2Gc;*U5|(KL+K__M)5q!ZG$V_G z0jxv+h+~%j>znuU^tdbYa6!Tn!spWmiajz-AR?q$hy?4~b=^*Ddar!xgCf_EqLfJ! zflw*go&?Z*)X7gooWMILYaFE63D#+SqREkHOhwfBADAeIO%qtZ02HM}sE zy$g>GpFR_LUnKALHa)HUsk-Bq#CH|7j-dQ15d+dUuujsFto?~|Bp(xNhs#DvXrHln zY$xCM)`B2r6X7#fq<48_bZ2W|3tWIU2!EOxT0C%U9fb}GdGndBC35B{lnl@t5z7j0 z=zV5a52#kwR{(7;2$2ht!db9H{4VnUQMnPm1znP) z1Kj$|HlQug`*jea_~Ti)n1tubEFg#8X$^!_gSK^VGb9U2F(lnF(5An9YRwCLM|5%9 zVm;6Gm+iVnX$#|oqB#Y`4?p0W9%`*2Xb*qjE|dE2+y7kCrR1XR3i<>%l9R+4ofI5N zYr~pUb&KVr7Ol3{1EQ2_pXfAc*j!Xo09s+OAPYw~aw>hejCd&N{Vpg_we-HHu@;g$ zgtW3Row+8g}Ce1Ibv;5S(M zlp<-WUih3`jV3*CCuO2A58Awa*M4wKB)-D{l=>7JHM0%ISSFeV6|)5YLd-R@((vw}jvESh zUW!|iMl(p#I}o&=%UT>Am2&x0rpA76h97tqfDCDf>5QD z?QEl1QrWWjx|Di=hHy){2lWB5pBq)(I=IZb);YLrs{XgzMy?OMZUF3+ch*NiG|Xl( z3<(MBF0v{ZQzlAwV~5&uO9~c-M=r`>;)pzVa@GF9^2PZr7|JVQhWw{=J`@(6{8f3e z)A;U`$+V&&I5N&_(@PqFNUBva3xe%_sdO?&%_(3|2qu#mTkqJ%z|6jSZM6lTeZt+C z+uNjC^CHrTuOC@1WN=KScQ3S1s4WK7L~7&`EaY z0crUMaI>dML;&ndF)dvp!UO|0ma|_`O&))tXO%xVqriDqCCN1aoKK#dPhS%oh0{Us z`?C1zY)?OIH7Z7)fkxn>t;3Zhw}0!`hhu`)JY;f00}T_eR2-XJjyH>vPkAx@v%N-e zU10|H8t){wh!WKy*kD)6hM|Idf;KLz@40qj>G{k?oN~PUY8*MMNMce=0YRltDSu4z zsA2S|cv5nBaOX>WYL5TDK~+xS}dP)(K#;E~% z)jTGB{|wVMJsS$%1wyaWI{oKZ3tVB(qT7NyhOSA4Q(~~o&g1%c>}p_pWkYK7#!>B` z;i)Z8mxRXsoEe^%9Xdj%v`!dpVuF%Co-;f&U}XQuY@$*DJhRO!8+MDK!VJBB^)(vb z;JTwWJMvV0>QEbT|Dqe0U@j3f0bq@y=Q2w9#e_LYjlecL>R?iE?YbfZwM0hx=Yv zf4=<6EAyKb<==j~pNT6HdALP23t6^k7;wPu&6hcilvxXUwn{p8k7G_+cFsLpG`>Y% zeDcmjK>h}2?Ue{Mke|#!$rR$ZxnX))w^Q+GNl}Yue^OsI^EUZLMtm0*uDTKAG)h%-w@<*k}JRgsK=`)D>}^F^yQzOw7Xoz*@KF=N`*%eG?O-6s_1bSo)6T$?CP@ zTLI}o0+P}{$&79uYdrpYokUj5Lk_L0XRm&;8nwf*9UqI2Y+qa-tQu!D;YZwGhU(`LB!J}_-^RS50Rjku)9A&BxYHEV0cwdL-rGs?kj zHdyq+XA}cd2*#`$DUnT_6SXvB1o{eaE^DKw_K@ly~)^s=OW0>?g2~>*KG61#NH^3W#Dg3kg_bQSQ4ms>f(`SsMa3?jo ze^Z!l7;|fZFCj%X)MLwO#*9D+0&ubJFVpMH%e2X;iO3&J@2_JyT{D9$l(f)xiC%&g zquhqbi9Gi#3O!Wgy9>kz^On!*SEVuj3xpiSAQpPryMvpYnIh5nn^E~S*D?^M>wp0< z5U>$ZCyAmI5Dulqh$FOwE;a171#$`KOnP;Yv`2fh|5gL7PhF_UCwV0ehtSh;zI_yg z`2Q%!l5@WJQ!&-&cdL_P$31UJ@(EK16vH`!FNAzM4#Q?wb-Uu=4ra-e?SxO zgYT6DxdWYo43WNyZ(_5s*VcfPHWsLkzNaDNFI=>Lys|-y$)xZSj(z=Jm6Ywitn>CA zQq))$rIQK!a2iNN{kO~&LbE45zgr8FI?nr8;EKhX+FnM+{0-ZYLUTX*au*;lJ&;tP zpJ)S@Q(bUC`mE;4`d6oNt`Yr&3BVNxu=!)iKTV^+kt$~KF)Ro~L62(jX}LhgXSL%v z$9oxI%rS1GC~1__J~UHDQ9s!V(XfBU_x+)Cw3Uf@*>s7Y=Im$THkKYLKp-p&%l%7| z#|YIJce65M;mI`ZxFUkF7^?X5ek{P-ytM<$^=TeG~} zUKzVK&IfV>Kl}Mv@oM)vD+t=?vr_^zLgtb_>GxC3bNzW7^*6)~G{OJg+Xk{B?IRd0 zN;g`{R~1Z5G!Sf!$D$GtmJPLvcV}8=WO5aHSax}&i8lGh-2_O%7kUaZ4e=f_X%NPASoSl#A z26Q7+?T?}Rxy0!O#ImVsT=AtaAhJy_R?`z-u}!JLLitm;l4)V7U51d6Ouq}GTTT%_ z`DKP`c`|353jl+;zc53S=sKZ*F4^3d9ZFyoRB1Jp$xdrx%-$OjZ*r(apE#ALm8IV? z(f5lr)*_iTnM}==i#Tod-<9Iz!5n9Z(hdbXJxqxnJxMa3DF^Kf>LA&)*|Lg1c*A32 zMi3hr*0ni>0&#Hb>*{`$74-q-EQt7EiEoa_p2Hem0M;H>LzDW?O{n?wfWaa3#SFt; ziD}f$=*!lg!3D1ozYsBURdFgT4}9$&+4*MM=SHu1BC6j0C7va{u!uXDE6vHm4D*BG zl-ZVR53g|J1GRKs>!o59Ke()0>hgpAzdthFF-unNvEE&G56yU03MQ!*A#mCp{SWpu zr{q0M0B6=eDn`xeTfuqs9S|6XsIKHSUCepNY@Wyol64uZd~$(K1#I_76PCj!rP7wGbyV+Y0hHd-oe2$&u)s_tXMSuRk4A&+3w-DP zW41eGrS7-s6Ju#5ljqx(f7hhS{m2ijcO5!p+T?ao@VJ%wH_Q8}M1$EH4Zol3CD*Fn zhGBx((^6DyjC#DifAe@?H1U@q!NjLC17cSHYT&&V z090c=YSj;M-^V{}nVo3(8}E}p)+0NRLs10WF57lmHz%Kf?bjjY+zRPc>}Y!PoGJLd z<`+IJ7CqXI4c3`dpaDeIpEjhD^ZTxNY+cL$n*PxChRk4%W00Dh4rJ+h3FMkJP$Fr~ zaY5jdnw=)UXeRBA+BRbaMPb`ygJ)zE04i}3>`)V?O28rTp4kN~kpr<+3S<}rrJ@#v zMi$<6|9;E!7!gp_w+!WTA+O^r|Ca8eI^cFD3+*AR1k=T|bjNzeH@8DqzA*EcpW%K~ zy|J1JF8@zRUfxFIu!Gu9>tq!DE@>b08=ZyR4vku;cfQ=pA4bbpv%D1x6~qwHBY?!^ z_$dmL<;^E@MwOR@U1(rzb#dUnc3H6#T=pKut}IUphG5zGntl<*aT5F8?}V2Yzx*^A zZtAumQz=tliryxlicG2L4;x;vqCeDTlWk+VnbR%m)V3q8zoblue={%8(ei$O)vp~wbY5@V8qU4vRf z8MpHFzYapWJ@l1|e+3n%ODX?YBw4s+ zBoyGgUhoyNn9bSZ&--}%+aLIDYx56X{@sszb_7-SvRsHjXo zA1!Q@ad`2Tt;Mz@uTT~Ww?E=*b{07-KqNA~|EV(P4hZHUM!;*tLt;sdh~c@mqPb*F z?S#ofW~6IWCJ^NXLxs-tbT|)^_HZ3Hg}L)v0t{L}A_@-cR;w z-d9?u+s2eh@Teo>p$~lmka|ECo`~EXu6dIh-!kQRt(i96pMG@UzKCt+K zpRB|R0?3PK($gwK>r%t~GIe>PS6>8U;P|gAIt`#L&+H^1-1^3O2p>Y1Re(BU!4D8+ zN*Rj~Q47mU-WC>hrTnIrryC7?ssoP2&CxE=HyGCFm7m}R%X%$gG64NnhF|^tDZ19M zMg`J5LMJ#y`th#~zNh`&^oe@a-@8N)u@x-?EaTOcJijZs&@@;ajnzVpQjqnRU79T! z>Mx78xEFI9jSpUZ^+qwJO05jqW2nk?a)caymK=Y=4el`2P?^bk4LW=t+`Nu{!2D}Pvl>NigkW|6 z*x+%vJ1V5gJt@5;RlOTkJCFi=obqPMjj#OS0n)6$F6a<%5+9)Da;#B zd=(t2A<9`93sz=|KkEKd+X?G(;~!fIdPm!D1sc^Ydu47#eMY(Kj*l#s2o~>LfNPbP zb`rtXOZi`rb$|ik;*!N4&?L}vxvDctYQ~QD@?ej9dTwa@84Kbth?-Ua{S6UfOJOF& z^ECKMf>J&K4cE7BS5^dD@O4|KJ0BrKO_nXR>s^Q72?IeJ7eCclGa3ZUN_VsJ`W_yq zLaJB?J9ymIwN#aDY);j}4A-6y2!?5;fINx^VN{UfB%Nn0nKk7$5-e__znO-%1958l zZNrVrT{0HMtO_$S-P3g1{G^8N@YgR64Et*k``*9ks@CK1&xZ;=e&OAlETh3^qaSX6eFWn zI`Hh$B&6_ia4tEVx0NS)xi?nicEq$=GPOMQ_FU5D&&sv-veHsF59|${Id)Mgh!N4_ zl=KrOvZh4`^!)8OgiryyVt6!oB3*(9qEf#WW_|NVs*|nE#FUxaO-xq^aqHLKW0&hi zFioya{_F`d`Xg>$DrLR@n2cDK#dVq9-N+WR)u}rhk~Vp))*!$XchF>x!^y0qHJ&Mf z@y^!pPj4q*tOfJMD9fe7Sh0F(m6exFTiiR*{cV51H@4B{Su_SHFkH#k>p?aD%Z-gm za#WIOVQ~I60uH{e8py#eSxMt%g|s7Sn&{W`x#4xvPnloXhD$SI9tu~#2 znJX%zlK@SQ%700nf`4$So=FsGrp_4tx1C+d0#AjW_^l_ZVp^q;_fn!xV>U^i*?!8i zz>pRPqC7Zg=J*wGW#hLDHk7GP8g2(J%o@&piGx*Q&%9SsWZI*Y#92{AnuUGZX35T` zJ!b=&zU-wR$OZTUtdo6%$Pkl4vDjtz=N7CgBSnsxHttvVdzbkg=F8x&WL`?~cao!Y zYu8$jzXKF?Wc&tr3qy{#|MBLo>pzfdAg&?2 zmoZzw6*I1_eHb;nArik8Kc%Sk{DhJZXdFHA{N>0%hxLeIkl6v*S;A-|p6t=uDpcPI zM5TgHh#EIJfbUBXj`oLN?*B=7Xdh@DNc=2r##9e-3K9cv!pPRne2Q;Vtts(g}l^Gm6s6$y{f z9|6xllu$+XM05k0K8&D_hJMIR4u(zGj+ulv%HV!=(zUUhpHiq5zY-QXM{QthGPidb zN30(?@i5;+X$MusM&2YTQWi1ZdR!-Ia#C2*6GC$vgM zK8+u6l~oOx8_E6s;~;+NG9ToD)k1gWzvH|5;C<{9n3L^nUO`m~U0WvIWOjJTN2DaY z11kw&hK}1dPDhv0ia}2R$xIoh9NIBJ3~7f^r**Prqo0m@RX&}FBV77WeDw(*9U_`d5XCKd`I^9siCc^9>#l`luD1!ufmc(ZP;O8t23D-;%THsN!)U zlf4zFa`3?<{!b7!h+D^93@d%v`)}s?O;0-&$=;=Kge3V~Ma@_fh9dYB8_740Y;YXiD>bTlP%d5H>2dhW= z7!51X{KB{acnRg3oV2dosFNCt+3=M$ns|szBp7rse~Fsk!XunTgj1J|b{amOnbsi;36Z(liH`FWnddkPvYr@qY7K0bdrfN25) zaIQ|{DL(}R4P9-LrkLy&??wRSTX`Q^qNcMsS^zOXZ_Vg}I4f;z`tvQL?+X&&TO@37 z<9vSMQTz=)|GUErho2!p=8qXKG^FsF9_j=oFvm^G7CmqqOXI@*Cyz}T`Hq|3@9l{l zUE3oQbw$EGZBlo?n3ptBqLooR7zMwWjX-G5Uz8Fy}l(O$RgMsZ9?+e za1&up?lVg4AHR?m$C2{r=2tuVM6KI?x_vKy47 z&p-ABC22N*2})s~wIn{lZK!WXDeN;EIoR}sF+IW*HRL-{P7~X=$xy*lhwwe3NP^${ z2SDG{J~{-&9i3P<=Kdc_Ch|62+xZ_0GB_Wd&1HY^Pyn#MauNR@O1Az#luYT}lv-s1 zwBeRWjnIV$%aVib$@^xG`N)Epgm4Gp#;cW~eln7y60u%yu0o_a(reK|0YeJRm7SB{+>Ea?*}`c1*UUKN(@F?S|!9QJLUXt>i31BoPT zs$Y0*=CxPfYAJZj0Q|1sD2|yu0A2#AL_Ba`0!Wo3%%v2Amaa>kwtg(Gop8qMG znsmG_HN_OM3>5kTmKQQe3BiA3SXHg2N)*Lxq{qd?4Gse>z)R(cgHZPSsOlF|)LxPC z9iAbJ*gNLKT|JuOrv8!Oyd3rKWfkK~n+=+=iLvIW-P{lrj?MqIXZf&c07wIR*C}Lb z7f*HdP*a<#9DwD{Tkbdf6Vs5F6kpG{+@}_Cy?^_E{JD(hKyv%)GFdsw zFr%i2q!=p#E4MXX4Lo-^H?_f9L}+n!?2RXu!G%=(e!|yot z2K5gia8jku2+^2-iPL^!dz2D)tL~0m<8|Q8hvyj=(mPlXo$ts5x}-oG7>YWY9LlR9 zXp<4`5KEI66*PJ$4;xe*vt&Yt=%?N(Bci3=2Vu7Hk2Q}4!$a$z9BR*=3} z!#9RP(s0zKfM)KR;4tIuj$go|rH^4at*py{q5?F4Rlghu-|7s`N5Hpj!u>k|9^H5H za-F%CRer{87mymw@P$4llrfcY8L(DSDjyiMv6&ghGlQqSjxFg7Qzp7kV{xRrL0<7uvb4roV5UNIW8Um3A19q`Oz%pxqM!7nV z$HHI-w%=Iusgqo2UG(MGHNw?y?3Gv8oBs0l(7}*7utw&>O$c;Avdez$THlc64%Tja3Fhf;pi zw#Np6haHa1DTFuMJ0MaYQjX!2-_X?~)fA_Y&LAo4ZY}&tw%C~r&ZF^l$G_>M;q(>2 zv3xk=tks7NXh50?9jcriT;K9Q@bJe|<|yBoAObn*_o)72bE{GX=_o&;Sz6FEVXs0X z&*zK!DV^LEgSm2O2KmQwJ38@wm+Pq6`AOmu?HX{X`QTzzkqE)6x1TEq){4l{>=$P7CAP5Qec=S9;@{q~SsIH6YGf_b)MH3HjKMhb) z2r@FX#xYI4NAciW=f5efx21TVPgGEG8SHY^6y^~yPC?Bg(RPi;1CeRO6Yh*kveNGB z@qMcQe6^++J<;N|Jdoow6pnNcfy<<9*@9I}ia6QCS%&f=kG~8g-SQmgKqf!6%HP0y}~x<(PwP(Coa!q%EY(@CcFw@hU0 zG3uvXz3as@C1Q#KwVRU7j$*=^`L_J^lCyXDW$s_#$9jIDzLsZ=W99!4ars^8V8&ry z;%bxLz8zeLEHmZ-&mk+i0I)T9ddnFjxK+L%P6 zz`th6vX{%$mJdAiiNyYOZU3*v+BazR1dKkEIAHPZb%Df4pZ_c1aR)D*eC}~vf6;pT z`YhiVwk;Li(VAjHt+La44t3zsR-b|TYpfu(Ytfl>;5P6kgQj(Rp8JerASOu%dmr?S z23QTxCQG9)grU~oq*eyV$i4crT&hhmk=|3XqE3U^xqz)6lo(jqQI_ANu~Af~%9Cqk zCFjv)p?>lOv3#7enDv`{C^xR9hI4nY0}MoWi}!_-Ps(j=9@MCT^BMM8h)vp$4HV0J z1=>=xV5V}ZcVjBfl97aQyB-Oq0< zQ>K2seL$ezq^Dp15J63s$o(1;-tZCsHzaINB5VD5e@MH!&IUP{*hWG@QB-b`^)rRs ziZ2O+d~Oz}h}5qK-}0=As`wey{#7&!Nh-SGQq=1**_*mTz`fIz9Yw=6`++06Js3 z`E3mAySATjjL-R+JKPe@~4q|i~QvfNwv|I`rcyxP{@t`svbvL+OtVRZR1LZ36I4JQATTW1R zHtm&OTZ%3sa7Y!W_`A^qbQ2ew=sfA{fh_9Oe&9bxhR6d)B7iQ~PLP8bKnDvxCcFS4 zO4EmGRT)Jp{!X+ufT%@6djZb^nSZ-3MP2k1W)->U%~U-x3|jP8T0eENG#-8cE8}(! z^fLae{!Z73_qa?WJXjxBBP|`p`*|7LxH(P6pb6;MNvqml$@*thZ3)FLE`MOH zW?5jrM|OwFJRz_wK$;h}1DvufYua0Y?d%2y`RH!S5Q?UjZFNx4be1lvNZK}g1knFD zo^?_@hwtt;Sn*30x3qk>1pdys&S)*bB|{-6*amH%i-fXXm~K1G?6>c6T5^&WoT*#R z$Dbb>D*;og@D^p~IIcE-FmFU!e+_dn^Q6Uq}dTCQuHv+(Pi*&duE{>1Hg zOcH;M;cMO-cvJ~NfL~n7bzGBjM$EC!G|(N&_!xdz`^2(9ER=5J0F<8npib+*I9d*F zcsP2Fn1p@)=NnoPn=R`Ra1kx&e;)>rax63MP6-kju$_WySv~bsd%SXI_OaBrt$-T>(-S`W~0T5F3Cra&yxT~D*oenNT zGn%k3x#o*1#BZRCbFku4s_>7;-^yLAsR{%>Z6237{d%a$@R;YE>*x>nrshc6F0b1| zWCW=r+Zh>OBQloeK+{kZ(6?2pB*icmxpSG??r9U;mBf!TGsQJs1QHcE)ak2`{IZ4k zp_asq`c!ti1i%jf`;Ame;kM4~5SUCn0l!|6vJ@g`G8_npYL%lJvd)THgs@&~BECk5 zwcuz)9UtYR)aap3m+{q%6^CXyax>;}i}jUVh@;cdP0}dFoS6;g8n%djkg;(uT zMlUNeEeG~ZS_UK{^W}`te{mZ9+}!=!jDyYd!E%DVZb#wfu%7z75AyrjSqoRA{0nu5 zJDT$Rqzw&I?DPyYeNFvT@ZhIp)$%y#*7G5b(le&Kqo+XZ^+L_q#AV7j0^D)aNabW$ zj6fPNph2jd3nUg!)pqm*5ch}-0M8}*@q#&ZH+4#nZ!K-<=J z5y7c&!o2GM$V}Vfmc}WOJcl&j?|aBU=kDHrQ}oZHkYIgRjEO=QC3-}x`^rX<^+WQ_ zc7Z{amW<#hyuMOsbM&=JCn~0<{>GawT}+J!U@)w53x9#_sk{@1-{A9zpuAHh+X{)? zD%Mkrhm1&MTEG||=ahQMp!}_Qxaucg>L-<#FE>4E?m|SYCV{yjhDkmq?6|7}%jB40 z&g#Yt+ski)eBx6+ulDgJx(H7V={$*J1iJWgYfXamrn@1~jYa4PeelP=NH^$+0->~k z=JXIsma5Vid#^|SgUl+YsQXGwV&_B>sjIN{r6Wpy>r5_PTXYbtbRlKC0n5{7jNF>H zV7QA_4OJqu1AZxniiWhr1S-u{nhw;Yw8bur^3%TlO~|nLj^fF^B}sLBd~S2z&+S>` z^LHzo6TbMe9oblvRtFCpHd#vddH7vG{K~Vx7~8IR?*Qd`yIf)k&dmhINi++mmqJqv z>j>`P3xnC@F&zs#CE19?V*t$e^*f12-Lc8BPKArW0)B)9!B{45Xm+JmD$+(!(4?Hc-`!y1nnQmKIH>zgdj}bb?)I0s{MbPOa1kX@ zlEInvnfkgx0uKnPj$)bZZ>#N$uWPoZX-6`5sH#k4DS2Qp{g>rs(oX zm^}Ll#}k`wvFU;Oi)i!Qo|Q8r-K3P7lux;GRGL*(PM>;}X@rg4x?AbsAM;D65>5f* z2J4C8U7uYj)-S}6RvuA%$l-`=cVDxGc`hhjG@roU~s5?@lTP9eO6;FGND;PyoOWc~0O2yK?E zp-2LCBiXMA6WNmHp@`3PhhKGChEdn@$$W95}?zE?7HL zeL74=#C$J&IYJNaU~g!~UHqm)1HCiyrxYzQYuO7Bzn}x!>(EPgJ&QapH%?4dQ^>qH z>^ExA;G>lp2COvRwXA@j{qIc4P!GSJ?Dtqjxo-naBK;-O5?i4zBMRg9Oft`T_$k0MN{9%G%MP#!3E~}m$XreMj1zTg0 zB4iXfx8gyqN;cVZI}>H%Y<>;L#<1)F28V||&TWYwsjpZYBtMkYmr%I9 z>fo64XZ571WKR_qzvtb>`TRg>Yw&B2F15rR_q?_0=_tGWAKea&4Q};`StQVCaP%Z6&_>BhaS@M1pD=D8|QeJeY3^lj}f zonaekde>=c>RMG?{6`#0ep~Ok3f}tjL-J-96cDoXWY!N>Oz-%OTy0KI2YBGSKGk=@ zT_EYcU>aGiP-9r}dWyR0zT^y)6>fRHNCIREc>@mAC0&N*-1o@e2(*%;Q=@kJeXY-V z)7@4i&+NZL4*o8fjwes+)Sy7eSsoPjT11k*5Ya!p5&tMLitbMOgQHX=w?Qdh!Vw1StMy@8l;JQ{k@DApCv>YmlZ7}boY z=+Hu9tlX<@oL2=#`Rb^pQ$je&pfF;(D6T`^ez?{ad%Lj?&v|IX>~yt*D?_Cf^j;mY%eg!-4|PGM ziGsT9y_N-Mu@CS%Y>}^khu5X3C(WMqo$S#GxnM2Jr0Yyz%iP3Mf0QxJvl(V5@YwC{ zFOo+eaG?Wem_U;Dn&a}LFS`Gap!#()0%~Y9EJu6(u`$z5t>&U?Z~mn(A$>B>X^(8< z!>INzrHb+g-qWAo1D6Kwx7eL4ax*yBSzPy(xkrQ;^>(*@$TlgPjnDq;px&KK!pN1D z$Hn1N0UAAwjD8n>@l@UO9C|+9Dw6_vMuO5W??8t+xJ2~i9-}Rn9(DtbNA;9uW1Wkc z4UV$e`&H+KP|}yFi-v_BY0015I_KYi4k2LVSc{sjeF!se89={2VvgAZ3XdK!H;vKh zB;p$ln=i!ljXj~XG%vbN^TMccLWZCnl2dVK5gSRC7-~PzRv#F}b+{+NCY`ZFJV~ZT z0Z;2XLygN%EtGFmz(*zBiBMtP@S)H&(Yi)uiTICDsylQPz?r)nHLB z1GZ=Sp%&Ltf`5~Cm%~lo@irTxv?tn{=Dad#8;q=HK^-j*JMw)GrA~F{D}o*E0PwIw z-%f^C( zFm4nI{ISiEDEy4p>UE2882PFGu@A{{7+XuV9iZ%?_5QL%MeV=WnNGe6f0!VSY>b@B zk?RB@8O*R{W)B1V;`bD>;wua;0J~rTvkMWuU{Le{Fablk3_~)V_9<$c!ldnnE$4+H zz+?~DvsKi7HfIV0MK)%=cH^P;RD3?&IO}U$%^3y$-iy!iypkb^jv0P&xV06xi&6)z z=o4Q39+f^8JvlZ=>8>Bk?45F?3yP!*-AkZnD;ejU!t}wD)66hm9Ff~yfC^XI6RgNV zv=xCxxi@i+#Zu>oP}!QBvZ1s#|H@f7Q0dwZ^UlsVQ>sk2P#4J*NPN+Xm^KNXc9T>r zmQn#+8aVQ)DM+0Eg>bT_p=BHifXzrNz_WFXD1(0}Q#hN*v0E zuH9QQ=7_D8!<-L6$x~#I&9Dr1gRr1@OBQ;Qi9F7{Fkt@S(hm;~NLdECd#;uW>gS+z zPkr(Zc+)w)5jDLT3|V-e{u#z}KC7`K=Iu|?^Ji{=e`~5H-jP=i-?mP%@NWxFU{WTQZ$N8%pMO#9PvWZhp)2LV7yg-|4JC4l-e;l&)*leCCOqC+nH{xbaDK$9*i_hjY2$61O-~XA8?Rt$r{37@3+}p`*|E>7GLG z=Md0Q?Y*9_fnvFm##myP1Lv5uQnmt7sLSQiIZKZ~>UMw2Ne>WMq%)LJWcr&D68;0C zs9I{)-lv9zTrKKEyGs!QWt^CxO2TF!CK<3{AP<^ueN6xSw&{kknVvXGjn+EeLQRf> zQ}9jIu2Om~uEm;lE!mE%p(t zZ>+Umj6+eQU%MU1$V85&gDgfoTzrKbdB3+|Za*2b?O#_sefRGP`83nbu~V+&7K1$! zFda*(W10&Z6iluRfNP5H?egOv?eeAO4IOdJ{_yeRd2`FK4}%VEs(rm*BX+g?5h(8_ z*iY&P*aBSk5cuaP;|qfV3X?>KV+y_lpRCF*Ai`>Yq#9YmJFHyU|6<&{5^p}t&AnxH z&x2pjsLtLvM)cL%|tZb11 z@1wu{Uv@#QEK)rzJdc*~87%~R=6`XaVDvd7FL(b)NL8m$Q^-65H61SNbwHt* zpQQOWEn1P8Ro=~$IZ}gh)Qs%L30I6!v$0$MKaZ8QjbLlnwmGPc74-g*H#E8|z}CM-3;CWX>9L*uO#tMB+%0o4!h4y+IC1-4aGqj? z_F~pE{m8;N#ByDS>-s7yj5ONbmo&!7LzepLMxqsluAJVNaP!HMsjcoiW@;xynz-QA zrUg{YM(XKP3^S=vr|ZfrgommLK@fV)FZ@6aTlKv{2%FQ_l(=;2A*84WFl<7bPWt74 zMD{g8A{zRb{jMFs>KO)GWfwN2)u%O6+cs%3~~WL9;bFln2Qst4W( zgYh6MyKfEr7N-~R@ep8|eL@9TOC{&k%Zl7JVcR~rW2n?n!oj_n{8oNytB8;;n)nYp(2bd!0lu#U@`fT{Py z%g+vXTI4=WGi`v4t}{n*8v>4R7& zTqje6^6(>;JVZ>C!@^Td5RyW>|DP5dBqPXDa)Rs@d!J&EV{8nXv&?X=y|`HuE> z`NwU!;~wFf(|E<{z)k-%}R;xS+U85kyh=euD}HdP1XjFhE-04qh#y-^lv0 z)sqV)o64UYKpq|Y>vI*ZBT@54XtP3cJuV0P;yBhI4J$pivGq*Iikc(0&zb`@zm?kw zssyw}rfxz|7>@zq4X)vlDRR;5FU~7#E71V0&z)cmJk)fiQ`zd-go@sPmAH{L5R^AH zXyZ&wdnRb7(wq@pUh@@_RgaaEhhL$>YB$|4O0SO&gLn0;t8D{z>Eh!+;2e6<1LpZ@ z6IG0ar_(woel>s6z%4rqZSQ_E72d48DHjP#s733^+0QYyta|_?0yCu>pp0#V@ z*mJ)!&K}SAkFWP5nuBD}$TClsHi1$5kkJ5~QKGaQb~ABU&fb9Bz%OAME$^N^&{Vje z5o7aE^Y`Z}%pnZeh89=nD&T;aYsm4C{nM29yp7jxi;k)MUI-H*@kw-~RaG|H9Qo8C zdcwDJVEa50yJ!A>rpD=Ndqh8BIui&~BnaQ<+tZ){$Y3P1zo{l_>F>wqnRX1H={6xV?cU#8GM(emBf11o#_n#`{|h5oLSRBfAbp>jaJvS2L=7XnJT ztPGEsK3q|)s?MME5qtRgH=egGGVK^%>$0xfQEAaUOC`tn#&F`R88N4Wwm(2cn@ zDMm@2@GQCR9PcUw)#>K5-0KbA6Z&poq@ORUmzOs?#nwxX+rK%W4|y5OKto?Rp(@n$ z<2y6;;)86qSU{eJ{Q!up^3I5KG@oXxB-`L`*w+ylzxne(N7#3rQaljjvrXEGy!15j zor8ZeZn6-j&-Y3ka4f)s07J(7?G5s?02U?}Rvm>VR69CIT@>A2R6Lpntblgu~ ze06$4OX5gOGuo?;TTZs)fL?%O^2uvjr$7E~Db6f}hyf>qjH0f&S=Ar&c&VdJa8Jy*HPYv#kzo%m=zDq>BG_0 zTg;iyWmob@WCzgwYICco0u!S55WgX+Vpl=T-SYs!@vzV|$h~SgFwb9}X?3hy{UOKl zhgt^r2I;EJGMskxgGbSX^q;!H6JmJx=ivu!IdZxDjTrf+`BdrRJG<13EAokNUvKu?_U&`qESC2x&Kp6Z52K2eYIP z%ioq~Od1=J-;W2UG_DyF3 z(b`_}_YM?##Qc&F^ z`Y}14y=L;mLk<>$dd+)vm%+Kq8;AJDt4~bVU(Iz@M)Ghc`5tm7v(sDyyL8w3*5XTp zwKsz1L+cfRZv>?Oih2p}o15yQ_d?SV%9a@K^36JS(PZ zg8WTI7b>N&(HsVMbp_KX=D@RY+-m#YUL`9b+&#+8(dOF>SKQ0lLHUXN%Sv{OC5Q?A zJ_Q{HJ4@{CfE}(w64C33nh!SB-MDDmTIA&vYXTzxEKGEaoJhPtIg8rS>#4vO7A_Y7 zUss?c2nKPQ>sa?Kbula^g47qxrKo2-`3g^o1Y)5!daCcPM|)&2&qeXEA}e+v5>w;x z&%D9@{1e)5VnUupuKLM>zbaw5V;~t>_@JwfQZwr7v=WKU4-_!6`Qp0Nu8fWoiwI*m z8o3()=T2&ll*S3}{StqKPsdc;GqoPqhbmaA$4Vnh>^OTF=%@`|zRWgyOM1HIP#Odb#v-P~7lCEh&$GyNVb9c7 zNB3u)L+jVs3R9T&GlK0H5-o-FPY904)$lcd$|$lU_r3-Td7bd&dU1Kr_2n{K_g zZar@eWcKCB zlfC%-&E!lp;K1P7r7NYSI+Q!F(+*MyjRglrJYL7e&`=nNsNq%rqZGcbNmaAF@0 zk`N7JuR_Q!9Chy;EF!sw2xIy`us{GFsP$8+zM@e$4m&p-AidL*x{1xt|Qm3>bPh00fM$W#r+d+@GwK@}WQV<^YWM@O2vP0mAwFxs< zMXLPjgcP;E{?qLYFWxIPW@q@_yut1V!e?Ab`sd5w6@`;b*-)P{eWt(fb$(8m6)Xj7oBe@v3mbAzUV7Oj&$1q?)9LW3 z3^kL}P^mKi!1N936}LH$^>)~>g5__*l|@{7(v_f-mtnY zl8pa*f`wGc&p>gYaCK}0c(MpZ8W1IMuPsK_(!{lh@ndQ_uxcbBtunPXs8=j-=`}43 zs)C6&7j2FvL)ShO3ubFE3=6H|&`u7#=j|_8Vp8mz(d%HnRFe7V{5jfmQEpu>3Gn?0WC3V@R|=G9LHA z-aa0`J%P9_lvCIqnrOZ2rJtLi@Nxs?#Ie$At@I@yieZ1$0Jpt`VC$=XSW>O_pLp6k zkxxeNf6QznxKHWYxlic@!hxvAjFiA^2L>cSP(B-9USn@}W+&sMCzqCitIa)TC*?PC zT|yO|BD+bmZ-`E>NcbKUh99KU_2rp3qQ6hS&+zMB#YVE3o#fi)T~{d~H6y59wQvTjfprs4&D-k}mw zgNYzQgD|u-4&VI44fK1}qib^?V<-W^6_)1tAjF;d^C7T*9(0#FW-Ty`MjlcFW!6)0 zOT9m-roqoQOKm+S9dQ#|X=#p5RtTs&@5`O-kzUrsR;X3?iK>;OJ34Rnjq?olR;|SF zLV4HN$~PsbQtG?w{3>e_O`3IDl)_%;E@JkeaeqlM$=o*4#zyOojxvRjXm8%iPBC(~&Yno8M^drMIu#9R_=nJb3SlM}T2+*yJskhwF>t#wo0!iv(oH`uZFe zqR=r3S886=qF9Zb)Ta6O?8g4q|3-w5?_h&k{!Hj$L96yo8UmYr9=AG>4tmmif4btx z<_k2}2dR0ahqGkE~Y^{w7u?swIdKC3DnB z_;yhB3-!g1APNRw#pY#d*#JbBdWlwz4*g1CVo8>??hO(TtobX4-?F~S^v03!97En> zkOA(@J@Uz^NFQgt50=%Srt3!iJMf%3doNK2qF(w(U&~Zs$GkFTvM|dNPgdMa=+v}A z)txOlIWJ1r&je@a5X=ButFh;Efte;|JM?CeI_G#je=v>^COyCzsl^ZVzi%&K zoZn7DC@{{$PUK8%HwILt`;p(W@8Pp-;l81>TUJ`-cE#@sec&U+Le^fkB!x@^pTxP%cDR5N$974V zVrVSxpR}~ow5&_MzM+5w^1Lc=nZ)P+z%I==vrK)TG)Ga5zp5SO%~2iZw*&q^$wTFd|kKO$%@q5)rA zSpTq#uB`H8O;J`J>j(Am!j;RMa!ZtyCWEW_yXUkmV9sp~b~@m@Si|*&O6VgBFJk$r zf9+A~Tnh0Y&KC;me!MZE0{YBj;;FY(1AayaZ~llPDf{aL0U>6ii+M#TnV%7TcEoD! zR(F*DUcCL;nRn+|Gyw&b7@cLEho?NV9o95iW~01XCXNKC&9gl(HE1K1OT;9@p@6m{ zPQAID@%;mSEh_+8!p6yZnUcsj#b~XnbDOL$A@qR0x!sl!dI)~{we?=Nz?EZ=8in|k zCmv$50^Z6!jHr(mf}{C)#^2BSI!^<-CXrIc8&x+RP4^V5(Liekl=3hWOhHn)K3gl? zkyWhbqHZ}OI|EQ86E(@BI$<9#C_+S>&he@S z+(O)4ftB%QD!(#d_EPEsFSC4&&x0rv5otqz3<=mFwN!N)F?sgpg-NFSpT_V6j@bT3D0EbhZM9W zcIAMZF%%WM0tPi72IbqWD?1wizo*;eY=BPc&n><;&-;?+M#m-4g!M>}j)W#OpSj9W z@mzEvo&>@X1c5H6TnU+|O6KlMvZ#kB`W-nX0RnJ91Czov6m*GwOSyFi^@jnLzF`x> zYYq4L&QYegy}`Zj4$ zjdq^Fns-oHVpAICChN%{Gt>FOlW$&yHtlYul3urIOW(iZiIe=0&@XmrXA@BOt{nCk zc={Ilq6vwegGIb5Y3Ec1+2guX_S@J#(-SahD^q+WJ$z83kc3jr3PY>0JOar0 z)%Lo_=Q;5i;Gsc5${gAWvSqKr*CCn6C!ZMdTOgNP3{9B*66iRRo$RAd6o$&4S^!QT z+t=8sA|kabshCioeY4m{u%6U2-)D76;d*p8A!~km)5D3#B`WoK6D?_cVUV&AaaCU; zB=pwz!8X}LaJ?7olrifX?$#*xjWOBr6W6^j9M43tW%%}Y9ISiN6*V0iR3d4utVop} zLrHV+s-VL`{q>%rMUC>C(`%gxz?Y5Z9=Ipc{cV*#H-xE9hsg=6L%-87nfc;hhthMN z<3+*VrbhN}e?5USZJ0GDpA;zxd-no*%mD%sksFCSi*e(c2IGA6p~2+az8Xmj&xl(| zRjSbTS})}Y=dD>0x+uZbcMbVa|IHVelf-yvu4E?`=;@mf8@+M%d*qWnK(DhIVj#L3 zNErUzt@jCt$zUMUw!iksSW;LDrm9c`k1$9zE4l#hoqxJir@mQ+XB%4a?Srae-2wh2 z_22oP5Nhp{)xSI>NtHj9*^#0sM|pCm7=X0&hMKZ0rx$^d5qMl#f9I=1fC#B;0qf8=wKv|K~$fB0_`gM!lzb)U4B#@i_VRi~Os+**?O=tgGn$R+2 z`v+}k?=A8lhyYr|fG0!yfF~mu6fiiMj|zYooZBD0B5dzmAXlG`GU@2U((T1Bw8I&$h?fIwNHIIFK%Q=TB4ekvjnO z8TjM-pMOe+LrbY}$R~1i{>6L+RtxKn2}swTZ+a*8e@uPz zowJ1&jNSj<=QBSd3FWYrZyg%}`vEBahNxR$C^>eu>JrY%@-AWn1Y!U?;tpT^{-EQo zugTpyBX+F3SaDnl1Z8X?aYYGpjS*~_)zUjM0lJcSuP6*zB(e`_83^FBcW&JvOt#ct z@5LnpcN9xs-nnBPN`nt^>A)Ok6fW$1*k?4%o4^?k;%96|KXWkDN9tc(0)SB)bEr#z zmv!%tr7#P>U%rXS!4YZZ)b6p)0s~_dcfwq*)k!|rW3mIqhUnby6YEeE#$JJOeGM(Mr?^BI{O_1<1Z&?BfWMmxKQzWlFMSm3feN)+(i~_dyRO!`wr4HB8$e z;t_$iUs$N#z&XoeEi1!@7_256c2#U`Jlm+pq+Wzv9C$*H%)#S?86BYGX(JkgBB{e7 zvTT5OX)H$THjP*8$Y(SOZpr^R2ljVVy-7fVIW*cFct2Esbslx>qK<%u_t;CO42^9) z9t-kBkbE&~Fsw9ok1K}&E+iZIz?1dOQ)w*!94h%CFWd%fP_iedu6JQgyN0}PN(3Ae z!1r*~;PZ8}=Vv2j$0h)?KCNy(;jRhik5tOu9ipAGh+#4eRXaK?Tlvb6u4F!D;ZN*x z20iX!5KOJOF!F6bx2UdP&whmz3zbw*J5ql1(bVKY%p40%s)CZ7Ov>`Ma)MoCYgNvt zl@Em^Q`L`b zJ18_|f73%PkDkkS#DdJn&OJ}|O3=Cug_LhX+2!pvYd=~NAF|ALrZ{SnsY|#gwe6Gm zbf9UvO|qsXP_HzHVqG-H4rSM5>RJ$dO7ZN_;;490DG1!SDgD1DmHko^jJov#2X;99#`J;mO$g;e-9}-MU1)546P4wtGz0oe zN;)k`b1gub(Wa~d;xe)YWezm09=t3rm)Y`gvy+(!s@Zid3~2CqcepmvO9@|EY8dL^ z5~(?g=_u=_au;m)crI19uFC!9OrWEcas3e-Jc*DKwVUUJw3%@di1LJb(`9=Z=Q$&XV3clxZ+ zbM~?+oE*26gg-`ARYiY8?ivY&%_=TgxlKng9V0PVCOSGx2T?{2;|p=IskehRwY`zS zkWGOSc0>rjF`}p!jTgYY05Yi3^oQ(*B$0N9hXUdZz6NV>x+HOgLNe@x2TtAA3AnWt- zsrJ>$l@5VA-?!3{4#D}@N`ODFQv6c3 zsOw?@=XaY41cWk@0#wL6Z&Se#Y<@T}VEomK^zCD#7YBD46#ZRHhQ#GZkt~0c zs;CzWG7J&sNQXrhBy(Mci6+5>iy(#OB3Q9Otbd$F!ojLmX#98g34x9m%cG8!z#6Vt ztZor*H&E;}#?KL9c=g$*EKN*hM!3@q++$fVVzvk!ve^LC9k73g2#>MWnk0qJ|MUoJ^E833TVk-MGK)j^xrA2bOx;Wg{dktUt|j&C9mTraMh*Vw z13FO&HlVNTo*Y7Aw>z=-BDTJ_7M9bk=C^Ps(Re})Pu9-#PPgD2?!o-Q4IZ7f;$!F; zS01-^CGlCcLK7PwiQwUT3_@W)<-Fo=+luK--T27Aaw3epzulCi2km*$d)0p!+vhs9 z2Z^$f@siFz9)vp2;B3zJ+dQvGUlpH&?IVuL%>we%7<(;x zGq;^kv-2LBS_HbH?qtQVxY1!xq>Fz>{}=(EW0jzKLcp6LSCyS`pqhlfGDl?A)m7vh zQU^@hob2{~)}*HO=(wrBnpvijQP7-}1nx$wk!qqpE-k>;TTqDSE=__{WiV?jnc`gH zEQRmiCO{pWJUPtULx(KQ_=%F$7)Zkf+F~6{k{6l6@wA)!0uB%D>bg z#&f09)Q0}%dc?(L`1kMlQH}BtP_3E!FL!2hDC5g>W0aC#`__#F5%dB=TC_bdqR9ZS zJ^jjAVolQ%BrMi)qR5kOS8PPd6yGi1crgf=cJGxOTtzv!a!QjP%JHe4MH=IG7o!5$ za^xvOUPybk$TTon>^CdHQ*`FT>(DBGQC=*Xe8`S#_woyv#<$)o_c4`MOTsnOqIjp< zI4hF7H}h(ARLL1fvpnpb9N+6`sdJd@lFNROcm28l{ztTPMls&Q0F{k2sDTAuun>Tw zwjX`-^~#PeX%QsSK?zlrbr+f2>$JO9GqcBPsHe#SBUt|eLX>1ub?Y4+azffTl3{`e zB9QjXES_%^J&p4IYh_p0*!&G5TMqcx0PRowV3H2Bu4o1svOW{+^Azfru0$}Z_b*J< zeXw}lxnnZO2>Zg`dWxR5+_yn z81#Wgf`Q)2I-i;f|(l7Pp=3C(oDi`x^crp15nRz>n7BZWoWM-?IqcTeq0}k~#6qeuO836I^)p z!KWctO6(G53Bu!fPiJZM2&U`<-q?dHkm0rLNToc5*iRP`Syqb$VlJRKOIxVBtBA~! z)9t)o!Q1+lY~cNnBQOtN-hiJVVNt!~rX&ge0pg4p7j+eoiq5(EnAOti{+Jzdr zMRE)Is~BYHF*yTvx0nV26#5&`Y0XB@-kR?*o6Yyt^;Z@jg_U%HZ<86IdqxVge;!yz<;M2 zO{MUcRj{DT(CX#c*ix4Q*R94Q2Dd|q>#4}5HFU(Iaes4OXvS}aTZo#J=09pGr%O&w zXfU~bt}+oCv5?$8J4R1MSS+L8hct8vRcj{k^%@Jiu|QpG1NPP0%D6;?UtSkKo?Z{n z`%{D|p+%d|zwVxBdV~qS)D5WBV7hm|mOtMf&FDP7(<+GjX9sW2*sfQJzjmZg%q|na zQ-u7l`=vIq&PnodV9B_w&pY^cNrO3v=X=aUe=wq&GzX)J5DdO`GD4=|m%hD>`jhGQU z9LnEEYBSujR~9TON9|~+4njLe8fP1G0(AfV1veU}0chTn9Mg`~W&!ek1_4ZN`R1Lo zlI+~4oul)?(8K9aebu_xau45el5$`%upa5}PmRo%SE0W;0ff1Y2?S2yCWzLq`( zl+U7#5YzEA)88BnERl`z#7zd%VoPk}6X2+;y|?W#V_DRIF#_9fu(Vzj z`LGiY08)W&W18}%29Zet?s3CkI?V-55UNAJk5;V_$w*s8ifL0Pk(RiyA95Mw91mD= z_}XQdpZI|jeT){jEpW`#u+Y_@W}Y~*QT~KGfr5rF1rnUJZ7m@7oDP2&{S&8YEq8gB zGxlXUTBW_AT7>+t$%2}U3P=$hS~=tpmn$7u&C;Ju z0H=YBuz=dVB=vF>h%)=X+Eq&%u*b6k3(a~XlCz>i+%Xp&Ye%nS3Kf5{yo_knvgdCM z*|rxrtN7~PvlNuAAH96+zNs4^8aALGn+*oq*lC)pzU<8g2XuT}`Pf?Je73*xFlnL3 z$_tDNkCy|tl`GBcD-e`Ub9tkFV7M_PSKC*-9|O{hyfasdGuPRSwEN7!q49FGxNy-+ z%4~*MGmH2n%Vbj$X`cAgt9c8<&)ti>7h(jZ-G(u}oW-?Xy96@E}UuO^jiun?* z%79Nr{TY}KyQ4OF=dD{h#56pZ?i0mSXD*WNvKp>WZ2yL>e!NQ2Fsss1J` zygyX7gWBeQ2-xEd5JZ1dl^V50`-b*gFBIB@%y#Y9wI7evx~ zK-E~ibq4y=G2VKH<71`A3V)0atu0_WoA2}o{xfh4eoz={>~o3f_vhNV)`pEb{ACai zV+SeC9lx}qUAKOEE3AniKGIqt2xJ@Z{^@H@MFmhm zYc?@*-gM~*Tbhk{dpJ)b*%B-~ zi)<#~`=U8y?cNvnCPR^ya^?svLkJ-J9o?v2Hx7-*QvV282Zs(hYrBR3J%8A zTMdc#bHqVmOkXPB8>A~k=*H(grMxQ+(c{cipje~fbR)hp9t_|N{mKU}dulDFeDq8a z$sCb}*^AAa2r&(hmjwSse_8u=-fp1C2g&#u{Cl%l(`2ayZ}Fc$Lj>}adB5VvbA3SV z&{;!2Rkqsf4Ux$N_VIs_Ny}2iNbN@1j3Nv`Chc##u3lXkr>hQ>zIUxh79{Y8Moh<_ zCIf$b2#g&wUpO<>k|!x{5<8D>PK(8>T3b225rTa8|83yIH5mD@U8r-e0H6`Vm(MLH?mzgqRh z<@W{fe?HsrV=GNIOr3vQwB18vu%f;m)xu(b-h3BJ|9xC#S&j!Hc}uyHnq8kiZyDd7 zoPt@A57_j2If78>7}rqUq$GV*4n&FYfE0j;0steB)EJ382-=`Pxz}yuUj!0VlB)P> zEjJ36br@zx*x6nvwE+&0o(#Ln-iEgath;I4^^?OXA3cma0K6S!%Gw$j${F)GeCUmOpt-VYBLtd^`7OWMNLm-quS zfH{bjNoUb%BGZ^K>-$;^gX=&aebzyRqeh{*>BHhd4#(}9K1HaH+y@Qw#>~p;e^qmc zJHnXM_8Ds0iVNDg6J?be_@_{;JF0#pKqJKpe?vhN7RC;m;~H@?x<)}Vu48DAB-oRZ zZXS1ZjA1#}LT;hcBHN;HmrHwvZl0Y%z$WCO%}~~q$mgW6U9-Vc`Lo_6dPrf|^06xhG zS5*u2_!uwi&0vzw4@&=E;Jj#Q{(B{<(%=k3)Yt}pao&y5<$Z!~@CGJgir~V=d=bq* zO>j_5dgNV@NJ$gzYx)s#2D14fnWD^5P)66#Dcy)jh4H^~BO=d=DyFpC^1Mijz^b!7 z&m%3-E+l1x2f!KGX{BUmKv&FAfc?{qkbw28!I9(hCH4_<%rK84Nt+r9BdC=+-HMeDQYL&#Wm{5qwnI9V=8Aa zIx>pxC-!!=Ctq~Ph^2=ko`T%FEA3_H-IcehR3cn}hcf(}{6cB+be+a?gs>3yIwCOs zXd_>O!sm4&8mY&!2`7w_3r}_-P;NMOwTbYm4}gOM1`n}f+|cvR?+5{xK8UO%bfQB7X=s%!ru@sYRqJLB4N ziXHH}oc9%#AXMm5*ZNU!^VWN4ru2{Jli~6K&O|x|Hp1GNJsoBft%fAEn8J@@pPXa; z1>lH^NAb|0JTh%wNH`gH&RD0z8r%7ED)U#h1Ha$&y6`M@r`s!C>#K9Uftmz;YyXZg z6zzhDyEi=@HjlY_ZPj*|Bh^jrx#xWqTh^n9Th&771eYZTIy`c;#u~3%1cjjpnBa0$ zHy0|50*ZCTfUUFDSSdPJwS;{OpL*>|5#Zqm?e9Pph*9vc`q5I24n!n7$hxv7OhO2( zqO~)=Q_{jyMu&Q+8Z#+1688r<&Bkt8(q~TUIfrdtt(4a$lpn_#YcTodkO;mTG?HUO&p7gur?Lf=bXe}nE|+T)ZLtj-Uw592<$y_-0op*Cb`$Fp%P%=S*+^c%)DM~S>=4EGWP3vpDqDXjl#Zr*;T`rJD%S|p zJKWx4N0RVA$x=Sx_P~1gfqrm<^+a{^MZTN(YdW8D&UAD?_pxm&8lt9{`U4XG&2735 z&XT7)J?(*7-fVuS4uDGb@_Y#iR*+Pi;iL&VN-JD`{LAJF2aAphPjbaB$h|L@v|_RM z@(YNc;?33-TLC)sbq3lYkS)tx_)z9Qtl{7CX{xVF8)_3LXfiwSe{Iu}$J3?bAzm~- z&(66CH3!yX{44v~g|Moh2>{4d9|tlXAGk#k%zXxcDWplx5$gGEPSe`W?Oe0FS1RU`_Z1`!rq8dV2qR2*6{PIL!emEptP zgOT^xkm;6aPs%JgH2HDv&rIQL*d5q{&9+`CYm_+00+4};fa&+EC_tCSMurk?+-;`;bF{VgiQADqRzvw6gbV!?KnK${kdqn=S#h)x{hs$IgP}P z6Ww|ThPP$(s{XO(Q2=;O z>bBIcPmUC86NpAY`v9)~{q_qu`e^I!hHV)$>KF<5>P!)XI&ee*pJsA*k9p_ZUCG;i<ey{xm+8LtEh%0ai?C_M|u)9M~sDt52jjv#WL?iuOU;w#%?&Y z_O~NO1#I9j4e$5LOMfz+tP`boRqJf+M=_6n2)Qz~aA}pTvH!jNF!1g_+V-jlyBHC@OeveB!gC*aZ>KopO3v$@B&onfw?Hb zAtPQp-+W$Tnoo5dn5PRQFBRRBI&=!zy*Q3BhEi*Q4ozb701>_zaRHswGYW+k(JHhk8b77BXql)bgwyXYf=GXCz@XMsdxe$% zBOl3O#lR13d)SP4sDDaA5bWMxygi_luDwTW*WLLm z)NW<%^SnNPm~0~_NSh(nmM|$;dH4=RCIg`);NToZU`E2WNF6x6TLCD_*K$ycl}5Z) z`)4pOZ8P-p4c)v~8IBM}4Fh(Scj&e&(wWZOSB{KmQ*FV3c^0DCm=RRzH*0&{4+m&o zDk;l_?wiGrQNonLEW@MaEYa-E4|ewW$8tsTjl1^Kk?|y~1~cO=U{rRuknXscmN6M= zGwSBb77b6fXTYl~tpT9sF?D&%U9mmWsBM&S)DyxGP08JDFieJA>|o*O`0r0Ob`#Ul zrf<_xLx28AXjr~bM*nfaf6If474=tqLpUl%qR&*6Uw4GaU6DD_gCdDkjPD*SzWcEH zkZd$T|M+~46w#8Ms9CkE>|!`gAg!x`PRn+%;gH|@9w()jycB>Y(Xt+$pv{VFjyTiK z0PI58fg%tBPHkZ4_Wokvm--uRa5`p5khEhI>g!nZO{vR6!^$N&u%Kg8wZ}nasuftj zI7qfTn7=@dwQi)7Wrh;RUExn=t+9~F{rAupd<%zGztf}z{z@Fp_(K0EuIAtYqqLiTW^Etc-3xJDAt*mK&s3z zvYO`i8;@Ts<*z(6r$!3)$EELpK?!fWHtsB%QJ@yQNissD!8bZMlVFc#X@E1XYzk`4 zlvXhb7D!U~YW>Kb2LwMP83umb$jUrP(I9Eo(O>CIEZ;*OYw zX%@FT!z)fJ;1w^7#iqG%Y^~|~{j+_d=e|%wi{cb?^K@3OLLWl(Ux^i->rzJDiUkr+ zEG}QE8F=DlweepMeC09lP+G0sQKzXA*C;cr{4v*t4M8WZCN zgHb%U^&Bf+#*#^0f^+v(5JeN{sdUu45w>F;vR5Je8WG%@$)c65M76edgW}m=j0LM= zVrRSn#VGa1Cpn+eu)XcHjg*zS*L7?Od_6(|-ynb%?y*BZt{#X*gF%V-!8ic$R@M$;>IJUH~yq?xb@5#(bkd2wvvPozvdZe*3EJJo~>p=s(N|G@uVBPi-IiYFl5 zVjB11{O)+jGKqq&5-q_BTg0hO5!?~1b18Da91PG?bh&R zgdE$cY)hsK@qVQK7RILkmbqE<#*o2%9LZ*jPcfpwS0uUqB-S@#>9@$yV_J%X9X2J9 zE#A+*Zz zFDR`$qPE~mlm@jE=C-}WuC}5SDVJ3tYBA65LfNvI;R5w$#xIfB%O#ZVy+Gsd=y-@%sQ^`a4F>N^z!!ePE&f)Ly$%= zF$^2o*~%1M!$HL^HzN*#r!fb+hZL$PwC2|opO|RnO9zK(otRoX9Qdfsap zxK?8}C!<*UnMMgbP|4)rxyhQ`Bk__-6>{4`#nw(AJo!{)xE~^;QOpQcu>H`}{GwFT ztvSf69G=Ada8mWuys6c@9R|Yh!s3XuBA|ldiynii07Es6(c30z4_y-5i!3g6*`a2` zkS_JBKf0I(h(TikgI6F+MS_9@?xh_<11&*b@|7nbOC*jE8Jtf)VWH+Q7W`EPuMllJ zC^WMn57OG0Tk{+)4nF;Vf3+{{ov`9b+%^O4%qADXaRFU}lQdMp(WR*M5rkg%h?uH) zYOdV^$*2~iinO8GBuT#e?G(gDsBF&?c#n)_?rhwff~U-Ycy^QY7O^c9o2uNuQsk09 z7SP}PtG6r1x9NE8wTjw3o^93UFO30*QX0-J8gaRP_Ri+zoI%fvF zrsaLba{)$17+pWcsXp@_3d;exfu49(TtO;vgxba}AsoiOLv^8zC~d;jCcOnt;cGUT zcyi3Wh%pxpRpSQR?0>@1hLrS_b-hf@z)5UP)?G6I#1IDQO9r_HOcJ&&Nt3+#RX^Ic z)`cv}_AULW4lVsUyB{*Tj^YIREg|CtJg*?q zBp8wqX+?Rc&*K3jB-kwx*INXWnfBuO8&wKTh*);HjP|CHd>K#JT@9la%S{>q=_#I6 zd0k6@tYz{&Rl}%mQZd6`$`e#y*Znl+_cejJA*gOiwCPc^H4k|3oMpRootR&QISIZk z#{o}Yg!~u_C=i%D?$Ab??udUy~J6Z$UNTMZ)Rj1l4Bzd@VSbY z_vu^`4fJZ_tePq}WX|`CoRr}TXY;m4X2)g$e`&8|<-Fy|##2d(va*;6&?@GCXj)OK zZLuo!==$JD4Lk@OFPDXgYRgX$oH7L9pIC%A;cR@4cjWy39{`jYOUVgAiw5SjzGe(c{4X2LMWHx)cK70fjoJ83>l#|F(JbSoZ1vjD## ztAEqjE_#2Z@h8`-mX-zTJdF@(bOF#*t*^Vsc2at{=o^&s(Dir>rCbqNM)G3E`#2)a zgZFWuP)*wsHV{Lhn+%AabBVF(9IwS!aQK)d%DK=jmJidhm`Uxv{|DkHInWAaZe(+G za%Go^hA#}a8VWDipOX=EC$|}@FUARf)|zrQACo-c9;&TYyn8uoFagqkH;=R~ z?k2IVTZ5*_+-H%G3JX9k1aIZ=KQ$;)%1Sr%zPNUt^(!(@I@= zSvYgB=z+SIe+|i_R@;D1YG8JML7E?@srE#gCO)j z3m7J>pL?HJ*m&ZhJqHoaIoR?1MOV5EdmwAZ6CPIIkVL+_alv^sok6j>JxP&%wI@kv z&QtT>2Yj^a8?`Od_w^)7Sz~<}=H`l8&hlxxaW0odgKpk4Z-h~;XhJJcAGgx2X#V!U zpKb|LNzJ$)g;{#(wyAfW3p4rU?)>ZK+dtisTs>;j1f=sw`6N52470 z;o>c_=gQhPoJyl_3~2uc4hf1&m(fQc6Suv!FX>g60xm@-e_KnFRMP)e=oyMCe-7b88mCV5d7&{Xj-&5Ko=0?ugw&Si1{>mdp!+~$;PCw8>-P_m83npR zbN%%C@Slf~RU@rX)=vNU@(>@O2BE#0z-i&oPrv?a`sv}1g+wMTg^%Cp@8^!D7m{dN zYw7AD%^!Z0(?99q_cT}sKm9fj{St>u5loo=J^h*Jm&*(=6Gc(NHe!KhxJL8imro5aHXD_NT}`Yr9pA`2>HuVV@{kOwm@6xhahZ;! zyO*F1FpYl+>8bA^o|72hM1}@~uAfL=e&XMIW5>-ViT0GsIP|@bAscu zzy2K{z8#7Uh+Rrb?gO!>+}vY<*wk#M1hyr-FZ@)Kb5MXiteRof%TEWZ-U;i?+uwlI zI)U1~dDipRbPK;GB_?;tdW?zcV3%2seql?RQ{jK20JgU;<7$CG5o4cRZ{E)aPM8vk z`@lW+5U-{pL^dN0cCp1{jKy3W1`*gqZFKly4v^e7q7&V1!|KsJEZ zb4qa^oHf9q2~CB?^t7_ie{526oZ0Vmd^aa`l>E>H*@}aYN3i_ zQeZB3BM)J=$Ax;t=4A~(Gdim2sva4WQ=*%?)^lLWrE~G3&ro)kgu1#Or4`1M^3qfq&-=f_AIuxuc9_jmzpxn5Y@K_a}mhzzWXlRl`=~Bb;i_8Ze`&s`O@DA||*%3D2Wc zlG{!9BFOz6 zc~8f_Fo=81`=I)LsM?I(a<)_uVBC zB08$#)hNQ+`7O+zsu1EK!BVY?5v_pavr*SB+?r$10fbcL=q$I6O8SPKBf5VC1)vfX zNji#;f2UlA(I9iOv|;W01c=aZU?=T^Fe=qOkH1_55R9gweq?=S+ctJ?>lTWZRB!Oo zWTS`TO|n;&gFrgZwxKoyu;#hB{>yGsn6clrSA8d zpX0cnHibmC{Q33gX}I&33KB3V7L^;U5}D%4S!X$vvW~Vwh?DyB4!b*-ND?qi0e6>` z5-?y7_gNG<6+gO2Me0VL{>qn^1QReRf0=u}`+7yU^S8BcQcUl@N+Q>i*r|k;ayRdP zr(ThwBEnQxr~R^wM1?~(hRS?sPAOH>;NT#OHqRTAh}k9Up|j-Hi$Y#G<#*@#7_veh zcd?pCc_tcY8V*d&)-s@$c~zn+qSNGttF_YK}dNnW5@TK_Efrqwl@EY zG}*`UoQ)=HJW*8vR*WaDUL+hk4t>+wTQ?6)5!BJG7ME@F&_LlG$*6#0f3)7^3$#)~ z8XN_Xj}z992~2xT;0G0}f-VOVRb1I57>JjuM5$B0OJpk@#VY#NeE6;$x`{*G$)Z@O zBvmoiL0i4l=7$@Fn>&oa-N(|e-rtGxXFE~58!sCnHu4}(-CBo6ZR^=Wn+jMqgYgxp z+e@{*<&h2{5X>&v8{Rzx^oN)q-oxr%cM$8W8kluE1B}%Qw z8>#^f*t!3q`9+M!@3Ia0)df}T=(-6kT_F`%kAJ-!)fA<`Ay5rz=WA!SRHLmjMj19y z@1}fPyu*6PMNQ?S@1WQbaxu)ImO!L^4a}Wc$S7I}`-T2@c@-L}f4pB`W!-bdQ*x`r zC|P;P|Ixv9uvzpAqI)!&q)NUo)MMG?-#Emo5D1uUDak^4X$%e`gn`RMrMJ1t(nayKo^H8>;gInTo_+uxKl6eAKK#sFs~BCo^TW@;z=a*-)bL!qDW?Yk%C+~Z{($M}Ye=~4dX-4j^* z_=k9L=~8}ulP=%wQi6u)nhv<#I^flAf5|%Fft<-TD$p*WJ~Gs}F8_Ftg58Y2?UH{x zW0(Bf3A^OqPPj_`?Zh{ee?xRl{(cdF@HIp}&(MKQ? zxA+z?xs;bq7&|7H*Q+ooe=1T^x4Ngj18CHu$YQ-%FH&;)I?3t7!{O7zyOXg~5Yefi zr%zud1urE0R}vb%n}Slp8#R6UKK=G2rS@WL)LWfsKwtf5Atdo*%WFxdu0eSw+zp*l#j zUIc`r-h*VKqc?|nOwZGq=7s_Fd1+CeF8!r=oA0{SiaM=p(w{uhLD}lIHj&Ug2q`H}`QJooUwW z3{$o-OWfF+nJq=u`&iau~Bf4RcT)XJyYaxAmub(1;zT(l%mudK(u!bnxm+pLW<)w_u^Zf~VC{bt}nVlzk5C%MI4PjKX+qlV~=&&uOik|}gla#a&taw4T> zt+OmnWtJlIwhB+hpV_&U>}e=io?Bgw1Kb9?-tsa3e?|1hQ6}9ijpjVVY49_SuM;je zOZXn!`gr}cWQ_76IX`{={_w{H;mC(6$0QF@m=xXg=aid;($1zy3a?b~a8CyQrXSGp z-G9G+`P=7zC;`L%hh61lg?1{%>3ezfUVy&>L;0;fN8w^}fP+X78$k>rg-u5JHn25( zo*t|Ye?l1-S?f1!O~OX2H5+V{Ffl;KHUVoQ91vn_rTM<`M#5^IBGc5+z$b)K$KoT5 zr&0Kb7k{R%FzVma!8!LJ6o(M&CjZfXKp1c939e?GQv@L`}8TAGqN;gXshqM=bmRpoBs z@cjGp_d4z?jQYUt1qBx$fumK26 z`Eg<>71|zW;y&(X2&62|*&Pfav{o1a(uNg6eAvhYhy+G+2RNd%c5L#q5 z&SXyws|&eE=_L;=e(@{@upBz&MFki8e)jc@3q1aA7*KZS9P`=zI6cS7^2nhzZ64%q z!MK7&BCpB)opBq{C+5aBgdI7Nv2rU$f8enPk1F!4BUg;^>)3T%sd?(anF`UD_%G|? ziC}mhrpbx9+!NZ@HcEm0yl6;9ZG83vw4P(w3+h*3*Z0&3}e~YdC zPyUa77a`*9!|?P+10ttKt-S!j;&^N;A%mW@vO=XW{rK1P<>BK9Zef9I;PuENuWW*& z0uwB~2bauEu!8UaaJI<`Yui$^7Yjge=~W424hoBYg8u#ZIt?wq&KRo@Mbd7>K+8@R zt#=HQL-OTkR6(aXI3y(|0YuVqG6>(K)kjlJIV>OT5hWST4Sb z-X4NC9SMoGpHbPXXBb64e*iqK>xna1Q5btS4_^y;6hmYsS?Drj{S}f|8eQ=|G_{6g z)h~z|E5MK#M@W@0W%kMNsuIs^998$wT^%ao!4!Xx|7FCx7S3OfMT9WUf-6F&vDQPb zaV?VdQnSpWJgqZ+(1nayW~t-2Qp*|r)-H+Q(gOD|?0T*1s`ijFe=D;XeYizon9}U$ zy+H{t5pb(YV~mCj-!6I|*Of*EnAWyr+TU)Wdq@{7^f2w~Y>DT<3Nx#FST}N({hTcG z*`oytYqnUJ>Y@BJthII`XuH7r*w+6=y)`ihpQB(lyj{!IuU7#bya-`2(~uyw-Vvft zvrrhaSL9x^$F7x$f6euD+O{-zk%9?UcpcZI0M=`d6bz&wCaEQatGR4Y0~b7A_Z(J2 z!Xp>GQ8%r;K06>|AyLk*%MSMKGp+}*z}uiksMR+O1_OzY>JAxaR+_a5BHV^py6&0W zo@JCc`oi?rgE;gf0*}5m7MGV!T6hkLW3%3!$Q=jO*d*>fLvffz|W6g(V$>meneH?9JpI>bUrR< z8B&3{H|{0*g{quZqZ<*tT2tz`cqPn$8QzQ8S%6-Z- zRHJE@@9kxpfBOW1#5xO1)pN%8GH+sA*EZdE1%$W+A@3L<{spBX4Qo&tkjr*1{^C?a}e-6|Ook{uD< zib+xwU>+7^-M?^!4qeGP%$*AnyVRgU(FuH8^xO|*e}$@cpOTRUdlTF6jaw_Gu>TgL zx4wbXpDlR(#5RX$Q%75ahdLHJL?A<@XoF}xGXSi})5UJTse!~=NOTDDx8LRTPk8yu zluzeOf99^=+cbC(GL z4N7i=e|vT#4NJOaf=g)KR8E2Hm8*A!=d$54^^Eqh{xVaB%RXl4Pu1-E2*7sdbA}Hl zf94ZD>|+FWoU4{+%W>@E;zW?`jy|i!rvn?GX{>(4GaeW7{c$mhjL&$DRnrP#meF>! ztl+gH?iHPL9DBm)VmQu5)Jhs*LtoG1NAi~+q+E=$0efW^km;ahJ4~k6lO1#5g+SBF zg1TlD8?~LJg;Q~Tvg@ZSa7D`0V@u4vIjv0Ey zlWpnNjkZ#c?_vDJ&B3w>F`&G^5==+TdI0TnnA4Cu@0B~5V{)hkb@kK%avB-6{PU@RC14jpzgqKsdzm(#k(#Pyw+@SAH*EyQ2mfx zhnTGjy?I~W%x`twq(-~59IKz$8#Y$GHf=qz&&G!8#0?t-oK!uQ-rukf!z_Xk!~3@Z=mDos;B-^tU;vnw zFuea5zCLp+K`>`s6g!DP=@?gTyNH#RX~DF;E)_U)*oqD0vOwhGS|e8EB2o#I zBpaC{;fY-2Y(+#sA_o##6cGpgJ^HQArw^KYIw8?SIsZ%ecV6fh5d3@59 z@S5I`9}AME3&wB$mb8GLKUF--pr-O=q-23!MZ@fWm%RYq@CyPn0v_ZTM8>(h$1(CH zzT+KZN(TV8(C&hDcmHqTsyH)RJP22%7{>%_4N-$k0xXaU#OrzXHjPm&P)C^Db_;f;z`(Kx4{7*=(!)|vUZ(&FC3#hxMfvqA| z&U_?)Rs-&t`PwNqxEbwW89Jk7FY7?-m{WP6_zWXE6yi6JL&Rqb%4Z(xMwA*`VH$L% zyc@{l@4V6zJJBZG$2bUWZk-0LjuVcJ_QZ*(q+@)ep(E-*v|HI18epiVI2`nnOzm@{ zu?Nwva7Vcqg=5$V8p|N_l3Usn7%$^|lKeS;O`RtpqOA$XQMOFDO`5uR^)160VkZI5 zH&6>YYt*vzIL|~&ZYBV!rB4+=WsB4lcni6h`W;gTSM~amy;t7h6W`R#($Qbo^%u^= zmuJO{1?Xs~sKkOg>nqkOmgt4PAHH5RbmZ$ zV!N7&p1%A%zCPuQJth1SopT$nMX&_uhm0O#XFaKb!(C(W@a~i+KRK#^B9%OQV<;EiC-CYqzwL zfo%P`11)I{-qMG^_kUL;>r%(vA%WW;3!tfmD*xMzY{tXesp4oH8@ROfzK&isua7tOHgsu+?0b+XDa?CMe@>v@Jyd0ZeJP$2RW`_!#XI zm}ra9zUoeiU7VH_<)}jBT%GHGycnGalN1hJnJwi!t&4fmqRA3%mgn>BzDF6BFOB5J z_nZ-^aWqpWgT(62wV|znIc{be+?1Us-+=SA&UHiGM=v|G+n2RSm=ET=JxRHfwwHoeZgg|D*%TW zOXD)S5vc3!!7O-3z$1$-hfct=ar!A&?9>Z5lx9ma1H@bmynp79`q#`1=Z>rU) z`*=71vT0u>O1)HlGIMFu9>8M#Bjd|8vuY~pCEH%s*ZX(WYSNm#(Y{be%HylC_1Ha% z&GjaWjIP$IrFxTpbsJ=a*g#JQyy-dcT9B$b$-jwg)nnz zm`Ek4IxU6e+tA!l~$DFY<-TWvZ z5GiP?wMZa;tvb*hg+$!TZFTqeB!piE3$cuZxD$!Eo4XDP$pw>Kwyp8yAZw%_wsNg8 zl3H2SGp3C-y?V;sm?LXyq$&W&OLj)8$H z2;=0W(7AJQUJc7rWH~@{X5YonQe$5bGd+kz#!Odg=KgIpZvTo|MA zSV^nxtx93~d(xZ6YKjH59$3iyEs;XP4E@e83bZ+hGBGje<0yTG zgL)?OQlQm4Ahzm1G(gjm!^rjonvl!@?E4Q5pjC_^OAh}J4X}b~ZtppoyII6a%ZxwH z;vRE<;M!NRoHS*$**j9FdJkPM@$$=+b1YI`ic1y$f`Re>fYPCDtP;>JpVuAZ-jCc3 zk5D?H^<7liC}HK`AgM~j5r??1oi^<#7K$mM+kp<6xTUY3G`-5vaV{fLFjE{K+jC~9 zd&srb3pgXiM!J17MyGAJrj%0$gUxhSdFcQWPl?@3Po ze0uwM`o}w%$%|l>*VD(JlfoY)zAA|~ot?Z=!hxDTeoVi7ky1On-taO~0^sHGbHI1| z@(e2A3WdKY{6(pkXK&O&muf9u`W>$e!7(r1eIXcl4>Vp1FNdJJXu-&9NxUw-}g z=}8jdQbd`WUl$yVYj{k#xdZ-b3xb71DW z*p7>k994HTW#>$8IMc%m)bl1@0uELwE|`-pNC|}laTK#(mp<0$O1!4+%kE(zCaj^u z-h1iL1EmqhDh^>t>w$PqfdKDu}^nL`honU2_i^;OGA*K z0JJ0%PAUI*^UJV}GJiPr2%NT?yOZPeHtO+^M8!?^3aoULvQieFmOG^>VW>eg^IY)%(VGbl6JZmk<;a^G`pM5ODs9-hDF z--!Zj15+nkD>(j&1UPq?S!G;@#6T@^g8f#Bw65ngsUj?@s2b|4RUbVa*D5JN*(ZBQ zI(nu8ca`+lU6MznyzZAQ{s9b%g z%dFksBl&AFU*WGO^O2kPv<<+pj5@)kjOHZWDHR%@bR^(4kPJ=jx9GS{^~i@cYlVN5 z8+l(vwEH`hoH`h`q0cUdRXANxqi}ki09dj^Pc+$^$G$2} zcr0*;P4RFCy{U=Deg;%X4b;i%hJfhkgtxkh6Ml8PGlr1{aY1p&!)j-?Sx!dXW>N{k zYvRlRx{Hr&3yp$Z4sx#Q%TE??q)~r{ZNwDqLbKJI-KMVkwY&+d*9N;xyPE{HbeTwvVH^R$hOlF}|9n zhqm=O2bw|D=OD8Ez7`*n!oxDTnqOwtn>*h(f7fpR6gFEA*_xTW^@5RZ-5L=V0KR+fB98TzvGWT z;bMqk`ro|tM?oW}|4cup^V3%V2do$DJp4A^?*Wz*#$yaY3)mHeg*fjo90qYCWy$N zHfOTTRcwv@6@{FZ+!c+uhyfwqWh+NP+~^+ZC^nq&4(^6G{0k%1zPj45h%aEjlmjo% zU}BDZvTDZO%P-v!{^dDqJ;iXap6b4N#n*NITWoO7Q)#8FyMD45b5Za%w|*Jp{@Fjm zPI=LmrwTs{7EkqOD0hFZA3@3ZBk`cvs+pz?Zz+5mu5>l`Wd66VG_l$+%151w9@Y(> z1CX1NB5Pe^(v8iL^|{2)GZn&$Nwb!gSvaJ-_C+g-Ht8fxlHNR-&+{6lU+oo>`~oLe z!iDkzw_w`X=t=(pGBW)uNWU?<<65I93&dQWCFc@E*rZ~qsumB-#TMT4QL{q5tM?EK z2bY&u=rk%i*Q$7FsJ$M)U(yOcw$v!Aan;fPQl;E$yHZ0r5y9>MlWI3hE@gCx!s~dd z>)!nD7JEmA{tuGi4mg*Au`?5g&ge9U&geCV&geFW&geI{&geMLIG49*RVTN^AvyU7 zf8}KG^cN^UBxHw*F>(BX`Lh|16_`!$dOQbbqnJ|JXBD~#*wK1B4#h;Q3nQHF$>w)n z{r|xlf!wU|3X5MkH^wP zOPh)FFzGVmw*w)=34^jLKs+QdBtL3XOT3d&AwxP5)P?UHHvmU>bO@X2((6x)-;MG{ zQzikg1DN{srEMcv{$~bWt5J%o#WB&PL9*$| zr*MSo?A(-;0b*R8YVF78QuijbMDIJC1J$)JdnR?Ug>4^1iBna2n2zGS^@St}HSPD( zVN-p_CF)-_xl)(m+(#3)5iB{$HGd|rT|0Sl@8b9fJIEYb z8^jF}$E9rAG)`B7x4Xuz@=wCk`oHai8Ilyjet~*tx}rpDo;IehM4n+24phR#1)4zF zvY#zCEC2{x0K6st`Q!I#b>(m0OP@LR8GE&o%GhEaseJecNo0 zh#L{S`{U($x_eLse*VI4hRo?o1=QUt-Jhg_#TAr@)X^>K2(X0Fjgr#_a=$jrES|PU zLZKAF^mZ*N?t)~zs5y_Qa@bIv4mhbY5^Ytt+oWa}Es; zaM3cNKy`q4L?RA|FeK4R;^vJXsWs;8)UI3a@e9w2iS-*b>X#vSFn?V(caKqW~Pj1!wK-gpZPsXwC=@9LjsZX)%Q4uE%3dLKd zpHX<6c!ih419V=Tfi#ikHIPRz{aO~&OO{^Zl@nI^#@Vv%B7awo#F_Jb>AeW1zLIls zvv%sa)rQz{t#Np!Ts$N8X-&$qc{|;gTj+dmd}l_g7K&7;x8Fgv^?SdrYr0>9YUFC| zeVHOws83gRM%C|C5wXh1)18kObxVOe*{q8w0z0;Px{47zzL_hjo~QrQ-jR7I&t%5E z4q-jyRn?gryHupqm{nuB(?g#xKcOT5PBgG{J>=-}EvkFj*!N`X(;x1M##)Q>lReRx zA86g^iR05XHG^ZDI40Xe@*E+>THQMZLn@wEO z-tp^~3o?y0!YLbM{`#Ao{@}qM`C{~L`ftAUm$TG4UkU4iF6y99hxneC8`U`=5u2;E zkaXqVvR!K(&lK)$?|qj{)j3E#&jA=@gmhWKGP^|)RTacS0Fp6SskctL!xS2HL$GnQ z6J54WuvqBIN*PULrVrt}qL4nZ4~%7IH}gH_>zC2hIXD64mkQQ7Cj@seSio2YovhjXbTj z@VsGjxh)etR42&M1vfZS%pUduNmf{0Dj1c~&{D~)+ug$;u@mC(Y8w=FOc3^=sEt?( zlu$7&&6QidRMOzrlw^NDb$mrFQc@7$_w4@MEuw#K!z+lz+bPzy4X^FaTE}jq=Cf9I z)%s0M#<;skSG!{23j3Vyvr8kin9}n1oL%NmSectC--e7#l~4H>USE)&^IU8;OH(yC zIl~Ab`SfM;>Eiw*TE_t%w)>M{gh!LNCpS`i?1OJ5=?R?{&KECpo+hTycdXh)mwu{i zs}+BF?n>d=Rx1h%Ft*c*VarRK$M3YFc7n)#kFDJ;qH|_w1^J!Yl*oqcTrsUVgTYi1 zgv{ocvYcEZ==A=S#xRW^)8YC&=J=Xgth8u_tj0~eQ$nZOhQ0&92l-2sAV}%!{xbKS zbE~c-7<9SQoP6loOWHJUYhRoFC;L_vD^`ENqlz*1G5%3m#qPuHa@R|Nb>?zWMpfvL<5$aMrTyzjG?px$PN-)Ro5!F;;M;^PE%vs^p8sAo_JHHMh{{ zHEvMNR;rfjI%h(mC)E24!#IHkStW&ie4~-rblJx#E#%T@oU^=BI_jR6OXovkb4*zz zrE8Z>+Bq73Vd)E&M!T*U9@2rCUni^KHQiM(A{yidm^J z(lu0%_wgEESA&-e&K>sQ74jfh`hrD&F!6G^$DA0}6`Zen(kAO+C#&H#HCS0riXPwn zOROAcfzF??vWZn)y;8-?RUD7i+X%#5$8!74m|2d!}@R>lj3XQ+JTvanL2LsB8E zLP2f-9Qxh+_>vl^DCPnCpdu%fRV!AeQY)(5Q|3{-c2l`{+uv3mUsHpXj*)#IR@w># zyvpiSHIp)@y1|r9&sFR?n@Z#BYVg7s-S^=Y3K-HWUbf=pDxK1s6zjA}C-4qd!)t1= zQZc%J@54$FOQJJYr;63Fvd0_(O*Mv9>UHR3HN2(nz%T}XK)2;4`58ePzBOyMDEyHn!qKoI$l z<}|#b);|KyQFRwkRtodcn1(L)fw40ahxpq$hxpq%hxpq&hxpq( zhxpq)hxpq*xA@yX8TpsYXh1Q4;J#c7gi8)*_);8#<}T-J4o+*tDbUvN2U*@YPHoAM z)5;&&-gDITzzh%*7c`Q3Y>ENCh$>Wfg)E$131| zp?1zD#h`+i?7WG^2UCbu$i}WE?}U@FYw3^5hx@cOZ$BfJ=jnM}^nP{I?MFiD!JB}k<}B6KTJC&og8 ztDizxsLNFfCJ;J9N+yJmp@K4``k_=zV5~3dN&}0|7cf?eY71zKxk>`yYCo(VL!C;P zB^RBAp||8JdBcu)N3myr7quxQ!`|so7Q@7fC}+b#>Ld|TQngHmW%f200IF{pV{^p< zFIepw3x;tiiWE#LZq^2KdaO^)DL&TeiV^aP3dRc{fCT#rlcFN%$3Z_zvH{v`)B!|F zGHPUrK~w?eh}BS7uq3bZ0%%DUZ4o268V?Gk1bv(E=vWcMl+opX`WBC&YE?XD7^{&a ztB!=Jl3L#dbWW__lwht@6o9DC8q|9AGqUQ<&ZL=blRzqUL@|kG{URh)sRl_{Ep%Y2 zBszV8HzkSM51*E1U!U0|bqPq>WDnq_kTaR8(SUEJYAQHFrlMo9dotG%z$;5&)!`x4 zmFot=lHj}W$DDM3n-#c8POOH+1UW%ba!&09w@XfUn$ulauo!HLI!iGnz&p^-nZnWU z{Pa`v{(qNk^J+92cg?}oai>pvXQTg`=I8O`q@5f(?0a|A{H=M@{Br1L5AWJxcSzY= zIDsLG)`0;6vsFkbh>fuvHLnb&KWKg%zaKZR&5u(IIvbCF{%o<6{`3<6ZKRzG+o&XT ztz9Hou6uu}_PDura%>$qgFIUgI-p24!F7m&g)`i*Jri%P9U85=u`kgwJkMvcQ3=ff ziz44ayN4I~l&uo7=WG+Urq9`O;QO`5v<)qyk z`=vX&gVO%sw8b}!x^~n}HA-=v;$1r(UrmPXbQZXOwCQboayIyR{H3B7(FhJY!uSbB zg7e~RsTK9zCIcJQIBETeugb7j9mqUdX*r`r)n@DkevpZMT5!1*+pH z_zTK`(HSnsNo+`ucKB~AL}p`r?_~jA1qC5Tt1A!!+aSON>^O0Bv@^GW=GD#gRWH8e zpYPs(=)WI7cHQOlFHLhY9!~A2tMjwL`CxQv$CJ~h9W|eQb1@iQ4bGd3wi{ed#;23P z#l_j^wE5xJFPD>cI>l_$7lYBsi}v&2{A!@HV?jHQUy&yQWXLnbIFly4yt1s^Tt(kn;a zXOrfb%aw0|j7goUXy%LHi!2Elu+^k9aIk^$1KNYz!qR~|GWQ$pEY4~!v|Ky;Ed-*N z5Nykhc0mx9mDWyW3&=+ghX>*gseo1?u~@BZf)5t)?mq37y!CDyIRNq>WWOlatX6k_ z6be8ki&Q8GM|fG@?9N-V>=cP|4pjnm4(cy(-t%1B%gvk?j?qORAIl#(pch=)>$vR+XIN7f9fSE!*u zxujRP2}qx=E-qi3w4a-|gYM%$F1t5yo5=_GF|caRrqio-+W1n^EpECiSnj8!r`QaS zb$RiNE??H66LG81$y~4NTni+B;Uuora}xyTNaGHik47*pASki|f+f;CX~b|#8p4~W zON@kFH-Sf~8ud_IPY#j7>S-F4@W3gW_j4JG#3f->;$o1el;+kGY8gW+U6ZT>nOkEY#Za5m~N&kuV<<;5OJ*+SSuSzwDVC=IfOxixRk z`slNsr7!F|acD*42#h#?4nILAwT0?EA@#zh*K$RRhQMl!Qp*)_4_zOyY~kFb7VWpn zQ6%g2*mC7z?&w^v=vD|SbG@$V0>t8+tkTmt8zMiC0{+pAkQW#s#dR1V->KP?Y#w_; zE;eKkybEwUZ#d~aQUu{62D!!91CDUPgEgE(sB#_^S(x*Ll)i6&9(8|Fu|4bM#mphE zl{u6<*2{gBk^5_w%p1|T#Aw4Ui)+1{gMX$h9$)Nv=eEG%A$jZAuxQNESSA(@YQWSM zHQ{Qx(>iD;@xwUtH0bXVo;Podq*Mjc_>V?n?8;SB3Wmtp5X6t`yHKxtf;Y=lxKmyj`11ef_bK@9>(4wnc! zK{ySY3Qi@NKu&XUDV6FHn=&!Ju_@dAxRV2mE75Loay8o3 zppL>!8xpl^lwda7gOnXfZP$t;<#w$)N-^6Y!BNg)5;-chm<4qlINCLaq^2jqF;&x( z=$LD@yVs+cr;A^}}OW+TJJ$wtN|r_vBnAk|=AYn#&S77WS_5rAlp4Ocdl zwzX9_LT%8DozAJPsA7PWg4uv_ZsV7}JV6J4V|x}KRc+2#YN68Rq7HDu@W8h#Vtyek zrbG(~0?bOZnG!;(U#) zkaCl7Eg~#&S6xjp?tJ%M_xiu*!|wTLG@f>^E{~@6t#>;5kL$i4PmYI^gMi2nhuuGa zyPvur4run}w$`E&#La8%%jdnz#!1+8A_?jC9YVpsbWXM$ z^uREgDE%cfAeqz#hhAhVr~&z(Fg0B66eJ>CuKTVXEix==4*9t8flgn%@fg0+q~f?T#esumwjNK#X-}gTIxg(2kOJij5sV)@^UojZ$hzq+?uQY-0y0 zEZ5IR&?S|}`;!jW#($Dq|4888GGOXKiTJs%dqXi0Csv#m(C{O$%7;Wdk-dxLnh^x| z#QdN;0?2!UONXXSc;lJ}d`$SDVhl|jm&{rXRjt>5?g}8r>F!TqsC}rC0x&eG<~)c< zlUm4?b!#YqF^YS`PmuJ%`AEvO;l#HQY~)>rbm)Cumb@E(R*$b<7H@1kYYe)(-bX(H zZ^up^KDW(PZ~IQK$A@u5k=rh|4BJ`Pgh<=Y0(zfy*V`G+5@!4Pe?d5ivK0yQ1o82g z^AmCjk$!L;^CQI2JjA?>fX7O>1A7I82mmP8k3Yfjd9;3^8WIiG9PFuBMem?l>BpiV zmszb8RGbu{p6N(E7vOSL>8tipCXI$Kb!_eI#G$ay!mH8GCX|vIYJhhqzWEA_p}yCZ z;E;a_1OUA5hgNPjYkK)FA5{rK9#CGe_>3S9NXL|-KoLM;QD8ooR0rHK&L2$qKLLun z3@OVo{rHEoMm_J`b+)AM3c>C=0qzq|eyww;N8e^l!}lO2*Bv`3ZfY~<;xvTojETHs zvFT5I%zy&e72cuvoGxi~lH{`K#BQg+sHrIcQI|mWG1>xVJ0Izsi4zXpv2SbYWcOc5 zOU;0Sp>`6O$~M?h^yFC8ED>cBPk?0J_ARbr0(gK62wtieBxPy>QsGvlly%5oy)=jD zEp1_HDY!8ii%VqO2V*l5i%H%z(TNldik}ooswP1wzpwQNtYG1?WW>A&KmX>0?Lm0= zC-~|8w7QWw<-ZwU-T@jTcB5nY^MkO(E0HLZfGCwe9L!22o@nMRJHT}F3uV)VWsY@((BKZb)&XL(R5`X}{t=#Bo`EYwn%I?G_MiiB zSQFrG|EWnc2d-MFyqK>k^$ehUl!hKG>&zH)@paI85H=}43kvlPza3jNHd|8ame$K> z+q@ioAnYY&Ip(QT))gp=wsXvlV%^1(b_Sme@2fsSKnFFgSx>OA8|OAj^i&e>T-r&7 zG)ep}s1Zk(A0hZ5vS{fMmz=1Fz)tY^bxmKow%^E7jc8jY$hom#`T*}+;xvI5Ii#-b z%Sp^u$FJWkWub|{3hS*x?e6=ZQ2VokPICf~n#Y@nI5be7IqNidoxf?%Z-17=TZX2a z=jG9WY;2}kSCh3`=SU@W)bQi9mAFSSlx;;YoW(O(ZU9?^zyES#qC8))O>juobPW-| z4|pRybf!N+jmC`RkAix*kRJ&N6tFWCmyd~RO8VWBt?4aljepNO1n$-Y~}TI}F>A56fjbWkHzi_bz`T zDC@A3tId1AaOz;PlHLWW{ibUus=+ODn&;X00?mX!{QbXS0j=3vMCi8!aE@Mz8en5f z){OFbr6)wJHwQLM5h8;42SS{&m0NBXB;*cK(hA#;t{RPse>~}MXH9S0jJi^nR6U*o zr%7NXZIi&^ndNTc*9OLQg1vYLR=;ulz9GxGGkaD%tg+V^GIh$%J<8wuYMYE*Mb#V1 zqLS}SxIrSp&?1OM5|%=Cq?6%gEr7ZIRD&(5Bv%Q9<3&R?a#T#N%a6{)jxEO_EcI{1 zg=kI)9Y|8RMv6nK_W+^1@ClZsJge)^fqo}0<4bXP5iXMDT`7qUY z78V#pt!=q(C|%()>n+u03879y+DM;e>Qo(JRMY9K5h{2sd9YJno#t8$J?VS%IrIKJ z4cP5kfqxPl_%l?uxuK_*O+Z*RCp(C0lNWYVd-jfJj_PyQQDo7Dqm2|y)!gZ0WeGmt zaUCUoc{4Qg{LeO905;$md>fVDI|Q~MUdK!Z{AJEbSMvPTrh>k=HW>2w*G}M~+0{sP zUTeD{jwu(-I!eUe0&v7F~q!jB5sL$5UzD9NTQ$8Lzj4Ax#3@keV7$*YX!OU{$dYcz$*? z9(dkdR$I7EfH^OoXHN62RL1L>6HB{0vxwNY`Q6i5nqjz%Ce5KtVFE@ZO+HdCy0q`l2`OSP4H|G~eH6*vN77+8I z3mh=4nb^zc@*jRap|b2TtcEd<7=baMaq!=!bP!GzLzKc|awi38qjHsY9lj)#5me{I zsw;$R(svgQU2>ny?>)L%s2vD3X7Vk47@4x{)3NGItZ9E>sA++qeTIaqAJN8+Y9?lh zY3y<*2L$YB9H!`y_fy!o+zyJdj6jld@uZ3UW1ok-uH7rHhkQ`%@w!_5+``j+n5tgC z)rLvDNB9hB3Dxu~Dxvs9@_mp9Vt8=$7x0_3$r&BwR@{9^(@$1=+5eFS!<=+7>gNn9 zbFBDSdxP_V>gBNdgP&}ACxNG{cL63Btp$x+5OBBvLvRvJ<<(T#FM)#BbNX$3ywZ_z z*vj|m5;{}0#W32X)65@1g8m0E69q`%o7*_HX@EPoLGse zh)>47R5r)`NE<1!2974$+6y(?A+o0e#?M{syvC1$~5Msl%hnT?ndLq1Jk4mjWVd?M;wEn;M&*>Muss z`$P%tBIXjI*LysO18NnwtdC$fXDfI6$2E<7W2iYvlYPMD1_~S%`fHD8zrIkehKu|g zGGO;8OF;%~m@&vx3;kDeJuhbXu7a;d0X*m)zaEo!V5S6kJkuNA_fq)I7^CZ;?6Ogp z;Gv>!>ph zpMimEh>R$*&WAERV?b<78e<15YGV&#hX{}jcQiRWI6fn-YN-;Im2t|noLGiAKzT31 zs7woq1>VMpBRY$-Nt08E#$25Asbry3fikx;jXlRvC@MO}Ng^jKZ2yklcVZv(Rtn)! zRLu9O&Z<#>9uUx+apySwPo-J_e}fH>nbfIeBc-uVmUI~Aadb@tq>sx>`PX5# z*V73FJ#ao2?wGmOuuow#kQkA#L3!l$EMoPH)F$VFVUJx0a!y&_f#002Vofohb!+4Q z{O67TM*)dVr3P^T9MS(3X~kbvr!U;MiYlVsoW=)%HbW)lAIpSSDms4w^o%`CM=~(x zV8dbKkbX~oJ3wK-$|*<>5SQ5(h1T*MSplu(FfBj&+IfC{r~B1BD#d4x6XHFf;aYNV zHVPXQSRqIG>?}d+ht=6`9bbjnKv@czNX^)-50Fey3O-g>DTvkM-k7;2Y`U=*@a(P9 zGgBp6j`>9?dffIsCym!4c2jvC60^i zjv@2txpRU-gFse?1y7*yfmx70|!50TBD<6IE2vu*1rwzG>LYVH&%}Oceq|o#h zzjksps=n2i{;n*Im@Z>4UeB@RS2YvQ#^}oLEzw_4>E>v1nSz?!-$6%crxhK9^77+E zl(XVQl=Qnt8zEA!x^k=7_@mDL+m|~(K=W64#H6q)Io%CFRY~3aw{M>*K{7J(S99rV z$l7i;R4#RNKNozu2%`0l;X1jBv|Z9IZkv3tcvDOKYXFb#pKo2R%<0truxJknVV_8N zC-V$I&;ud#X7xm&8wFrqw8A$w^NaxrM3%yU2HYbu0sB*TWt1Q!(`BlI;2`V~TXgl& z>na+qxRMo;Bkp}Z`1&8D9THc<3kRk`IP2R*5JNKDkAlXS%itJ>u?eu=r$?1Akx{kj zE@kW^n~BTjWrxtT%T}QsDC$sVf7{ruD3$D@l+q6 zj-<2(@5Qf#mQjM^ku)};%vzX}*`Z6@@Ovqy!(NZjL|p#v<*~TKa4EB)V+Ui`FK0Y! z2(4@&FJ?=RjIVWGG%YmbYBB76W<9ASAM^ zDmaZ8{77R}-Y>u9r%keCPT6fQIKYx6LjPH5(z31B%hHh}8b=rN6=+v4XqpZGRX|*X z)GtC)GLmoGb(+=Xf6kKeF7{NN{T1~z`lKd&b@A{1{^r)muJx+@^wi14jvrS++sI|} zZq|!GHM4a^;Pd11{Vm|doZo(-+l`$s-RRTos4{Sq17=#E-}rc4KtEI25b))Dh`PxB zv_HIgx9a4@l-hlkCE&f(nbDE?bbg}y>CW$Wphu-Kv+Cu*-p#~&a_q_6nxZ>3ln_BE zc(JIEu%9s7Jl|XmMu_&vwd@vp`ztc=Qcz*v!@-5!22JW@P{3o+ZgRoAWeE-chyM>! zL{Y7$UBe(7@nvtGOacYdZ*NAs}H}o~-UX>`tLH^jlDDL0s>sqp)5p z>5!PVfbslRxfX!KWA@dk;p^?YvBwgD)0fw6z{lHJ^UM4D-g(vAgYoD3Hz=X7?bNN; z#kI|o^*;OI_A>AI^=9Gf#Lag$#2LQ7oJhrW^4vn$nRRmOmf=V^3phxbJ8=`GAUw2p zWyW*;>cl7bVsZE6@4xB37^e1o6Wr)F1gIhAmwMP_UN5J=h7@tw^-<}A)XV}cM>Kdr z6G4p#KOI;2>{C8--h5si*7%(DbY#=|0C#pqq1(#bJ43V`KCui1TfWC?rxa(11;ab^ z`XHYj#7nzc927e7n*3{l{{UEDsR_{nTbVjx-Mu= zRTyY_3UVoEB(9K4EFl-<5lTZ7Yd?{yU6gu|4SvP<8)ou9gaNr&#gHD2??xCcTPDO8 z>`bdtl-c^=cy^ZmLP4_e;ni=haanxmu%$J@MFMwud~@ee0q}pSeC2-(BwQjhnh+B( zf-oMQ1)X+*+IsK{xI6yq9=!mfT^wJqA+`wVg|{_lqjn>`@`D|Qt$o2I7Vn8Hy{UQJ zzdoQI#N}OG?vppovj#(3Yf*;}Y>>^nYwW@Y^=|Rk9Tpb-0Lg1M7CzVJlO;BINOrO9 zp;^`1wCAD106-Mfjba3;f$$7X`n~ifXB!2CKCTx`yb?+0d)gsjmaTJ z6~Q$j0xxaNg)LHvEklc*$`D1=u&)T5ad_#BTT@br9c(S^JMafqRoMeE>YWd1D%WGq z^%bpuqw!k)PCT@oCnu2#AW?W1UBW(Vc*P}w5iU(QTtmLUzz1(!q=f2^h-$T0iW1qK zz%`2<0;-gWqVs4}3(jh_T~{WW1BWNhgNR6Ym+D}s-eHN@cUTu94A4$zwqOewDRRpV zCV6C9BV3nS?x$GpSH~2cF$qI+iRrnKEr|blYQGqzvvRo!#i!-D1u06+YW<7V@G9^U zi3oL>!P<>SrdXgs1*yG)pCJdHDI-tUZY|)90@h`K{w!>i#o=Bl6{9g@KYA)hV&Yu4 zh;>|NQ^HrZ=5-+L*~)b$a$Fh~^%aC$OSziiPGeF1bzB6?Ou9(i4$l%n0cn5DWl^tl zh}6KGmQ8IWqmcW&h4W~*(p)&Kd4W&R+xQDIkLbWs4HG1g&M(=E_vx2diyod=HChV)Nb z!}eE2$W(lKEuJz^{xPH<474}#suDIS^+*&p7FiDK{!pDxlXwrTf_ZLqf*0|Ijm^P`I zRkuyk>=6;O59d!nt}EWed0gx@03F7i0(FS>S&A@}1vvl?p*v!4*Hvj^eRIH~cXteR ztP&~yx_k6_*xZGMn>$l`vma(md9*z=72HQsXwE|5cV{0`spMU`7x#OpVN_9DhrRL+ zlt7I)L!_@%`|~P}#iQ}(|(2{8OWV5(NIs{pd0nTO|%MNGdZ?3~pP47&-g0VB{i zZ>m;XOqFKL?(O_-B7PjGh)EOIWDFXAbY<%LXmaFk`p6Kn6ZMM=f+Z^tb`&`xjK)-i z;ylwDEDW|c@Pb6tHg8^HMv7lh-%MGV;87f3z|R*^XQqk^``So3%%H#=fP^1qR{Ths zMM>SS@0WPacVeQ4Ajl|jiB0glSLO^A25wD$BDGWu6W}bi&N6hZq6G6KsZr?9r9=>c z9j)|L>bh+286e!9b?jKgMO;R zr2;%pv9e3BcL{xmLHHUeAi;n&APOH|qWEsaniKL860Vo)G-VbeLX{@{r1LREEHVX^ zvht~^wwh=)jo{@=be2=3m=>VF?0u_&ggmjPhJ< z=->K&6&J-KZZbNTyb@2wmSKw0D1GIs^GK6n!;&mPg}O&7>{ta| z5E{XFZhz|?S>5X}8f-jk+0V%?};n6kVZ@E(xLmpEvN zg0JYz6cz2$1F>}_0EC7~XMe@GHnm8`tOiYlgdTOP;Hi)S?4G_uj${n7ZmNF+2isnqOW%>O!Cz;=9RvP^Sir!1#=T~ zF%c4dQY{OQ+A~u)x%m$!ZlWkXJ;dNnn6(}!MyLcSfi5Q2&iC`-(U@wg04dw|`=N;0 zK?ru;6Q43hKxq;dwEhTdd(T`s)iPX=3}fSUu|hj=fA+>%;F}P{518#d6_Aexs(l^q zG!ufirQBmB&>~b>0IFZhXCK^F^yK#CY(M6*vk0v?wHiV4OhJn?RR7ow-GzvfpOf{eYcB{xMd7V{40MoFJUU0Y zmHqj8de8&XZi9vJqK<_<`*Tdaf`!s;r~m<%mmlju!-&u9mu8@O93C&j*N@kv01+f{ zO}7>><9kQng?CE=DgmYzpb^fVi9U^Ockm*16;pfF2*Kn)n%s%fM z9{PP(%ax3D#WdnyBuzZEn^Fi5Dk2}E9D;8;C?SKSUqbAsl}7=pE2PH~@~6Ic4sd%j zgvd~ALC!+5;b|Z_+=8l<#t$@*cqi-)g?xgDzj`PpqZ}F3Ql0W|J7qJ4MI|)c#6^1m zaWp*Xalu6=27EqOK?;Th?@WC^VUZkGoK0LWxFNq%qsTa#5!>;58%OjI`k~Ou;!|os zyEdGco1r}AXEA3iz&)n|36PKw9_y30@$;@YIScp>nI(JJfD)w9+*pmA8MuomXLJ>} zHdh!QS3LOMO*nsy>a&EK@)GMtJs!&e6k=*G{Jq$;0}kr1)PJM+9a@pR6Kir} z7D`CiEJvbn9rA-WVEz9q{PY=f>f=r6z>G@N!wylwso*FNUL_2IJn25dys}yfs)JM5 zwO>sK70;<%$XYB^PLhsI#sl1g_a-ZKIJVZUv(LJ#@!&>d?o-JV@aKmBxLOJphIHZ7 zd5XRXpGVQ$T9eQm%N;=@8S=oMx%Zb9)OO1U)yhFOgU6tM`C;eC&pS*54H8WYX9^uz zRuXufCql$OC)PJ;ugL1^G(e#_&S9KevI#}D{(i(*a~VY`EC7*pr{#41bRGlJIEqnNho^2W(H76 z`f=(_TCxc1(KQ{tVu*eeLjO{h!93R9(7OmBl|*tUd=pY+m1?uP*xp@4FeOOV+kDm^ z@9%EI$?RCh@i{4elk;`URzv&AXTF`GSZUd4tz$v=Hy?%xKxg$0)X$+OF1V*Nz>T3w zAw6Cdc`C*H{kRD8p-1siYtK&hZz3P<- zEO!kUf8<7G6ZT&3tOj0+aj7EV?}Sl{36(NzxJXVIq&7b|=4rWm{xNtFiSHO%=djF! zeUg0Y#@s>#_)NA+UF~m>&}XFM>Zs&fSzgJv!kAEXn@ws1btj1d&Y!ch&15FFYYBJx zASKy-43y+Q`l{zmC%7DXZ1?<0nSN{y_fiJbgL?Y~ELJm&1}GOMU)qH{K;%J7 z(AcRQi9#$L^Bo}to;mI?<-HuD9;+Bf516%xNl#lOgznt%DzaxiW{CE`z(2N#&G-_XiRzWQh=z@7J zrJv`4^ECgPu7Zm@=U3BvL08f&M*` zy;9`AMoef-cb;%3L*+%-z!id0G7dKIlc-vXqp3?ie%1_V10)>=7QLXeLf0~ObV=(2 z{W33LMx!m|7)*l%OwN&Wq#Rjjxe-ag$;^h0H>H9I9P7G5xubj64tF@k;E*~EQ6i9P z?W>l6@QiF4dOPSy8b}V#aS_Cb_dkae5kw5a+-X3Q*;yT!2ZKp!!rd9nfulZ^tAoNz zKvV;^4KTnOfHdSy)S9oyC@jd&57FSjrh%3xvibp%EMtPN;vl{uD-UL9M!ZB-!?IJ^ zjRqbbrgyh=sT)jY9qlYo8R7>nTyvJ8EJY(nfIfM|pr1NPAv?e=YVF8h4G2D@fS!94 zTd7{gppuUDvj&w3LddMD2N@!hjCdAnqaFxG+ol}~nD7VUUczvWSbh%p_Wgr-?;$re zI3X<}pnC%qftqfaC=2!*A7fu;5|e2h{rQ*@yoC74x@wO6Zc%9(SB@zm^j@Xhq-W%m zr1d4K6IH2>uMLUIbmL(Oa|z?pSoZ+SSXkEJ2{Yf-;JKH$z&(1#+6XT=JPUdUCE1AV zFi=wt(D5h9IH7}TBv;& zs9JMT?>FdGq$ru?^oKV7`=;7`@1M_c^+ z!NkYM^Xc*UDc56?J~t-e<`Ydd`%}^C;bPAau!Jww{&`kTWsB?GqdPY|Cz;Dp!qLK! zha*u=$R1Pm=D{wIIfduOdG@*Hz3d$T2jLz#C68$vx(a8QsKM7FvO=pqadN;mGn;UA z^J;8xg*e6VxyYx*l}$HginVF*)U3X}`o-v@OUF?Cx#293N$=Cef19w{eg!;t1u7^2 zio0F5^}cTAz8tnPGp6O+V3fGMWlS{vW#u0ZE>-2J5|qc7;Fu(l;B?@a=x*7q^ zi3nh>&ZErcB5fgt-Jv#qkDgy5=3nKS~^@_%{7uT*Sf)&)i9s0I7y(VDo?_mu zlKc_&7wrJ-GR}cscNQT26=qRQKk=Raspf)^9Xq?$xmFYnOJE_W7z5l|)EYr~H<3 zHE|`|l78S=#9m96N2!e)kK!o(End{2Pk5Go*D6@7Ja{3l{7bR%m8Rz2-Zp|%#sFJA zFa4TF`XnZH6%oFHg~9bG-bVI7NbRD*^Jn$S>AV^NCE)hq9_(6!Xqi zAUqpU{vFVG|*93GlRP{%LcwOBHgC?yR8#H z)33adInU@`==5WH0$-5~|KpT_uRCjWerN)Np zN={-)|K=}tE;y)sIgxnfL#S zwczy2&gQZ9gNhWU1gB(<8h?OajW%GlzEI!<^RP+ZLp^Cb%%7AQRd9VMJCi&|`yMni z7Q&|j;Oa!Ws44_16e#oCbg%QL7!!=$auO-^)cL;mho*HL;jr7sM_FiKEa*jvDsm11 zejMXNmp7A?ktC9$ZLTA1iIxe62aX9ABCX5d!u2d!t|g%_!Flk?NfoMEbA;qN$OH+J zMOdKm?6gU}Ahi!Qtc&R#h*Hi2VMeAPTUIkTpahTXA^2YWDryd|k>hW{fPB_tnOrVh zleykvQ3)m!ngE-UtSOdy#0#^=o~axT*Ls@r88k$kvUQ+78;+xcqBnU|n?^Vi#kL5t z^8{LWK@+Tqdoe^2`;L*E8k7$AnWo%L=W zyfVGG`cY}Q)2ehG!2>tuH*@QGY%)bI6aHL$iwB~Gq>QjP{=69(sl_>`prLnYC|!4i zM!4jKGs$Cl?Mn5KA3YSa;Y%IZI&nXw6D)!XC`P(kCS+zPt))JZ<^C-;LB?8fJ-Pk-kokJ#9zbaU_l)VO22h!1}J-6VV~ zO|W%_6m$Hokg8;G3ULkgm{^c8X)P=c;4Hz=A-e1$(siqRVCXG2@*snl!qwMo*6p8h z9{GvV0)L+1PXNXUII}tMm7SYFOc>7o!NyPZzH-L~W=*YwgsP0nc*G1e7(%4?+%1Ut zW-VJ(BuGj|vt$OEp1asTlTmIY{uKBD z0TWvx0+7+2EW`XQby=d7^RYimdg_DTw?2V`-KO}b?6B7uiCA*fm@Zx#Cw`%6rRbuJ zP^8aPjM1=;K^N7!l&f`x+lT?Bi24W|z*@jKs8%MIzMtR#g*S!Wl-wkK=R!o;~% zv=M`M7hLzlmWp>-)kzSdZU@sO$6dtB-m@i3W-15}V3yXLaOlv~!n*MJ zK3;s-JUl+?VCwa@Gx_fDvL|*&Sz=rNZ=n51POW)x%L)ME`>RoaN%^94?P(l1xjyLS z0pQj0G2iO)neWK<*39bg3bSXu{_B0nrGOSa8y0%I?3@2I6kuz0J;H27fz) zp|L;zZXCc-{d!eAe)nSHxbgn6>H2zIo}D~ielEZ<8FM_I{a60d=~L$JZjwO>_koC6y7h^(w*tAnx(d2{S8bJ0K zxI8|1fS(Y7_-TiJauYgE#7vK8bt9-k6DwyIFr^AR7_XpUb5@-&_;PS>xP%LPCcq0e zzh!n-X}@LLYzt^`8Mf9@vb|SxPs9IHnzds?{Zim=GV@`7clrL&;cnB_mi0T}%UESL zbqg(1yI~B6&%-!f2G@7$yMxOL0ul)M+-jxG+hxc;7aEhJDaWE zVmgm`$Cj7-L@btehc70jI^kk-8K9{`^P*Cu3Y6cG56zrWs&h)Db7uq-2TYl;$y{o{ zxFg};xW}Pl^5GL&1oME=+lQ{)MLNX_DTE5H{+V3F?(#i2c+x?8S^XTCi6gDoh)H_l z(ju>s)EML@@*(1D=LGY(rC)>1WWp*en&Fv|sLd4qv9{(CUi&EkvKb{bieqkNw|U&C zyaJjv=Z*H|Tf?~Z7s9)j8jt}n{S0bD`#dyRs3FP_%MEgiwVuhGLKGFza%oW@tEh7o z)C%Yy6~PC|N|6A;O2PHK@%=&z@7vrd-GF@^wGsU-q?+_b`bA&K{z$5?aU_&B`zJft z9Mvr1pF^lAh({4s#5+>dHP>d?H5Wf+7gl%lb!o(SDQ%K6)~zGfEuemz(KvuZThtDxgM)g$^WBtC8Zx84}zzHRwkc z;OSYlXL#9zHv7%o^r3g)tG$>GiX-O;DEMis>_-{h~ zK0}=Pp#{Ahik^VmYs-{iQr-z?{~%8B52?65GQ1DPfE7|OYK!-c)=}or%Iyt@bv7aI z2^V=8;Cp^X9kzQU9{DPSiUGX}#%_S)1uBhsHa$?XXhb3V#i1pHdGw5Cdp4Kb{_a=b z8S{XC2cPMu#>d-bx3ZgEjRx--Ua^yQNP}@cQL@q@)PMcpxgx=m(7b<+ipY=5I~iq+ zK2jgQ)0_I@(0aFvmbJJ=Db<=(sTW~O^!}X=~Gf7QVi+w$2;tS7#>Hx{>=S7R(*MLiG3Vb{!rm$KDsjq zfT(%7B^|btu`p5*BgFh?zT>N*SJ+j?(P;>2%uQjBm0n(zc)?U@NjXZG1U16ox<-9+ z6BCK>{X$G+eAcZs7jrV|V?@>nPDX|8$I7{2*1M+RzuSGJdIj}}wo4Ux=v0O%d!Lpx zvocq&g6!5t2~7_e^yb6CprD+i{J+FeFxKd(xM90R#X9@}V7^>;>) z?A963t({GTM5dp0mx}^%_8z5R+CH>sORMO4Fk^yw+d#Nzn91NRPJKMkz&VfdyWhL! z4Q+&pQ_Dn2_W!blaZZ z#BL1t!P~?u`{U*IPxDZKBcZ;rlw_9VGZNKE5$60!F-?C_hIB>-GvQaomNFEOkL;yh zRtKPk>@k{Rmi>OI^=&-v>iMHRcSZssq~rcCn_G|I3qiaJwgC zlb7zxRPrX$+~gG^7rEI{YRHBhL#VyD@(5+@r$+)#cP+L8q%dr-_X3Y`ONr$@rLwYL z)R_o$S&1-f>kLYuai~`(MKJHDkRLoVcg$L-zq%t(;a*rC)E=01FKh@30R(*zegvGf zU#AgG$1X(T1J>T}^uC6?Yq`YaOyIucY^$rM735uLq#F=HJC;}{k?PM^-&ZHid6^si zEV3e#$49*^y*yu*ImWZI=q1L(avz8GSDj$+VsKVvQnEDNGcb@doUnSrV!b_c9dni6 z__-{yCd~HD5)S{|9Sjdo-i@Z4Z~*p>0UNUVFUv4LSasx!#)I0n7a6kTG3(b~-0I8? zL~TDUhz*bG+-vX~a^X+CRj(nf}e4BO^Qb zitP8-m~ADl+T*Lk-FW7s{-}8M?$2HRi;JJQdi`m(&EtJ>LPAu~EB5&oltzBz11bB- zLr4X9{8RJPRPWjtC!E&6G?a}@C{zvoC<`zNDE%Z%4tO`WdY{by{r_>IV~PdNx0}1^ zfgBOvoak!x@$J8i7jBPbFCUMKledQl&Ua7idRZ&m)#(xEt75;zNp-u(Q$coyfropC zgp>^G{_Vp<->C5>qizj;?b%J-c@^Hob^Qhpa9u3#ru6L$-be}+T z@ShwQj!l2+?bIDnwf!e|(~=NW2C7<|3oeLB@QOKN;+9lN~{ zNb@X=51XFT1^I*rz0E5QRCpF<5@?PHu||(sSPmfXjD2E+&**$O;l^wlqXzedr67Wc zLh1C8FvtN%|1mX4S!_ZBN(ecSSUDdBs*l#%+TX?_3ha6o#sd7rNi4QKJS#Tf(lY3d zBX~ksc>kL-CIM-=1+99zuW}VWy~{?I42B+4j++cpAT}qmTyvg|RV_aLvY3tq%s(u_ zWXXBWK3n!O@D5d&q(TJoQ^JH-BoIHb@;}vNzBP=rVo6h>H|yp3?tn3?hoSD0 zQvHJ@A2Vdp(WbA~)uaEqVN)r=&z9zg-i^RS1Z<$5Zn8nTlLlKy%-;f`F__9N#JL-blfYOW~ zjtgrN?Ht&RC`)@t7u(`_6ddYH9sDAxoLlf+IO~)x(CTBF81IqrPQNu6Yp-0)r9Mh; ziZ0qN59^r$LLxa2*z0u^{zKeyIe5u(J6~Ss$psMVlu9f=#vXj(sdf@?dvS?&DM_p8 zDgBsnfl~LJ*bYKe9j_w8n)cjHgR=WE6Y7)eE#;y6JOj7c_q}eZoA?V(K*krxcDsti@`}tm)Fb zgaDidZNTxR8a02dn%+>8EM&PPWZiK!ah+K0r`hpH%TOqUaO&JsiY@%AsL5hriDxvJ zKXF-V6zQ-hvkrXVC55ylNM4nxIF_b~pH$|5Sb%Xf_HMpj4+NRX!Kd1Zy&(S^!X!V! zKkcD?LRV5|COo-R4TtaY`$^}~Q?)j-(h$HGe^!PqX#{hd+xxI+&YMlYL=l zx}3*{aV;HUyxm76yFmX-L~nr-E$Q`H)gPY;XebCeM-HoRt^^LGtNDb5dhf=w;-O5 zc*uODG+_&N)HCf>%{&Lbd8fWMVs?`FPYgP^P|+$*Z})FXpXuCk-nAj*;Av?-0}_eU z|AqzXEQ=Ui%2IhSorT*94n)tSW#td#Tm7kP%UfM2{94t_7#5V!iN;~a-aD0f4CnZM zCq)MiO2AQf1Oa9@l01o`Li7)ey@4`D65pT8b;Ttk{Xr;!x0lY zWKZLfKgv%Df@{?tEHMH471~3}RILC9*e&75T%k}^=|3x6H0r7w{1pa>`!nXgm(v{B zYMhEDj0Z{9?m5sphZ)*8;*=Bt$8yqi;ip?H@|PH30O+NdjzHznSfxx$k6xB|hkr^F z>bY2oDTPaqvTgW~Z+6M}wPd{DVhd{eIcpQ>?GuXFL4B|?`vH(l=)q=x;STaM+T*#dc5#}J?D@-dXqZ4F4a>q$;Sy9v z%?w6L07vyL(s}ECFGXaCgx7|?YZE@`7gXl{X7O;wOie#+en*-Gc@s?v)=wX+ES@<~ zIIl#=1oT;#VOjTLhtt;(DVE;SP%n4(?hvCiS!s}edZG6jWPCD2uRA#7gz@~kRg%?T zRM@sVViRVNctUenZ&VdxBPiJT?J~~nCXL~Y14!wjw91FcT6Ef}DpYC3w&~KZ(Fniv zMOc!yZ?m)xG4u!hj`}(}p$)K(l{1*+vM=!5_F3Ao8gGHV!o#raJCFm4`DZ7W=z-8s)szWs~NU z`nNqX){kG?u1IRrJfLS+!)U~1LExI{&ETv5WU>S>>kUq4v>wm&xC{U5z(gSpEL6tE{G0O!Ad z8G0QyJDBauAKPEI3N6ks!Ox{VHUA?I5B84REkJjX$1_1LTV2nE;-VMK0Xc$o_gzhfjrbLn5 z*RU!Akk3BG>&-sOZ_VvEGdeB-dYx{o-8epJ_>~!V<@kb&(;@?QVsHa0i zV`T)C8nzZ#gG^a(Oim)Mp|sVI?#@L4)2u48D`>wxPrAaO-GB^}#11q-nGk*b zWcGy<4e+}~8ot&yorEk4@L=15Trhz{DMeaFA5oDE_z{aEC2I%w$}(X-7c{nM5DPv* zFf>2wysc%B;;A}DfxOTOYL=Jtg*N@>U%z=Xx_$26bmi{BI9-o1P0Q`bndzA|<*oF9 ziM6ru8nHKFV(>1RB8&>~(4HkY3?q#TLw7a5{{zo+^v&Wj7Gkq8y?>fzt@-Kp@=KkK z?D;^I2v|npVE-G~Ao5$CJa*7(20n#(dIemmRc77=T({vb>b5fh*NTezk{lRIa*XCzl$*DtCFr*H)yV2#AuL@)x#@)k>Os!XK@)B}grnNUqvhriln_Y{>4 zKYDO5TiTz5A(nv9QyA;wprAQ-g_ewZGH_ca&uz|(>%UMovb?lJa<%CTV=qhV)bU-y zU(9HX48{T01ibb3h7I3`qd705YN$V!jf%IR%{nrh{nB|PQ?;AGlGV7VzeBPjojqzq ze~M@%H8YAk^niF!I`CDge2PRZ5L1sMugs-WC&iMB(E)Cq3>P)M&gc@OdDcD4#@>~9 z_9_QTg#yXWJz)Y*s#oIw`V}oG2ud3=`gL~MjBf^-nBK~Wp=W~X4MYNjnFqK3oU4$3 z-wU~xu8Wt-J!5E7lG#^MBkNyHZ;AQaL3D&UU`@&?f&(419+5j8m@G-i)WT85`1Dj+ zCF#QRpOfMGv}I)0O~F|pwVPsKf9swGYNQqv-i~W7aNMS1rqK~O!4=MKt(iSDdm)n!z9Sm zn;rGx-~jPd;<3rz161lR&O3y*WRT?$5AL=B_5H4ljpM`?FfpHa;Q31LZpe#Zt3b~>oe0ny z1;UxdlhiTAj>k%M;whP?wov?dZ!(YHpc3_L)fYy^oIaCA@sRl@xezp8u}__G8SOv9 zSVSpSNBtU%le;Y4+m}fF$NxJ}Y#(ZQLliN**|yK(vz@@FwlEKv-f>yD3Nwf0UH9g` ze@+EgLCD?t=c|)Y3ouCb8w+GBKMR$W3iw0x~hv_Y3@ZuEJ-`8U`C>0@y8oBxqc{uRKe3g1boROq_i$MhG*A2G~uKE`e zLZgmj_yND9w2p@{FvX#pl#mDBL`Zvl0sqzsSl}%N}XDCci^l;cGDMNh2^0+#~SJRH+4%w7tp3 zH8PHW8-ZG<)U}=Cqo`Equ?JE;pygaD^;H-{>g>EoECJ<18UxCxAt2|`)`_{b`bC`0 z0V?Z0RcY!sO;8RKd6R=GXlv>bdm~M$U;@7qLk_q(s%VAp3|VPKU7C_BxM113j)N*_ zqDA9Z?n_6*%STIBrRzmYQOH}@F7x6sl<`cI*nl|L6>0{C^zGOSTL~>vt`Qt!N=3@2 z#`{hBE-W}is-TdV%w#QTkW18DwP{9>QSp(%8Hda?=WsZ+%9V>-j?TE2neY+hI7JHF ze_LUHWLIVV+5J07jJ@t$F_F8bV=WcAg8i6ZD*%AeC5G^#!_l90_3M`|l(%&Zm%ocJ zQ3SFy)`69<5S5|n(e^$Dn8*xfRT^8BaVucDJ-UNBJeDNGNiZYn=5yZu}5uJO%KsHp~i!(y@(fo>WYF<_tsn!+(2Y=X9){? z&fLC|?;Byokj>#OYK+a{UW<9bOs12Bs zBArU7NqlO|2h7lRNU9iEmNrN#iw98iHpt&mUG|=6Pn{QabX^^RZ$Gr13;-39Eq2nf zPm_~Azr&ps_Oq#ZJ(|=XLV)F+ze{H1o?H37yg4!uiuXocoXiy*?MJv72t3P9#{{mH zGR=_X?UHx|K;y}vrt=Q_j7uxXOZ^7Nj+l>S5f3N zP%DEVQ`6%`nSlm=8Yg+>N!g`N`61c4+1uH1*3s2QR$f z-&=a_2(t|jBu+cZgDup+x2SQ0B zn?H&m_JufUxS2*U-8F|{M#!IL<)q-GD{Mim*NA!^(fV3Bn(PIqFlt!&bT45ku8HSK zDKWO;e}PLjJgJz~TCc%wZz=#h1zLgGd8$*LRu2j*K`!MQj!{?mMs8(|-9<6^aWR`_ zWrmtH(*;KUV6~gY>i0t-bY;lFtQ@+T!oYs_-&Qw%x7x5V)#JCg;=wAf8@SWI!DP!M z3~55!RFs$Fu4+o{*yt}4;YbXUZMc*tFg8OHA%NFWhd_7*fPBSUHn9?rfm1`|InRI0 z3iGdCkpQWZhexKVMq7gr#YOl6x)*gg>DNW9SCj9$ilWeVfDTNb31P6D8SW; z4V=6*f`I|W9%ZTNgRx1>)o3-F#mC`lbwzZiqJs6jydNYtkN?|(ut-ZfUQhPcGJdZCr z=e^Pjz}Qi<*|N}s5l(4v+4iSbRy{lBlAPkQi+LchPq=c2hP)(a_~8FR|ByPDBz=Im z%9BcKPEMg-%xDkNAMb+EDVBQ)pAA6o=s1Tx!i#YE(EhOp_4ne;y`bX;kLZx{s%wPh$pm;Y4KJ!f}cxKkXbqXFhGZb zJ9t|SgSdGyOadQfrndhYghH^#NwEQ^VUUK|y@j|nh&|I9%yj4m^Xm*(ZW@?Mn=Fb4 zT10nG}~%tlR2bZu?e=c$!-RBSTfE; zpTsYy82oDw^s~aN6e0hk3B+BOO?S;#GaE*Cbiv-hv5l&@^c+JqxFeU~7`dHzGK_D$ zKV`steeP=`!+doHbJJM!UCMt@cF~3_&_{hEMD=`}ZqSBnRRDYZM;65IS_4G8UM+}^ zpZv|27u|I^FR8snn&{0;DWd3VsfS@0|9|Gn;lG(HHr@s%ag_hfT&2J_azF&;PjM1x zsY#D1y?$q|vK25GwDP4_6A&ZQ+B4TvJv_2kH)SbahJKcj+l)xUu>2Goy|hQqx6|Yc zO1Mxk7n9>okzf@anG>s*Y-JB0be@r5j3p*#$CjhfimVf$M|7wI4mH?GaixhN4r;D% zhd5qP4~K-`>`@5M89&L<9&?%5U>ArGaf^z8$BFd&SN&w4&Tkzh+%v2C_+iPFaDurp zu2M7ukyB1CpKI*Iv=)^6H+c?X@)K42h8cYE5k{r)MUBF5g%L6mrrAndDh3qK=7=9Qq5<+DCU*AkG!b z)Crrd;Gtd}p2`+N)sI`lVTx7#MZ;04PhX}ds~WYcaWQv*dq@g zlX?q{RWq~lLP};l68-fmfrhuTcXND~e0$D+xiMztw|!az3Vbbob^(FynpqQHOHFo^ zkgeM3ift@jtp_a?lr*~yt1w{{FS*W}NDvOU3}dx#&Uny(!n z%iUilhNrCW>2XxUB|u5Zx11T78If#Lmk=o{b4o{{K-mmLe6R1i>`&B?9{PDO)TcIm z+p0tV$HBkpAKm8+5|Pz;pF^raV6W~GVnGb$|JF*Rtm?Ban6`jn-(Ed>V%@K-| zt1P*OVTug92}z;2Inu7F%9ovLpucZ?ExKQh$CKita;FrjBU4^;BpJakbZ(yF~ayKmX|FPZ-?4uyE1!*!?L4q!AajFUgw~-wR%1>* zdc_#dJLH;Tu9qwob2Z$ikSqRA(smRl)AO0tw{fet5l*Vte7J zYk;_!L_xBr#4R`Pr0W8uXLrqLpu3;eio}D%Rp>-aesJ)>vQ21H{n5kl@>p(_J1se21 zkNY@^LyFiB(a>Aa$OrnuoBmzzfQ6E+z>iT5C7_#O1Q3`#rR&{oi%;hG?TyiE)9`Iy$Q4&e;CP31dBI8CWmBU4-cO>u&gM|GEE*0K&bG`Wtm?c^)}@^6~9lu@>NwIpgg;d%Ro z7*qxQ!mb5!w`ij)WGjVS;}jon{C)oT2gSGNYSTvN+1HIM<3N}$ zs5F5R)dS)49&HSg;(8dp=Q%Z`={6Yak(wiQ!BeOm=6E9F|M-aBRGrr!FQOS(po=ZY zvRC@j#gUO~=<}<>i9JO-?48_rv)~zN{VTvXmC-yp93O7}fic!>U#HKo1tVRQu{^tQ zF4lc39iGN!-h$FTk_n-cMA!SnBhm0ou$2qB$sg$Jl50S4{Bvu^lNFAe-kla{tr?&U zJK+WXDE7E+W1olp_v(a^vqdRN#+Pe2MpN$Uy!iaem`OPhowp0cbxQy|X&0_G-Dodq zti%Sva%*hpa3cW#%YnL@eBWim2ju19t|=l-kJmt@3~|x47C(FET9WxxTACFb&DrD0 zAeV84z*wF|01F*tQix7nv4>m`z^YQ|3Q(u94N&K%pQS~D_a6vk#+NSKks>`I=t)`I zvbQu=Dlz`IA_L?y%Nc}dFS z5BG75ok9uc&g{!UcY8_XN$C9Djj7wl$NR11+sEOBv!~0)(Ko)t`}Of~;d}Vq_Rn@p zk03kR_v+L4ZXW(?UEIx+Mc^XD-ml@OvLx>9b!B!J4)CC1N9h-|gYyqld(N<61()xZ z`1;M&o}+DOMG!yP-Cb>*D2I=`XL^iLBc>rBg@ z?n!Gn(@$^b9L8D3p-k-tpErtzsjAzX2a|(?quNl&9`zY{g=qfWA*0@Zar}sa~19(riYO}cIhJ^xP zxS;!H0`j`VIR9bLqu5C}4^{c(*DZifjYJfg8Xk0|fQ=X?h+IA{>6eh`tc+f^LjdST^)o#~eB@y4EcOONAVp z#L=8uF#KSyC1?N3Bp6{QWqb$@ODG%a`AO=5n!M)V64%g=LMw!j6>Uu=K4#7s70Mym zRyfPhQVY7DPM3{1DS@HOwyzBJwJZmcHMQs2;r(4~L`?me1fXqmdlF~yYaR^9Y84yl z5)+vMG9BImMJ!0tTDgc`9=}C_iq{FXsgt@NHUS-j>b9M5O>+zq+=OAsrloaO6|)df zn0P78sk#D+t$G9c_dvuw8WEW=i7}xW%qTabdAC{6p>zRU_wi|9QGqYGBjH`kYiDc! zinE`zh)(LnaWhDDREP7HnMw_~Dw7n-T>*AGrvVPA+W@Vnjs<0nfG2K{m_TSUK8HPp zz5MREJ>E8$NJrs+)yZjc*DJy8SJjX~{6lt(OS=G2X*S&J);fyoRNo9m*+=8sJEfUr~+*IU{^^2VT(Y;nytW311ZCZL2mVw^`57Qp+TbPLO{3llm`-c?*CdbLO;a)1|l#<{fm;5KO zVG#$cRbW74OH#}}^Xh}>oVcsu9zIwhLy(h#zzt>JIFfZ1TN7{$euqXF-2r{af*0NH zBSmM^_VL%8FOGYjx4YULbY8-Vzf9=Qi<-)Vg)rS<&TTQ0L+(O(u7<{tvt^Z2@-}o8 zRd+clc@G?wR^%An=F=I?KtB;Jkp{||yi1*oVUATg+|A46q+jzF{8s<6!XV=`p2p=V zdga9di}I=)2Fuh!QYX@)YyZiV*wB<|Rr;!x!5_tO4>2_R@6@WAO{*79i8z3x zMm^O|2*oA5^X?Vu-CuxdYZ0vp%0gS{)g(B_-6C+MsUBdqj}r(sD5p-CIsx%Gcy8xE zePTBQPFVgS_laJdUlL2EUbJL~5R3e5QN~y9Wl0R(MZ(xOkFCq34x{I) zD-Ev!mW|9x^U(Ul$eptB99R5YBrYSF_Cu$Cz4^65wyL1m`G(5aHyz8naN{n@{ULY@ z8pYOwzA}Wzwm5u5CG5lV1}-*E&yMY(-}o3L^gje9yGTFKdQCN=4;`10#|qwaH{cl8 z+!Fs@QCj_zU)mCPJ|z7DKXnPXOx+3oe(B~V#DIdpQN(Y;3X4#;F1)+z2+2_q7sQBO z#uN?(VOFBnM4pp| zvrN4mi=c$lMc1)Dm^t1=H#4Y2O@|LUIBB(TpET4Pgr+@AupK%!j54u25_W!Y<(O0# zz-TCCsYv1Q9b9B)dxqkmWjwE%%JPE~WXhUtP;}%#j#C}Ha5WLV@X)J=WjZ^n_IM^g zw*>*wsOfkG#jM|qb0R$BS%_Si>F*0g5Is(W*3HadEBkgJqIYKPF_}#C?e>Z7#tFinLYT0M)K)Rg&iCmAAh;8g*5puykO*=ybHV>cmaaj_}{PF(uIJrQqZ3aQWnZ zb1~;T0DN~+vs~iK^;zZR^|20Y?{AoWyDT}&F?epq+B_M2Zp1?yUBw$CBj5a=YU^ax zKFx`6<~V9@+gd1C@vgQ#1EKxqL`P@m4K?Iz2gbw69fRAr2zs4~Bl0KdrH1xM;1WX3A%*VAbV0*iuiG9nqW(&l(2aM%4SG~i%2XpR zT8-I*1RKzPgBEFoYW=%o+YQHZj}9^Lwf3uext4k%>rvMi5d$NglPujN!c76ShsRwn z@CUET&$IQ1s-Uo&Q4-aWprbqzxeTsHS5koz`oSf=QU##{JSgZ3KXh~tim?3&6-%0} zgtAo_gbB|gSY1?%QMVxD#^4f}L7d1z-uv64DpX^k4e0hO_&C(sRV;R?@MVM zAS=+rV5c7D4`11!-R{9acfT$KCu#{~h%#dVPI+!scLB8}Y zaoB(_!g5^)M$MFa=#TLYnk5nG9OhN<^NE-=4o{$yOj83Y@u$sCXM;#__VXT|UDK%$ z+S*5X!_5^=19fsIO`;xWD;}KgunUmyNpANdSU6<|(w_RN?_AIe7DWnTVwzD2#I4?z z2Ge#KBFNfGHnbKq>QZTylHJkeVYjBjFP8ygOqCeG6F1AD^9!YII-0q3jRB7!|N`7dkk2^wp}-HZu~ zL#$FjR|%J){^l)RLI~%a*s9v?5ff4hvk&|$GNgMFrk~^%)OH;`$kbg|e~ihI2(m}D z6UifxC;pR&H{Naj?%&iGZ^ru>esy+-@cHk~im{z|j7>=q^Bd5QEJujja+9PYm`K(0 zRiTFxbTGWP%LA|$_$7c5KbG~rclSfmlfC&^u-Ve#QbC0HhwoYXt-^!MK3J0$d!TY{ zG|-{3lSpm~x&*7B0_UPQKUeR1Q9vnW`@|Y}k=qoF*BZUMuqOOKoXe5T*lh80NFFXl zNBgd!55t?fBfR*J!S|I>{DRer6k9HK?E50S*Ig*nU27rYbC%$t(*b18aCT!6l}(=h zwtiSAac6G(UtrO5#*Zq0Fo%TaI#yns2Gwe>5$^L80g44ToJmk`qN0hmI%8<$it`j8 zZPTwGgSQ2_Nk`@dV$7Hx^KHa$R1O*A)SjPgXi!uVYjqUHf1T}{VhXtV&jx9n+#R>pFIQ? zlJ((~f$7^h|5z>vGc35P0NN=wtPIOVsroTujL5tWNV{ciK|dHq+SDrt_){}u#AxBW zRr5IAy8F0bfS0K=F=BW?FKVo(Bj3Np9ZRdr@T*hAGG5`eeWsuTL?)2I4r(IRlAAeS z!em=>>6Q5-xY}4-e_NjG2TN5!66EF->_393yg?^iyNR-SoX6)?m)T zVvR2@TG+37_S|?rzvWSCL~1Ers=|UbujXE&bw8yFy*%Wx{n_3`5ir)ll@t}YycWh8 zZddY`J1f?~*TWvDsY&fBHSUXD@qyhB>&c#PL{m2Li%ZA&t1R-ecN zzX>@1GXOwu?uiuxbkonkL1i)lrKYwh_2tMnS z7_Wf;%7tP0{6Q-%&@BZyXmSL7|js`XZUK_kfYM5g@C1e`*^Ybw|ALO9y|o?G&snPC|hK5VJ%Z ze2vP4800Ei(UDVO5um=g$@izNR+ykT$(MvO6$r%61njdy*g4%cAE(HS#rZ=P8w(+JtOKR-h74lKROJUw%;P+JIrQ!D`-3Ucr z*N)K>9C%`&-K-z|XoorZFtE%-5V+NuEk7KZ_|ks)Fs`w=K05p|dv}y3`K_^wgeCvt z>kXPZO1yh10@po70oqZf&R49uJGS<82);TvI`X`_zTW5wslu+SJ;QwbK0aAjEm`a2 z63k(Q8iT*_x+=fBHB~$MORl15uBfT_eW@UuACz6n8l#?A)0c6%esT_At+<1e+%#w> zYP*{8bB(Euxp^mGX@+eo#?W?DOl@Hhs!V7q_iS7y&?lJo0rmvW-vQm2)ca$PO6Kn_ zYv0~7iQca=4G!-j#|7Osr%Ub(s$X$V*V-4jk;T#k!57X#VAN5y{rsv9$0TYz4!ZvGy-#3zISmt>-lYCc&Z&f zqmAYZ6izSacqk7>Z;JdKio7jm;|RkZXYa-8mY&l=3z*;XtJFvIW6WayJ@zs1Zrul-lH>Q-+^ zgAlHsY-m+v^HpL@X;Y_jAx~TrT1?BT3_kG&>y?mupUR$03ku;@J#cuuW}f+ep?>9 zhOM#(M<%iZ2vU-?;2HA%S186E+!2EijJs{>cPFkMX_a*_`^`u&Sh*xF=U+q`0nWLh z`MdEK>mX+%e-1Rq+VIVcbR+{{^}5o1L->JXxUswhkwyAujJ?0!6rPKr_DGZ z1Z}|){2thnO7@_{1#LlO+#Xm+ohbu|EQ4(|>Y+x^DQqIJsTQcIm7|Jy&wyrG-NA;m zzXKc=vI*I7FHlJv_EzoGtr|2CeCX$CICbo8e-G7dN43h7>caejv{}s9COyXckpLxU zp#;WN{G0tTXzpLR_H8FXu6zX8^Pep#FOKXG%feau5mxv;qbs9PN8nuXKa=0Z9j`fv z9GdA~bgxJz1ngW<8 z5;hT%EtE>-GM_Pl8chgBL9!@syEHeGFi+RH#iro*mf%7}(RKk_yBx=Vhua(#2fnY7 zr1_oCK=M2;W+(wRss)90v^d z#{3*&=X1%$F6MW`&3)g^`;mdbRF_~H!E`DdiZ~;Xz|~H_>vStxa4IHSaG0;n?W+qP z{3Vrz(wPO%V4|9S?MSraTNGSfQsB^@v{sZeRPuZHpMn4(t~kvuyM{pDoho0rzK1|O z78Vvd-bh+SuOPSezUjF6e(=yNTIYl7W^>}niTfH9(*M3w*Wh$KePR*~qMB1w=d`52 zF}l8Fv^Ps-jYah20;$5{erpx4_s3I1?-_5Aj9TJLFm z^?dmZT`mANHmrrc;pb*e~GB~>{Md=fUt}^{SJMvJd z%U+i;L-eNaM3(9G)VXUYExXGsx`LyN&-!INYv+GBTs$D+2D<;l;Q~Dw(dqDG&Ly9P$NJrXTcyx_h2;UBl;=<%=#$@PLDhH zGo^Wspx38g`pVTa<13BVhnA3L&M}c{CgdX56q#XPRLs1?9{WEK`diz%PUnBR(V5L( zqp5M*0XY(@KC^U_vpoEw>=sLZdE-oo3y5?k(W& z0!i7O5tYiG_vAOS4eM9H;qTN(;@!sl9`pTY2D{yD9J@`olz2KMd+2p=I- z8`^i0jc%MTQl%e{S8X`_RzxIhdu{*(eZ@oA?nk_tK_E4=f+dFn0T3ys61A4rQx^*j z{14WOWp>B<8H^MtAah!ZASf4v`7g5QJ-gBa0_B(kzEXTb=S&6D`ABd$E?LU}adXIZ z+c1IZH%TH_bmwSKu7*%b=m*N2bGP1y7Eu0qkX0L+-~MCQEYGdKdAC5QFd{M?&p=M( zv0E`oGok@iAsWX(1UX7rYp+bF9Y3`m`Z8knUV7nzEn?#GOvp>m&}?NTIj^=!ez%9D zZOGZTzop8pllx_qwoPc*%q2_5?clqGGdtio%3q^>p1etvEKV?baVAv(-e=_ zvgqKeMrt{=0;7v$jCx?gQdA)Br%1;@x7*pvLPZw8^ZA5(8nf67 zANE2b`KuyI8;xI8e~2%0d7fSQM7dw>E1EhRs9Xz!-WN+_uF?C7Ub&MTc~b3xCP&Kv&RI|{`NbYP4nli7_VyZFgXlKjm#56=#OCa{HE zrU&;Uqe@r;QnVPJNKCA!5_)v2#EoJx-_~P@El8zEs>6xYh#(c~hQ?@ z=rU=wHRL*#AmL0t-l^Yj}`2fk?3V zt>4Bqb2JDHO`-TbfC-!bm}NKG^8jEU1>Y)cDD(wx9VUV?gq|^T1G{`uZd5#iG8&9} zFoP{Hf(HASu3Xs%+(n{U0kgVjFhXAq$142 zC8v@F;XM&79}BZ1E;kNXm+A!=rev&k_0#`dr4UE3a`g{D%h1b>LTOHqM#GC|;m6Wp zqfFLZe`O|J~ANDW(H?Ta7Nbx5#(3d`vhqR)#DQ9MWT@d zL@d3Z{WCt~7Bw+hGu$L}au^tBiu0Qq&Gf?0VC&Pa4~-Hg4Qze|#Hy@m%GGQX;w+}g zf2hcXOlo8f7PaB7F&ggC{k^Kq&B!1`(RZ2`MTJ{S0WGqk&|$+57YU0-?L{eNK-#4l z(0&xlk1tyVcE`orfWrl{{{+Q}4jQu55n9>d6lJaFCfEf9+_hOIVsb*k_bFxOV4&+d zt-igUU2X!IC^yGXoSU3Ce>S{~0zL(ZU;Dok5B~{Dc=wRTv^6K*-14({sYbNEM(Gt# zY#IM4a35Hh)pv9E=xBsRo+|#j)Yq36)X$zQ-ZTO}JvIMZ|1$8=WMujQyll&vN+Dv5 z{cwM*dwaRv8~hyIPrbBD73{bX%yAn&YS^=tOHxpfroz2_E+ouRxE*z`EdNi>9iBP_a)mi&6&9VGm0&pZ8&xmNwG5~#fYaoZF;u#aOq zh7aV+{EX-0JTCP*Vg4|B+C1N^^g8I${*Th;78ictOZ(Mc)Fj7e1|l>%XI1(K3^_<hRp`%=FeK)LW1IS&&1i+3(Dq&WNSXutr)78o7Gl&8Jlf7wz-VzrSyNKY6aY&b%*N zk{rwI8xueDH(~S9wT?De{(b9B9nt2X3b#7^|L)YwQ6*zt@RDG2;yOK>fx^l+ziyq{ zC-2|$xe-q9KS5LPgW}UwuGRm&jfllRa3nEdrH7Mwdzu(y5D~cz576v?1d4g5hKJI@ zuI%M)CnvB-GI3ubKvt^D~_TGpty*N0Zz=sA4q)E4;9xK___X+U9Q2QrcMC8{)I%yYzITddV8ge zgh)JB4rTKTFWhcX0xq^JI;qC8fWxwCLo3I%eS@Dl0H;f0DTVe0L)~AESRU>r?l>EU z(V+rH!T?06#lhBDUH_o-JP8jEsNVCm?w&p_g?VfN+) zP$$zEAy(n$20#X(cphJl)7TGiA8#+BZ2;MoSgW^HhkRWr9V5w`_I3S*MI|qp{}FgL z(!&ZGI;}Qoh2T>z1(cqtx<>iN*`fhJej{Lpi9*{u{*~bq;~|+%L`ZMg!Fy#Lz4DA` zPk|-MSj^uVvt$vZte{v0a8#cGe!PtlmQl4(?W%hy7#i0HHn>Q^`>P7J z=M6WU7;_W-kzaOAi4vnjYnE+9*ppd19xKYf*~CEz6+U)`tyr(mHk8%koTNO6m>X>m z{MG;2`(Q#MTcaFexQM4~1)-hTY!wfhWscg2v?B*QDTYtV51OpG_vE4QBdMGjpfGi+ z6>6^n*K=Y41EkuslWzBB%si`7Nq%4{lBov0ZV`z2>s8L7?3rI<-1>h%+>c^{ic|a~ z>pvSl9FoM;cpG6L;z*UWL6T|D?5KRoJSqyAqRRU+(FOhSBz+&zy9WV(F1deipSI6` zh}!6)Id*V~mDMcfN9NJKx)~4bbxQiS=@~HqPhC{i~gr{&0z!D0~#@XT_4`m6~q#=4NC2WyeHWO^o+@8?ed( zWJ@H~bMWrNgKMezGxUg=r|DbFq>18(eWKkC*(24)cF?1O8Jg+Gk~)nqyzdAPDP5{x zim=VD=JAHGjWkrax{i4TqF_WG1{#HW%w~z(2dkzrkK%(3ypZlc;x5Z4665@5R9M;^ zpDzGMlVa73G1o7Av6K5~ujIv5%8$PQBt)`AhJJwECg$8+Hb!pDkA;OH&5JYh$_g%B z@R|kzw6`My@bX()*FntCJRdXLXHQNJU&2?cz-FmN>rh!DtyBF7*51P5&i#D3laEEa zkkOVdF5~k5Sl$dx%_{umxs&AJ32}N?wLbG_D_sstnD3=3< z1(pP6Xj^!+A6a$iG{p8C>L8sHY*@KssP!;k`WJ&m~S-&}TG#nebCW9i1L;6n=+)XR=uE*vLFSdmi!Vr5)N zPi2tKSqW3+dM&D!pqmS{3tBSvV83M*p@yA-1tY84z|r{q<9e9vLm^ki8JWlWxLI0b z2A9GOa?D1@zds}}EXiOP{G;SrG$Q#Af=)E>A{nDJbRr2P^R;f+|E9AR1gFbje$(R|ot4+*%5oRYa04T8ZNxCJGPPNC z=rWOVfnj3uOxP)DHUy|Vv9QS3k?M8aCb%?OM?rNo2gXm=Y9cyz;<9oQv`zA^ip=?i zoOBx%qlJU#TvW)7cl10qVT=sG%EnMzE zDiwB8B&wQ2pN*WWEvUnas@U)*qE9e$;$Z)PV4AEwLtDFCFIHl=0U+pft@`F?EXl2o zce0DaP>e7)EEkgu&aV|FZ_{RWvSBEbm6ZPept5@5J;a6~d-#}7!9 z0`q@CvRZOV_NpSfmru%^Gnmp~DOPaeT*snVdXeCh4-^61r8IFNlN5y4E_*PkG5!xz z=M-F78*b~cqwd&F$F^cEDzkLh08?5X5I>JJJ89Lw~5P8$AYEfug1=d^$Sw*$dIfM}n@VPyLT}4ISOj zl2fs|?S{{NGY8I;?|-Y_tv_0EsTRrTd&Z(Ykw-q|s=Zm=qL;myxjZQX&04HA8tDl^AE5ZFf6=-A!b*9iK;KedF)$<>mSpf+^Kip>D3hJn+$L5U#fFARKA> z@GkRXESct-5Ri8s-HgB3zSMM`-6Y+(epE%aEu2&pe*Jfz&(|fNYkQZ$e*gb8ygdLC z^g~+^n4t-hYRIcLKVrq0N@%s2?^g|Xpq0w7Y6L67ztBK}QA|7$*;ZWYhNuP|#E=o2 zjglmh6AW-HF6>uQ`XO#WE*XJdPEHgyR<*$#UJM2m)uJY-&|5Wy^o8L_%^(a}#De8agg zs=jj14lBd$>`I6Wj@1O?R<7YSMnEkdf%eK)Xr%rh><`R zqF-nH)_0DU=gpznJiE;X8L|`<_jnwt`7bhSFdu}VnBOMGUq0}*T-z>dpUAHAbf+B; zk#1Vu{VEB+-4S7<1?qCm|IbAacTpcBkZ##9wZ?#>=Eotn5!GdgfS+`21;qd&g6hmk zLLkFs1hcG2Wv%JL7$i{YOS*_!Na$lXwL31fHAwh#0v2bWyEU!iw=7sqCY+G2BxRXd zGdzJkJRz(Bh(voH!ofgbZtS^(7(7HJh$=46rx2m=P_?5v(UwasiU)!_a8S_m z!j`feo9KnE;9rYwC=yFN#qN`8QWh&lBJuzU_VEqk`<`^#{vt7LMTY5ht-Keg3CQRm z8SU)wJlB1L@LYZd>GH2sFG+)m-{MlxU}~d3C-*nv3)(@EI4|S9e&3y-2=sWL&&LnL zIizo*lC#zJMFuEnBezg5uF23Z0$BS+V3EHMBVTgbYt}gLr|`M!2jOLdGc63jQL0Yg za_pa8kDNa~H@=Hm*-Gx;l@A<%!?P^y&{rvA?YgJ#Un8(oZZxs}b8=7WHMFX4_@x5~ z34uM}-ZOJ=*&Mdr0BAPvn3D6lbB--%yzbcOjF;0W^*wb5UhZM4AP>iqz;veW~>uM zZKBTN=FD!=l~97BzC_9yY*HQ_7Y@4fo& zwHzwqO{7ccSqW2D@Ejy2#?sx^R7>{!luM=+QLU=OIkkv6>CVHrV5}ogNMdJ^{ZLG; zVyGFliCcdTm|RiMnQKurr=6jjiW4>cUYN0@^<}ff3(ucJD2=KO0q(nXzS85lA?}d< z7J|Z53Nq|e$Xf41Xcd;ses85>Sh(`HZ`5U2D>$_xan*(M2?NBWG9lCUuhVOt-WkCOV0Ic7$pAY%jSQMRDOHv zr1-7{o^Be}5N0G)ZF+vL2CJ1)5F@5;%)sv>ac-k|mX>z7Ro2@*1!`WAT0u{ySJScJ zm%-VU7OifY4s?*ITit3j93A&T&7g9u%!fh4z_jUr$wZi~0uZc5QL}YbU+(6|sl!@F zip<~Ji}Cy6HE+Bu`H$n)s-n8O>oW?%k3Rdy!>`-Cbm9}B9Y1>_+DIwdm38+iM0P8o zy~VZQ2+3%09WHo#(`i$7Q?AW+Jz4$8i7)eQgSv1N;QcZ~S6WO6wkiD|REAbtKg3r! zJ;HfPd&oJ6`LecC86o6Pokn5T%jSFRqJGaQM)39Jmbr@2C`IApgX4%*Nk(U{r+Pi^ zxZM3kM|nOyy*$6&m%n}9pC@R&7`%O!UnKu}Ycoj8`BVc;WcG824l$;69;m&yYKqx}M<)1WEb3 zPYRY6!}~%YAd@%3{)cAy7tY!9?Zv#c`->S5|B0U0YpnT=R7%Y+g;z&ndja8o$)Ols3*vI)HD#3B~ZUMcOT_CU$p!8V;NAC z9%_t8inhfzwWuG!y+jou8OC`srR6hPW>lF>aSlp9B+P~*i}w)Vl`A|#yhl!iS*hZD{!)x?Wvb=*1iAjLCj*h*5PmY&R)pWAVh0M{;PwfB zzV_h9DDtLX1S*RyKhPu#$t13x*Qj^WJVHhx`l z?rHyg(PzQO{rPlZ%|gIxoDU>e96Kq-;8<L&bHh9+|GJZF^s}EqIw>PbxId8&vD*4ma^u1C(>IlQAwzL#c^fb-9}c!A@sBVm z-#)NsziI-9PHH7YgUr&-!bahXkTahxyNE9O8V5YtxU$DQbgFR)%QXKzNdM#W7zx)3 zL%Cw-ccW!>|NK~g+TAa&D#oM^guAH8`&qG(N10by{D89r0pCWp{sqW2X09I=;?{7S zx2ZqnJK^*J<^x^OAAnM~x`()joJ`12so4q_;xpC8DY{=xIsd4LpGLN}lxV@d_3ks0 z-0g}-6MB>^@_v-NNg9A#>5*zy6S%?kBshzD>yxI`E~+%f)cZpyB-oJnyBm5l;eSkx z5H5No3erWFd=J1#6vU_U=TZ6QR{Z@&;VY@mG*s*H5{=fGO9-sM^yEE|jFImyFAFtP zf`+w29VF-IfFQDuFk{%tN3v0qZ$JrQ2z2o3Fs z1Ux>*bN)y^PPO$9=KRszab^;z|Bgrt?iTOcJ}j_d!of@1cl;~Yi>J`nriPyrDqF#S zz%Su<6)0iDAzCmEVTJ}+VFC-ZKmJ+%hp@8(Of~$csU2`7Lg;K6+|-CFwI(Cp>^lP5$$8ncMT7OlJn!XNeHBIa@_AR)HhQh^@c;N^r0$>H*#lWJJly+q z_SA9(uhBwYijh#4^wVGj@v1WslCW4d8$%shwK7X5EwQEzE#1&7d8r^V?~t#!Q=BWM zQ>4Z#PK2M6g0d_W-dG^AJ;g6ZQw_%}&=U#om<7qMr2U&>9a< zjQYcomkLuV#C4Es#9aIqEsAGF*n)KC1Mp#@godK0(582c@?o{+lYTm*+EgGfD@slO zH4~RH0%+UO(iOqXOth;4PKMCCb;@<}?~z(0a0UE-x{fvClVSu$pc!E}T6!({nz35; z3?N5{^{@4wFp-Z@6lxKul`MTDSFOj^MU?XGw=k*iSCi}^Eqy?DRAzxeWyqTP#T+J0 zb8h2AS$2(ECcV;ZUAB7jJAV?f)3_$n1)YeREourhV6Qd1sHg=w9EWdDY zRt9E3)MWnyW!A!qCIinkV9}T|T7`nDKeG#0Auo|+`eL1qtCG)5Qph=M1~-w`jYHD~ zH|i^lQZ}mo44|l>Z=so=5MDAZY-IYk{LN8r!LkTMbd+@|A_7a*T3mx~k!<#Bla0xe z15o&3+1AezGD(sOr`0koK>ckNw_>W(#5T8jWQ}8hs@G-4Pqj8}Vf$(>0fX7kKTA71 zl%w80tgtw;&R@R9C&;Meg9c5wAhVFMKvrlfPAR?L9wd>FENV&nyij{8EJh!`Vt%5Q z1Pap15l*W&2Q;WOWdIGj@!;Gq-OcSP!@(me!OmNo#gD8k?Zj8G2 zT6sCm%yNE=%BM>Fi|GCS^vwyb{LS?75qLv+KapK4m}ZXJc{)3?u>JFAUV@TOD4JfZ z^&@6D8hBy(Jf8Pt$>uoW&XS2f%(;dLmg(nB1ju8s zR<7TCx6rCf9(?@CnAv&GE?nr%X0OYJ-((+m2Fce?hl`#$2de+*o&7y0cQzb(IS+CZ-AQt&;QY&??2V<6@1LMvOMP!xW-I+-l^&j+Jm(lYS#SC5 z1)d9M*hY8^2Zvwr;F=b)y1{Z^YxqE*G|{T$HPs@yVt8XA3x{2@M6bTYa##Y zbaMdPUf^Y1KPyyxCdn^b+2J-oe4Tj$W7b16?5!T0-m z5JrCkm#DWMjefI;yIBl5202mKFB>l7mETP>@IfQ+&Gk8cZ| zCbR76AG#HpBZmvW1z+(O@afCf4J4UwW^U*F<8H-xZ51%FSy*7=mE*5QZ=V+Mr)mN)bT7z&6Hy zc}?^k7c7ro@-8jm+xrdwG@=a=R#u&*+G%Co`TmR94jQrOvL@-JxXh)pJvQ42EqmN3 z=t&`uykzxSWm5e1@#_)c4@4W^=q<<4J0*S=;bSX;K*`3t$Q~yz8plGSaf0f?Z9;_D zI`)FNl1=RpD942a%wbZ>*IeB4H9#5Ik*OV^5K?$0&?Mp8@p$V$v$Mt!_;EkXnO>jm zjwL$X)U1Mrz^~CoqXls=)T>|_?TREhqFubpxFEtb=d%gks-^DJqaNp@XvKe z81s@HLqK&9`Kv&=ET0Go2d$kXsTV-Il)wL7y?1M0(aUZW2>D2|D`!M5*F<)ImGH43 z=+z=_d5W;!e~5MAz+S+TEZlm!D+4_YtqeHTxJ0Q`ZiQZSf}f!MvB|L^wC;K4sF__Y zIXfSw!-;_@)p3#rO=&-3N2aAb2BRsQ8>xeOM>!K1J~D(NL9im6iO&*T08-GujZD}u zGZg9Li{P}WU+WU=z2tILJhf=jb&5*eOOaj#)3a%h-D*LI2)rINOS6XQ+No9o1s2G)` z>?BW3o0m|2k5B_f|SW(6(W?2kt!kNH`v6faq@Ym5fFp{ zK&U3`pD;Gy;Y(P1%fg$aIEew(+L3A%L7`G= zrpao}Kp6uQwNHF&xtLHjH#^|tvTnL(GG3m%u9M~8fRynuSCMz}lqwGrZ6KX1XPEwi z8Ym^L_pq6Ej8(E26c{U1}Za^i2pvCGW^lPHw&^aldwyvU5#oPY>TtdaeC82|QT$pUBvsEx#tQ zi8uN?-^W#|J#_f(l?Y+c2L;98$;lYhXxO#yAwpeXt}|EQiBKuI z4&<`xXXR?yojLr*MLjX0d}A~Wi7RZ`+5+26*>+kF6ZUIf0abrgId-M;ZmCs})G9GN zx0%o7_824=fT-@HRq-Sk>LfCMHUW*}*2JtjF1871K(idS<7G)Ca?RfYCp?+-)Q0ToG>nYqYjmoxxw6 zc>UsjrduQVNjpVqt@O;dR6v)Af8xXaCHF@5x3I6yZzkphDlP3ujp5GMI-HiWZk{B> zLIta>3|SS*YqQ1W;ok(3=zo(Tu7hrpjoposR|6Ywe3j`fcS1-Q=tO=XXFZp$1|>(& zcP7h_M2PM8Cp+YRtk$8mOwIW8yx1AoIk!(p2)phBRz;7KP$$ps(roJfYkdcnmt-z~ zKH>I@vGh#~itD+-I&WRI+1#12)9tarS{vO=7^MAMPK#2d_wo@Fcz1S(6 zWU}TQdVlTAtxv*Rt;MBmfa{+=qZ=j)X13k1TclFN;4WiyE_tE+;SAM;8CQQWgOs?ZbRogOKvF+?7N&fLR$NRi1yPbF zT|ylHfSRA;wi%%K#-DsGD~1comkci_)(jNQm?5B))i0L`Sk|#ijC{;7Nd5AtJhD3T zLi6$xifN{v?sv9OPgxm)+*ovJ)ljcx!)u_{@M-EMI!-jubxeFmdfhLyzu^ zyrS%astaF%rwJWhYlmoT%Fs>EwXX!@e-wmM3r!K!H@?(fExgn&g!jJi&{T$+yak>G zks61@uR$HCG{nd89{MZb^!v0{C<^-|&a>Qb8-5YZP#|k9U~WH8<c|v-6hg#+cju<9Do~Zazj~)$e3Vz1MoHE9HDfT=`r?8bgG`c)W@Ij>|WoU{k*HH3?i6} zDk^&S{(NlWf7xUwFsrKz|Kc~$57r?h2OILdSA5>zG}U2<$49?!(g7=QU0HX*s%Bcw{gW~sBhmw5Q(bAN}X}GabQDP>?)e*1Zj&HJN7)Q^+>!`;Az;C0E-O*(3 zr$5Gt?0;P!<9>NF>N{-v2#6F*AvTi{lB&37Zn2y39qBt`dUt&qzWiS4y69|4sc-lu z#$NoX^ZLTJfW77F9~l0vc~u$5m4~+@B{Moo9>aw#38PJIXJ(>meSI#o?DNZY-QU2J zL8^sLoE?pi_xI33s|OQ+0g~W{^z%(id-^PwYfrnfvt%Y8C&hLp+5g;n+p?s~PRO^l zygmZYEU$(DTbe9a+NLWrZ>HcN&ck=oh5B|-9YkW7F?v|0q{3&&n2_R|H=(uHU(?@@ z{KDC~N0Z+-o}JqHQ#&pn^}3EXW%hh()_0ysP8dq(bVd|5hU z@u{0HzZ{%+UVgunw1k1(NXbGS0a01qnQkg0$$rcQKAttf|0J|hXnD|;zPHAgmN&!Pit*$25*_M>OGD0AJIGEoTKkReG;FRZt z;&wo^6a%(=3_sPfVBmw?@P?JJwpy#8V6qvk?Or?8K9M3clwqKS&?HkB1Qu5FMT;mX zt^$u*yuSLTv;iWXEmANbYX5s<CPyvs(idEsQZR-%-j^)*o4`6U(>fUKmZ_j- z5fUqCI1|%i(3UB#=WOy88aNR-FOHek`2bx}v#2tP!Eo6Y#6Jsfo9Ujz#tLFIMx+F( z<+39sht}E#Wnq{iXV=w8H8?gk2ZguFX(g?1u?_;z5o#4O%!f|4AlI=8j}tF=6KyNCnG6~(NZ=<%1?ZF zF>-crWZ?lkS?^hCEt%IFq2{MmNyLz?jamVkQ$_mc1Jk(4=E`EEDC1=pbNi_p$vwPG zn|s$v_*>VD$=P3Dp#F|{ZbwN!sp$WELmFB!#8hLdOOm{#EcO$K9+&#le?Z*ec!Pr0 zIRozHlqdvdi)j}7Ww*@*+bCGq)ye&ZfLy%Fj?pXQ zY1)-jq0*z6A4@Of9x*^+)u&BHeW-lV0ZE0vD>2QmiYa%?+}RQy0>CfPF~pN$7m|AY)XabScaf^%1(MerS7q ztU=8cu+pp4-7+1JU-@8P$t?sa6;Sd64!XU0gdyt;r$}^jGiQV5Kv?5+^S^0yE;~~G zki-lCa;)oEWQHn{M{7Aqa=x&BE7bzJTKFkxpI45IRRl>RvOkS(1Z-R@deG`5{J@&a zXXA`=R>f2Q)I-1rj zDlBZVLmyPfgmM5u3IA??LjM>jL8#pCem{B{m~3(@6C`@N+(s!5#z9pa zh+CE+?32~!RQk1ZNF)>mPGvY_p49EUr3`h&cye;|d{-KN%eHW6s^3Px9t;kGG}coY ztE^`I-rXX|CqfqT^~f87FqEK9NUr7Gwq@-HQa$+zb1GgzX@rY|@ShQ6;;-(%S|3ZE< zwlQ(Pl9W~`;WriW%>RRaKN{(lUM|aRw%l(WNE}3c)Ab%fLI<(A)$*S2b@uQ*fGYH( zV()n&b@VvSu+%H`^tfV663N_ySG=$#R#hX4u%RD88Dd;UYbAx?4ZC}FUMyan#Z!dQ z(4rDIjX5a|r0@KAp+7UGDNL?m5=Uu5Ru?;^!s0ZshfZr_Sww}wCiyk}KkNm%POc>R zxMXxcF(M!aZ@|Q_HDx7pM`Ix1q(BWCRVQjXU`ItJwRE-@(a5flwP;Ujp#wVrH_%{G z1W(ZdZ%eO$OjMlaAz>+Y&nS*VYW{-pE@6)32#qm)j4sH;MpLIC&cHuDTxcPQS&WuV z>)%sd8n}+mT$&Aph4$)DF0xgvuhCnLnsZ67HauX>D;=aVM6#AYR2^$a&(@ZT=h)b& zU`BLGAG=G#=7)-xY(y+^)^7wUnbD74tdbFuCVnJ^yxf6HNV={}g{1^%PezWFI}81Y zgdQ#yC07rL0gf@g0Ee5PG#=Er%t&9?jH)HWID|ScR=7;6=u3b#!$Y^60bh}PR11lo zUkt?5-shb$1um!&HmFQ}%{EBzCW6?Ntb8+JSf?%rljXzs3iy@ z&na7U>IPawigK4U5W)A^4x3eeJF3K(>#XvM{j(4Jp<@YeAuX6;c?<5VFn-`BdL-4* zi20j{txci?`A~iU?H86Bt!z4L0N(811p>gKIiVUVR44UNT4dGIhH}ZYI_ofWPV34u z<_OZ4FsLhlrgHkH zaHR;^k9Bo0kTZ2Wpf62FK|g=CvF8T!WSMcc)A*QEIR?w3_p?%`$6Qdf3JZVr4p ztUrEL23j~E`had%zZyT5zi#^+eDM$amO(>Zdx}|}k*ODS@36MJZ*Egh4Ih_s9~al7 zciDF@LSJ3N*vNP5Hr@A5Z1J}@ymybEtiR#Nw*ay>ztpn8 z-U$Z>AQu?GDOVuvd}Cl;u8$NS9hmSt@yFp?ljXBqY{dx7gOmL}9j<1f!MV~SC(M+E z%iMq}vDxbZ6OObA>Wp=FMlL=qPyUZ3GE#8;`hUXp**T;RAe!b{HcUm1OI8Pu@LH_w z>{^Wa&}(qDh|P=JdchuedcaA6-cUzQ$CRH#b9ljsRMvINKZ$0Ya5<^?C)_6pVgM8L!Ks2;X4C71kefo}VkVen{QPRkaf?OPMwtG=!egt4K?k zu6QwPCU0gQ6q8Zz9!DI$?4)}M_Iy&)iyC&3zvPeYE=Qi)21hT_b%BUI`l_tuPutCL zv%}d<=k>1_=sy_Z-W=YW@1EBmo}aFFxgLxu9j~{~XIKk&d$a=oK0R0PGNYnf5dw5> zYSQI`@IcHR9KKduWv`#UEW$BUg02dhGaD>byWh4d&^mL>OIqba)NOQoWhZHzKb*^| z{W3hhS>GA%D|l_=1p@c-81#B{!kiG_3A#w}eo6H0y5G4ZLV*i#Xqhd zcu5ZLx#kxqm?Wp23lONgARNm9HYDgwZ^QzLaTK<-uK(cekF@;ma{5`%0zW(T^RmOk3e-Mkut>?Y;r3$E2|AV%Om;86vvT?Jl+Q=QGm3<$M}5g>?*Ev+gmE)7xdHTo0Z!(YwZ~_TxO2 z;Qb}}KT2)lZ>LW%{0vvo`l-2KDf1{zyd2!KXJY5nO7Rs44Dx!jY=#-X09mz*Qqt{d zJjc52`wFf=#+3_foSo{%;xxyq_$+ae>(n%o;*n~CETBrnR=}DRa6wgy78pZx&>Z^~ zqQTXE(bEe?239pyFH6V>@4=-@lwuWaZmXMm*XpOUSk|j&$F>qkf9FxcHV)%hIIMbG z8)YhjITN2YHq`uBJ5N)AOecD`T}W$7!YH)bCj}N?6EG^uZsK0we_uSdtz7=ORhp_8 zkp@%VR#3x1OmMEgglZH}>Iaj2_7;dSx*5_(R8~pG){WaT=AN(O3t3xNy`2Os{qI4? zCLP&1_){Y`q8Nt1mU_nZJ^nm2LDUtWP%cEantxI{W1>{A&X5)h8)g*J@>(3+zUb_GQytL@3?B z#}gDdMA)WLuM3lYun?QmBePFOP%yFrtl}l4x@A8CFO_jd_E!|pA#(!sjvfhbuWkQ8 zUAU0qBulfF%or zilG4~V|+8P!ORc%cLRp5FTd?JZUMmv%A&IN<{`57r?3UT)SW7e4FTqbkaJ8gmrger zWp7B{2TGB=z%)Dwa;it)EUijG`SC{|d=JOYfUFf_xpSnVha&t2{`+EH=ZarY1_3kO zgufGcS$_rx#`?$-xyvq&7Lf@FiK^(Lza9ZQ2mb%K1>%;{$D{|5327d;BinQ-E}{B{ zU02?{17&QcP3GSZv0X8`Rq7^d@Wf1NRdXNmpgbeJ=uS6=3fkAVA%6R;Pv17 zt)^$>NK+oqn=a`3pH#<3p_`hX;`sCf2uN8SR&63E1K0!|dcYM`c z5zg1$5bDjf#xB0YTL|k+{dX;M;M+5LrA-k>xs;+5Md0V^5`{HM6^$^>&(kjI6}Eq1 zT7tDy0!trHG;fIz&+zr%juHeX)g-tpc93qNcFh-PCsU2?YxLX)eZ7(v?hM|Pm)Cz1 zjhRZ;8X;bFh<)(;H}?{Tuq|`z&1;Dh|DLOl{x|bQ+G8{ymHHr9s!d2HvO`B{q74^Q z!cI;)Kp+FowG?e}+2Oq(s}SwzJHX~8eu_$o8WP&1=^;=eej%!|wxK*aY-Sz*fO~jJ ze0uR)s_PYH^*c(U+hy>$%8o1KJ%#3VZp%d0G;di(%-i>VqUspF66nep2{|Z+Ny|(Z zT9k(BjQqtRQc?bU#zFPfj*N1ydYV?ID|y1w;2RESO4Uhd| z4Ar6OagS+5waZU1i8H~>F{)D(&qG62pJgr)BQIDk6j?|HC$UnJeA1jm&Qkcziy0LN zP03y~h9!uQ3xX5ThJA)@>=RcG6`oJH06tr&ksi4d694S`OX0WUa8GO!n}d^z|N8hh z6qpEL(b9*}+644MaSMmAhw#8nZ4ed2xtl`9M%T`NSdFY3+ff_4xtpd!+#zFi$HIwb z+|g%93XP3Hmu|We=8j4ep+`!zCKc9re1%EM#myfyNj{Ark1qKD>bsQL(@Z-uyg^%0~z^i&fgMgj*PBptte%BTVa%-H5Q#`m0}4C zw89sJLI0CqB|t+dniKPtY~+wd|L!L#)T=PSrUJV}sS!aW?P33<&42#d@?z(u zH-Fy<5+}MED(~F8?gqLH_KVggVG%GdY779b4xJfzW9q?u@xjqS=C{dZ<0RSd&qnaZ zT@#GK1D2f{x*BqEZ2hy(12;FGY+V{flwY}@x4Y--#nI&8uhNi^o3yB@Ph4JrHfo`f zfChb(4RLnmZNqSMknJ`pnqBBvXdN206|pU*bt;IfHO;Y(5mzUxy!`&@d8h05le?QY z7r(6|oOoYX&}FbK{BG;D6Q4Go5xDDKwhoh8FO$_Z8V<$c8RudCwr}4NRNtRb^U>|x z*E2A$EP9OWSE23f*Vjc5tAB&Q`L=+4&8qaUIde?@Ae~^;9h%&sj;F-6#bx60SF?|p ztr=r1LAJLokp14M)zSRqfa&ek`Eq{KKbZu4@A~S*-U*+5{tN>2Kd$;ez1cD{Xyt>j zjJEHRiyeQsxoF9IrykBO%cw^0zOjs4A2Tw|hE4>9-)deyM-O%D6813%Lx8fPT*ShFoqmeq3$XNj^g z$y+DRgvLBYn=?SgN55d5%PHU!=SGhi32!J9XL1wX8M=|fBv#z+KSDIl72LmI>2*2q zHMwU-P*IqTH2z2v;ztD_vlgV3SyMoQIBWiv0s`SuqjxOnFwAzK4GvK$ zJoXPha)pHRXLMO8%+>2g83K`<>$VY$X^Q!@HU?AB8+iX1jPL#78S(#leRnu?6aH%j zg`f5J`i?;eUvJu-*bQ?QmmGmOjWcwySeeE6MvbFgH@@DzG@fPPjUI(1G7u`0$t>)N z;EpaHN|t@dKd1>HLeOg56LhEiPsMPV>Jo=&Gj4%SdPMu+WC#TI>xTaJW!zKnj2|Iz z@HipbJwylc8Qa1K-w8|#1$Su^gREeiVgeb*?Q0qGp3|iIQVv`T4MlEQ6N4DXuci7z z4y=ZHQx4Y2;R-hh;Y2rsXjD4H(A}>E+7#T;a-HxM0j_9@O!0&XVyQzUQ8A6ayY&!q zO<5x{XFKE??&}rSm4mzn=X$`LD&5_SN$H&CK%UPpbpvcC^KhO z^A#mA1SLi7O??4&8V%9p?nHstB2u1Rnn;WjK4lDS6LBOLbP?yQwO%)NqG5iSf{*E_ zM4spQK(ro41d)f)vYW0#wRWC$ynVw+cP6=bp$uhFd)~cR5X;{ZkdPD9aW;P*L1zC) zA2-=46GeT0x#|9qUl}_{q}KX$$}Gfg<2-^WGLWuviXu8z9i#d|gu`!{PRoB}KKYNO zP7#b33d$bT*`0-3&y4dU|NB=9=x)*NJ?iJ;Et{mM<(9Mo$sfnyvGN2Vo~4VP5%+0b zASlICy#IT9@UL9V6DN6xi;67SVo2-MkgA0GS8>7w|c;;6|sgg{=rAkYOCMNwoN~i|i zx!;m@S`m_?;4CGsfn>0kZdo~MKx=5foEx*c8QI#zhZG6IfJL zvhg|jId6gIA5O|j*-Bx(`FGC<4TnHjNL2YJj0(AfiU^V9DQIY}bY291h7J5!W^>pv z0%d%O5NMp(>9>;dyMANJ<%8}Sk{t1!y|_5q;OVBgVxJNcAPOsbpnRC-FI?XYr*pOTGYGb#4vlxD_!_9W^#uGRfLZ0JKsJr_e-# zji(3k>%I;iQw>ZzT8F6Q7vv*~<4zh2NA6!oMTwSQAh_w1Mg*A>mb`f=Ht>;@tSqvS zQCVP@0<*B8)`>r33R;yIYL)5`yQLZf^3D=g+kGe+M@g(f%9gQC=Vx4Ujo^z-ZJ_CY zby|g0@jz*-8Q+pcKs7Px0;ucFX+Nwfd{K~`Q5P#teD z;d+Mof*hJ>&-HO>ZQ9kz&AVLa>BO_?IsDIMHr}N7X=m4y;pC^o*E{J%bnCAO&o||S)BqmdN^$=2n`ADX=6peG;2;wfi6o0v>WF~)F1eyy}g(hY## ztM~SypRxQnoNVhD@NDJR#&`0d|I@}^hcMa@H-7v;W@|pR4Onw>YiDU|(c6S9*4;i2 z7;#z2uBCaW;AP8nW&sx7(JcD~e}(V#bI5z6)E%1;IrZm@*xn}usTKdaQ7c*rdgN9H zqPi132%Q9)rSzQ|y3&RO88cPlt1)VZi}#zO$*Uy7}L^Um<5ThAP5$T>EVFqxvm2i=z0e_B5-L{=gk{q>^75 z!W<{Y(ZS|q5=w0{-{q&Yl5opkLrZ9562Ys?<&(k-0%H2+3_;xBoH2#qm4iX|Xy*)} zIc4y^#WX1d6Pc7>ae0l+`5u3B-f|^4>Anx+LadMkv8UhDJJN)_FZXj-6XY%1y1JS( z%!I;r9@3U+1nh&lIQo>gzGKY`R8a^M1x(L2+V5G{AKfG%F+a{j@q~=#e7m3Y&kZu_KXxRv6 zMQt(q(b6R|^lmD2L671fPx1e&mXFY@TaChIjmIFI%9fVg4$Pz5Q`66UPoHjJwJfN- zr>HbL3zaM!fxPSadB=vGlj{=r33VSqfjg3x-EE)e-X`5e!b$1jzJm)zLcH{vl(pLp z(Zl1R4VeOKtxYE@Q)slC#W6fw?D;@tW3vl^vgKJT8s{H?vx_zyx))oMRUcXAF2vW; zj^2}-eS&@|+KqGmvxS|pT_caj{kL*&idC#taWrxU5eYOrW3+&oMT`Y7mZDSP9)T6_ z0Fq4*Sa1ee^w<_#!}N4RQJ`W=zf8c`6YJ@}1-%};WzqbTqp<6k;$1fQE_X0~cn}x?;7LH%;BQ_x2sqfz@b! zy0T=l4C3SH#+$ZbCq{n2)`iUNp)@givWf9+`6fse#qlg`(ttli(qPvuBa#*aX4Bqm z9b_$bCOF2$?1yno3ukzQ;Lcds6PB;cI7fbr-8j|#qfFO2-2$R<;p?8!JWh+osF#EN zx@%j7SMU5sM9Djr@+ zv>yIOGwu+K3(t9bg;hzlc;Z*aSezg8m65pvPm+AG;%E&cj?%+AWHIH#?jw5!#?H0t(L$?{mJ1cE zA2j*`Cdf*p^8mJ24V@7?1tqqUdkQs)C9YTqURgGCj`(^JD}TM7{<0s5Qf&Ol?sJxo zu@Ud(Y{~s{T$@+IMm4dF_DGhi226u$2)r!mKZwX1&Z*BFwp_lU#myw4MkJSJ>5(#idT_Td7svR*NPwT_qmSw)q1}rBVM-A-Qb5cLE#uU}G1!eBd`l zeZWFuPujrkZ$L34hJqjNWQ(QL&`H{ocRsYVqO_8z63@~T6bK2Ko=poOt{vIC{vgnc zP-5-9B??@K`3^^H$2upORCE<;v@XLM?v^!j`~Pl`T7G$0JvhHS+&!4zuG&3#9bUHf zWNWLIfgO5U96!At*mK~*)^|F#kmZk#mWS_3_grI-l+madfjZ(Bl|QAZSO~AHlVp!s zxt*9;@P@;Q;a*CCn}J&n@E`D8`4~?h%}?b$&jd2w2U#~|{|@f{vSP<&0j#{OJ2#6i zw(nh8R^=0UJe`#K&EdwBJbTHc(6USMS?F$ORPUS>U6rT1~*!) z)LmlNcqDi*SmjAVe0;!Z&XWUImK@{gHMm1&)q}KqxI(_ea|;_>$O~lY-s-#0o#x4* zwz1R+Wzhh3yhwH(Pd@A4oK=s0x0VrlTHwGc9pUqBu?tj0&fY9TH!BNYr_2Y*6O?P) z=MHU{NkDm+dLpik)jr29BMzK}c&0FcC=E5f3B}Eaj96!;^e^~IhTLD<2?TND#cePF zldm}JB<`PR;GN@jd;H9f&1H`D3@qEgm>pYG0uT2beHS$F5CJ-abC0FX=qsAORv;L3?@wZT zFoQ3v*t8&EN01#Ii;{$)c#?uRoRCPk75*WpE!32CWy+%j+QQvoDfKZRyutdCXly}X z@acvLoSBJ1-=F7H%P~RV0>>2hE4y_yVqlm}oNp_!)1cF3E9Tf5H$8?hY*85=(I}NG zZF0h#cA~R21?MCiwdt>oIO9(GArRo@B?hViIR_?ki_{!w54}5WkcOWCON!`ieCnH= zrTSZpsehYQ!bKlfQ~(b1hcrly01+Bb{)FK6LE!%(?5(5Xc!G9e+}&LlC%C%>cXx*X zNzg!m0L$VMY>~y?ErH-Ji@Qs(1Sddnm%I7B@4e@Ie|_ilGiRq~re~&Ws;hRU>!~}E z?Y=C^cZQpWS#{PBpic6tE25bwyxp$Q(P)B=h3A;n3SRby-e3GNJbOD{%ED$wF_?cM z2&vpy#H%oxlXKn+!VjeS20JPssm#!4GJz_Al2E`N2M@`dyfx9%fAbv08B%%D0)Fr(2Q^k)0Ds`+G+$`n{bbF--0vAd0ANtU2%bK{8XP)g@1}xfxC!IH36Ee$BKM0({U#Va*A;7g#6W$jwmz*YWFVUx5xpQN8Q{xO}2{<8k`ZYa05R4(YZx&hYyO&MSr z3%xOF;Vu%)V}6%sq8esRE|8AHaUcS)$d}TaX*IhWUs+vl?`_d{j8Tl-FpcG zSvB*>q}V3ssD(qSFg_>l2wW+iiD}4IJ5uwN@*IVT*yo1*W;=xC-qnlxVZo7&5^jaNjofez)euxtvoC#I(3Bx2_Km);o`>ZMJ{B98p#B#dj?w3mQ30sqPtdw ztSx2O1M{#!Z!b(dVhVqye(;nu z$n)}ZB{x~+JJso0VLo?R^20aLIr%Fl0VYaNj*)A&3G$a1XK{}*_DZD)%Mmbk39~;zTn0{!gQ|ioEY&=Hk<3 z6~HPi(y7!s?*Y|m5yP<(kqF<;Ic_@uo&wqyUHu` z-W`Mf7R9jW;_~b2P7eaDQ)laiHPXQW;xKZMuHt7y^JJ zi>fkI%AVdiOFzWarw}DJZiRMViB3R!{5XNn&=QBDd_I@A94rG&lA(EIO%3j4Ml002 znK4Fm=A{h}3Ljwmx~NYdD&QU#-^zzvx~#}wUaZMmE(Gai`B)pw?QuPW!QMPWCSnBn zQ$^(SeAX+-X8#?TUM&$s-Z!s^$?E;QoY&Y&5E?}UOp_tr#BX9(mCEdaKsfp{6{U=L zOrdo0fF9M_9{^x_%N=_m{OSYN2tCv1XdqzXBdvS*f{>|vhzS22)-fLzf4-tuD>%6E;0Uzx}_f@h~2Xvi9!@MW)zuPiThvD_TsOTn0a&@0)i`GcNOghj>+jArLfb4t_klJp&FvNPU3=JQ6cEpJX9ie=FAW%~dwHwkL2bN+7VyB~AN zX+bE}7Fw)rmnl?+_$&h9efyf)5s z{<{SMvJr_{sB4k#(?sc-{l32n@Zrr_Z`ib>tM-qdDrBi8loO6^VY64vp! zY`Zv0TcOM_cioq=wSFyvC|D5CC<*U1QT?h_=V*2qrG^Mhe*6rvY~W~oo6OaBkxf|4 zSjviny(uA(ER6cj-Dl_=v0j=JhmC%kF22qL2xtD?xxX~>*cYm;pp~g#l4YxLZ$IK_xkDl((?9?3ecBN{Fp_= zQ|a4CDT%kIKCYG4wG$uj55!Cw9VrnpnLe=w6`)k!l^ZVe<%-{HS@)^!%U>V-+|NE< zK){FV8Of8cPSbv;_8<$78v`|^Ve;&!dzKFKm0DN^g(o;o`_sw(3o$u2Px2O`m0BO- z41Xk+ZFM-X73R?)^N};w5#fs1(ILjQ<+{0T0G#*$C?7kYX1`b4&pwHZ;X_^Tjq(rl zyYe={Mg$jaAO2~aHu%A}!;ge`{wLywz!&>Q?zrZ;CgW~P%4xuvg@0R>>B!O_) zH1ZbbD)}W7@UYLV*PQK0nLDdG)jwlO!**x5Ydh3X{xXzH;Qfv1ZD%$8*6~L+*jxSi z`(Ps$u~U^;oC6li?=0cEW-qX^`vM+Y{Ky(mEJR| zDt=d5<8NZUdZvGtgYZutkw$&;yH^%L+sadx6w=y8A9ygI} zr}iaEykK)1+?~Up!rNZf;f4NsIu@p9XpPb$wulJf@yTZ&Y6ezH&)6l-VZpo)1IcSv z0!7Mam@CXCE}vfG6SEgHL!iw9$V+5~CM&_^9@#Z6)ctIQGG+0UDV%ExyiUK^ojCz z+eFXTb$_`e_;zQ;d-^ni$!DZQ%ftJNiaD+#-zY)1lBfXNvey2R+07f+8WPgmw0MqA zq56rwDxSMQTc*jM?q0O&^mvc+4|U!mFZCwHk^_y*{kFvznr2*$Ok2*J8=V(*Kbacp z-;GJ-a=;VuI+`W|v#8syAZob4-kdV30iu;O#ynj8t zt&pd(c+|B+7CXV=~7a;{qI+Uqu1N z24@@Lmz&XsA}ozg^r+*PHDUCG^ivizyKeEt>l~R}i18m3pA z4cb;Y-ByQAcB@ahy6ZdptGo~1SS)vC2n`9k-|03P4R1?75N-(|_?7x;ca~gt3k}9M z6)0C0QB#C@s|ZX|gBC=(Qym&#+;HW2f*a#`%O2pw1{c=#Zay2N39ZmGNT$`RVxxb= z#;C4?ubxe>_m6u|u3Qhj-DnL;N%mwh?@CK7I^Qc%=^QJGR_wwM^+prD&Lw4Fm45n6 zUnPepsaAq|*)$3Gdu+OXaL@e7VaZjdyzshBQ1+E}7YCsj4Kib;MBEJaR+2SNn zY|r@qhTfUq`ZpM>@4PdQ29lW@ux}IL^*v+(@{4BV zOb#U{(|7=n7pg{je;q`wl&x=#KX37+-u@$pJ@Yt1_7lpPTvZ@?*v&f@68Z5_Km@Vw zbC>_N&pPgp`(FDEW}GjuEIN?&1mB*U8@gfNI<@f)b3KF?C3QVpt6v5Lm65zRxu3+# z9x=1rAKf4FPFL=)wg-NFSUvgF-Qnl_+V!Q|m?{tW)cPk#(!4_&HaT%6^0avlcgXBt zfaa#ARp(7NH7r2$2P{BSkhY^p0z{dBd-T$-B1V?rH3Af=k#TO-!tzmk!)IiaF8!x>+B~IdSX6O-|wfnLk>I<+<)} zTW4XCo!@jNs`z5JOO4xMbn4$LD{zT)ua$uaRbivg5Gj5Uor{ps5Jq_-39pM!6RRxA zjz`k>>>V#hwx{9M3Q~naF+J#VZ-N7MTB}={KuEjXER|E_tTN54001+sHqKBUIncJDWWKyH)cOGW|=wb zw^rgaf(sm%5N;!+d6j6rI(sKfgrnaKC>=afnej1vtIdosaZ~9xYMl&$Y)vTgC?|y=Oe;wPDfu+x?=!W{Ee2*@lpy}`K3_9wF@x-gfm9Q?N{>p($)!$Q z2-DjH-h`EojTjhCkdB=1`R*5c{YZrKbix(>gbs1w=Dj?EVi|4nBV?lOV)O~r_25?C z+HNsO@WRFYQ3%{v)2*2isma&`QCu3eZ;oF^UppJ{JxdlfH;y!r>g6-v>n(kc*9(r* z#@ZWvzGHBeiDja{8dEcr2N0hUyT2e(Kr8?FQj2etKP6M*y}tmpbBxif;qS-d z8hx%=!|`_+<)od``p3~kC?T~fy0=KF#w(bs*8N_J_<0ClY}?TFoxJi1ekqz@>$ebl zE;bhj5S9+3@G$iQr;hGdb@QVW-K@T7DA?fJkH_*+fBXh9rDZSOiO~h^*koHUnUpwn zK^N>|7~UC%-C|_3W}c8e`e@Pt+7b-N=v|OhB}ioE{E?>xHc_WNyWkoGdLTGwCGrln z|F8U^ZeyxX--{Jn+bGiar}GwB`ri145}gZw3n*loO$JqJpF#*4g0p8*Fl#Fi(cgfJ zFFI6ga;kAIzz`(mW@=KW`DT(`kD~uATh$g6r^ebwQi^fJ*KRH#k5KR(VdTiCfc+4$M}MQ zDvhQ-|w3sIrVSJ!&|Jad3cpgUb*67z){JrxgSR@*QfZ83;M(FghFcYH z??WM#NWEf-oesYLisemb99(E&p?RCb&h+r-?wuBSB`R&9{gSlwVMb$G3?4M49sOuZ zF?agpO^AYzyrUT&C+V>}Rpdrk*N{nZsCFLBSC6Ey zrY6ypF(oRd+F4@r-(vlnqe}%x-VnMuB}QP6Tik8PW=T=9SOZ~a!>ub#q5f3cr#zD6 zsfP(lZ@o>l-My#cFH#w~>bZep5`IE?2|?1acs;aMz_FWQElJpCgiP8G=5r2C<%dZx zTcbgDwl7KJ)m2QXEsYRcA#UI61sCZ&Rpfs@<^P#eD$#*JL5j?fCMIPjB(7*(ljcn(|<#Ax{gp~PH#b2OU#&dul(cl~`EDiEk`j|#5=%l;*>6iE2ZiBQ~4$ZY)_4Rpz zJs})0z&s%+`{4Y)yk%5+G}H;@XGw97v6miZ{WBvgJ5Pl`X^K3pnNiY57w6Bky%dNW ztr2W9#OiUT2oFd@!bB)k$-2s=Sx&0xg1b{7;2mYl3(~o8z^|^TccyOx0?~daDc0g? zHK812*?mFqpFZ^3== z^AG5)OCQJ%NFSl?j}_IFXOe_0Cg?cklT*?%mcur)jlQy4 zS`z8KMzSO83%d@`No2-)O;sJ>D9URIwd}74swRM>kzXWS2+@)e6X0dEJdyg~5WKnJ z{1x%KLWhRgX-T&xdq{+*)la#yoII<^mYF;CCVJJHUk&=&+)P!Qz-c7t`?=04z-zHL zOs4jk(0`#eO@$gUR$(z5L%Jd)g@c3_)jviCK6pM&5mx_o63Tgm%$|15*ohdYB?btG zvF1DNG4y^GEN5t4SZIqHFLF^ye`7^g^K;?t2V$hHHm=`b$p-0ykyqk9%_*&yIOIEb zDakIXDJhevfS+<}MPdrq@=FCdK<$)0Rjqmv1;_OPTC>siPxE2I z8XrK}vqki(Yj~b41;BVg6(PL_5u-@FSGqW2&A59dIJy;dD`dXEgmI zqDBPjg27&^CLthf_Ohb;&yllv9IlG{wc@iy#QGNBF$x5z8S7q~`J*1|amouaRHB^x|Ir=`z~4g08QscsI)Eub4nhl~RGbAdHhiVNRP> zB2Rbjw`#@VrrDY_&&pbwpLM0Y#QzpdT~}TyIcoxEQDqL~5ZPl?Mjn6?66>4p1Zmw- zkR&W$0@=Adob=^ogAuq^4B!D3*Tpji^RZwr1l`eEgcptmNMI(zn4RR#0n^4Fy#_jMX?pUHM2ypM-=Wj|T- zYwiIqf%@iE=(b88gc=4IkZ>+#E5vfnP6#}=Bw^$Omof}0FsQu`&ZEOy9ei4dFkZT6us1R4|?XP9Bd>y5f@!7isFTmfMv5OEiCFO;8f=q^!Sn zvvfOd`2Z$hOJ`u?jgp_}G(WYYc{h2?m6SR^5P!BL7Qax!Nv-Chd(^UXQ}ZeMXY+y> zQ>eb}F`wBNC5y@a=C#ye4LRJTS$0 za!cr^y@k-nF;JWr+r;O5TlsfVnb1imCph3AGKh`iTE?IdMF4)TNJrx&ESQrG?-vjA z0sh7!3L!|Onq>%w#D%&iuI@!B{r5+T6hzAWKs}sAQ=U!c!jG44qGnS|EuvNpDAdvS zYb3A=77e21LuVJpKjI&h**<)1z?d-&JvPkD8aP4nNGu5-;c-Z3VRptCJ-W#E>(2s~ zzY$UEjj=6dHcLh=;|UlP6LI86#a487&9ODp&T3T39D8BLb!jdTzS%Gxi+M}$6u{s; z?PI1;Q=^uk%j{y|ul;?fpA_~o^y&7w`1Rt#Q|!;fw^F11Wl?mqyDd1w-_6ZRUjOEkyt^AIWI^{|^tTsq4_o%?a=dDALz z{}uRh`Qhf}K`ZceZs2%7YtCKh8Ac$!w{)wtpS=0-SIbfQ_2l`ueQagtXejxI%H6I7 z@WIu8^;MBxXY1wRsJc6My!L$H-4HZ0{w!mgHdh)L0VKQ35{?gu5$rg6J)Z&sdo_OL z&RcABe7W@r#6+@npF`IvKYPN??3)MK+`pZxef5X6c>N&Bye=x%ee?if;pg10-~M$z zMeDfPm76optnK{e+}2;TpN>0|kzODmg_Ooc*Y^c(mqo_;3lHj-!e8(>W2YG>vg_h5 znLs@%js5Ok^O@?v%O}6r3m2gOjX&R)x$dXEx3B#>{U5r<9m^mr(i-2wQ*5%ovYg4zg003s4KQWMQ{vZKy|jxkQY$D9>W2ycb|6WyzrcK zA4(~yzrEA-;bEd@Ms-ikc9i6vu544hz>d4Gz2rG z0Y3ZbM&F?4Hmunq(Z;~#)vM^q(bzXBq2`&%cuL=K%8py~$e|zNNJ}(q>}~ssYIwX* zx==#}wIkT0I-oQ(P})&LZN)YWhf6kTs?iVd4wksUup0b%C!|K%x9zefs=Vo>DYOOS zNC&;Qa^$;EHb$UO&x`h=U4#Rzal{N%SQrm@lqy|d4iA}7?Gae@A<04wLU01N?@OE| zI}Pv3fUG3WQZHzRt>gj$`TSq)WxGBnF_DF24TMU5V_ifl0F$Q%c&pdwd(Xc|!~$!S z&z?9U))w3M3U|}M8@bv*pSA1htz|Su&@b5i*ZRJhX#+hm({Ca;IICLvI;d;iP5M%8 zq%JkSw?aKqoUm&pf=SbnxiI^1PYI8Cyop#Lk>CNzFoMeQtw&kgaxEM3=$ME3W;DTh z1+A|sg-mo3O2sK33KlQ!lvP-#>?~78QqHAlhdUM~Vjo^{-u}K~i)om*Emkfq&|fL8 zn3EgI(g0=>y!5FFIa3f~c=~_(?M*AOE?ZZIu)stW$Rnd_iL9J-0;hXKAaj8h>l`*9 zK=4h#FqtiGR(SzdbZM9GWT`44A6%}PQy zA1l{dQ%bNZ%{_XsST;*S=*H2f@puznHG>=LO9mzRHv%Y6K2kAoa7E=tF4aqb- zI>zSJ^o+0;Wv-x?C6x@CGW>3t1PIR6(jt3foLT8Om%f?9KCU=DtH?5o{L59Kw<`)Y?mgo#5W3+%BQ}{ z<(4Ln#pu@P3{xCxcp@fV*-2=z`@rmp#2liz=*Q3wq<7zMGR$$)Gmo0|e0wIPD?gjf z&tr{ZRJ!*hYSq#05JCc}s;mW1c1XBRhq|=A&gw~dQCZA>cobsI4lVFqd?bpH-^*!; zP2}tLCL}n?^1SJdR4r+t`b)TBV<15+tIL*_fD1Ag#q<_Wtt?_$)p_< z;W2J!eJYCDq+(U=g>qRJ<;RF` zDU#5hq^b*UC=q7lS?Kd`8s7t->Koj{a*)^3M#X}(h{6T-jJ2VZp=f^xxr#2oBDVsb z48*Df-_TH#ZWIMd2FBiL$WBu@cC(PB7|yjU#vFf)q8{10UY%VJ8Xxl`^LMpMd^gYe zba&$bFzNQK&nM{m*EQCy`&!jTyd_TAcFmn>v!MVp#_-+Mn!>=OLE z@KiBrGyiQQyAK^!^mkzFtWUCBQT`U8F?C`QmfgrKKdt{-TJB{l2$F?a}{&H>e zad1o*%VO7%yP~7{5DrA64R{Df^)!IXSpkt0AouPj6K>q-OO!UB6zBGZfIZ;)Uu=`Ma38LmikxG>E4p2oY~QAy?G4*uDTto zowNPtADw|0nMpP6+v)Nt4Jvy32PmYElJAmqjeaQCozxGzgZy*fj;4$MEAHc$K)cnX zT}T0$22o^>i53jnFzCRb3xggE`Y;&4VA$MaVidCv=?j3d8@bCGBLOLe31HI&>UshX zVLbYx{8XMevcX;E{%@$vryF|KkrnC2RErktU}WU8kJq<}4NLVU4fRX4aXlAK6HMXQh|VRMP7XZM3EuY#i=#`D4dAH%|UW3u60cZEtRl7zC~k@hVxxz z74jL?kpPyg?luZIX}67{EM9WKPc(F1jQnnU>kq*=-Omo+3^pD5UUskAV(lS0T|>gJ zadlkuvvqqnrpG)Dld*nKVYV|iDS5+y-_A~^VWmvPVluqJnZUH(l&Ej^fJC;m1%}+p zZ}o2v0nN`bb+KI|B#p6D6x|iEI;&W%v205VDPq^thA6N3M8`3|^g_R>CWL=2;6$lQ zJ$i{a7T?uZ8F)Wiy0BbP+ICWzWBOA_!{S2MFYK^KpFP2tA!jT(X2m@ao4bta1l^Za z%PU!OfQ#IS{!H7mUY|t`UC1yEZZ7;ocFEeVwz?Kp=0w4Xknu!srDnn5_=Kf;?6SH2 z*noP?3Wc|*;FpoL-8CVawB#lyy(<`kIS$X3Sped(So_gtz zczn~Kg9oGJ1(zm?)AGRQp|XYMZ?M&B%#+^Of%Bu4A1`ltW9V8Xj;)Bo`%0#|t>Ghz zuhlrIOmZIYFJBfsc>^WQIuES^FAHBiZk!umpG5BtfKMm(5vjmjP{H=Xv9Gsjk#5#= zO| z{zt8crFW=Re486jcS|p0HaCYZT_UGex6;pN7O+{{&o17c54T;wSHCWQpwCumEbcS+ zJ6g?Lnn|e}ZkDRsS22@7)IiQno6t3GrRUz6-}$d(RH#bNhn}mi4VknPMwctjudbq5 zozEgBlPsu8KlHF(#w`8Y%5IE?J4$ybG0>_$u?r}pEr=Q)geu?Re|?kYM*4R{lXR%8 zYS$h|ydnfFvA!(`RO$Ac^R(v$0blpKspZt=>cyqR#a1_^3WqcB8BGcqp_djBeC-6K zK4dXG2Z)uEWTb;xZW^%rF)lR*rAFl+&UO)<$HIM-VMrK14VD7tp6c8zO^^FAe=L^+v47$yZsn^6 zC8Q?}X>XtK5Fvkj`$Zg!Nyb8_ja2zE!}j-J&)cSXT+guw`Ut@-hEMPU_Q5=SGGx)) zy^+eEy0&5d>73p=pnf&#^p4mj@|+^4w2RRC1Uw3F!omg3?+Gi0Kv_#^;@ArUk((eW|lqwyg) zyz**k>bL~_rOAhn_vcfw$qP^YPrx4z*rfE*>uUaQjE8B{r0PwIo#H3Iex@+xYdQ-Q zc{S~}&c1xV{OQH1*(+#Qa6cjRa;W!yd+W&qSZ?)OyBk^%6zvz_M28ON8qs1IsnIe;~Sp->!y;2oZy#K8&Y(0A97~26=d0UH~x#kd$DuJE=?Oq z05#ZRY{{>4tX$r8kzV*uVwU&tgxD33#QWe4v-FWKoFK>Spy@3ZGOJmD!pbb8N8(b_ z3W0LikuXa4VE-*6dsBL}XQ-ZL;Ouy&;Z2%mL8?LxnAFSgTci2n@bM0gUg zpaqCym86>stU8xRUFLo!rwCareddyfxhesF-zD1NJWaUS24}lP!mBUw$k1q_Txxgj z7x+&h$_@WdaVA1xEwR@Gwxv;ZZeQ_G7bi36+FY~8?Rv`mZWmDw33l8~OKtTGjl`EC zs0I~@CRn%nb>Jfqgau z*L=Th}*6nz2g3T7?scj2J%R@12{MxvF;&Jk$QPlFq-4tuUYH z%o=_Z@dgKwnqv%n3rI@<0B3xx0N`xny4=IpO_a3vxu zc~JSSS-MCRRi$)z);I92h$H*K;BcXqtwc$_4_CYXvWBz=IO*2hwdQ)etnsP&(Vo02 ze=J4Ji^F9HDee|U@(Qj3 zJ~_~_Dv0s%@Coqp@Cftp{oB@j;cs~fuOllg|5i?fPhOT+K~YhNUrs<&RE}3xfL}la zRw*hVB1I?h|GSF?x4MJtyH8GZ{Gx)Q5c)?PCWu*}B_YsevzgqH_J+JE1Ag!eql@br zp?NJzQGQd4&DWWpIQ$}es z3kKe~UTtkvN7?!LXQlfgp<=V*vZMz%I2ah1_4)aC`CIwZkG!B|t6M^TJSr-pJ!)nj zkUbh2lMgU!*$-?(m%U7F8wg;Ov8UUMWnNU{!w`u&jaf#J5|yi?j8R7biR#tq#^NJHTMUbG)p7Rh%8Wva)v5Mk!*o8$#+W1OTg*b5 z)fx6A!^}PqW5N-tM70kQ#*8BpiL_Kizvj<{5`mm>;ZW76g=9{I0jO&9LJ}u@33N0n zhtULO6p>epy3Q0#qb*wvF~%NI)qY!@U@WLo5V4GGYXE2j^`tTGp+-3i2KrimW3VDq zuMR2p=}21kvwcve{K>7x zu@cV}KabIg!ZSw;;wQ)JS!XU&)d_%M`Hb@`295^^l1D%HV%5pna)EzX$EV+DO>9}h zp@If!Eb$Zu1^K|yGt0OL-ZVdJB9z6&^6O~B2VAWFOCh2ZQib)Uk(D zz_1@q$93XjPOE?676bv*`D#01|m!+7#vLoOB^zNsc=6 zqU^XVxJbeszg<+GWn+=NotD&M(B0AN?`zM4b14n5obcUw-! z=;5ClaQ`M2*U<_P*uB#HUWMIQe#SCuoiiAARIm~HpHE%5=U1?ur!~J$9{d8RP&~@A z)Unx$1j)d9=vdK~WdG%t$iG_aMraMIZ9@Vg#bd9Zt@863kojM=G;bi+$3OpbHWj}D zsG`d3GHxwiyYg2bzkf|+w-pPfQZmE(yG6D-gzV!3Y*!v-^?kR*V!nuI9SE+00ws2U zsi&%79VMVq9wez@IRPl0_+vd7{p+y*J;0lRIr=>OT)Q3CuOjViwLG>)%9RMGc$h4} z(th3D3A`f00N?0h_MmuUQQjPIu)xiRj2*53JD-I86-;B*t3k`iV0yZgboRdzBRqJT zU){iw|I`&wM{nB+C<+c;7O0~E&%mTDX}b=vlg+OyGMx*wbWVKLH6*hfKo40t$H*f!uJ3}rFx_kg6*R}zeK?f`PpPSNB#fl zta`|NVl|Qh)G^v1nFyh^wu}izoBnZ&inptV#s#LclDxGNG={*$`FLRhy|Vm-d0AmX zy&OpLJoPbJb-~vnSDlewxzFCBs7@`zHS%W*r4HS;aups=o9P;zF-^l0 z4T~_Ah53ylu!psd)7BMix5do6(3;YQJQzJPhXp3I29p_C;g)O@r85tbF7(4RwU^p9 zU_~P3KRw0&UpiRK47T?YBTU&H?5}l@MWa$ zcqXdDbJ+%{NzJU&HdDgVj;Vq4Q&Z@c2Mk=};_|4CMM~6*=l4oMEO?9J&;H znqihbhEhEvIE?7S4y6CaR?n!z21u~3Z7MWGISu4#`^opQQW&=!NT(>jmd9v_3zpF=tcF&4|v}zYCFICVgdHf&n1gvM9VcP!e!PkH*&sV9TaDAErIw_D{F&X#0Qi z^IA~m!`&e)N?viJGl2>4T%*GZrfM*y9IT+wqaGp9R{gqp{<#026vb{E0h0M4WZh#o z@0ATh*lo?vkB$DR+gliK1VaTjQj__o%E97=t6$gu=U z@OH7Sm4BC)*t*cT@VD7NO6To3;5l(I4Fvo-t@5u8c@M3R-UWByAWSsa8_<-yp!U%5 zdWZaHC3){z-YE94@&-8qkK0w^L0Qn2hE0fWbB_pbE#D2lvSzS~?bGp3$Ui$twt4gD z3~&n-hu%52a;N?cA-6TZK518;3=y@x(3*ga!~{;qOkFZ|+*SH-nFx#O@?c`D|B&bN zNzP6hUEro3x6+0MTwIqIM!1a|7r45G9`_8GULND0uM$z21ukn*K|j?yce4oGB*WTx zMd@C+*;bxi)`I22u};yqVd3o>xV2M03Pt#`b!as3UT<~8-uB3Z8X!8F-1F;;R4q!u z`W9ABF>El60*tIkqG#X4D0FGudc$mHbXK}pt~+@CNF~3G!}5)Z_Z^uBSWUe?0%kLl zgB=Y#o&dCPFLDKYiPe^@%C?Qz@TcP;! z$iju6_0Pwcp@lX=-T$@UH=rW6*@im^Gmlz#nIZ+zc~@rIlSbYQcQK-}FHHVdOgW^c z7bC0wK)P zSf(-@PKYP@h@V2Zrm_8HxDOB^J;*|M?_?LG=h#GXfA>1LBby^H^?17@Vg<|cAVu_| zks-s3Lksd?FH$;^o;Af9%I6*n9z@4pDhPSBr95zvCQxJvOAX9pJvUxPG={Y1JUoi9 zW;Hwtzh*Ezig=$7M-;-KjioBX#)`PxgUBw!RF1Hak1`+Pm5(zYiZYFsDZ}psUz3mB z5Q;O6-Xg!#v1zWG^_}j(`YK+>W-9a8%3n)jq^;u1>!|unOO;0Yq*Z-}9c> zv=~cbR#zE6J^1FF4yrU#;ST){NX)J7h$Z_<)hca6zS-ui=4cc>rs;|y0Yp2-(h^9D z+`+n4Qram>a@F^inoiO8d_!&E3o7S_OEnODHjC^xa0xDTk3*FdjaKo_={M{`Kd*8LC%pn)ZXq0? zlJ+vWlLO7+jd}&$sn_5Tt?{rxHarN5y<{!ut{@K{c;;TBbQG9-;!ZjqY{G+j3fc#; z^dxTy_gwZ$_`>_r`{LheoDto;IfG)XDL=!7tl zkK7Os!B!*YPIo{xGJBIQnF4)?sp(1OGj%CW`Xf>IkwX$^-JLeGN*8}G>wg?r!d z;4t?9(h=rl5H|n!iQS?Rz6uQnS>qwd$&#U=;?of*z@tW?@Y0b$LB3l^=ydo1L6ChS zf;k;=G3ZkwJRgYC9`qp*(NmUY%LGjeehVE<3xBH>RSSK~8C8pXnjeQIpM{cLR3Bm$ zXGx5VGd%(?2JwrtWCF(bk9de2z65%aTp_wnD~hyYovrha{i-UrPo@6sS+0q*P%$JW zqF+XHv!$IQ5%g=m7n*_0^q#~2ICR_FvqLj}N#%`*A6LJL0|{xVXJdZm5BO|vN4AAZ z-`q?0#Vm~u^AUe-JHvYpCXA0c^%3g>3wM|oDhB4B9!p{ z@_;|jx#>YARld{jg}}Hk&QBQlWfv|!facrY<;2UuIX?ZGMBhZwc0k>VQg;Cs#j*tU z2O6uru?Z=ia;%2*r8ImmOD#l$EJ-w7uEELeX^B(`+V7_vxTzq=%d0wA^PBcJz_Y)p zAamGdCYWDF32eIhocRh0WGVgd6UZvl%lXUu=#%An=(!Io6_2qpszVD1}_RajEb!>ql1&gHHefaQJ3h9qXtb`@gX6J7kQ zR@v?lhxFoo-6X9`?<9Xsg!fBub%xeri24i3-trUL{*Z!nU>NPv)0Jb8`K6MXyJELc zFz_X~aOJ5tr4jGI%990AJXfz8E9`Q+m=^t6`Cv#>n&2Us6WGF|Wmdp)HAnb>7~g&` znIlOclG6$loxEw_qRyqYd;a7bl!Nwk$yiF;`eeL6)wC7!&7}xd`RNLkbMk%@qse?A z*9BYs%Ioym_o(dKa*F|bd^35%k$GoTXE;nFBFNcJCE5-w_ZY8 z9nl4RV9}dHIFF@-_8^4|s~=k#9;yAt(t{6&49|DRWwBRw)wI;lj3iG_S`|D9kNC?| zgi&g1lxDLdgBH?-kB8{bSKcpdm_dhsT?9YedQEHrm0VsWX*MwtSda1=w~StEz`CC% z<$``2@=+>r6;QgnI|h&vkPd02OF-aVzVG|L_kU}h*)#XlJ!h>mXYc*nd!OT(jeYp% z7Y;SopQY9uH$S;btpBw$FB92SEPs?Vr~`LsoNRg{)RJZN`d1xow}sfI|LoEWa`Bpp z{HW+$%%%DRvN)gg#>d&}u|m1m3_e;|nxQ^N7?K^|4kBZ10AaG@0YKf2>bXIGm}$`( zNeWsW_u8!zX%lQekTMffI0@z1&6{s->Lc`4pFar2D+6qpwXs=k@BspZ(Jdbi-U|&} ztZiDRn=uBY9BmG={pnSkG7uRe(e{mkb$mr(yzD+*RSeL(eBNHtiF<;0@8J{YVIOyE zg~NUKavk_Wa%0L&Yr=eE&wOK$`*=`pcS@U?`tb1;(MwX^hp>0X%nL@jk4NMrGdRK= zPlFpi`YbDn0Tm%8kvh&;aKXj~<^P+mYLwe*BW+Io;{2cIPDJE}eK>W@5qt8Dbep$s zG=RiO|H0}P>=R6l)%VG7EO66 zOy6RXOW&|n#<<-IrZ1V;Hc#=R47NCB%A%eLGM|nF%$Y?-B_ViP^#Gn@Pjc7c1+rls zIXD|8Y=r?u4Br0Ypf6A_0#%)CYEOIoCsMoCEyRi|9Cp->WyCNmx1?JnOay0CMj2p0 z>n?XRPZxftDA5mTV8F>W*rLA+tBuDRhd=DE9lc&sSETF5m~S(Z=+nSwgVL#4eU==_ zcfA(_vnjL!uyJmH!6FU~EC*TI{MykVOKZD9;cUVmhFgy>*mIy;><6qkH`908#gx?u z{C4;Gmo@rZ58fmW<}AMSgi2#BKJeo@ZEO2FZ!(JUJqQQ>==w{D%%%>ZKZcYir4fc` zJA?vFmz!(HTgw>~7zkbQ=20}whB`HZw47<4Lo(wH#^aU%R3hiuPPc=ic_&wlp#Vyp zBA?F!Hkal^L*vpoj;p@0Y#B9{RpnVSrYaO(G#2K`S}uM0-jRNNnBFwz<~cJ+c<3)S zgi+rZnb$=RG93ETgT~hU4p#D-X*^ivLQK!dO)pXgqF94q`tHQy~m^)d=Q)r9#m$}&}F3+H%sC7g z%L*Ua7a2b_+N|8&RJ)Z0{VT|&KwxD4B86`MDn`(kg5MlPttN66o_sGn1clM6$f?WdiIXj)Ymhc}W}X(jR8mcOIuc za>?=iA(CqAnDd6Voy+3xK_WFis77O=SF~e&;a)vhDsy|yK-Z06jzuBjT3w>jVx|O` z13i{2!|9*1Gm+*(Mf;(YWUnpIi**D3dXiSNlCW$ao_Nzk)eN>1cLv(Co$;W|eC!qbA#y)@BA& zw4UiFIzkH(B5D|*iYxX&f@?>i4JhgSN6&fTN@!G`zeJ}Q=MQS%mHE@&Y+jV}5M6GE z%Tfza7v}?c=?<;G_0~-tKi?~Lz(clzFq?ewKaCuHzB)gqSu5n*y$Upsa^b`O!eGeY z$D_yc4aNa|N67{QDS~}2I|;unemaLM?A<+kT0GZNwBY(d0(hm)g~Bk;!?*_y=kA>j zoCjXIpyl2z^VyA} z_QU%o%t}Ml%HcSJZ$?IQ!x+l-hM2LQk(W*DS!Nb$x|l zcBTaOb-gq!Kyo#D>0TyG>PKU+cvE`!0=m0aZvkfK9^*WZ+uoNM9+SP=PdO_+9D(nf zXd!W4M-JrLUQNSe=MPC`tBjfFTOhHH*?9$j|CQ!}uoMp|J~tk`Jy;;J`GR z>}ubTZgCF~x*I*#5pSMVs5efSZLy9X12n+*uFeAB%wK%6lz2`_QTv8Edxpp5vB<;e z{Ydf53kA{!rN}z^w8*vM9>7Hn1hMhIz{AB&jz*B-kk1=F6GcHo6?LV0T&^j*=)sMB2gGb8L?_c}S*<1@W1LO!b_ z(eVTt^t$%^o|px#SGe=le=agL-LNAK{~C5CrbGNzlIwia_EB28istP<0DXXNjS!BH zuWiA{yg8}Vca!ONM-TkML{U?E?lz|raM3B6$Q_Q_-WFM;w1myP!ABIodCf4MzLLg4 z1UvNS#p+HItdOP5Z%&59dOlFNh#&rRL$>}ELf#Lt-#D%2gehFOy75k=@0scj;Ssn$ z;J-MQ^Ist0EQcv4rG*wTwyw!))(`H^3x_TP zdD&r)E*v18dk^R7Lifyn(tUG3NEbJ~6d~>HZec~(ys@hdvw4$JAExn!ttL$Vjq!#N z&6Goaoj0AwN%^g6Qn~YiKzn+NzkBOV8b_qj8_YUy!t9wv0(h2m!t5`g=CFl&<8K$a zLzFr~`OU0A=-yGMzh9a7WsD=hTd$29pE+SzDA2Az)n zx(%w?Geq*OrB;%5HQk58EOT7^Zwyr=SZI?{2tHdq+CtfsjbQ<7ayfFyPxUpf921%` zdGzBq=Rj9?a;^bz)^tOrJLU!SxCqB2t>4=F_jqIwAs=>cM>dP`-+E+JfFVP+-MS)| z3J6IKA+S`a{61k1ewAG2NwJC&i&Z?PEBm8TrLU5@y2I(E6brZ~sMM|HzwU{3eAFFp za(eM>bq)U)fb-kzXS5<|IL1oS>2X#eChNYP9n{NB35NZoe2hj7mE*nn0={H*kcOmQ z-LLB0Z`3uU9`mw&8K_g)WM1XY7%N^zN!3!>Za$4c=8``ff`TQ*ld3tmy<%N4u)Nh= zzO~0^`o7hxug%%K${);dQ?qzVAIB@XRUh=T&T=shvoz+^GfC3UJ*_B5G_f|knME)5P5JKz@u{2`%Md#-`mwr zsp*5O*vV8p23Y7jnC21e0fA*tl3McB`)q0wjZ$1=?$9*Jfo)Gt5=4%2-KT zu@rqK0LIj5HZ7%(klp*q414jtvYn6jKhg&^d`aSBb#yIjcd3Z?Mv{U_r}LG_1*YD) zH!2c8^s&SAkDE%j8-~>g@B_KUS8O9f0tjBbmQqn?K!2j=*1M_I4gDg^tR{|U5{GKR z-H`oqod`}ddPuU(FcZ%ylRdAM&Cj7hp#}$@hJIO=*pdQIRF;VPB*-l~_mQXjA ziPM)KHZtw;!!#-~^@VO?)$irg#H#fne72f*sBRIWzU~4Ju`F+AaPyCcy&a6XW}f5@ zQz01A>MQiE2V!Ij7{SUI`P*R6PwG{3XMRIelm328&gUxxUe&^0%|0nrrS<*BayQbX zjT$EM+Kw1aqz2Hd17D(7IpfIQ0Tgwz)x4KU(}h|%GfscSM^_PX0TrqR4GYtQu`D-JpA`XYGtOcONTCFU$OD=;yCQty!ue3o>~W3EZCz(jX(;@Y&1n{D z1Cio+ZKviQ=UDTbPvZDUND*MOl7nM2F4dZmgWfou@?4&70*^r{5ar4XC5kVnzZys%1=*XyzvyK7m^mG zb3xCg+Q@J+7Je`3>2ct;I6nQ{v)XtXQ&p_N#E$YD-oOIy5;Fho$HG<@*>=TgP(!?@l_0kz5A^q~lHJsO-{ImK?sML1R$#dfx@Ebti{l@9 z(DF|oK)a2ys^^o%w1GAJ6pOV&1_J2T?vyQe+1hjjB_=xVWkqg8R@Hdc4ZLBDVdz+* zHP4DU90i{Me-$3NZtPzWv1PkWI+*65BLHO%WRAtvK!A9>2Z4((6Obbeg7jkcX32U; z7-iB$iz7!oo*SH}zxwZ1ABHC8GkEKIh8Cv|xT!%85gNeYgB$tvBxn@QSJ^g>;y-62 zY&k?f0v$NdQ!S`q#dPUas~2}h6%w4cr@uZ<;8GR;dHE>e6{;#|E7Lpbdt4H!!+H6~ z-CzfGPv>|gi@o6cabcp&r79@8B`3}UY4HooQd>3Sk6OR#(br>oq=F_1Gu(O9uI0eQ zTjP+adThWM0p-IC1r2TgTK5Fax}UXaf5m$aWB0_EN6T5J3;L{X#gwpCoapbO^AvZk zy*!FQVB^ob1S{*Z<+7iDpPqZb_(d(?DT$fVpC?_NVACQXAr|etbjv0aIdou}Ldu!u zb}H8sK1hcQ*ZX)on@ymLI9VZ{aDFhHrUL9CXCm=G?YQk=+}#B3u;D))yYuiWytUc> zY5{4q&H46$sJ94RYUe2@Ypgqwa(l4WdKODJ8t5Pi{;eDZ=)OgvQ zNQb3tPvIX%wC#`m-|F@x21)sQ23O@W$#vq<2A-pxiOkAkzzd=jIUU=+M6J@d0muw$ z)mQLuSY0Bc7CF;M9%5%<^Wn zy0%n=v)KarloPHXTc(9w?Q2khKqqp3ZZJdZX+^D9#~&i&!9=a$GKDnxbAZgSUX%hZ<~f*+9Yq;5`X+-G+Uw<}yMDBluq z)MFy}io3==lQa-GR)L6P`ZV1*typvcxWK=XTFLK`*6hv(h6kwWLxyLFH0BSWz=npV zbDl?AqK<;iPJUR}S@!M-A;5XPdy%g!o{s`9cFCM|;2WJ7=G&*ac^ z$mh^FV0MwUw}*rnGcZg)xYJjdg=3i2cXqO7{-U%hc;I0;vn{Gsig6m~@4AT0oYM)- z#BJyp|JP`Yz*lL2!3|r{cno~C@HdQeO6h^FMBZfK>bgNBbwaeo{2 zO?b`(d+t)y(%G-yWN8pGuep_Pd7$DNUas*bte`$+_>Sxg1#RS8{R(C%y6#v;!z`|! zlG_svJN+sXfj<)*>G+2+jxE8SqWvf-^_iW(H)BZ9G9!QY8a8hLXI*f+waKL|d3Avt z;=R!!i)%|#xrxL2o0yA2T!#5yDiRKkEmX_1etC&^3kO9srLTpP%cE0_x>$;*^&1Yb z)){HY-LQ74n5zbm0L3?4=CxIx0F}mIPrRu2?~U?UitF?*tFqJ@oDq)qZ5*ZOnt@e6 zZu6T!-$4ITH|6@$UkX)cgB$P5G|+EfKTK{9F_K%B`~LA()jE5m5nn|B_tQ65P0Bxg zJ;t397H%y`?ZQSV$<|oAmKy~+b=A>+M*S?V50lINC!}&N5(AWXy@w}`Ia&B$XT)JA zqf`FY+&~p-YB%J0uOFyC+507_Q#Ks%y|p$RP$RI(q`%3z2jZRtV4l2vEKeE7fZrWt zwOk%?A-xzu3~q7+!%u(LMZEMkXs~DK;gC6H2SGa0df7(pSGQ>b0&v!TG<}`RG-D*V zCUq`T?O1T&580r;I+sXcYmxwq*pVEY*$&Rqg6oxUn zDsHiR;=vk4l5-`=pvFV#E3{HdEz;Qu(Bc{y$nQ$L#a3o8nMPb~{nQ;qe}9>wJP$B0 z^4ol=Rwp>iDxz37bSy z+-Q!fYG-bQEfmNwRIU&4GbGlzq3%M$TeywpQfqgTO*DRs#JYNyT-6+Cy$THozqe>J z2Ip1JfTry z{74NR<+`1bR^0|l2I6{IGH`WeL)HNOGhKXbv8BQXfV>Jz_Gn?-)e9DI*UN|I=@3ho zMGC0lOJ$>I1#+n2?Z}o)*0+8Z{vIGPib_??dIv+=Rj1BAp3tDSt4)nCVljksZh_qM zB;pNn3-X`OfxuQ}>U6WwIuF7>dnK<48lWCAYIG(eilR-;- z)pF@1tF#IE^q<+M23y!szZ!+BD9xXkJ4>u*8oXr+I%mB0EfWpoI%|w1F9NQ_k9RJjXA{}RI z(2MT&blK_%88)bhN^4*l-^q%AE<}Xc0u^hiC-jv;*LPuD!`+%I@4v0c&%dZ7N>`Ss zUX2l|& z3i4#FCrsH)E5IyCto$#XyA_I(P*+Fq4%B)Kn-c%)kI0N)q1Jqul~-l1@~q-L#XTp| z+#x{(MR&8h3AkwH?NG+z+pV?)LaZ-vuJBqv(`o?=I7)cc)!m<13(&X~FZ*ROOR6Z6 z*%6a&T7yct;>t9GeH-Ny!vd8K73oA%b>v`XJZygI5V)OYV*;J7-o`rO(O;zt92c)> zw&mnmsF~pzW@%Rvkld>oQ7u{OiUq>>7Y+sBQlwIIj+&;Ue@=RckN`npSz^1|-p4+z z$Qp#sC^{&VY(Zi=pd?xNyl<9NXEC?(KJ5f3fM;bp?DqVh#&peGE~R^0~BniKh9 z86c|1EkzW8ZY4pxQ-52oIixVFFR4Mv4uuIkNL-yX&XbtS{`X&YKIh>^rL6QXxahqv z8(?2cSR70#>pHmV9k~aV)Lw-`Pius1xqT-L8f{DHS9{Hm9WdcynL5u*ddepeDQ7^g zQMXYPq`rv?&(%p7|B1fJh)X_=L@DDgz(G{nYdBcLW4%n@6~$V{YA_hAQo$UHedr=g z%P{T0;~GTb=*wslB8d2KwftOw(f-&Wsiyf)Okx_wvAAw3D}+|J!ntPDz$7D&5wkCg zb>Q!Cd~<|y5zExEqHlSGYtcGnS4Tw_)WuT4#ry^7P*c&&NzHG(XFH0s z2{o;2D$g8lL--xvt@=K5h(HIrjWW=Qr>=frB!2!F^|7eF)^E<>4rI++{rSc0Ji}kj z;O=a}koQ8iB?myVo3(L!x2a#kk9o{7xFBOU%7(0K56tGVD+_|Tof)IlgTTJTuxtW7 zWvx9CJB6&H=P!CG2?3h3V2vzP<+$OUiw@OH6^oM z8zm*7y(bb@isHC%9X-Vc8**4K1Yx;bJ^{2s*Wc+)32ODE4$pXys7kyK)2#(r3%DORx1^1s~gmeDC7ptXwvoxB*B z6wMx4Mk`_&ZXFv@E1U*zWgTAnhrOZ<_w!qnEWMm+)HF-@rMhlyPQJTiW>Y{(+Td97 z_>GZXmB*0Yoa0uQ2HBWx+ubB7(<32d~-S2arzvr!s#=fWThe-70(Li%oBPxWcLalPr*QCo8l zI6`ec_;8OFvVEmq_i z5z4Cgu@}{ADeB2m`@z&VXuIEqnx2K$v=r%5kD_w@9+VTh1_I@6Jxpy=jnO1WguX=x zU>EPfcqbk7yub3WeVF_+7rO4hGa< zlm@cVBmG4wS7}=Gz~XnIO3ngVzaLWKS%8cKb_6h>)x#OXE6>BAz--6yl9xU9gAI z0*D6B%vMNh$<2J4b}7zQw?NMKiPZQoUyn>@=upDRsdam^=*tVkH*W%TEF06mm7%Z> z_+By6)=kl(beW+>2Bw*{&+@)~z8f7Nd&?SSVUO}Wkev_DqtZqH+N@-%9E!JUpJ0qIFNW+b6$6wq%(;Ar%&yS2R+7{U#)qUd1Mw?%3);dVL0Il4fE!g0-8U( zUNnwGIgntlI6r%=Azmyw_M0%>xYysC|Gen~;gWIWpM8sTZ}MNwO%&w|J+AwuA2}SC z{X$Y`9nm!ne5=QFHM3*&H>hPfzaBRUia(`b!-P7{>dmFiU@rkM1nmT*f zMfkS53u%KBt>|LG`?yZX1dTKyG-ZD4JzIN%;>#y6RslaoGCu7w;)heWWk6juPZgy! zArjwLY$O$r1M9wE8-W#(sa$@3w>3(|ju?o_1pOu$Fi>f(w!O8w@hWAh`tR2usEetg zJdR%@ekLC%0@~s(m5=ELdsTLeQ-Y=`|^ip#ESokDdcvQ z(cL~yKsHS1q@;K6Ho_qu^wd5La^6+G%frsXkoNFF*5jgsi29fW_MPT>DMAHK?7l5! zS{GeN&*_ahpUvCQ6QBLG>T7$7r_fCr(w>2{;WK;VK8k9t@F25B?|8N6>5Brs_2_C6 zwe<->E?WCQE-rEG+GxWvP26|Ua)__(o$)z<@@|T;2G13Z`9vIRLqt_Hd8+_4~5? zUnqF24b6Lb#OT)rBA}`fB962`+6af@gjj0T_dnl$7&V3~+&c@uXP|qc*GFzrHfaH8 zb~M`Dbmah}Q*i|XYy{j5`gC=w6|t4G`CRP(mTfRhFx%+EClc}u`{ci2JF*I@zR`gk z7ymlUL5@14CKsdHiBt+?i}y<*D0}>HN`7VG*Mzb%7NINP!awWLnkfSOtWB!BB{k8% z=8$%f=bXJ1==PDivAz9hv=0&no2^=C5uZ9KvKdP1h9z1r7}s}xoIy6oEcpVf7iD(; z3~VO8`5zx?(5?SouE<%A@RXu1@WkjKpg`B{K*jWU(B>Z%F^>wy!~Emf&49*QBIuzW z0>-}Z;cNiyBq!-;K?DTQz+%Bf6LBZW9}=dQyat`0o#uZk2J9*C4lQV-7rwImE>ifa z&*0l89x@yzRvpDKmtVP8{e4z;eRa?aCA+bX-GUmyM0-;Cu9;h9qK~6npMRbYcNG%mJ9YZx=>t#!v|c%CvgBIH$5~ca}NDRiED^ zeZ(Gzvntnq&jaqhc}~b;-@}jOYXNf0wcowlj6+Uj$zlq6+$hylz;MXG|D}UFz-iek zzuU^>M>(uM%y_b4oH}tN66m+ve4rbLeh=_q*j0WXIc2ZI6AA+VKSEgM^rJt5$lDc0 z?K7Hqe}HEN##Z3@whBrsP2ifKr5YUq5~B%$uw^neaaB^E0f~!=YSLjoAIg4AR@l%d zl;_YCck)R6&6Nu5C3Mk(PamEW=N0ifnYiB$d_~AC`Q~9S!K$Xt{xYflB}We|IoZ5O zz=eVb#?CheZjye0Y*l?>zaF(k6V>@r%z2f=@x}L=#%Pu^Il}a5b!oTwy1>jL0CS?` z)-jsOBaffZ9kpe_vC`9B#2}H+CDqcGO$5n6ZE58N8@aX)Hso1}*#LG@@pA98IM2zD zLYnbn5*U|$M?5K)zHBL}lwLu3X{|7+42GHm8l_IGIY?5Ai!NfcQU81TC+j~F@`+Vf zqGY!cNbSHDDE5Go=*b3<{zG=`LQ+jAQTof>W*S3H%RE1+xmn}dA^SO-1wErV*Pa@9 zKjI%Id{4%iism-o$huhIDXh+HP>gz7aAiw7_DW6d3J`4TVD};WOY;}y?}Ieo8^kq3n`i7eVz4lwLW} z-gU6?_LiDM0G}1O58v?aaN4~}HYRO=fevV2`#u+_SF*nM@mvk`R9`X68YETgWN=m9U%dh~ZS!Ue;xGf4c2b-p zrD@WUHDy^+oK3?6v+iS-QKtpcyKj>OR+O?yW47X>!=(NjA}Va?)+}7B-g(gw-5;DHw(Y47hT7{w3f|D-$*yDV{OE9gR`-TL+5H zMK5neh8}0BOHmiT-eY%*;QjXJAJX~vE9Ey0>+g-Wi=W+Q+ulsQ>mKP!Ds#k>sMLI7 zaXx|jRdQIYCt35YI7lMJ@{%R2futGDQ}L+k{p7zI)CyUe5_Ou5X_^u_BWr3C+g$9r zZz7b3(o*nD|DD-LKO5$yue0@-eX*|llli`5W^-G*!-1YCfPAFox z+O~Q@xUD7FzB*{%;Mvxup>ViEvhqUxpn9rtnjDNJ`R1YcE#ECd{#(=(a5JQd>?zlL zBGL0%^Q-&Y_H8MJG4M%&dE?#i^1vl-CeMf%-p|u-U9%9zBN4;ig4>F**ULC%^j7I6 z75gt+Rn|v0PdRuWWgi!y%PNpALi)vezD_`QZ%^zw{ zkG&Zr7b{)A^F1nq=cjY7$k;K~$mYqGa z0mV_&R9Vjay3BC)lEI9EN7VJ-TZg$?sBUUuV4R^Vv|9hAT-wwYddsrZsOUKu&SeJ+ z%3kslAgc+zJ!t`Bq@b>ZkqCZ1E9uL&lFl46ipU_z<*#Q62khRUZZZeQ5W^9BA4Z69 zcV$D{HvnEPe5j$iI=oZdcz8uq=!c@%ysjOg0NuIZ8}hsAC3T0Kia$w|*AnlJm**1i z4(g)VZ8)bSRZNwCBGH{LPp*tsF=RJCqQMF$aDHe*XA?w&U}E|TfH?=FHDhmUuh=iA z+qz(IrdjQM=uERC!V*ZMF%Y&{yy?3%tvCk}eiu$1R{uKxUBR!)bD|4OfcvFLuNNP{21Idu|YS~QP`kPl074<`)MbIUh<_Tv)ldbM|@ z95`z}KiYWxi$E0r8zhh>y4zS_KObf~t3Vop!{s0t z$8Yo*2H081GGo=!4P#p4}OhvBrO* z{OnL~oq0w*Fkxn(%l>OV^isnS(AyT)1>d|yPl0?iqe8uk2aI&o8`xcO?#(u2Lr~O} z3Pn*t^rnNspt-4&vNCNh3guYIsofb(T+tMfpTpH1&R;RTmXy#p@Vx}F%F~`A7M`R0 zwjnYTJwa_c2s0c3WD4-Qq0NnD$r0TqG{DQ+%#T@)Fy*db~tFfcoZI{*J} zY$D7qZftg=E;UQW(ERwG+hV4H!+b|ixvzQsoaHxQV*!@S?5g^=>d5~yX7BQ}hM&!X+TeK_s6bVxo+*UFXM1Gcx*{Bes?(+1z; zRlCLke@?cH;^v>AS?SrqevF}zw!wRN)sAp}oXX{$wO%@2F-YkF@PH5wkX0WF&7xp) zrPnQbztdjNzd>^V0%lFymf0p33Kq$ZG(^ETZV8K| zQyIna4$Wi}12J%X4#R8P`0QJDZD-l&xRyIm=%l`w^P+NHy7((uOUnf)u^nQf(W!67 ze1VYOg#$9Hgu*v$-F}Z3z6!^#5SILoqf^AnJI*ipx8CP=CWkxqFK7NMOa@V+4RmHd zbC_E_`ye%U$|HvlyO^$ml(wg?$){@+$=cJE8Y`cCP`YBM_6a77$^WC|fqj>iD;ZOC zGQ4}8#d+O&Fd!N%|Ds=!OiqrdQXZ2zHkJTLij^Mw5^cICw@0Go8sJ~Fs*#h&Guhc4 z@`*l!Qr+I8m@OjO9*;+X*6^k$(6cDp6nM_b^f)u?;Bi@Bz;$bxyV$|>JNFEC)2v-T za$>xVuSFGZQ*RFX55Ehq(lRX`?PQ!T^}taWTbRZrlbS6DK$6qbbXgBv(<^Z1`T~8) z-mCt7@!nj%AOSCby#XJU61{CFCYSEE^zd7L4N6W&dFT3ie}A*ycoa>2P=6FHeo)A8 zOnT8ofe?3@pg((}Ipo`y?hTT7?*zY1+kja z=?ty6MyMamNrO>;WSR~p}abWMaHl+b6BymuI=4Jd_$aF z^E@EHR%#Z7pU;*0cVJY3$5B=v;hg!SSAo*8us09ME6XJlOK)4m7-82wq$B5aG>9NI z%sw-KW8p1Z^yo;bG_F$nxPQ&1D^bKUNqWey0*~pDZu4)z!`oou+Y}$!%@ve{&IYa2 zIw`MK%;XhpqY$ElS>u@1k|umoHLSYNT#0mzGh^tn660 zp68L8(zP)G{i7Os=)DBEB@h!lLMvq{`CSB|JPCzC;= zp%xW=f1XhBCM(NVQ+(+mcn})#85LV|Ti2f_dcBtbun(QzptYC)^Le0@q5XW!Cl5b8 zFb+B?IHkW!wnMPUKcV7)nc$6CgyVuQW9(8Bo)0+Inw_QWBeKdz_Yv+6f4Kc%5{4F9 z&u^tRuSR@m&34?9_DnJ@htwJOwIw*j6?DqbOej;R!$P4kri!^N$Bno3~D}7}pFq*Rp#XxAR(8pI&yGU%Eo@JI&b;k-CSSImBw1k3M65 z@2Jp{IL)(LCrL@N1`=ZEy~o%6JfNlUrvS%Ik3z+XLjCiqKRF}vltw{r;Vi2h*+h}Z z89+Gkb~fe-j6WGp5-_BqIZjpbqg}c_@folyYSAW1(6E4>$8$}+A|oXGH=yFy!IY5>}B&=)AqbWCgj$tTF(!bY!p#!AD6>3 zjMk`0Pp(!=N;+{{44-j{?9w}qCu^hrqi;QyWyTPCAK4c{b|yqi8)}dC>RM zQ|k|23Y=lfnB`Ab^uhKtc@E+L$GDqT?mCpQ2tM-!Dg8U;!bF^qAAuoG2DtBKU zl{l|UUgZKnbG?9u&Bi^bZjh7{$+fxOqLp+r{4<1XXVA^0H(TdZTO=buu(>=KR`7c( ztH=LnaiY^GMZAh6C9jq60BV~l2F zIhuLmrsGq!n%NSEG`Qu%C;kf#Ra{6VUK{8M(Jff)Jw=KXFU4Oq*=C$^Qi`G&(cR1w-NV<}9B`O;JyvlCZgzP%-jV*riG@{aTMXD&@m2%rHf-06V2G z?Gc1bBoyx@T2sv5DsjB26Nt|12^W21Wl~BM#B(0aXAyi~9(UQ_s&!7@MxX>{;4bw*12aVo?=4cc%p52G3OyJJ= zDip7r*?7*2^`05Fdo-6>Cg+u-dA0X?IF0oD^yPeoVJbp1gQpHH$2jl$?%{Oz{CE02 zUlfSN(Eo{su|kl-f7nmRhHzKIz1%kF06v_5sr)0Bj-b#b_5K{uE*-|ip&dbT$f! zIwW!a=E$-{H}aaEu3g>-^<_3XTXu3%kz|UaNYFgf$aqcB5=on7@S=I?zS(}<=JsqG zdn6vosO8W*%AjkDVC}cU)k4NacUr$YF*%K8rKM(dEuw8`HrvF8SUfem2dwNzBT z1oQt*t&wk@slR`MlhJO}(rT2L(QxJ0a24Ee@~#tbG`-;*6F~F8;BAhc763@uP76v# zA2n3D)WZKJN{v1m(oRY%f^g|>tC#Xvl(t&l&+9G5u|aV`vSVSO(L%2gZU0BZRn=xZ zw~3cS!fo)jx2<~83b7^-7%~;`|K(mW=%5F4eAvn$viChOaeMZG zON{YUm!g_bgBj_oFxqnBFKn+w*&>X~F)XCy$!fnkX6X^D?uFp4b%?0l)Gsqo95yfW z(Lfbyak$89mnmq%1j`>AU$5C!d!t|{SC5;J0IrnCl~;}Dno2oioNCzWc0{HuI-Pj+ zSlS>u5<@nR-jj=yAi`6hS$Z=+X}5#_LylGm9zwbOt3;6ScVO5dCS4b?&rXO^;l)Ia z>1~GH4kczQyMW8H_1!iuR>q_<6H~=9-kh{#dxM11oBff#srB;sV?$|!VmE7lbcCNY^r*oSriq8Puxw6I1-~}+3k`p3TYi)y-3sOa9@IF_ zI&ulZRZq@LdNGrS=3IX%aG2WfzmMeS|5P``U&?agCCgEk8i~glAn#&KiEA)G(I4;I zB$e1FCrTM)CV<{yh3h^*f%TD}i1kFop)kXxx7%uQyi+YP63R>Y%Rs=T?(6Y<-&jOZ z$Y);4920@iewt5qs6bo;mq2eLV1*kv(99Ap%Sj0XiyEvJZ8Usu%akFI%BgqR+!x-zXd|9~h{ZBRrI#%+Qk{b`M+@x5YLV>gaSr{5BuiChe9E(U{v8&} zA1b~1$&u>!uZ(`)?Os0cf7*HrxTv=1ZJ0(Hq@_WmK^ml`yF(fY2}O|3LkNhZ2n^kg zl%jN}bc1x`(A_Za8ScIRH@@%3<|uowz4kgYXUJP+?`rEU|6P+6-QBvAKf)ldiOJW^qs`$cVK;SV>QLffbVqqNd;g+xNP8hM9dvFy<$In8WW5bBhm7RQ$l&)r~0O+Ex=L z`4g?H(jQg*N}ohOow9OX%kZT7W&8o3yzZ8H(U+rBvB^cf)Xavv7HGGBV%qgm_oYAw za2GOtWQ)3s_&cdteAxHQYqNBi7ktn}`Tl*_f?fxwQ{Cjxf*sCJvRF%4-PwNVgGhB|*w)whI-q9S3b!Ehfn4VRpBmy$u@Nzh)>-vgPPEvIaw0r0b8s;QF;o*`+cH^5eI zh4^@D+@x&6m|&X*6XNV48zns-`#zyim@~W$`B{AH(M)6{C^gVujXD*G zxYs;AS2+G_Sn$Km>HInL%bvq*VqeP$Ne{3eNI8Q=K7$Kh)wr!vLWnn7SDDy7Rbk7| ziCVdPUlODRjcZ`P$s&5~v~&wwl6W7fH`Fd%i$J>aIPD`(E!qaYHbh5~cmS4qm&zr> zmf%EK-VToe@i!FCG}8N8CdlO{UQRrnY~!fKQ$0kWemNjE6_4 zMX6M8Fb;lQxKAun@CMX-vKXQ=Yf1*>?_7v01+oUm1lk1Wk^8Qw;|OLH?5O*uCk%$C zXXfu@0^|~$p^TN-Bn3OLTO-R3Edvy`wzuc@K|lU!!W0%>^^2oa^524S%vI4Cn_hLb zzshfUrQ7l+O%-}wBN3in)1fwl?L&)casG0E`7yDES0x^9+rI1F&4*kdu=j(+dWY0~ zmrEl$suNLko3jvNmy?hQ?2E(b=VB$7&&zz2fi4pFT{@~@6G;)?MbKC^Z$M;%G7$lU#R?Iqwsx?F) zcLA)QH@?$oNVXa2v6%eZER4^CqoCKB_ga)}qNuK~0PxohR6};u_U!NtOG!U#Nxwh7 zi>!i~Feo|i>USNJL(Ibrb~@oJ$pX?L3m7v6jSE#Ok@M^P9IZBH-OJ8u_w597*u~CHa zBXQ`AS|?0fOFWY5&3Xp*ujzadrW6UI;H0J*XgE@x!s%lT>-VpHu1lHznZ|^CV#rz| z64gNA1hDw#xx#w5@?FPyH}}r-kj{^&+d84cS|Tst_~&j|Rb1b-j`QYH&rqD607O>_ zqKom+t`l{^HlKLskf>AJF;|M)V!2CG?}p$Mug<~js*kC61EVVOzE{%VN;;NY z-or>lwmN*9uWoV^a-GO<3qCLMSM}2g;mT`uF%9<|L`xy2eWVvcEzBkxYJDYy&ZvP2 zu@Fxl7Ld{2T6wIz%1;Wsgo91BxHZeqj1`GtP&G;;!~`c@XT9#+ISpiwWzPBF5}hM9 z24@2f9ckqMoPWkklM>HVnlM?-1Bg(d>rn>9w=A_++rYhbi8w9p+LslK@-_m^N*G)tDDtsYe0Xj( zSrf__4To9+#Zo7M4tahbv!9&Tb8l46yuNgRqG9CCDgDUnQ~Q#ErpFZQb7wE^B~zjn z13v3`+4{V-{#`U6AI=AwkQn*hDxMKkmJjqXlgqs?=nI08^-Liu%asNo<*F7R4}hqT zFZo74c!rs6E^l@zEnMfSNrI?>s9ljcRJ-_CUYw9Z ztpio)D=To@(s=;7M&`g1CsfXYK6ShvPRKG(d`BZ=)uvptRKOJ){w9TF()&*HW<=oX zrlPRV?ABoS!$b7f!2uKnfSL707VdU7;*%AEiM&3+)ZC^U&||h!CACzqw?vl3Xm1?A zd_}#{EYymQpDr-}yno;9(|*OJU2=O8<8S=P*V$5NDQd-6F!W@BY{-L2Xvw_Iwx z0e8qlL}+Pm*;ml_WZ`fS9D!}D>Rjp9gRzA;FQu z04`!YcEw735~;jv_64Cku_`x!n>{eU5<9U2)2=J^PITe2ydolfy4BDCea8a%?MKy0 z@?WibGiY-b=(``WzbOfpl*{BcmTc&!p|sGUU!r^^Wub3BUaVD%HP6Ry&-=s<+){kULjyUiLPc)QPI99XJ> zY3+nllJ$gj<#qkh{V&^Q%5rH`V=e2fjB-X~3KDi9r|EUEpH6t&S=3Lm2==83MFaj# zxcLjOjGQR!mvQGq3~SNd@UQtK8U6=#3!#8^wMCOnVC9_jpY_51-n(jsD4%QnFu3(eFO75U#++f!`BrR@=@z zXF|!|X)0oB5b8qZnDP7`=-3))w&58V!Drr%UW%l-imBC8GnovlI$@p(g?OhKi489c z4`e<;AH4oh`QWG6Xoo(Bx>_DmyoLZ>m7R>D*t}$}-j?-sS$x0BKk8OKnfm`;igfS` zZ#UE$+Wr34Tyzw72BX2e?o_{B3{&)?0YrPmd)xhc!;qcuaoa3}kp7GHLjEa*g0)cqe9P_Zp^Hr_iFdR^L~Veu*Wp0AC3+(4tPAi zFA~nEAu5*=HV(tAedLi%vfuVDNq=LQw5tll2_2=VCjPhY0uxtHq!T5o-KcZ>v8a|S z9qXpHya>>0N*y2c6Uk{3YaKVuI6toTh>+?I-EiaJ5vcfG@^spSImheqd0ZvrW7E@J zMhh+sz(;XLxz_aY`DT79YTc1c=Wcqd86RXTJEFwiu{Pl9@Ft(~iEbT52=gut zRA}PcDGL;7%{Ik7iz~g5tAEu*`vk5O@cHw{N82YA%*SH8iSr&#DBtv;(L2mt4jBh( z(*fyWcy=BdKCzQ;3cef^o>7=gt&WY(_0QoYds<0tJcP9kml%rtMk?bm(84! z9rS@O7H$&{B26|ouA4WGY#F{O3$~oZtoEE$(kkQ3cOh|WOw(J!sR+jc&R(>z2y+d z#a^4SKb(pZKIxun)0;tw(3*_9w(YtS*rcR10>5|yLts-6g<=ka=gAz-L11-v9{;m4 zZo4Q&2bF5e8%bukhON1zlXnB)3||VDX1HR^RxiFy(I+m{QQSU}e=G;6!T-He)1}y4 z-FVU8on~!0^qm_L2HF2>N<#Goh`hC&4p6Y14(zim)S66eiD06ipTVKMp0T5XP(ndK zY+L8d)ENxfyA^o5Ayr2AN1Eo5td=JwlmhDaE5|5U76j~IdJ0})V4MZ|Mwx4MZQb*^ zoP>l*%=V}^#oHpf^OQ8@lf%(^0`1Rcu#L>w-Ufr{ntMCv3=UYm?F|IoU$+E10grGy2xjnlR#4zER*<&Slg}&IX(3=ny0!AeI3%~Y zWMBK}E$Q-O_%(@Lk_GpVI_)O4IQhlf&JtV}Bvna#mr@#P+Fk@Hv`0LWv4}y~_<$8{P-e`HQ8TxD;wgd| zT03N`c>CgBTr{@5^@#yi9J%>8LMmDKeI0OZULGdP|iuYXTu3?U7*Xr$Em-c_~BWd9vkh z1O_zR{1SCtKo(htJgW~};}OquAOm(9KBJTps3r8Z#NS=&Hd+|jmwXv~j^n>Jw`K?4 zXe5^STc}dXl_NG|A6f@+JxCx3qA~MJ#s(UJ5>N1N5h~D%cq9}4GkJhKs|&P^8kro; zfCsF1ZT5C+WU=V_HFKH*BQBm69Y_jkksilVCF1&IExa{5-TCmM*uuu;!fOL0HVfi! zq5PF3Q*GXdcphtVGf4eflV)2oY^mnF?C4ZuQAXNlIXG35z~sj z!OQmGtu5HGwL7@jdyi=~Ji1j=2#w@$))NV{t@aRzl6AsVljcqf{NaR)+Xni0NSjP4 zMMY3dK1D^xl}^(g)0$WR@{{-u)LKM%Q7RjkRqL#IxZ6T}-mwvffBDB!HyBALnBU%Y z-;AK(Ez^kx^&FyPytF+s7G(9($t;QZ)k8R%!$HlTw|xLTDN;Rr7xdmzW{wBnG?jg> z6Il55To)qS{EnOLImc}8$gfA8Gn*A}34JLTW`DhOUC*2SMW?G@{s}E_>Diq?a*cD5 z>e#zD$FHubwsYrs+jA{s@{gK1`d2SKJEDFC(`E=jYr-4K5S}h1W|mNxc2yDCMs!#$ zf~b6Q&F@Cl&38QSbJgdG@CUT1MP#> zD7L6xgNrz*OfDG^$j4?!VZZaW`&zd_7OfI%@tRHsWQe-y%fJ0ZmRY#%AweMlC;>0W z2su&VjR*WTp(L=y-hVuNmRPV&<4qE#X&od^NR*V-Dl-w?>-%z(P$$``TU`MNq97c) z#3)u1s$vqz-&Vi%u9lC$FjNuRW9sE!d72U1Bg5XuG>gFlt{Q|*Xq80UAu|E&s!wL# z(#|q;eB5dKxYLb-`ivQPE)^Jlq7h#r;ltrx&|7{LP<97{CLWgCqcK5QKveQw>^9ieU~TE z7Kf3nE_%#DCm=M;l%jPuw{od@NT}%$Z%)S^#LQuYMDW*ltOckD3`$j|qxbpZC|2{m z<7n%M&I;#S2uCG>UjBAVUrfhTn>`#WARP$1@CdVn>{Wu_4~4tlwy$%S52J3_4Y@Fv zpbYYZPJQR7;-~qpfgp~yAc`8|B(yL)LUPkJxFvM{C@u805FXQb85Kv>5;=2_vJ)|9 zo>4MQbQxrY9)NREVyyC^Q&sOjnUqVD>vV9`VhN6y{Qzsfa~h~_BaePUrxIXXzq-*U zeDKL-BQM6wwt-J&c-a^k?O2{^j{MO*Q*RDC<)w;Q@0c~tG!N~i>d$mXTT8p3Q%kqj zqH)dMQAi22s3qc4+MBncGS zN>!m#E%l@gpN!HK0*@bNSGeaJE!_;iF0D1&Lvv=!VgpyodX%@U>sWu*kzTbV-YY4Z zTJgecqtHmAnfX_rR+mEHb}SM<9co2%p;4w7fsy)4-xrD7rQ^`4t!6fXN2cI&LQ`Uq zfDKyIilG7{2H3M-rU-Ow6f7D_T8BzmCBm5T5TYV77Ej{L)`Xp6G8PRKtt_>?<;eus z9l;j%lzNOfJz1@+^*l+FjpF;Q=5$jO0wO7*SR&>YRt-t5!)^EavyhWfOl6`Jq9REa zPuU24QH@txS>HjMt%e>YFru<5W9lRVl)7SWu4RNbx|a24E#lYQ*WO1{3+grR?=)_Q znv#Bk<@s+PqbhL|^NfA~G&f!GFO@9_YkhtQG}|wM{tee4(~--FP`))w#7PsjUiP9F=>T7qhK5Pd}y!t{ck?;k{_;{}N*I$*V?=lyh~Dmzp6+*1Vp51(hA zSoafTs2QVpxJ)OuSGkJZEUo_G>>w7x-B>Q&`U&zb1Y4;le!`=$EVRC{z1$W8)djS# z<7NE93$rh3zdB~#TfJ>U_sAyrM*8E|KS9iJmiR)mF?E<&C|Zs1YJqK#frfDw2huwN z+y2)#V(K+Og+$cd%O+CjxyN-}%?OdLyph!+{Zis&CE64cs^Q1^_D_k7(DS>@D81M2 z7%bK7XJ?&iO<8;X@m>*iCq}FCa@8}l^y?%g)f)M-o*b!Tdt9(7+Zb97E87)aEL210 z5&9F73tA)G;8UaZIr=4%t6#k}vdtXF@93nJ1s3jslv`V2)2Cky*-7T<`$)jXo z2pywUstSb~5dk?Lj{sGURYwAkh+1&X$2CqK0V;oY(R_*5cHP!wyGMwjyeQ z&dERw7b4SJW$F665YMxj~N42lm!NbaqA9be0A7K3;C(wAgtyZHugoiWUxp3dpzy8j0iS*{T zt?~7L%Jcb6;~jy`IZKJ;n6DOqvE$kY3dmgTd^ajT=eo09l*nCodgq!mtanZvT;K$H zz9T=HLFi*lv?d6ps)!+3J0|l8jTQlV(ks_qQ&ymFErS+Y7BkVs^nWn+T&o%1`_g7> zTD_)4RoGR_-eY!&#;8BG6KadCg_d@9TT;^v6l{@`iA{qclv=;!L`PWbjw93t( zq*^e2Q>|gT7eAjv+F2HxLFUG^;#v>#y8CQ-*5c>%$UT1!=0pFax80FBAQzudI<>xd z1|_TOAuSl33TQwoM1o? z)Z)C+9&8sp!Yo;)oRAXZlT`WbN|UmTC<-T7X0&R1q74rQl6{%XOX0uB@fs~z7M|jm zbsTkzXg(lsP!x(94C%+9yCh)^7n3{VHG0{5rMP|Z={$P zj;dH^MX;^@K9d$Cum3%w8tTa7`ZYThdja0%fn%(|A3_tuv??bkSYJ2FaVNEJUyC~b z*TzK9to~|DHNw%*bv#F8GpbNlkfYvi^q-E`FEVV!m#!qb7!qB7x)7aU*Tjy_g;gt0aMShZneO zZPmQ~vpy0W>vnYNSYC$A+yDGo1ijK}*##8&7$@zD)s)=~OF#{Y+treVCa48)@&9_c z*X8~l(kV%B6Ln- zB&cahEaUrF4RChMrAn^q`ey1$|4$Sj0AYOg%{uh+wosju!4@*r4M|QbT0DW5;vhxX z37%sx2N;+!r`qR~I^SMt3gK2wfIMUMChwSkfO{uu&Q>t?%y)V*>3b0)lMBfv>sxuD zBgr_AfTb%IV`0y)k!bIK2y|CXI$=3>@PGR98U$}w^Z6wiL<6q~&jF?bS>%Vr(Zmy% zYaSzfjxLTm@w758j8TjoYN3dy>@5_k?xh~a&|O%(`J;upM+xwZS{j7)+=uBNiSS@Y zxEoY=7cZ|`HTs-#+6%6nV z+Yn)2TCt2(#DZ;{ik_bAu?}snzE!K8IQ6(sIB^Y_xb642#BNP>!3`#nBvP@}z`V3LWyr-? zI?mqcG2$og4@ZS^Cn5L%2&g9RzZD@DA#HQcTwm?sbs`y(!bl6law6bt1FUP2^xJj~ z=F|#Bd<10K@-@)v(4D_Bc#wFyUai8)m&l3wDIoAHCzfF&F`Q7 z`rKeLzqjg0>d{a;*R=p}?w_YuK3k|e;){;;Z;&e6^R)x;&I4lSLgqQw-RWu`l)iK% z{m>9Qmp|)|Z!k6#ch2C1?Vc~wGLDM_cOu--n2b|>HB8sBP(?2lfmueS zJ=CS4IQPWr@tkzly|MRiWNwaJw^lqlUDD7@e}bJPd)0t#p=`tH+;F~#**T|sbVyK+ zwfdqX{`&^*rakWbC*-pjW2TAwzN&x6O)}D0msmDfg{O;54H)EnVlp8Ku*$tVVvG6M<{KjARswW)3&P>8~ zG0kg$dIGl!v5G+|kFCb?%|F=HpX8bm8(s1IE>%oa`EC`*_?0N>Y47^1Yaw8=JCLTh zsd8-p0e$4n2U2{i4-WMw+G|xmbeN#LikXV~v5I3VaW-*$U-OdJyPujpyC@LJ?2obx z=Tpp6ELY`u6UX|Mllm)ViYV?_rfAas?Y2ax#mfwUXz}UJGgOJ+5XEMdvDb05UuB^~ z@9(WCoz>P`ev2yb`R66I-jCGGvRqw#|;hQxdPgi z7MmG-;w3Y$M?u!cj=5MT`DFb5fUnVRBgzAI!bTVAxg2D?+4I^Ht!8Y25G^uu{yW;# zwF%n4ju-1~$U8U^r#6Gyup;Jk1;iu!NG&(OzG;c#|kU4wPo{~LPQORT|qP< zB)81f?ef{gp!P#e+q;-{x@4o0+z~^Xkg03t>M8l`f7TV!iQU%&xJ?mJzg=qzJ@r&} zBQkuKH?m3{LUO@eT`QkGDT>K)r)jGQHxD4fT?i3slM&HL-WQmV&n2pqQOMp9!Q@y1 zm%aKtdQ8Ps)9C~54f6Blj&?G|<SG3wKi` zLc922smO^ay3Jn*EH3;H<^h(4j01RtzU;fdkKU?%#O=2af6Fu;O=th}Zh?0&vJKDw zUFbPPD9>+@7@-p$I@XY204bCH1TSJ1(2adF^_X&qiuHDw|U72HpRgV(ZWJ z{F{T|VZK9?Pb{R70IzBDgBv}-??lnKX0pDWW2#S*G@kHv|9KVKgP6dEhjNYg{8y?H=zgX@eFh}Sq;nUbchkSU`ndD3 z95|zr6Ry4#BWdOgpSsObR|w;QX~jtmYN-FRuLfK5G;MbyD35S55!|c!2l)g+u(ttG zl^8GcuA2YCj#z%$LhTKZv9$IE3oaM*3?TN?VxMUQJ4g)hM9i7MEi8v1kpLuG)qz*S z3;=So@gDZ8&?2vNS6&t27Rsh+;CSNR%Wh* z;E*S=Qa1L#g%{MCY_!#PElKux(K06qP8c~k+wch5HlReu=eW>v>qSwR{lDBnUR#x) zZ@4-M=z0k~F@Y0$VirL*`)8`Wb}5SEDk+ZLIU zQS1sNc~MiQ+h4@G^17rXj}N5TQ1kUSzSqFwf5BHLqYw-RMA+ zjU%5+?yLF1dD~4nunTpG{nDmQ5UV+vYfxTmPk*Av4)P9;>6pl(-sU_Hy@O@>g z1V1D%lj{BNHJzJOfF|Lc86A3!vew>3 z=I4Y2GiG3~Tjxevg1Ahhul=vAO&I6*4DT<(X%Pb$CRS>H>0MruCKJ~8rj5wj_;GqS z2u_~k$RI~PXL9|*KN_KeZDMr{eUK5U|H~mYFmG)2upVhs6wtJY<03}dB$i@-BaL_> zLz;|H->Whro2bRb19SOul^HQWW^$S+4HUfRm5 zrM4R&G_hiZf~W8>-`-5NAei&}vey^kZ1{Yujbr*BT%^gcI=F@J*|hhDVaC<+Prk~M zCcmri-36@<{qhGC$2GBX|4aV^)I@bX(e+Pl-06tk(??=5x_;Po`!%i9o(S0F=R|a40VbhbIeejZ`0oJIC$V2@I z4*LEF@;_`pz}{8=35-7;COH}GIyhdTHx7CzH?kOq{U|D3MI(kTjsdDim>>#>< zO_QTa5_Z>$<224K3K#bEuY)g|GimQe)t@RzpkA|#s0aFEo@!@hBHi&En5FOU36tPF z&&edXi~MVbEc$m#N&@fNYlQ2>Kl!4+5$wK^V!mUC7E1m%SMdT+ZUH>%Yg#xn;z;hQ z|GqJKm;qp_1@C*c4BQL{9bUg01I%k*ogOlCqzE4H*@MpMZLbf6AG5ekSXk4zy57Lif6O zjHUyv7#LGe@GpU%0^?oHSkp=7=S1kZdZz#VSSDLZPi}ktID( zg+A7#9wVqRKC*CHZ69zU34a_CA*lW#Li5@K-w24$92wif8MHw<`E3 z%D7&v0CTRt*o5Q~mbc$`{JZC&%Nml26-KT4=6r}B& zyxOlbU@sL~eAyj{tvz&7eAVAeqb_qYpS0RdBv|129QZkOOK{S{=1h}w>2`||lo>Y{ zKVPseAe+EaqM~X2nN@o}=|$51-5+(ilYwOVc_NMiTW;A17DE;8H%f-uV=45#@u!7( z60#A+U!jYxUVL3?EbXdY7hKgzpyA7f#s~#u+#9UV8FN9i24RF(tBbY);@Xi(Ie&;y z3&5>dvVkmDY75G4Sk0X7Hk~@@5TI5h#<9Z^!8Pj z&Y&H0=!p~0Wcp3M?J_n|+dma-cmW&a_~Gz7p_eSbENQsr9bJ5YxG+dps6|7WoJc!O zw9~g8PrIsqI$=Fo5l>Ri-$ay&{BosTr0#YGkb&H2v`ygh=;x`KGR*Di9s8shxNT}P z-K&W#arRJj@(iZvHdPG_T@`CV z^nNrQ5q^2h{;CnvasGaYxCQk?646`MLk>YjGOYfC!PBCi{~eC~{J1CmE+&P(r42ii zg_-u>@^hH#2TPiL-E_0+44zIX-bc^qt^#DdRrA27arhzU!3?h}ET2(9TN3Xb6k9e& z9H<-1mEB+~KDoq7O$A*$U^u&d=1bZRCR+azK9NA~qXCYCIS2f0NBlnu(Xn8RwlI8& z361oE4v|g!7I^BHP*j93F@k02UF7iqA`s*gdZ2Lup$r-b@+;u}sK0ll|CFNP90ehC zAMFL;9_mS6NJsilI;DX&{cjl>=V6ajO%{og)!R%9mt9eZexK7^pVt{`r^o zX1cQ0LZ&ah`=%Td`3vYc%cWYI$393`-RBCml%RI)YXn6aTDQKd(foelC$#faf$7VO zCLo>YZ@lXp$C8`WiYPs@QF6kL=Q&>q(j)&qRb|3^;Wff?G9+ER4{QF^VLPfAp=RjX z?Fq<(h(jSL#B*@^yKisaOc&wkEcGq1B4ntCQp;Bb zaDjNQ!T}NMMV1q_WDmK`ml*_qBPD@1>jKinNKo z@@GT%E}_!A&biLRvHbZO~1_)n}bZv@wz|~1(lE3S~PQN;{!#fCnavV`kQ#OF1{AwF^ zn2iu$M>hG`KrCSM%#_B?MuAtloE#DfZ$SeeX$b`VY)Z86^vffdn5MDoYNi$HL~>!l^!9j&_> zKY{Z(u$tKfIq%I~sAQOg%}vc%g9!_zC%`p%;m;|s8~FcF$uzEx{ShfcUNZ+Z6*t2o zMvvjNAKJX%XV)1Bev6&6H9K#GkV#&8!6=ObwTti1T0Rvh1#lgh!QlrrY4X^WJCObi zFI|B|4Jm$w!@D^RJbmrE3f(S3*%FUdWuKObr#=LK{D6nlW!29g`#$F)^V;%dV5pA7 zc|}gso5S|d$~p09%Ay9miGU#=+rJItjPy-gYZ0Gz+3><<3~%HDuztB0bkWu-e+oA$e)uUAK!V2&Rl1ZlLHU@ujuYPcYj zxNB7Mb^{Vf^1d8NdGXOz6nyr7hfX^~^o?Q*OEo^m6G2YH_XfuW1Tr^r)$e6)p1uC2 zjw8al3OrJ5u?rxzdj8pvYcCCVU6`uZZn`ZaHkaG~0;7|G7@uIz1dB z&Q!rkkf7L0kR<3VCfPGlz;U~(I-`$o1L36|4b%iDMt;$`CnEZ-x=Z+!VV*hmwK#%W z9X-)K{x!6wP?MtIl!=k!uT?)m{vh};th1tj2(3NO-~XN#1iCEnRtWf7c|CFSpb^;@ zc~Ayb8oO(Sance|MI4iZ9!|<_tgsC44@Nip`Joc`fiv3)=Vc!^idWD9ZvUR_X8zWn z&AP?e9`D~SOD)-F>42dw^Q3&Sc=PE|evGu=j&_H-uN!6e&*pbIO{)a&Zi=RB(CO_y zoP8;cG4@;E1{m~d>aJ%dY8d!^1ztke3~8pXYo}_)Gu@^q0PY`Gj4cetG%MGSrh6*I zuTQCza9R#cMln~e)exv|F304j#7)nRN@5iJcn%s62A~m}ER&=_B>Ro+6lj9dnPy3h zmftBfR|#C>vvx!&Y@FiDLVD3b6E_R9}1K~ zfyU)J!;@k4(@pWpMKeFO80zLJcOln+ol=xOb|~wsDlnACR488I@@Ez3guGU^5N7`f zFWtWMji~((a^Eb9veGLEWu{r_A%1M-^{%J`QS_Qo(O=eHOS5aVkEz?fR? zC7c>s^pV1euq2D5Pit*zDN3$%g=9YT$tQjB*yV1gsz}?f*H(kstUFc~=V)TLC0|@+>$ls8owxMFQB*BzshLMWBP#(3 z98B=vDVgv*fxKqpFf1NZ3e-!k>1)*8Ec@WFko4r>UJ8=$%Wr#7R6ssp!O^r-?sn=Xh5+rH#YOF6#4_ZU55M_4Oe-xi* z$EeD7rXv?$q|2=NQzIuX+lt3jOcz|xo4g#s3{>DP&VT>)JA{_Ni~`s(u?^^(xIE&L z)y8&cLie>RE41Ys?$k@H7Du?Q77yx?EY{ns=8;d33%8GcJW0v;HCxHj{x(rX6urXG zi=Ui+K|QLa;pyUQT$U4NO>OO*`&_FyR(m0(XTP7~a@{hs;LB~73ZP9Gbm_?Q)x z+0@J#$dxgX53i4Y?Dm+7u|!+Jyo(u~MRP@yN3rMki00V#3#AFS_@W(V z&1ub?*j$-A&2Y?^IK|}B!GC+Kj+N{w2f~?h0(fE`TT?UILzHw};)_gJLF;%}9M6aW z#;;%OP3&*G#+|>NPI|`|oiS_fXy#1i%7piNnNehTn5{M5JlRss_HTYx@I|o0QT5}k zD8IkI=(!Qdx)%P(#Wi-ftKT`rUr7S8&t?!PEGP!dMDPEizur=6t^XU}&&HI(K2z zLaD;sX9dh$@Le23c{dTPmRk??q*tG&Kj8dR0o3W3bOk0!a}Y~^PIOjp=xSgR=zt$u zD%u*pp@uW(#f8Wd{+h8n)xw;>7q(zhiUZ!pz^MO_C<6+}$zH2M@5`-6TS1nc^z9|> z0*qR0=_IqDtI%@Qn%Xx7J#(|IP`_0v_NtJy;HGE4o1pX_7B}>aublPsnoD(TT;4C$ zC#gmy#B2gO6IzU&G2wPN{>ze8cx@X5x=o-$ylH!L=iCgk(eBV|L`U(*Wj)D;ese*;j zoUvDh+DGSUsv9+WP@jLIL5s2Etag1Ce?ble^hR?~8VUV!@?HM4HJ%6&aVCDd;({=K zsTnX0_J6o(-0%h{Bb6zGJ*}kW%qnlY(W@@3@o7FD1zO^pefQm*n~C6{q!IE5*D%pQ z99TAJ)o0K2V;O3N+dh8j5ZM_+<&d}}LZB)1dZAvvR%BcayH&*qq2D8qtU&@m8aQS$ z>!Oo3XEXm&z=!SWOuL6ZAFt4Wpk0!$*>4uvWjBXN$e#bs9H|o5br$O}*$>|pU&;ZG zC_aqtHnC;XO1yb=Pv#U`OuLv3<#FfPyJbXt!Z*ihEJsg1tnOvH;)|kCBcijL?RVRK z`H;3vWW{F-sdAfrb1!J>+}Y znj4PN779E6Mkh{xnUnkUsXOo7Kki3mGrzh@vNIXlh41J}LtzfD_>Udm&e=~wi$8^y zy*ROyVbJrt)|AQB^E-JXGxtsK-blvd)j_c!!>nV|SAB+Ai>6_Lm^r&9hkk;nR|iwk zpSsHy7ou$;lMzeud=_U=e4rYrnLK!(Q8l;C)xmeCSc;yi-~BN-$rgqhAR0_o@mLTd zq6Z^tVToax3r;%qCSXU5UvYLw-HLmcVfYK3nfFu7dp5ltgOiJ!ooO`K{3>gR%zra!RRrl(Q-;F@h*59Pyphnyb%rqK+Dk4}m+RfZ5r3no}tZv5WJw zNi~ux^0qN=02-|+5{VnVAX1|5B;~SEess_q#4^chq|q-QA=#v6%#c!2Gi=JJ z!yoB#mo=|=oqt&_;~I(0@r6u!4E?-EHx!SCSd_33LM}source

DenseAxisArray{T}(undef, axes...) where T

Construct an uninitialized DenseAxisArray with element-type T indexed over the given axes.

Example

julia> array = Containers.DenseAxisArray{Float64}(undef, [:a, :b], 1:2);
+4
source
DenseAxisArray{T}(undef, axes...) where T

Construct an uninitialized DenseAxisArray with element-type T indexed over the given axes.

Example

julia> array = Containers.DenseAxisArray{Float64}(undef, [:a, :b], 1:2);
 
 julia> fill!(array, 1.0)
 2-dimensional DenseAxisArray{Float64,2,...} with index sets:
@@ -34,7 +34,7 @@
     Dimension 2, 1:2
 And data, a 2×2 Matrix{Float64}:
  1.0  5.0
- 1.0  1.0
source

SparseAxisArray

SparseAxisArray

JuMP.Containers.SparseAxisArrayType
struct SparseAxisArray{T,N,K<:NTuple{N, Any}} <: AbstractArray{T,N}
     data::OrderedCollections.OrderedDict{K,T}
 end

N-dimensional array with elements of type T where only a subset of the entries are defined. The entries with indices idx = (i1, i2, ..., iN) in keys(data) has value data[idx].

Note that, as opposed to SparseArrays.AbstractSparseArray, the missing entries are not assumed to be zero(T), they are simply not part of the array. This means that the result of map(f, sa::SparseAxisArray) or f.(sa::SparseAxisArray) has the same sparsity structure as sa, even if f(zero(T)) is not zero.

Example

julia> using OrderedCollections: OrderedDict
 
@@ -51,7 +51,7 @@
   [b, 3]  =  3.0
 
 julia> array[:b, 3]
-3.0
source

Containers.@container

JuMP.Containers.@containerMacro
@container([i=..., j=..., ...], expr[, container = :Auto])

Create a container with indices i, j, ... and values given by expr that may depend on the value of the indices.

@container(ref[i=..., j=..., ...], expr[, container = :Auto])

Same as above but the container is assigned to the variable of name ref.

The type of container can be controlled by the container keyword.

Note

When the index set is explicitly given as 1:n for any expression n, it is transformed to Base.OneTo(n) before being given to container.

Example

julia> Containers.@container([i = 1:3, j = 1:3], i + j)
+3.0
source

Containers.@container

JuMP.Containers.@containerMacro
@container([i=..., j=..., ...], expr[, container = :Auto])

Create a container with indices i, j, ... and values given by expr that may depend on the value of the indices.

@container(ref[i=..., j=..., ...], expr[, container = :Auto])

Same as above but the container is assigned to the variable of name ref.

The type of container can be controlled by the container keyword.

Note

When the index set is explicitly given as 1:n for any expression n, it is transformed to Base.OneTo(n) before being given to container.

Example

julia> Containers.@container([i = 1:3, j = 1:3], i + j)
 3×3 Matrix{Int64}:
  2  3  4
  3  4  5
@@ -86,7 +86,7 @@
   [1, 3]  =  4
   [2, 2]  =  4
   [2, 3]  =  5
-  [3, 3]  =  6
source

Containers.container

JuMP.Containers.containerFunction
container(f::Function, indices[[, ::Type{C} = AutoContainerType], names])

Create a container of type C with index names names, indices indices and values at given indices given by f.

If the method with names is not specialized on Type{C}, it falls back to calling container(f, indices, c) for backwards compatibility with containers not supporting index names.

Example

julia> Containers.container((i, j) -> i + j, Containers.vectorized_product(Base.OneTo(3), Base.OneTo(3)))
+  [3, 3]  =  6
source

Containers.container

JuMP.Containers.containerFunction
container(f::Function, indices[[, ::Type{C} = AutoContainerType], names])

Create a container of type C with index names names, indices indices and values at given indices given by f.

If the method with names is not specialized on Type{C}, it falls back to calling container(f, indices, c) for backwards compatibility with containers not supporting index names.

Example

julia> Containers.container((i, j) -> i + j, Containers.vectorized_product(Base.OneTo(3), Base.OneTo(3)))
 3×3 Matrix{Int64}:
  2  3  4
  3  4  5
@@ -115,7 +115,7 @@
   [1, 2]  =  3
   [1, 3]  =  4
   [2, 3]  =  5
-  [3, 3]  =  6
source

Containers.rowtable

JuMP.Containers.rowtableFunction
rowtable([f::Function=identity,] x; [header::Vector{Symbol} = Symbol[]])

Applies the function f to all elements of the variable container x, returning the result as a Vector of NamedTuples, where header is a vector containing the corresponding axis names.

If x is an N-dimensional array, there must be N+1 names, so that the last name corresponds to the result of f(x[i]).

If header is left empty, then the default header is [:x1, :x2, ..., :xN, :y].

Info

A Vector of NamedTuples implements the Tables.jl interface, and so the result can be used as input for any function that consumes a 'Tables.jl' compatible source.

Example

julia> model = Model();
+  [3, 3]  =  6
source

Containers.rowtable

JuMP.Containers.rowtableFunction
rowtable([f::Function=identity,] x; [header::Vector{Symbol} = Symbol[]])

Applies the function f to all elements of the variable container x, returning the result as a Vector of NamedTuples, where header is a vector containing the corresponding axis names.

If x is an N-dimensional array, there must be N+1 names, so that the last name corresponds to the result of f(x[i]).

If header is left empty, then the default header is [:x1, :x2, ..., :xN, :y].

Info

A Vector of NamedTuples implements the Tables.jl interface, and so the result can be used as input for any function that consumes a 'Tables.jl' compatible source.

Example

julia> model = Model();
 
 julia> @variable(model, x[i=1:2, j=i:2] >= 0, start = i+j);
 
@@ -129,7 +129,7 @@
 3-element Vector{@NamedTuple{x1::Int64, x2::Int64, y::VariableRef}}:
  (x1 = 1, x2 = 1, y = x[1,1])
  (x1 = 1, x2 = 2, y = x[1,2])
- (x1 = 2, x2 = 2, y = x[2,2])
source

Containers.default_container

Containers.nested

Containers.default_container

Containers.nested

JuMP.Containers.nestedFunction
nested(iterators...; condition = (args...) -> true)

Create a NestedIterator.

Example

julia> iterator = Containers.nested(
            () -> 1:2,
            (i,) -> ["A", "B"];
            condition = (i, j) -> isodd(i) || j == "B",
@@ -139,21 +139,21 @@
 3-element Vector{Tuple{Int64, String}}:
  (1, "A")
  (1, "B")
- (2, "B")
source

Containers.vectorized_product

Containers.vectorized_product

Containers.build_error_fn

JuMP.Containers.build_error_fnFunction
build_error_fn(macro_name, args, source)

Return a function that can be used in place of Base.error, but which additionally prints the macro from which it was called.

source

Containers.parse_macro_arguments

Containers.build_error_fn

JuMP.Containers.build_error_fnFunction
build_error_fn(macro_name, args, source)

Return a function that can be used in place of Base.error, but which additionally prints the macro from which it was called.

source

Containers.parse_macro_arguments

JuMP.Containers.parse_macro_argumentsFunction
parse_macro_arguments(
     error_fn::Function,
     args;
     valid_kwargs::Union{Nothing,Vector{Symbol}} = nothing,
     num_positional_args::Union{Nothing,Int,UnitRange{Int}} = nothing,
-)

Returns a Tuple{Vector{Any},Dict{Symbol,Any}} containing the ordered positional arguments and a dictionary mapping the keyword arguments.

This specially handles the distinction of @foo(key = value) and @foo(; key = value) in macros.

An error is thrown if multiple keyword arguments are passed with the same key.

If valid_kwargs is a Vector{Symbol}, an error is thrown if a keyword is not in valid_kwargs.

If num_positional_args is not nothing, an error is thrown if the number of positional arguments is not in num_positional_args.

source

Containers.parse_ref_sets

JuMP.Containers.parse_ref_setsFunction
parse_ref_sets(
+)

Returns a Tuple{Vector{Any},Dict{Symbol,Any}} containing the ordered positional arguments and a dictionary mapping the keyword arguments.

This specially handles the distinction of @foo(key = value) and @foo(; key = value) in macros.

An error is thrown if multiple keyword arguments are passed with the same key.

If valid_kwargs is a Vector{Symbol}, an error is thrown if a keyword is not in valid_kwargs.

If num_positional_args is not nothing, an error is thrown if the number of positional arguments is not in num_positional_args.

source

Containers.parse_ref_sets

JuMP.Containers.parse_ref_setsFunction
parse_ref_sets(
     error_fn::Function,
     expr;
     invalid_index_variables::Vector{Symbol} = Symbol[],
-)

Helper function for macros to construct container objects.

Warning

This function is for advanced users implementing JuMP extensions. See container_code for more details.

Arguments

  • error_fn: a function that takes a String and throws an error, potentially annotating the input string with extra information such as from which macro it was thrown from. Use error if you do not want a modified error message.
  • expr: an Expr that specifies the container, for example, :(x[i = 1:3, [:red, :blue], k = S; i + k <= 6])

Returns

  1. name: the name of the container, if given, otherwise nothing
  2. index_vars: a Vector{Any} of names for the index variables, for example, [:i, gensym(), :k]. These may also be expressions, like :((i, j)) from a call like :(x[(i, j) in S]).
  3. indices: an iterator over the indices, for example, Containers.NestedIterator

Example

See container_code for a worked example.

source

Containers.build_name_expr

JuMP.Containers.build_name_exprFunction
build_name_expr(
+)

Helper function for macros to construct container objects.

Warning

This function is for advanced users implementing JuMP extensions. See container_code for more details.

Arguments

  • error_fn: a function that takes a String and throws an error, potentially annotating the input string with extra information such as from which macro it was thrown from. Use error if you do not want a modified error message.
  • expr: an Expr that specifies the container, for example, :(x[i = 1:3, [:red, :blue], k = S; i + k <= 6])

Returns

  1. name: the name of the container, if given, otherwise nothing
  2. index_vars: a Vector{Any} of names for the index variables, for example, [:i, gensym(), :k]. These may also be expressions, like :((i, j)) from a call like :(x[(i, j) in S]).
  3. indices: an iterator over the indices, for example, Containers.NestedIterator

Example

See container_code for a worked example.

source

Containers.build_name_expr

JuMP.Containers.build_name_exprFunction
build_name_expr(
     name::Union{Symbol,Nothing},
     index_vars::Vector,
     kwargs::Dict{Symbol,Any},
@@ -164,12 +164,12 @@
 ""
 
 julia> Containers.build_name_expr(:y, [:i, :j], Dict{Symbol,Any}(:base_name => "y"))
-:(string("y", "[", string($(Expr(:escape, :i))), ",", string($(Expr(:escape, :j))), "]"))
source

Containers.add_additional_args

Containers.add_additional_args

JuMP.Containers.add_additional_argsFunction
add_additional_args(
     call::Expr,
     args::Vector,
     kwargs::Dict{Symbol,Any};
     kwarg_exclude::Vector{Symbol} = Symbol[],
-)

Add the positional arguments args to the function call expression call, escaping each argument expression.

This function is able to incorporate additional positional arguments to calls that already have keyword arguments.

source

Containers.container_code

JuMP.Containers.container_codeFunction
container_code(
+)

Add the positional arguments args to the function call expression call, escaping each argument expression.

This function is able to incorporate additional positional arguments to calls that already have keyword arguments.

source

Containers.container_code

JuMP.Containers.container_codeFunction
container_code(
     index_vars::Vector{Any},
     indices::Expr,
     code,
@@ -194,7 +194,7 @@
     Dimension 2, ["A", "B"]
 And data, a 2×2 Matrix{String}:
  "A"   "B"
- "AA"  "BB"
source

Containers.AutoContainerType

Containers.NestedIterator

Containers.AutoContainerType

Containers.NestedIterator

JuMP.Containers.NestedIteratorType
struct NestedIterator{T}
     iterators::T # Tuple of functions
     condition::Function
 end

Iterators over the tuples that are produced by a nested for loop.

Construct a NestedIterator using nested.

Example

julia> iterators = (() -> 1:2, (i,) -> ["A", "B"]);
@@ -217,6 +217,6 @@
        end
 (1, "A")
 (1, "B")
-(2, "B")
source

Containers.VectorizedProductIterator

Containers.VectorizedProductIterator

+end

A wrapper type for Iterators.ProuctIterator that discards shape information and returns a Vector.

Construct a VectorizedProductIterator using vectorized_product.

source diff --git a/previews/PR3838/api/JuMP/index.html b/previews/PR3838/api/JuMP/index.html index b687bbbcb65..1d2615316a7 100644 --- a/previews/PR3838/api/JuMP/index.html +++ b/previews/PR3838/api/JuMP/index.html @@ -15,7 +15,7 @@ julia> @build_constraint(x .>= 0) 2-element Vector{ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}}: ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}(x[1], MathOptInterface.GreaterThan{Float64}(-0.0)) - ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}(x[2], MathOptInterface.GreaterThan{Float64}(-0.0))source

@constraint

JuMP.@constraintMacro
@constraint(model, expr, args...; kwargs...)
+ ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}(x[2], MathOptInterface.GreaterThan{Float64}(-0.0))
source

@constraint

JuMP.@constraintMacro
@constraint(model, expr, args...; kwargs...)
 @constraint(model, [index_sets...], expr, args...; kwargs...)
 @constraint(model, name, expr, args...; kwargs...)
 @constraint(model, name[index_sets...], expr, args...; kwargs...)

Add a constraint described by the expression expr.

The name argument is optional. If index sets are passed, a container is built and the constraint may depend on the indices of the index sets.

The expression expr may be one of following forms:

  • func in set, constraining the function func to belong to the set set, which is either a MOI.AbstractSet or one of the JuMP shortcuts like SecondOrderCone or PSDCone

  • a <op> b, where <op> is one of ==, , >=, , <=

  • l <= f <= u or u >= f >= l, constraining the expression f to lie between l and u

  • f(x) ⟂ x, which defines a complementarity constraint

  • z --> {expr}, which defines an indicator constraint that activates when z is 1

  • !z --> {expr}, which defines an indicator constraint that activates when z is 0

  • z <--> {expr}, which defines a reified constraint

  • expr := rhs, which defines a Boolean equality constraint

Broadcasted comparison operators like .== are also supported for the case when the left- and right-hand sides of the comparison operator are arrays.

JuMP extensions may additionally provide support for constraint expressions which are not listed here.

Keyword arguments

  • base_name: sets the name prefix used to generate constraint names. It corresponds to the constraint name for scalar constraints, otherwise, the constraint names are set to base_name[...] for each index ....

  • container = :Auto: force the container type by passing container = Array,

container = DenseAxisArray, container = SparseAxisArray, or any another container type which is supported by a JuMP extension.

  • set_string_name::Bool = true: control whether to set the MOI.ConstraintName attribute. Passing set_string_name = false can improve performance.

Other keyword arguments may be supported by JuMP extensions.

Example

julia> model = Model();
@@ -52,7 +52,7 @@
 z --> {x[1] ≥ 0}
 
 julia> @constraint(model, !z --> {2 * x[2] <= 3})
-!z --> {2 x[2] ≤ 3}
source

@constraints

JuMP.@constraintsMacro
@constraints(model, args...)

Adds groups of constraints at once, in the same fashion as the @constraint macro.

The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the constraints that were defined.

Example

julia> model = Model();
+!z --> {2 x[2] ≤ 3}
source

@constraints

JuMP.@constraintsMacro
@constraints(model, args...)

Adds groups of constraints at once, in the same fashion as the @constraint macro.

The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the constraints that were defined.

Example

julia> model = Model();
 
 julia> @variable(model, w);
 
@@ -75,7 +75,7 @@
  sum_to_one[2] : y + z[2] = 1
  sum_to_one[3] : y + z[3] = 1
  x ≥ 1
- -w + y ≤ 2
source

@expression

@expression

JuMP.@expressionMacro
@expression(model::GenericModel, expression)
 @expression(model::GenericModel, [index_sets...], expression)
 @expression(model::GenericModel, name, expression)
 @expression(model::GenericModel, name[index_sets...], expression)

Efficiently builds and returns an expression.

The name argument is optional. If index sets are passed, a container is built and the expression may depend on the indices of the index sets.

Keyword arguments

  • container = :Auto: force the container type by passing container = Array, container = DenseAxisArray, container = SparseAxisArray, or any another container type which is supported by a JuMP extension.

Example

julia> model = Model();
@@ -102,7 +102,7 @@
 3-element Vector{AffExpr}:
  x[1] + x[2] + x[3]
  2 x[1] + 2 x[2] + 2 x[3]
- 3 x[1] + 3 x[2] + 3 x[3]
source

@expressions

JuMP.@expressionsMacro
@expressions(model, args...)

Adds multiple expressions to model at once, in the same fashion as the @expression macro.

The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the expressions that were defined.

Example

julia> model = Model();
+ 3 x[1] + 3 x[2] + 3 x[3]
source

@expressions

JuMP.@expressionsMacro
@expressions(model, args...)

Adds multiple expressions to model at once, in the same fashion as the @expression macro.

The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the expressions that were defined.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -116,7 +116,7 @@
            my_expr, x^2 + y^2
            my_expr_1[i = 1:2], a[i] - z[i]
        end)
-(x² + y², AffExpr[-z[1] + 4, -z[2] + 5])
source

@force_nonlinear

JuMP.@force_nonlinearMacro
@force_nonlinear(expr)

Change the parsing of expr to construct GenericNonlinearExpr instead of GenericAffExpr or GenericQuadExpr.

This macro works by walking expr and substituting all calls to +, -, *, /, and ^ in favor of ones that construct GenericNonlinearExpr.

This macro will error if the resulting expression does not produce a GenericNonlinearExpr because, for example, it is used on an expression that does not use the basic arithmetic operators.

When to use this macro

In most cases, you should not use this macro.

Use this macro only if the intended output type is a GenericNonlinearExpr and the regular macro calls destroy problem structure, or in rare cases, if the regular macro calls introduce a large amount of intermediate variables, for example, because they promote types to a common quadratic expression.

Example

Use-case one: preserve problem structure.

julia> model = Model();
+(x² + y², AffExpr[-z[1] + 4, -z[2] + 5])
source

@force_nonlinear

JuMP.@force_nonlinearMacro
@force_nonlinear(expr)

Change the parsing of expr to construct GenericNonlinearExpr instead of GenericAffExpr or GenericQuadExpr.

This macro works by walking expr and substituting all calls to +, -, *, /, and ^ in favor of ones that construct GenericNonlinearExpr.

This macro will error if the resulting expression does not produce a GenericNonlinearExpr because, for example, it is used on an expression that does not use the basic arithmetic operators.

When to use this macro

In most cases, you should not use this macro.

Use this macro only if the intended output type is a GenericNonlinearExpr and the regular macro calls destroy problem structure, or in rare cases, if the regular macro calls introduce a large amount of intermediate variables, for example, because they promote types to a common quadratic expression.

Example

Use-case one: preserve problem structure.

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -144,7 +144,7 @@
 3200
 
 julia> @allocated @expression(model, @force_nonlinear(x * 2.0 * (1 + x) * x))
-640
source

@objective

JuMP.@objectiveMacro
@objective(model::GenericModel, sense, func)

Set the objective sense to sense and objective function to func.

The objective sense can be either Min, Max, MOI.MIN_SENSE, MOI.MAX_SENSE or MOI.FEASIBILITY_SENSE. In order to set the sense programmatically, that is, when sense is a variable whose value is the sense, one of the three MOI.OptimizationSense values must be used.

Example

Minimize the value of the variable x, do:

julia> model = Model();
+640
source

@objective

JuMP.@objectiveMacro
@objective(model::GenericModel, sense, func)

Set the objective sense to sense and objective function to func.

The objective sense can be either Min, Max, MOI.MIN_SENSE, MOI.MAX_SENSE or MOI.FEASIBILITY_SENSE. In order to set the sense programmatically, that is, when sense is a variable whose value is the sense, one of the three MOI.OptimizationSense values must be used.

Example

Minimize the value of the variable x, do:

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -165,7 +165,7 @@
 MIN_SENSE::OptimizationSense = 0
 
 julia> @objective(model, sense, x^2 - 2x + 1)
-x² - 2 x + 1
source

@operator

JuMP.@operatorMacro
@operator(model, operator, dim, f[, ∇f[, ∇²f]])

Add the nonlinear operator operator in model with dim arguments, and create a new NonlinearOperator object called operator in the current scope.

The function f evaluates the operator and must return a scalar.

The optional function ∇f evaluates the first derivative, and the optional function ∇²f evaluates the second derivative.

∇²f may be provided only if ∇f is also provided.

Univariate syntax

If dim == 1, then the method signatures of each function must be:

  • f(::T)::T where {T<:Real}
  • ∇f(::T)::T where {T<:Real}
  • ∇²f(::T)::T where {T<:Real}

Multivariate syntax

If dim > 1, then the method signatures of each function must be:

  • f(x::T...)::T where {T<:Real}
  • ∇f(g::AbstractVector{T}, x::T...)::Nothing where {T<:Real}
  • ∇²f(H::AbstractMatrix{T}, x::T...)::Nothing where {T<:Real}

Where the gradient vector g and Hessian matrix H are filled in-place. For the Hessian, you must fill in the non-zero lower-triangular entries only. Setting an off-diagonal upper-triangular element may error.

Example

julia> model = Model();
+x² - 2 x + 1
source

@operator

JuMP.@operatorMacro
@operator(model, operator, dim, f[, ∇f[, ∇²f]])

Add the nonlinear operator operator in model with dim arguments, and create a new NonlinearOperator object called operator in the current scope.

The function f evaluates the operator and must return a scalar.

The optional function ∇f evaluates the first derivative, and the optional function ∇²f evaluates the second derivative.

∇²f may be provided only if ∇f is also provided.

Univariate syntax

If dim == 1, then the method signatures of each function must be:

  • f(::T)::T where {T<:Real}
  • ∇f(::T)::T where {T<:Real}
  • ∇²f(::T)::T where {T<:Real}

Multivariate syntax

If dim > 1, then the method signatures of each function must be:

  • f(x::T...)::T where {T<:Real}
  • ∇f(g::AbstractVector{T}, x::T...)::Nothing where {T<:Real}
  • ∇²f(H::AbstractMatrix{T}, x::T...)::Nothing where {T<:Real}

Where the gradient vector g and Hessian matrix H are filled in-place. For the Hessian, you must fill in the non-zero lower-triangular entries only. Setting an off-diagonal upper-triangular element may error.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -204,7 +204,7 @@
 f (generic function with 1 method)
 
 julia> op_f = model[:op_f] = add_nonlinear_operator(model, 1, f; name = :op_f)
-NonlinearOperator(f, :op_f)
source

@variable

JuMP.@variableMacro
@variable(model, expr, args..., kw_args...)

Add a variable to the model model described by the expression expr, the positional arguments args and the keyword arguments kw_args.

Anonymous and named variables

expr must be one of the forms:

  • Omitted, like @variable(model), which creates an anonymous variable
  • A single symbol like @variable(model, x)
  • A container expression like @variable(model, x[i=1:3])
  • An anonymous container expression like @variable(model, [i=1:3])

Bounds

In addition, the expression can have bounds, such as:

  • @variable(model, x >= 0)
  • @variable(model, x <= 0)
  • @variable(model, x == 0)
  • @variable(model, 0 <= x <= 1)

and bounds can depend on the indices of the container expressions:

  • @variable(model, -i <= x[i=1:3] <= i)

Sets

You can explicitly specify the set to which the variable belongs:

  • @variable(model, x in MOI.Interval(0.0, 1.0))

For more information on this syntax, read Variables constrained on creation.

Positional arguments

The recognized positional arguments in args are the following:

  • Bin: restricts the variable to the MOI.ZeroOne set, that is, {0, 1}. For example, @variable(model, x, Bin). Note: you cannot use @variable(model, Bin), use the binary keyword instead.
  • Int: restricts the variable to the set of integers, that is, ..., -2, -1, 0, 1, 2, ... For example, @variable(model, x, Int). Note: you cannot use @variable(model, Int), use the integer keyword instead.
  • Symmetric: Only available when creating a square matrix of variables, that is when expr is of the form varname[1:n,1:n] or varname[i=1:n,j=1:n], it creates a symmetric matrix of variables.
  • PSD: A restrictive extension to Symmetric which constraints a square matrix of variables to Symmetric and constrains to be positive semidefinite.

Keyword arguments

Four keyword arguments are useful in all cases:

  • base_name: Sets the name prefix used to generate variable names. It corresponds to the variable name for scalar variable, otherwise, the variable names are set to base_name[...] for each index ... of the axes axes.
  • start::Float64: specify the value passed to set_start_value for each variable
  • container: specify the container type. See Forcing the container type for more information.
  • set_string_name::Bool = true: control whether to set the MOI.VariableName attribute. Passing set_string_name = false can improve performance.

Other keyword arguments are needed to disambiguate sitations with anonymous variables:

  • lower_bound::Float64: an alternative to x >= lb, sets the value of the variable lower bound.
  • upper_bound::Float64: an alternative to x <= ub, sets the value of the variable upper bound.
  • binary::Bool: an alternative to passing Bin, sets whether the variable is binary or not.
  • integer::Bool: an alternative to passing Int, sets whether the variable is integer or not.
  • set::MOI.AbstractSet: an alternative to using x in set
  • variable_type: used by JuMP extensions. See Extend @variable for more information.

Example

The following are equivalent ways of creating a variable x of name x with lower bound 0:

julia> model = Model();
+NonlinearOperator(f, :op_f)
source

@variable

JuMP.@variableMacro
@variable(model, expr, args..., kw_args...)

Add a variable to the model model described by the expression expr, the positional arguments args and the keyword arguments kw_args.

Anonymous and named variables

expr must be one of the forms:

  • Omitted, like @variable(model), which creates an anonymous variable
  • A single symbol like @variable(model, x)
  • A container expression like @variable(model, x[i=1:3])
  • An anonymous container expression like @variable(model, [i=1:3])

Bounds

In addition, the expression can have bounds, such as:

  • @variable(model, x >= 0)
  • @variable(model, x <= 0)
  • @variable(model, x == 0)
  • @variable(model, 0 <= x <= 1)

and bounds can depend on the indices of the container expressions:

  • @variable(model, -i <= x[i=1:3] <= i)

Sets

You can explicitly specify the set to which the variable belongs:

  • @variable(model, x in MOI.Interval(0.0, 1.0))

For more information on this syntax, read Variables constrained on creation.

Positional arguments

The recognized positional arguments in args are the following:

  • Bin: restricts the variable to the MOI.ZeroOne set, that is, {0, 1}. For example, @variable(model, x, Bin). Note: you cannot use @variable(model, Bin), use the binary keyword instead.
  • Int: restricts the variable to the set of integers, that is, ..., -2, -1, 0, 1, 2, ... For example, @variable(model, x, Int). Note: you cannot use @variable(model, Int), use the integer keyword instead.
  • Symmetric: Only available when creating a square matrix of variables, that is when expr is of the form varname[1:n,1:n] or varname[i=1:n,j=1:n], it creates a symmetric matrix of variables.
  • PSD: A restrictive extension to Symmetric which constraints a square matrix of variables to Symmetric and constrains to be positive semidefinite.

Keyword arguments

Four keyword arguments are useful in all cases:

  • base_name: Sets the name prefix used to generate variable names. It corresponds to the variable name for scalar variable, otherwise, the variable names are set to base_name[...] for each index ... of the axes axes.
  • start::Float64: specify the value passed to set_start_value for each variable
  • container: specify the container type. See Forcing the container type for more information.
  • set_string_name::Bool = true: control whether to set the MOI.VariableName attribute. Passing set_string_name = false can improve performance.

Other keyword arguments are needed to disambiguate sitations with anonymous variables:

  • lower_bound::Float64: an alternative to x >= lb, sets the value of the variable lower bound.
  • upper_bound::Float64: an alternative to x <= ub, sets the value of the variable upper bound.
  • binary::Bool: an alternative to passing Bin, sets whether the variable is binary or not.
  • integer::Bool: an alternative to passing Int, sets whether the variable is integer or not.
  • set::MOI.AbstractSet: an alternative to using x in set
  • variable_type: used by JuMP extensions. See Extend @variable for more information.

Example

The following are equivalent ways of creating a variable x of name x with lower bound 0:

julia> model = Model();
 
 julia> @variable(model, x >= 0)
 x
julia> model = Model();
@@ -233,14 +233,14 @@
 3-element Vector{VariableRef}:
  _[7]
  _[8]
- _[9]
source

@variables

JuMP.@variablesMacro
@variables(model, args...)

Adds multiple variables to model at once, in the same fashion as the @variable macro.

The model must be the first argument, and multiple variables can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the variables that were defined.

Example

julia> model = Model();
+ _[9]
source

@variables

JuMP.@variablesMacro
@variables(model, args...)

Adds multiple variables to model at once, in the same fashion as the @variable macro.

The model must be the first argument, and multiple variables can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the variables that were defined.

Example

julia> model = Model();
 
 julia> @variables(model, begin
            x
            y[i = 1:2] >= 0, (start = i)
            z, Bin, (start = 0, base_name = "Z")
        end)
-(x, VariableRef[y[1], y[2]], Z)
Note

Keyword arguments must be contained within parentheses (refer to the example above).

source

add_bridge

JuMP.add_bridgeFunction
add_bridge(
+(x, VariableRef[y[1], y[2]], Z)
Note

Keyword arguments must be contained within parentheses (refer to the example above).

source

add_bridge

JuMP.add_bridgeFunction
add_bridge(
     model::GenericModel{T},
     BT::Type{<:MOI.Bridges.AbstractBridge};
     coefficient_type::Type{S} = T,
@@ -252,11 +252,11 @@
            model,
            MOI.Bridges.Constraint.NumberConversionBridge;
            coefficient_type = Complex{Float64}
-       )
source

add_constraint

add_constraint

JuMP.add_constraintFunction
add_constraint(
     model::GenericModel,
     con::AbstractConstraint,
     name::String= "",
-)

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

add_nonlinear_operator

JuMP.add_nonlinear_operatorFunction
add_nonlinear_operator(
+)

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

add_nonlinear_operator

add_to_expression!

JuMP.add_to_expression!Function
add_to_expression!(expression, terms...)

Updates expression in-place to expression + (*)(terms...).

This is typically much more efficient than expression += (*)(terms...) because it avoids the temorary allocation of the right-hand side term.

For example, add_to_expression!(expression, a, b) produces the same result as expression += a*b, and add_to_expression!(expression, a) produces the same result as expression += a.

When to implement

Only a few methods are defined, mostly for internal use, and only for the cases when:

  1. they can be implemented efficiently
  2. expression is capable of storing the result. For example, add_to_expression!(::AffExpr, ::GenericVariableRef, ::GenericVariableRef) is not defined because a GenericAffExpr cannot store the product of two variables.

Example

julia> model = Model();
+4.0
source

add_to_expression!

JuMP.add_to_expression!Function
add_to_expression!(expression, terms...)

Updates expression in-place to expression + (*)(terms...).

This is typically much more efficient than expression += (*)(terms...) because it avoids the temorary allocation of the right-hand side term.

For example, add_to_expression!(expression, a, b) produces the same result as expression += a*b, and add_to_expression!(expression, a) produces the same result as expression += a.

When to implement

Only a few methods are defined, mostly for internal use, and only for the cases when:

  1. they can be implemented efficiently
  2. expression is capable of storing the result. For example, add_to_expression!(::AffExpr, ::GenericVariableRef, ::GenericVariableRef) is not defined because a GenericAffExpr cannot store the product of two variables.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -296,7 +296,7 @@
 4 x + 2
 
 julia> expr
-4 x + 2
source

add_to_function_constant

JuMP.add_to_function_constantFunction
add_to_function_constant(constraint::ConstraintRef, value)

Add value to the function constant term of constraint.

Note that for scalar constraints, JuMP will aggregate all constant terms onto the right-hand side of the constraint so instead of modifying the function, the set will be translated by -value. For example, given a constraint 2x <= 3, add_to_function_constant(c, 4) will modify it to 2x <= -1.

Example

For scalar constraints, the set is translated by -value:

julia> model = Model();
+4 x + 2
source

add_to_function_constant

JuMP.add_to_function_constantFunction
add_to_function_constant(constraint::ConstraintRef, value)

Add value to the function constant term of constraint.

Note that for scalar constraints, JuMP will aggregate all constant terms onto the right-hand side of the constraint so instead of modifying the function, the set will be translated by -value. For example, given a constraint 2x <= 3, add_to_function_constant(c, 4) will modify it to 2x <= -1.

Example

For scalar constraints, the set is translated by -value:

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -318,7 +318,7 @@
 julia> add_to_function_constant(con, [1, 2, 2])
 
 julia> con
-con : [x + y + 1, x + 2, y + 2] ∈ MathOptInterface.SecondOrderCone(3)
source

add_variable

JuMP.add_variableFunction
add_variable(m::GenericModel, v::AbstractVariable, name::String = "")

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

all_constraints

JuMP.all_constraintsFunction
all_constraints(model::GenericModel, function_type, set_type)::Vector{<:ConstraintRef}

Return a list of all constraints currently in the model where the function has type function_type and the set has type set_type. The constraints are ordered by creation time.

See also list_of_constraint_types and num_constraints.

Example

julia> model = Model();
+con : [x + y + 1, x + 2, y + 2] ∈ MathOptInterface.SecondOrderCone(3)
source

add_variable

JuMP.add_variableFunction
add_variable(m::GenericModel, v::AbstractVariable, name::String = "")

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

all_constraints

JuMP.all_constraintsFunction
all_constraints(model::GenericModel, function_type, set_type)::Vector{<:ConstraintRef}

Return a list of all constraints currently in the model where the function has type function_type and the set has type set_type. The constraints are ordered by creation time.

See also list_of_constraint_types and num_constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0, Bin);
 
@@ -334,7 +334,7 @@
 
 julia> all_constraints(model, AffExpr, MOI.LessThan{Float64})
 1-element Vector{ConstraintRef{Model, MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.LessThan{Float64}}, ScalarShape}}:
- 2 x ≤ 1
source
all_constraints(
+ 2 x ≤ 1
source
all_constraints(
     model::GenericModel;
     include_variable_in_set_constraints::Bool,
 )::Vector{ConstraintRef}

Return a list of all constraints in model.

If include_variable_in_set_constraints == true, then VariableRef constraints such as VariableRef-in-Integer are included. To return only the structural constraints (for example, the rows in the constraint matrix of a linear program), pass include_variable_in_set_constraints = false.

Example

julia> model = Model();
@@ -355,7 +355,7 @@
 julia> all_constraints(model; include_variable_in_set_constraints = false)
 2-element Vector{ConstraintRef}:
  2 x ≤ 1
- x ^ 2.0 - 1.0 ≤ 0

Performance considerations

Note that this function is type-unstable because it returns an abstractly typed vector. If performance is a problem, consider using list_of_constraint_types and a function barrier. See the Performance tips for extensions section of the documentation for more details.

source

all_variables

JuMP.all_variablesFunction
all_variables(model::GenericModel{T})::Vector{GenericVariableRef{T}} where {T}

Returns a list of all variables currently in the model. The variables are ordered by creation time.

Example

julia> model = Model();
+ x ^ 2.0 - 1.0 ≤ 0

Performance considerations

Note that this function is type-unstable because it returns an abstractly typed vector. If performance is a problem, consider using list_of_constraint_types and a function barrier. See the Performance tips for extensions section of the documentation for more details.

source

all_variables

JuMP.all_variablesFunction
all_variables(model::GenericModel{T})::Vector{GenericVariableRef{T}} where {T}

Returns a list of all variables currently in the model. The variables are ordered by creation time.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -364,12 +364,12 @@
 julia> all_variables(model)
 2-element Vector{VariableRef}:
  x
- y
source

anonymous_name

JuMP.anonymous_nameFunction
anonymous_name(::MIME, x::AbstractVariableRef)

The name to use for an anonymous variable x when printing.

Example

julia> model = Model();
+ y
source

anonymous_name

JuMP.anonymous_nameFunction
anonymous_name(::MIME, x::AbstractVariableRef)

The name to use for an anonymous variable x when printing.

Example

julia> model = Model();
 
 julia> x = @variable(model);
 
 julia> anonymous_name(MIME("text/plain"), x)
-"_[1]"
source

backend

JuMP.backendFunction
backend(model::GenericModel)

Return the lower-level MathOptInterface model that sits underneath JuMP. This model depends on which operating mode JuMP is in (see mode).

  • If JuMP is in DIRECT mode (that is, the model was created using direct_model), the backend will be the optimizer passed to direct_model.
  • If JuMP is in MANUAL or AUTOMATIC mode, the backend is a MOI.Utilities.CachingOptimizer.

Use index to get the index of a variable or constraint in the backend model.

Warning

This function should only be used by advanced users looking to access low-level MathOptInterface or solver-specific functionality.

Notes

If JuMP is not in DIRECT mode, the type returned by backend may change between any JuMP releases. Therefore, only use the public API exposed by MathOptInterface, and do not access internal fields. If you require access to the innermost optimizer, see unsafe_backend. Alternatively, use direct_model to create a JuMP model in DIRECT mode.

See also: unsafe_backend.

Example

julia> import HiGHS
+"_[1]"
source

backend

JuMP.backendFunction
backend(model::GenericModel)

Return the lower-level MathOptInterface model that sits underneath JuMP. This model depends on which operating mode JuMP is in (see mode).

  • If JuMP is in DIRECT mode (that is, the model was created using direct_model), the backend will be the optimizer passed to direct_model.
  • If JuMP is in MANUAL or AUTOMATIC mode, the backend is a MOI.Utilities.CachingOptimizer.

Use index to get the index of a variable or constraint in the backend model.

Warning

This function should only be used by advanced users looking to access low-level MathOptInterface or solver-specific functionality.

Notes

If JuMP is not in DIRECT mode, the type returned by backend may change between any JuMP releases. Therefore, only use the public API exposed by MathOptInterface, and do not access internal fields. If you require access to the innermost optimizer, see unsafe_backend. Alternatively, use direct_model to create a JuMP model in DIRECT mode.

See also: unsafe_backend.

Example

julia> import HiGHS
 
 julia> model = direct_model(HiGHS.Optimizer());
 
@@ -382,7 +382,7 @@
 A HiGHS model with 1 columns and 0 rows.
 
 julia> index(x)
-MOI.VariableIndex(1)
source

barrier_iterations

JuMP.barrier_iterationsFunction
barrier_iterations(model::GenericModel)

If available, returns the cumulative number of barrier iterations during the most-recent optimization (the MOI.BarrierIterations attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
+MOI.VariableIndex(1)
source

barrier_iterations

JuMP.barrier_iterationsFunction
barrier_iterations(model::GenericModel)

If available, returns the cumulative number of barrier iterations during the most-recent optimization (the MOI.BarrierIterations attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -391,7 +391,7 @@
 julia> optimize!(model)
 
 julia> barrier_iterations(model)
-0
source

bridge_constraints

JuMP.bridge_constraintsFunction
bridge_constraints(model::GenericModel)

When in direct mode, return false.

When in manual or automatic mode, return a Bool indicating whether the optimizer is set and unsupported constraints are automatically bridged to equivalent supported constraints when an appropriate transformation is available.

Example

julia> import Ipopt
+0
source

bridge_constraints

JuMP.bridge_constraintsFunction
bridge_constraints(model::GenericModel)

When in direct mode, return false.

When in manual or automatic mode, return a Bool indicating whether the optimizer is set and unsupported constraints are automatically bridged to equivalent supported constraints when an appropriate transformation is available.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -401,14 +401,14 @@
 julia> model = Model(Ipopt.Optimizer; add_bridges = false);
 
 julia> bridge_constraints(model)
-false
source

build_constraint

JuMP.build_constraintFunction
build_constraint(error_fn::Function, func, set, args...; kwargs...)

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

build_variable

build_constraint

JuMP.build_constraintFunction
build_constraint(error_fn::Function, func, set, args...; kwargs...)

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

build_variable

JuMP.build_variableFunction
build_variable(
     error_fn::Function,
     info::VariableInfo,
     args...;
     kwargs...,
 )

Return a new AbstractVariable object.

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

Arguments

  • error_fn: a function to call instead of error. error_fn annotates the error message with additional information for the user.
  • info: an instance of VariableInfo. This has a variety of fields relating to the variable such as info.lower_bound and info.binary.
  • args: optional additional positional arguments for extending the @variable macro.
  • kwargs: optional keyword arguments for extending the @variable macro.

See also: @variable

Warning

Extensions should define a method with ONE positional argument to dispatch the call to a different method. Creating an extension that relies on multiple positional arguments leads to MethodErrors if the user passes the arguments in the wrong order.

Example

@variable(model, x, Foo)

will call

build_variable(error_fn::Function, info::VariableInfo, ::Type{Foo})

Passing special-case positional arguments such as Bin, Int, and PSD is okay, along with keyword arguments:

@variable(model, x, Int, Foo(), mykwarg = true)
 # or
-@variable(model, x, Foo(), Int, mykwarg = true)

will call

build_variable(error_fn::Function, info::VariableInfo, ::Foo; mykwarg)

and info.integer will be true.

Note that the order of the positional arguments does not matter.

source

callback_node_status

JuMP.callback_node_statusFunction
callback_node_status(cb_data, model::GenericModel)

Return an MOI.CallbackNodeStatusCode enum, indicating if the current primal solution available from callback_value is integer feasible.

Example

julia> import GLPK
+@variable(model, x, Foo(), Int, mykwarg = true)

will call

build_variable(error_fn::Function, info::VariableInfo, ::Foo; mykwarg)

and info.integer will be true.

Note that the order of the positional arguments does not matter.

source

callback_node_status

JuMP.callback_node_statusFunction
callback_node_status(cb_data, model::GenericModel)

Return an MOI.CallbackNodeStatusCode enum, indicating if the current primal solution available from callback_value is integer feasible.

Example

julia> import GLPK
 
 julia> model = Model(GLPK.Optimizer);
 
@@ -429,7 +429,7 @@
 Status is: CALLBACK_NODE_STATUS_UNKNOWN
 Status is: CALLBACK_NODE_STATUS_UNKNOWN
 Status is: CALLBACK_NODE_STATUS_INTEGER
-Status is: CALLBACK_NODE_STATUS_INTEGER
source

callback_value

JuMP.callback_valueFunction
callback_value(cb_data, x::GenericVariableRef)
+Status is: CALLBACK_NODE_STATUS_INTEGER
source

callback_value

JuMP.callback_valueFunction
callback_value(cb_data, x::GenericVariableRef)
 callback_value(cb_data, x::Union{GenericAffExpr,GenericQuadExpr})

Return the primal solution of x inside a callback.

cb_data is the argument to the callback function, and the type is dependent on the solver.

Use callback_node_status to check whether a solution is available.

Example

julia> import GLPK
 
 julia> model = Model(GLPK.Optimizer);
@@ -451,7 +451,7 @@
 
 julia> optimize!(model)
 Solution is: 10.0
-Solution is: 10.0
source

check_belongs_to_model

check_belongs_to_model

JuMP.check_belongs_to_modelFunction
check_belongs_to_model(x::AbstractJuMPScalar, model::AbstractModel)
 check_belongs_to_model(x::AbstractConstraint, model::AbstractModel)

Throw VariableNotOwned if the owner_model of x is not model.

Example

julia> model = Model();
 
 julia> @variable(model, x);
@@ -463,7 +463,7 @@
 julia> check_belongs_to_model(x, model_2)
 ERROR: VariableNotOwned{VariableRef}(x): the variable x cannot be used in this model because
 it belongs to a different model.
-[...]
source

coefficient

JuMP.coefficientFunction
coefficient(v1::GenericVariableRef{T}, v2::GenericVariableRef{T}) where {T}

Return one(T) if v1 == v2 and zero(T) otherwise.

This is a fallback for other coefficient methods to simplify code in which the expression may be a single variable.

Example

julia> model = Model();
+[...]
source

coefficient

JuMP.coefficientFunction
coefficient(v1::GenericVariableRef{T}, v2::GenericVariableRef{T}) where {T}

Return one(T) if v1 == v2 and zero(T) otherwise.

This is a fallback for other coefficient methods to simplify code in which the expression may be a single variable.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -471,14 +471,14 @@
 1.0
 
 julia> coefficient(x[1], x[2])
-0.0
source
coefficient(a::GenericAffExpr{C,V}, v::V) where {C,V}

Return the coefficient associated with variable v in the affine expression a.

Example

julia> model = Model();
+0.0
source
coefficient(a::GenericAffExpr{C,V}, v::V) where {C,V}

Return the coefficient associated with variable v in the affine expression a.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> expr = 2.0 * x + 1.0;
 
 julia> coefficient(expr, x)
-2.0
source
coefficient(a::GenericQuadExpr{C,V}, v1::V, v2::V) where {C,V}

Return the coefficient associated with the term v1 * v2 in the quadratic expression a.

Note that coefficient(a, v1, v2) is the same as coefficient(a, v2, v1).

Example

julia> model = Model();
+2.0
source
coefficient(a::GenericQuadExpr{C,V}, v1::V, v2::V) where {C,V}

Return the coefficient associated with the term v1 * v2 in the quadratic expression a.

Note that coefficient(a, v1, v2) is the same as coefficient(a, v2, v1).

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -491,14 +491,14 @@
 2.0
 
 julia> coefficient(expr, x[1], x[1])
-0.0
source
coefficient(a::GenericQuadExpr{C,V}, v::V) where {C,V}

Return the coefficient associated with variable v in the affine component of a.

Example

julia> model = Model();
+0.0
source
coefficient(a::GenericQuadExpr{C,V}, v::V) where {C,V}

Return the coefficient associated with variable v in the affine component of a.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> expr = 2.0 * x^2 + 3.0 * x;
 
 julia> coefficient(expr, x)
-3.0
source

compute_conflict!

JuMP.compute_conflict!Function
compute_conflict!(model::GenericModel)

Compute a conflict if the model is infeasible.

The conflict is also called the Irreducible Infeasible Subsystem (IIS).

If an optimizer has not been set yet (see set_optimizer), a NoOptimizer error is thrown.

The status of the conflict can be checked with the MOI.ConflictStatus model attribute. Then, the status for each constraint can be queried with the MOI.ConstraintConflictStatus attribute.

See also: copy_conflict

Example

julia> using JuMP
+3.0
source

compute_conflict!

JuMP.compute_conflict!Function
compute_conflict!(model::GenericModel)

Compute a conflict if the model is infeasible.

The conflict is also called the Irreducible Infeasible Subsystem (IIS).

If an optimizer has not been set yet (see set_optimizer), a NoOptimizer error is thrown.

The status of the conflict can be checked with the MOI.ConflictStatus model attribute. Then, the status for each constraint can be queried with the MOI.ConstraintConflictStatus attribute.

See also: copy_conflict

Example

julia> using JuMP
 
 julia> model = Model(Gurobi.Optimizer);
 
@@ -515,21 +515,21 @@
 julia> compute_conflict!(model)
 
 julia> get_attribute(model, MOI.ConflictStatus())
-CONFLICT_FOUND::ConflictStatusCode = 3
source

constant

JuMP.constantFunction
constant(aff::GenericAffExpr{C,V})::C

Return the constant of the affine expression.

Example

julia> model = Model();
+CONFLICT_FOUND::ConflictStatusCode = 3
source

constant

JuMP.constantFunction
constant(aff::GenericAffExpr{C,V})::C

Return the constant of the affine expression.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> aff = 2.0 * x + 3.0;
 
 julia> constant(aff)
-3.0
source
constant(quad::GenericQuadExpr{C,V})::C

Return the constant of the quadratic expression.

Example

julia> model = Model();
+3.0
source
constant(quad::GenericQuadExpr{C,V})::C

Return the constant of the quadratic expression.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> quad = 2.0 * x^2 + 3.0;
 
 julia> constant(quad)
-3.0
source

constraint_by_name

JuMP.constraint_by_nameFunction
constraint_by_name(model::AbstractModel, name::String, [F, S])::Union{ConstraintRef,Nothing}

Return the reference of the constraint with name attribute name or Nothing if no constraint has this name attribute.

Throws an error if several constraints have name as their name attribute.

If F and S are provided, this method addititionally throws an error if the constraint is not an F-in-S contraint where F is either the JuMP or MOI type of the function and S is the MOI type of the set.

Providing F and S is recommended if you know the type of the function and set since its returned type can be inferred while for the method above (that is, without F and S), the exact return type of the constraint index cannot be inferred.

Example

julia> model = Model();
+3.0
source

constraint_by_name

JuMP.constraint_by_nameFunction
constraint_by_name(model::AbstractModel, name::String, [F, S])::Union{ConstraintRef,Nothing}

Return the reference of the constraint with name attribute name or Nothing if no constraint has this name attribute.

Throws an error if several constraints have name as their name attribute.

If F and S are provided, this method addititionally throws an error if the constraint is not an F-in-S contraint where F is either the JuMP or MOI type of the function and S is the MOI type of the set.

Providing F and S is recommended if you know the type of the function and set since its returned type can be inferred while for the method above (that is, without F and S), the exact return type of the constraint index cannot be inferred.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -545,7 +545,7 @@
 julia> constraint_by_name(model, "con", AffExpr, MOI.EqualTo{Float64})
 
 julia> constraint_by_name(model, "con", QuadExpr, MOI.EqualTo{Float64})
-con : x² = 1
source

constraint_object

JuMP.constraint_objectFunction
constraint_object(con_ref::ConstraintRef)

Return the underlying constraint data for the constraint referenced by con_ref.

Example

A scalar constraint:

julia> model = Model();
+con : x² = 1
source

constraint_object

JuMP.constraint_objectFunction
constraint_object(con_ref::ConstraintRef)

Return the underlying constraint data for the constraint referenced by con_ref.

Example

A scalar constraint:

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -582,7 +582,7 @@
  x[3]
 
 julia> object.set
-MathOptInterface.SecondOrderCone(3)
source

constraint_ref_with_index

JuMP.constraint_ref_with_indexFunction
constraint_ref_with_index(model::AbstractModel, index::MOI.ConstraintIndex)

Return a ConstraintRef of model corresponding to index.

This function is a helper function used internally by JuMP and some JuMP extensions. It should not need to be called in user-code.

source

constraint_string

constraint_ref_with_index

JuMP.constraint_ref_with_indexFunction
constraint_ref_with_index(model::AbstractModel, index::MOI.ConstraintIndex)

Return a ConstraintRef of model corresponding to index.

This function is a helper function used internally by JuMP and some JuMP extensions. It should not need to be called in user-code.

source

constraint_string

JuMP.constraint_stringFunction
constraint_string(
     mode::MIME,
     ref::ConstraintRef;
     in_math_mode::Bool = false,
@@ -593,7 +593,7 @@
 julia> @constraint(model, c, 2 * x <= 1);
 
 julia> constraint_string(MIME("text/plain"), c)
-"c : 2 x ≤ 1"
source

constraints_string

JuMP.constraints_stringFunction
constraints_string(mode, model::AbstractModel)::Vector{String}

Return a list of Strings describing each constraint of the model.

Example

julia> model = Model();
+"c : 2 x ≤ 1"
source

constraints_string

JuMP.constraints_stringFunction
constraints_string(mode, model::AbstractModel)::Vector{String}

Return a list of Strings describing each constraint of the model.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0);
 
@@ -602,7 +602,7 @@
 julia> constraints_string(MIME("text/plain"), model)
 2-element Vector{String}:
  "c : 2 x ≤ 1"
- "x ≥ 0"
source

copy_conflict

JuMP.copy_conflictFunction
copy_conflict(model::GenericModel)

Return a copy of the current conflict for the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference.

This is a convenience function that provides a filtering function for copy_model.

Note

Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

Example

In the following example, a model model is constructed with a variable x and two constraints c1 and c2. This model has no solution, as the two constraints are mutually exclusive. The solver is asked to compute a conflict with compute_conflict!. The parts of model participating in the conflict are then copied into a model iis_model.

julia> using JuMP
+ "x ≥ 0"
source

copy_conflict

JuMP.copy_conflictFunction
copy_conflict(model::GenericModel)

Return a copy of the current conflict for the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference.

This is a convenience function that provides a filtering function for copy_model.

Note

Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

Example

In the following example, a model model is constructed with a variable x and two constraints c1 and c2. This model has no solution, as the two constraints are mutually exclusive. The solver is asked to compute a conflict with compute_conflict!. The parts of model participating in the conflict are then copied into a model iis_model.

julia> using JuMP
 
 julia> import Gurobi
 
@@ -630,7 +630,7 @@
 Feasibility
 Subject to
  c1 : x ≥ 2
- c2 : x ≤ 1
source

copy_extension_data

JuMP.copy_extension_dataFunction
copy_extension_data(data, new_model::AbstractModel, model::AbstractModel)

Return a copy of the extension data data of the model model to the extension data of the new model new_model.

A method should be added for any JuMP extension storing data in the ext field.

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

Warning

Do not engage in type piracy by implementing this method for types of data that you did not define! JuMP extensions should store types that they define in model.ext, rather than regular Julia types.

source

copy_model

JuMP.copy_modelFunction
copy_model(model::GenericModel; filter_constraints::Union{Nothing, Function}=nothing)

Return a copy of the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference. A Base.copy(::AbstractModel) method has also been implemented, it is similar to copy_model but does not return the reference map.

If the filter_constraints argument is given, only the constraints for which this function returns true will be copied. This function is given a constraint reference as argument.

Note

Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

Example

In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

julia> model = Model();
+ c2 : x ≤ 1
source

copy_extension_data

JuMP.copy_extension_dataFunction
copy_extension_data(data, new_model::AbstractModel, model::AbstractModel)

Return a copy of the extension data data of the model model to the extension data of the new model new_model.

A method should be added for any JuMP extension storing data in the ext field.

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

Warning

Do not engage in type piracy by implementing this method for types of data that you did not define! JuMP extensions should store types that they define in model.ext, rather than regular Julia types.

source

copy_model

JuMP.copy_modelFunction
copy_model(model::GenericModel; filter_constraints::Union{Nothing, Function}=nothing)

Return a copy of the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference. A Base.copy(::AbstractModel) method has also been implemented, it is similar to copy_model but does not return the reference map.

If the filter_constraints argument is given, only the constraints for which this function returns true will be copied. This function is given a constraint reference as argument.

Note

Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

Example

In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -644,7 +644,7 @@
 x
 
 julia> cref_new = reference_map[cref]
-cref : x = 2
source

delete

JuMP.deleteFunction
delete(model::GenericModel, con_ref::ConstraintRef)

Delete the constraint associated with constraint_ref from the model model.

Note that delete does not unregister the name from the model, so adding a new constraint of the same name will throw an error. Use unregister to unregister the name after deletion.

Example

julia> model = Model();
+cref : x = 2
source

delete

JuMP.deleteFunction
delete(model::GenericModel, con_ref::ConstraintRef)

Delete the constraint associated with constraint_ref from the model model.

Note that delete does not unregister the name from the model, so adding a new constraint of the same name will throw an error. Use unregister to unregister the name after deletion.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -662,7 +662,7 @@
 julia> model[:c]
 ERROR: KeyError: key :c not found
 Stacktrace:
-[...]
source
delete(model::GenericModel, con_refs::Vector{<:ConstraintRef})

Delete the constraints associated with con_refs from the model model.

Solvers may implement specialized methods for deleting multiple constraints of the same concrete type. These methods may be more efficient than repeatedly calling the single constraint delete method.

See also: unregister

Example

julia> model = Model();
+[...]
source
delete(model::GenericModel, con_refs::Vector{<:ConstraintRef})

Delete the constraints associated with con_refs from the model model.

Solvers may implement specialized methods for deleting multiple constraints of the same concrete type. These methods may be more efficient than repeatedly calling the single constraint delete method.

See also: unregister

Example

julia> model = Model();
 
 julia> @variable(model, x[1:3]);
 
@@ -683,7 +683,7 @@
 julia> model[:c]
 ERROR: KeyError: key :c not found
 Stacktrace:
-[...]
source
delete(model::GenericModel, variable_ref::GenericVariableRef)

Delete the variable associated with variable_ref from the model model.

Note that delete does not unregister the name from the model, so adding a new variable of the same name will throw an error. Use unregister to unregister the name after deletion.

Example

julia> model = Model();
+[...]
source
delete(model::GenericModel, variable_ref::GenericVariableRef)

Delete the variable associated with variable_ref from the model model.

Note that delete does not unregister the name from the model, so adding a new variable of the same name will throw an error. Use unregister to unregister the name after deletion.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -699,7 +699,7 @@
 julia> model[:x]
 ERROR: KeyError: key :x not found
 Stacktrace:
-[...]
source
delete(model::GenericModel, variable_refs::Vector{<:GenericVariableRef})

Delete the variables associated with variable_refs from the model model. Solvers may implement methods for deleting multiple variables that are more efficient than repeatedly calling the single variable delete method.

See also: unregister

Example

julia> model = Model();
+[...]
source
delete(model::GenericModel, variable_refs::Vector{<:GenericVariableRef})

Delete the variables associated with variable_refs from the model model. Solvers may implement methods for deleting multiple variables that are more efficient than repeatedly calling the single variable delete method.

See also: unregister

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -714,7 +714,7 @@
 julia> model[:x]
 ERROR: KeyError: key :x not found
 Stacktrace:
-[...]
source

delete_lower_bound

delete_lower_bound

delete_upper_bound

delete_upper_bound

direct_generic_model

direct_generic_model

JuMP.direct_generic_modelFunction
direct_generic_model(
     value_type::Type{T},
     backend::MOI.ModelLike;
-) where {T<:Real}

Return a new JuMP model using backend to store the model and solve it.

As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

Notes

The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

  • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
  • No constraint bridging is supported by default.
  • The optimizer used cannot be changed the model is constructed.
  • The model created cannot be copied.
source
direct_generic_model(::Type{T}, factory::MOI.OptimizerWithAttributes)

Create a direct_generic_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

Example

julia> import HiGHS
+) where {T<:Real}

Return a new JuMP model using backend to store the model and solve it.

As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

Notes

The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

  • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
  • No constraint bridging is supported by default.
  • The optimizer used cannot be changed the model is constructed.
  • The model created cannot be copied.
source
direct_generic_model(::Type{T}, factory::MOI.OptimizerWithAttributes)

Create a direct_generic_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

Example

julia> import HiGHS
 
 julia> optimizer = optimizer_with_attributes(
            HiGHS.Optimizer,
@@ -765,7 +765,7 @@
 
 julia> set_attribute(model, "presolve", "off")
 
-julia> set_attribute(model, MOI.Silent(), true)
source

direct_model

JuMP.direct_modelFunction
direct_model(backend::MOI.ModelLike)

Return a new JuMP model using backend to store the model and solve it.

As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

Notes

The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

  • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
  • No constraint bridging is supported by default.
  • The optimizer used cannot be changed the model is constructed.
  • The model created cannot be copied.
source
direct_model(factory::MOI.OptimizerWithAttributes)

Create a direct_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

Example

julia> import HiGHS
+julia> set_attribute(model, MOI.Silent(), true)
source

direct_model

JuMP.direct_modelFunction
direct_model(backend::MOI.ModelLike)

Return a new JuMP model using backend to store the model and solve it.

As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

Notes

The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

  • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
  • No constraint bridging is supported by default.
  • The optimizer used cannot be changed the model is constructed.
  • The model created cannot be copied.
source
direct_model(factory::MOI.OptimizerWithAttributes)

Create a direct_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

Example

julia> import HiGHS
 
 julia> optimizer = optimizer_with_attributes(
            HiGHS.Optimizer,
@@ -793,7 +793,7 @@
 
 julia> set_attribute(model, "presolve", "off")
 
-julia> set_attribute(model, MOI.Silent(), true)
source

drop_zeros!

JuMP.drop_zeros!Function
drop_zeros!(expr::GenericAffExpr)

Remove terms in the affine expression with 0 coefficients.

Example

julia> model = Model();
+julia> set_attribute(model, MOI.Silent(), true)
source

drop_zeros!

JuMP.drop_zeros!Function
drop_zeros!(expr::GenericAffExpr)

Remove terms in the affine expression with 0 coefficients.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -805,7 +805,7 @@
 julia> drop_zeros!(expr)
 
 julia> expr
-x[2]
source
drop_zeros!(expr::GenericQuadExpr)

Remove terms in the quadratic expression with 0 coefficients.

Example

julia> model = Model();
+x[2]
source
drop_zeros!(expr::GenericQuadExpr)

Remove terms in the quadratic expression with 0 coefficients.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -817,7 +817,7 @@
 julia> drop_zeros!(expr)
 
 julia> expr
-x[2]²
source

dual

JuMP.dualFunction
dual(con_ref::ConstraintRef; result::Int = 1)

Return the dual value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

Use has_duals to check if a result exists before asking for values.

See also: result_count, shadow_price.

Example

julia> import HiGHS
+x[2]²
source

dual

JuMP.dualFunction
dual(con_ref::ConstraintRef; result::Int = 1)

Return the dual value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

Use has_duals to check if a result exists before asking for values.

See also: result_count, shadow_price.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -836,7 +836,7 @@
 true
 
 julia> dual(c)
--2.0
source

dual_objective_value

JuMP.dual_objective_valueFunction
dual_objective_value(model::GenericModel; result::Int = 1)

Return the value of the objective of the dual problem associated with result index result of the most-recent solution returned by the solver.

Throws MOI.UnsupportedAttribute{MOI.DualObjectiveValue} if the solver does not support this attribute.

This function is equivalent to querying the MOI.DualObjectiveValue attribute.

See also: result_count.

Example

julia> import HiGHS
+-2.0
source

dual_objective_value

JuMP.dual_objective_valueFunction
dual_objective_value(model::GenericModel; result::Int = 1)

Return the value of the objective of the dual problem associated with result index result of the most-recent solution returned by the solver.

Throws MOI.UnsupportedAttribute{MOI.DualObjectiveValue} if the solver does not support this attribute.

This function is equivalent to querying the MOI.DualObjectiveValue attribute.

See also: result_count.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -854,7 +854,7 @@
 julia> dual_objective_value(model; result = 2)
 ERROR: Result index of attribute MathOptInterface.DualObjectiveValue(2) out of bounds. There are currently 1 solution(s) in the model.
 Stacktrace:
-[...]
source

dual_shape

JuMP.dual_shapeFunction
dual_shape(shape::AbstractShape)::AbstractShape

Returns the shape of the dual space of the space of objects of shape shape. By default, the dual_shape of a shape is itself. See the examples section below for an example for which this is not the case.

Example

Consider polynomial constraints for which the dual is moment constraints and moment constraints for which the dual is polynomial constraints. Shapes for polynomials can be defined as follows:

struct Polynomial
+[...]
source

dual_shape

JuMP.dual_shapeFunction
dual_shape(shape::AbstractShape)::AbstractShape

Returns the shape of the dual space of the space of objects of shape shape. By default, the dual_shape of a shape is itself. See the examples section below for an example for which this is not the case.

Example

Consider polynomial constraints for which the dual is moment constraints and moment constraints for which the dual is polynomial constraints. Shapes for polynomials can be defined as follows:

struct Polynomial
     coefficients::Vector{Float64}
     monomials::Vector{Monomial}
 end
@@ -869,7 +869,7 @@
     monomials::Vector{Monomial}
 end
 JuMP.reshape_vector(x::Vector, shape::MomentsShape) = Moments(x, shape.monomials)

Then dual_shape allows the definition of the shape of the dual of polynomial and moment constraints:

dual_shape(shape::PolynomialShape) = MomentsShape(shape.monomials)
-dual_shape(shape::MomentsShape) = PolynomialShape(shape.monomials)
source

dual_start_value

JuMP.dual_start_valueFunction
dual_start_value(con_ref::ConstraintRef)

Return the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref.

If no dual start value has been set, dual_start_value will return nothing.

See also set_dual_start_value.

Example

julia> model = Model();
+dual_shape(shape::MomentsShape) = PolynomialShape(shape.monomials)
source

dual_start_value

JuMP.dual_start_valueFunction
dual_start_value(con_ref::ConstraintRef)

Return the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref.

If no dual start value has been set, dual_start_value will return nothing.

See also set_dual_start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 2.0);
 
@@ -884,19 +884,19 @@
 
 julia> set_dual_start_value(c, nothing)
 
-julia> dual_start_value(c)
source

dual_status

JuMP.dual_statusFunction
dual_status(model::GenericModel; result::Int = 1)

Return a MOI.ResultStatusCode describing the status of the most recent dual solution of the solver (that is, the MOI.DualStatus attribute) associated with the result index result.

See also: result_count.

Example

julia> import Ipopt
+julia> dual_start_value(c)
source

dual_status

JuMP.dual_statusFunction
dual_status(model::GenericModel; result::Int = 1)

Return a MOI.ResultStatusCode describing the status of the most recent dual solution of the solver (that is, the MOI.DualStatus attribute) associated with the result index result.

See also: result_count.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
 julia> dual_status(model; result = 2)
-NO_SOLUTION::ResultStatusCode = 0
source

error_if_direct_mode

JuMP.error_if_direct_modeFunction
error_if_direct_mode(model::GenericModel, func::Symbol)

Errors if model is in direct mode during a call from the function named func.

Used internally within JuMP, or by JuMP extensions who do not want to support models in direct mode.

Example

julia> import HiGHS
+NO_SOLUTION::ResultStatusCode = 0
source

error_if_direct_mode

JuMP.error_if_direct_modeFunction
error_if_direct_mode(model::GenericModel, func::Symbol)

Errors if model is in direct mode during a call from the function named func.

Used internally within JuMP, or by JuMP extensions who do not want to support models in direct mode.

Example

julia> import HiGHS
 
 julia> model = direct_model(HiGHS.Optimizer());
 
 julia> error_if_direct_mode(model, :foo)
 ERROR: The `foo` function is not supported in DIRECT mode.
 Stacktrace:
-[...]
source

fix

JuMP.fixFunction
fix(v::GenericVariableRef, value::Number; force::Bool = false)

Fix a variable to a value. Update the fixing constraint if one exists, otherwise create a new one.

If the variable already has variable bounds and force=false, calling fix will throw an error. If force=true, existing variable bounds will be deleted, and the fixing constraint will be added. Note a variable will have no bounds after a call to unfix.

See also FixRef, is_fixed, fix_value, unfix.

Example

julia> model = Model();
+[...]
source

fix

JuMP.fixFunction
fix(v::GenericVariableRef, value::Number; force::Bool = false)

Fix a variable to a value. Update the fixing constraint if one exists, otherwise create a new one.

If the variable already has variable bounds and force=false, calling fix will throw an error. If force=true, existing variable bounds will be deleted, and the fixing constraint will be added. Note a variable will have no bounds after a call to unfix.

See also FixRef, is_fixed, fix_value, unfix.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -916,7 +916,7 @@
 julia> fix(x, 1.0; force = true)
 
 julia> is_fixed(x)
-true
source

fix_discrete_variables

JuMP.fix_discrete_variablesFunction
fix_discrete_variables([var_value::Function = value,] model::GenericModel)

Modifies model to convert all binary and integer variables to continuous variables with fixed bounds of var_value(x).

Return

Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

Notes

  • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
  • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

Example

julia> model = Model();
+true
source

fix_discrete_variables

JuMP.fix_discrete_variablesFunction
fix_discrete_variables([var_value::Function = value,] model::GenericModel)

Modifies model to convert all binary and integer variables to continuous variables with fixed bounds of var_value(x).

Return

Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

Notes

  • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
  • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x, Bin, start = 1);
 
@@ -940,12 +940,12 @@
  y ≥ 1
  y ≤ 10
  y integer
- x binary
source

fix_value

JuMP.fix_valueFunction
fix_value(v::GenericVariableRef)

Return the value to which a variable is fixed.

Error if one does not exist.

See also FixRef, is_fixed, fix, unfix.

Example

julia> model = Model();
+ x binary
source

fix_value

JuMP.fix_valueFunction
fix_value(v::GenericVariableRef)

Return the value to which a variable is fixed.

Error if one does not exist.

See also FixRef, is_fixed, fix, unfix.

Example

julia> model = Model();
 
 julia> @variable(model, x == 1);
 
 julia> fix_value(x)
-1.0
source

flatten!

JuMP.flatten!Function
flatten!(expr::GenericNonlinearExpr)

Flatten a nonlinear expression in-place by lifting nested + and * nodes into a single n-ary operation.

Motivation

Nonlinear expressions created using operator overloading can be deeply nested and unbalanced. For example, prod(x for i in 1:4) creates *(x, *(x, *(x, x))) instead of the more preferable *(x, x, x, x).

Example

julia> model = Model();
+1.0
source

flatten!

JuMP.flatten!Function
flatten!(expr::GenericNonlinearExpr)

Flatten a nonlinear expression in-place by lifting nested + and * nodes into a single n-ary operation.

Motivation

Nonlinear expressions created using operator overloading can be deeply nested and unbalanced. For example, prod(x for i in 1:4) creates *(x, *(x, *(x, x))) instead of the more preferable *(x, x, x, x).

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -957,7 +957,7 @@
 (x²) * x * x
 
 julia> flatten!(sin(prod(x for i in 1:4)))
-sin((x²) * x * x)
source

function_string

function_string

JuMP.function_stringFunction
function_string(
     mode::MIME,
     func::Union{JuMP.AbstractJuMPScalar,Vector{<:JuMP.AbstractJuMPScalar}},
 )

Return a String representing the function func using print mode mode.

Example

julia> model = Model();
@@ -965,7 +965,7 @@
 julia> @variable(model, x);
 
 julia> function_string(MIME("text/plain"), 2 * x + 1)
-"2 x + 1"
source

get_attribute

get_attribute

JuMP.get_attributeFunction
get_attribute(model::GenericModel, attr::MOI.AbstractModelAttribute)
 get_attribute(x::GenericVariableRef, attr::MOI.AbstractVariableAttribute)
 get_attribute(cr::ConstraintRef, attr::MOI.AbstractConstraintAttribute)

Get the value of a solver-specifc attribute attr.

This is equivalent to calling MOI.get with the associated MOI model and, for variables and constraints, with the associated MOI.VariableIndex or MOI.ConstraintIndex.

Example

julia> model = Model();
 
@@ -982,7 +982,7 @@
 "x"
 
 julia> get_attribute(c, MOI.ConstraintName())
-"c"
source
get_attribute(
+"c"
source
get_attribute(
     model::Union{GenericModel,MOI.OptimizerWithAttributes},
     attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
 )

Get the value of a solver-specifc attribute attr.

This is equivalent to calling MOI.get with the associated MOI model.

If attr is an AbstractString, it is converted to MOI.RawOptimizerAttribute.

Example

julia> import HiGHS
@@ -1001,7 +1001,7 @@
 true
 
 julia> get_attribute(opt, MOI.RawOptimizerAttribute("output_flag"))
-true
source

has_duals

JuMP.has_dualsFunction
has_duals(model::GenericModel; result::Int = 1)

Return true if the solver has a dual solution in result index result available to query, otherwise return false.

See also dual, shadow_price, and result_count.

Example

julia> import HiGHS
+true
source

has_duals

JuMP.has_dualsFunction
has_duals(model::GenericModel; result::Int = 1)

Return true if the solver has a dual solution in result index result available to query, otherwise return false.

See also dual, shadow_price, and result_count.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1020,12 +1020,12 @@
 julia> optimize!(model)
 
 julia> has_duals(model)
-true
source

has_lower_bound

has_lower_bound

has_start_value

has_start_value

JuMP.has_start_valueFunction
has_start_value(variable::AbstractVariableRef)

Return true if the variable has a start value set, otherwise return false.

See also: start_value, set_start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 1.5);
 
@@ -1046,12 +1046,12 @@
 true
 
 julia> start_value(y)
-2.0
source

has_upper_bound

has_upper_bound

has_values

JuMP.has_valuesFunction
has_values(model::GenericModel; result::Int = 1)

Return true if the solver has a primal solution in result index result available to query, otherwise return false.

See also value and result_count.

Example

julia> import HiGHS
+true
source

has_values

JuMP.has_valuesFunction
has_values(model::GenericModel; result::Int = 1)

Return true if the solver has a primal solution in result index result available to query, otherwise return false.

See also value and result_count.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1070,25 +1070,25 @@
 julia> optimize!(model)
 
 julia> has_values(model)
-true
source

in_set_string

JuMP.in_set_stringFunction
in_set_string(mode::MIME, set)

Return a String representing the membership to the set set using print mode mode.

Extensions

JuMP extensions may extend this method for new set types to improve the legibility of their printing.

Example

julia> in_set_string(MIME("text/plain"), MOI.Interval(1.0, 2.0))
-"∈ [1, 2]"
source

index

JuMP.indexFunction
index(cr::ConstraintRef)::MOI.ConstraintIndex

Return the index of the constraint that corresponds to cr in the MOI backend.

Example

julia> model = Model();
+true
source

in_set_string

JuMP.in_set_stringFunction
in_set_string(mode::MIME, set)

Return a String representing the membership to the set set using print mode mode.

Extensions

JuMP extensions may extend this method for new set types to improve the legibility of their printing.

Example

julia> in_set_string(MIME("text/plain"), MOI.Interval(1.0, 2.0))
+"∈ [1, 2]"
source

index

JuMP.indexFunction
index(cr::ConstraintRef)::MOI.ConstraintIndex

Return the index of the constraint that corresponds to cr in the MOI backend.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> @constraint(model, c, x >= 0);
 
 julia> index(c)
-MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.GreaterThan{Float64}}(1)
source
index(v::GenericVariableRef)::MOI.VariableIndex

Return the index of the variable that corresponds to v in the MOI backend.

Example

julia> model = Model();
+MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.GreaterThan{Float64}}(1)
source
index(v::GenericVariableRef)::MOI.VariableIndex

Return the index of the variable that corresponds to v in the MOI backend.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> index(x)
-MOI.VariableIndex(1)
source

is_binary

is_binary

is_fixed

is_fixed

JuMP.is_fixedFunction
is_fixed(v::GenericVariableRef)

Return true if v is a fixed variable. If true, the fixed value can be queried with fix_value.

See also FixRef, fix_value, fix, unfix.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1098,7 +1098,7 @@
 julia> fix(x, 1.0)
 
 julia> is_fixed(x)
-true
source

is_integer

is_integer

JuMP.is_integerFunction
is_integer(v::GenericVariableRef)

Return true if v is constrained to be integer.

See also IntegerRef, set_integer, unset_integer.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1108,7 +1108,7 @@
 julia> set_integer(x)
 
 julia> is_integer(x)
-true
source

is_parameter

is_parameter

is_solved_and_feasible

is_solved_and_feasible

JuMP.is_solved_and_feasibleFunction
is_solved_and_feasible(
     model::GenericModel;
     allow_local::Bool = true,
     allow_almost::Bool = false,
@@ -1131,7 +1131,7 @@
 julia> model = Model(Ipopt.Optimizer);
 
 julia> is_solved_and_feasible(model)
-false
source

is_valid

JuMP.is_validFunction
is_valid(model::GenericModel, con_ref::ConstraintRef{<:AbstractModel})

Return true if con_ref refers to a valid constraint in model.

Example

julia> model = Model();
+false
source

is_valid

JuMP.is_validFunction
is_valid(model::GenericModel, con_ref::ConstraintRef{<:AbstractModel})

Return true if con_ref refers to a valid constraint in model.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1143,7 +1143,7 @@
 julia> model_2 = Model();
 
 julia> is_valid(model_2, c)
-false
source
is_valid(model::GenericModel, variable_ref::GenericVariableRef)

Return true if variable refers to a valid variable in model.

Example

julia> model = Model();
+false
source
is_valid(model::GenericModel, variable_ref::GenericVariableRef)

Return true if variable refers to a valid variable in model.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1153,7 +1153,7 @@
 julia> model_2 = Model();
 
 julia> is_valid(model_2, x)
-false
source

isequal_canonical

isequal_canonical

JuMP.isequal_canonicalFunction
isequal_canonical(
     x::T,
     y::T
 ) where {T<:AbstractJuMPScalar,AbstractArray{<:AbstractJuMPScalar}}

Return true if x is equal to y after dropping zeros and disregarding the order.

This method is mainly useful for testing, because fallbacks like x == y do not account for valid mathematical comparisons like x[1] + 0 x[2] + 1 == x[1] + 1.

Example

julia> model = Model();
@@ -1173,7 +1173,7 @@
 false
 
 julia> isequal_canonical(a, b)
-true
source

jump_function

JuMP.jump_functionFunction
jump_function(model::AbstractModel, x::MOI.AbstractFunction)

Given an MathOptInterface object x, return the JuMP equivalent.

See also: moi_function.

Example

julia> model = Model();
+true
source

jump_function

JuMP.jump_functionFunction
jump_function(model::AbstractModel, x::MOI.AbstractFunction)

Given an MathOptInterface object x, return the JuMP equivalent.

See also: moi_function.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1181,10 +1181,10 @@
 1.0 + 2.0 MOI.VariableIndex(1)
 
 julia> jump_function(model, f)
-2 x + 1
source

jump_function_type

JuMP.jump_function_typeFunction
jump_function_type(model::AbstractModel, ::Type{T}) where {T}

Given an MathOptInterface object type T, return the JuMP equivalent.

See also: moi_function_type.

Example

julia> model = Model();
+2 x + 1
source

jump_function_type

JuMP.jump_function_typeFunction
jump_function_type(model::AbstractModel, ::Type{T}) where {T}

Given an MathOptInterface object type T, return the JuMP equivalent.

See also: moi_function_type.

Example

julia> model = Model();
 
 julia> jump_function_type(model, MOI.ScalarAffineFunction{Float64})
-AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
source

latex_formulation

JuMP.latex_formulationFunction
latex_formulation(model::AbstractModel)

Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

source

linear_terms

JuMP.linear_termsFunction
linear_terms(aff::GenericAffExpr{C,V})

Provides an iterator over coefficient-variable tuples (a_i::C, x_i::V) in the linear part of the affine expression.

source
linear_terms(quad::GenericQuadExpr{C,V})

Provides an iterator over tuples (coefficient::C, variable::V) in the linear part of the quadratic expression.

source

list_of_constraint_types

JuMP.list_of_constraint_typesFunction
list_of_constraint_types(model::GenericModel)::Vector{Tuple{Type,Type}}

Return a list of tuples of the form (F, S) where F is a JuMP function type and S is an MOI set type such that all_constraints(model, F, S) returns a nonempty list.

Example

julia> model = Model();
+AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
source

latex_formulation

JuMP.latex_formulationFunction
latex_formulation(model::AbstractModel)

Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

source

linear_terms

JuMP.linear_termsFunction
linear_terms(aff::GenericAffExpr{C,V})

Provides an iterator over coefficient-variable tuples (a_i::C, x_i::V) in the linear part of the affine expression.

source
linear_terms(quad::GenericQuadExpr{C,V})

Provides an iterator over tuples (coefficient::C, variable::V) in the linear part of the quadratic expression.

source

list_of_constraint_types

JuMP.list_of_constraint_typesFunction
list_of_constraint_types(model::GenericModel)::Vector{Tuple{Type,Type}}

Return a list of tuples of the form (F, S) where F is a JuMP function type and S is an MOI set type such that all_constraints(model, F, S) returns a nonempty list.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0, Bin);
 
@@ -1194,12 +1194,12 @@
 3-element Vector{Tuple{Type, Type}}:
  (AffExpr, MathOptInterface.LessThan{Float64})
  (VariableRef, MathOptInterface.GreaterThan{Float64})
- (VariableRef, MathOptInterface.ZeroOne)

Performance considerations

Iterating over the list of function and set types is a type-unstable operation. Consider using a function barrier. See the Performance tips for extensions section of the documentation for more details.

source

lower_bound

JuMP.lower_boundFunction
lower_bound(v::GenericVariableRef)

Return the lower bound of a variable. Error if one does not exist.

See also LowerBoundRef, has_lower_bound, set_lower_bound, delete_lower_bound.

Example

julia> model = Model();
+ (VariableRef, MathOptInterface.ZeroOne)

Performance considerations

Iterating over the list of function and set types is a type-unstable operation. Consider using a function barrier. See the Performance tips for extensions section of the documentation for more details.

source

lower_bound

lp_matrix_data

JuMP.lp_matrix_dataFunction
lp_matrix_data(model::GenericModel{T})

Given a JuMP model of a linear program, return an LPMatrixData{T} struct storing data for an equivalent linear program in the form:

\[\begin{aligned} +1.0

source

lp_matrix_data

JuMP.lp_matrix_dataFunction
lp_matrix_data(model::GenericModel{T})

Given a JuMP model of a linear program, return an LPMatrixData{T} struct storing data for an equivalent linear program in the form:

\[\begin{aligned} \min & c^\top x + c_0 \\ & b_l \le A x \le b_u \\ & x_l \le x \le x_u @@ -1244,7 +1244,7 @@ 0.0 julia> data.sense -MAX_SENSE::OptimizationSense = 1

source

lp_sensitivity_report

JuMP.lp_sensitivity_reportFunction
lp_sensitivity_report(model::GenericModel{T}; atol::T = Base.rtoldefault(T))::SensitivityReport{T} where {T}

Given a linear program model with a current optimal basis, return a SensitivityReport object, which maps:

  • Every variable reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
  • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

Both tuples are relative, rather than absolute. So given a objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

atol is the primal/dual optimality tolerance, and should match the tolerance of the solver used to compute the basis.

Note: interval constraints are NOT supported.

Example

julia> import HiGHS
+MAX_SENSE::OptimizationSense = 1
source

lp_sensitivity_report

JuMP.lp_sensitivity_reportFunction
lp_sensitivity_report(model::GenericModel{T}; atol::T = Base.rtoldefault(T))::SensitivityReport{T} where {T}

Given a linear program model with a current optimal basis, return a SensitivityReport object, which maps:

  • Every variable reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
  • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

Both tuples are relative, rather than absolute. So given a objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

atol is the primal/dual optimality tolerance, and should match the tolerance of the solver used to compute the basis.

Note: interval constraints are NOT supported.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1276,7 +1276,7 @@
            "The lower bound of `x` can decrease by $dRHS_lo or increase " *
            "by $dRHS_hi."
        )
-The lower bound of `x` can decrease by -Inf or increase by 3.0.
source

map_coefficients

map_coefficients

JuMP.map_coefficientsFunction
map_coefficients(f::Function, a::GenericAffExpr)

Apply f to the coefficients and constant term of an GenericAffExpr a and return a new expression.

See also: map_coefficients_inplace!

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1287,7 +1287,7 @@
 2 x + 2
 
 julia> a
-x + 1
source
map_coefficients(f::Function, a::GenericQuadExpr)

Apply f to the coefficients and constant term of an GenericQuadExpr a and return a new expression.

See also: map_coefficients_inplace!

Example

julia> model = Model();
+x + 1
source
map_coefficients(f::Function, a::GenericQuadExpr)

Apply f to the coefficients and constant term of an GenericQuadExpr a and return a new expression.

See also: map_coefficients_inplace!

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1298,7 +1298,7 @@
 2 x² + 2 x + 2
 
 julia> a
-x² + x + 1
source

map_coefficients_inplace!

map_coefficients_inplace!

JuMP.map_coefficients_inplace!Function
map_coefficients_inplace!(f::Function, a::GenericAffExpr)

Apply f to the coefficients and constant term of an GenericAffExpr a and update them in-place.

See also: map_coefficients

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1309,7 +1309,7 @@
 2 x + 2
 
 julia> a
-2 x + 2
source
map_coefficients_inplace!(f::Function, a::GenericQuadExpr)

Apply f to the coefficients and constant term of an GenericQuadExpr a and update them in-place.

See also: map_coefficients

Example

julia> model = Model();
+2 x + 2
source
map_coefficients_inplace!(f::Function, a::GenericQuadExpr)

Apply f to the coefficients and constant term of an GenericQuadExpr a and update them in-place.

See also: map_coefficients

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1320,10 +1320,10 @@
 2 x² + 2 x + 2
 
 julia> a
-2 x² + 2 x + 2
source

mode

JuMP.modeFunction
mode(model::GenericModel)

Return the ModelMode of model.

Example

julia> model = Model();
+2 x² + 2 x + 2
source

mode

JuMP.modeFunction
mode(model::GenericModel)

Return the ModelMode of model.

Example

julia> model = Model();
 
 julia> mode(model)
-AUTOMATIC::ModelMode = 0
source

model_convert

model_convert

JuMP.model_convertFunction
model_convert(
     model::AbstractModel,
     rhs::Union{
         AbstractConstraint,
@@ -1331,14 +1331,14 @@
         AbstractJuMPScalar,
         MOI.AbstractSet,
     },
-)

Convert the coefficients and constants of functions and sets in the rhs to the coefficient type value_type(typeof(model)).

Purpose

Creating and adding a constraint is a two-step process. The first step calls build_constraint, and the result of that is passed to add_constraint.

However, because build_constraint does not take the model as an argument, the coefficients and constants of the function or set might be different than value_type(typeof(model)).

Therefore, the result of build_constraint is converted in a call to model_convert before the result is passed to add_constraint.

source

model_string

JuMP.model_stringFunction
model_string(mode::MIME, model::AbstractModel)

Return a String representation of model given the mode.

Example

julia> model = Model();
+)

Convert the coefficients and constants of functions and sets in the rhs to the coefficient type value_type(typeof(model)).

Purpose

Creating and adding a constraint is a two-step process. The first step calls build_constraint, and the result of that is passed to add_constraint.

However, because build_constraint does not take the model as an argument, the coefficients and constants of the function or set might be different than value_type(typeof(model)).

Therefore, the result of build_constraint is converted in a call to model_convert before the result is passed to add_constraint.

source

model_string

JuMP.model_stringFunction
model_string(mode::MIME, model::AbstractModel)

Return a String representation of model given the mode.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0);
 
 julia> print(model_string(MIME("text/plain"), model))
 Feasibility
 Subject to
- x ≥ 0
source

moi_function

moi_function

JuMP.moi_functionFunction
moi_function(x::AbstractJuMPScalar)
 moi_function(x::AbstractArray{<:AbstractJuMPScalar})

Given a JuMP object x, return the MathOptInterface equivalent.

See also: jump_function.

Example

julia> model = Model();
 
 julia> @variable(model, x);
@@ -1347,8 +1347,8 @@
 2 x + 1
 
 julia> moi_function(f)
-1.0 + 2.0 MOI.VariableIndex(1)
source

moi_function_type

JuMP.moi_function_typeFunction
moi_function_type(::Type{T}) where {T}

Given a JuMP object type T, return the MathOptInterface equivalent.

See also: jump_function_type.

Example

julia> moi_function_type(AffExpr)
-MathOptInterface.ScalarAffineFunction{Float64}
source

moi_set

JuMP.moi_setFunction
moi_set(constraint::AbstractConstraint)

Return the set of the constraint constraint in the function-in-set form as a MathOptInterface.AbstractSet.

moi_set(s::AbstractVectorSet, dim::Int)

Returns the MOI set of dimension dim corresponding to the JuMP set s.

moi_set(s::AbstractScalarSet)

Returns the MOI set corresponding to the JuMP set s.

source

name

JuMP.nameFunction
name(con_ref::ConstraintRef)

Get a constraint's name attribute.

Example

julia> model = Model();
+1.0 + 2.0 MOI.VariableIndex(1)
source

moi_function_type

JuMP.moi_function_typeFunction
moi_function_type(::Type{T}) where {T}

Given a JuMP object type T, return the MathOptInterface equivalent.

See also: jump_function_type.

Example

julia> moi_function_type(AffExpr)
+MathOptInterface.ScalarAffineFunction{Float64}
source

moi_set

JuMP.moi_setFunction
moi_set(constraint::AbstractConstraint)

Return the set of the constraint constraint in the function-in-set form as a MathOptInterface.AbstractSet.

moi_set(s::AbstractVectorSet, dim::Int)

Returns the MOI set of dimension dim corresponding to the JuMP set s.

moi_set(s::AbstractScalarSet)

Returns the MOI set corresponding to the JuMP set s.

source

name

JuMP.nameFunction
name(con_ref::ConstraintRef)

Get a constraint's name attribute.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1356,7 +1356,7 @@
 c : [2 x] ∈ Nonnegatives()
 
 julia> name(c)
-"c"
source
name(v::GenericVariableRef)::String

Get a variable's name attribute.

Example

julia> model = Model();
+"c"
source
name(v::GenericVariableRef)::String

Get a variable's name attribute.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2])
 2-element Vector{VariableRef}:
@@ -1364,10 +1364,10 @@
  x[2]
 
 julia> name(x[1])
-"x[1]"
source
name(model::AbstractModel)

Return the MOI.Name attribute of model's backend, or a default if empty.

Example

julia> model = Model();
+"x[1]"
source
name(model::AbstractModel)

Return the MOI.Name attribute of model's backend, or a default if empty.

Example

julia> model = Model();
 
 julia> name(model)
-"A JuMP Model"
source

node_count

JuMP.node_countFunction
node_count(model::GenericModel)

If available, returns the total number of branch-and-bound nodes explored during the most recent optimization in a Mixed Integer Program (the MOI.NodeCount attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
+"A JuMP Model"
source

node_count

JuMP.node_countFunction
node_count(model::GenericModel)

If available, returns the total number of branch-and-bound nodes explored during the most recent optimization in a Mixed Integer Program (the MOI.NodeCount attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1376,7 +1376,7 @@
 julia> optimize!(model)
 
 julia> node_count(model)
-0
source

normalized_coefficient

normalized_coefficient

JuMP.normalized_coefficientFunction
normalized_coefficient(
     constraint::ConstraintRef,
     variable::GenericVariableRef,
 )

Return the coefficient associated with variable in constraint after JuMP has normalized the constraint into its standard form.

See also set_normalized_coefficient.

Example

julia> model = Model();
@@ -1396,7 +1396,7 @@
 julia> normalized_coefficient(con_vec, x)
 2-element Vector{Tuple{Int64, Float64}}:
  (1, 1.0)
- (2, 2.0)
source
normalized_coefficient(
+ (2, 2.0)
source
normalized_coefficient(
     constraint::ConstraintRef,
     variable_1::GenericVariableRef,
     variable_2::GenericVariableRef,
@@ -1421,7 +1421,7 @@
  (1, 1.0)
 
 julia> normalized_coefficient(con_vec, x[1], x[2])
-Tuple{Int64, Float64}[]
source

normalized_rhs

JuMP.normalized_rhsFunction
normalized_rhs(constraint::ConstraintRef)

Return the right-hand side term of constraint after JuMP has converted the constraint into its normalized form.

See also set_normalized_rhs.

Example

julia> model = Model();
+Tuple{Int64, Float64}[]
source

normalized_rhs

JuMP.normalized_rhsFunction
normalized_rhs(constraint::ConstraintRef)

Return the right-hand side term of constraint after JuMP has converted the constraint into its normalized form.

See also set_normalized_rhs.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1429,7 +1429,7 @@
 con : 2 x ≤ 1
 
 julia> normalized_rhs(con)
-1.0
source

num_constraints

num_constraints

JuMP.num_constraintsFunction
num_constraints(model::GenericModel, function_type, set_type)::Int64

Return the number of constraints currently in the model where the function has type function_type and the set has type set_type.

See also list_of_constraint_types and all_constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0, Bin);
 
@@ -1448,7 +1448,7 @@
 1
 
 julia> num_constraints(model, AffExpr, MOI.LessThan{Float64})
-2
source
num_constraints(model::GenericModel; count_variable_in_set_constraints::Bool)

Return the number of constraints in model.

If count_variable_in_set_constraints == true, then VariableRef constraints such as VariableRef-in-Integer are included. To count only the number of structural constraints (for example, the rows in the constraint matrix of a linear program), pass count_variable_in_set_constraints = false.

Example

julia> model = Model();
+2
source
num_constraints(model::GenericModel; count_variable_in_set_constraints::Bool)

Return the number of constraints in model.

If count_variable_in_set_constraints == true, then VariableRef constraints such as VariableRef-in-Integer are included. To count only the number of structural constraints (for example, the rows in the constraint matrix of a linear program), pass count_variable_in_set_constraints = false.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0, Int);
 
@@ -1458,18 +1458,18 @@
 3
 
 julia> num_constraints(model; count_variable_in_set_constraints = false)
-1
source

num_variables

JuMP.num_variablesFunction
num_variables(model::GenericModel)::Int64

Returns number of variables in model.

Example

julia> model = Model();
+1
source

num_variables

JuMP.num_variablesFunction
num_variables(model::GenericModel)::Int64

Returns number of variables in model.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
 julia> num_variables(model)
-2
source

object_dictionary

JuMP.object_dictionaryFunction
object_dictionary(model::GenericModel)

Return the dictionary that maps the symbol name of a variable, constraint, or expression to the corresponding object.

Objects are registered to a specific symbol in the macros. For example, @variable(model, x[1:2, 1:2]) registers the array of variables x to the symbol :x.

This method should be defined for any subtype of AbstractModel.

See also: unregister.

Example

julia> model = Model();
+2
source

object_dictionary

JuMP.object_dictionaryFunction
object_dictionary(model::GenericModel)

Return the dictionary that maps the symbol name of a variable, constraint, or expression to the corresponding object.

Objects are registered to a specific symbol in the macros. For example, @variable(model, x[1:2, 1:2]) registers the array of variables x to the symbol :x.

This method should be defined for any subtype of AbstractModel.

See also: unregister.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
 julia> object_dictionary(model)
 Dict{Symbol, Any} with 1 entry:
-  :x => VariableRef[x[1], x[2]]
source

objective_bound

JuMP.objective_boundFunction
objective_bound(model::GenericModel)

Return the best known bound on the optimal objective value after a call to optimize!(model).

For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

In the case of a vector-valued objective, this returns the ideal point, that is, the point obtained if each objective was optimized independently.

This function is equivalent to querying the MOI.ObjectiveBound attribute.

Example

julia> import HiGHS
+  :x => VariableRef[x[1], x[2]]
source

objective_bound

JuMP.objective_boundFunction
objective_bound(model::GenericModel)

Return the best known bound on the optimal objective value after a call to optimize!(model).

For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

In the case of a vector-valued objective, this returns the ideal point, that is, the point obtained if each objective was optimized independently.

This function is equivalent to querying the MOI.ObjectiveBound attribute.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1482,7 +1482,7 @@
 julia> optimize!(model)
 
 julia> objective_bound(model)
-3.0
source

objective_function

objective_function

JuMP.objective_functionFunction
objective_function(
     model::GenericModel,
     ::Type{F} = objective_function_type(model),
 ) where {F}

Return an object of type F representing the objective function.

Errors if the objective is not convertible to type F.

This function is equivalent to querying the MOI.ObjectiveFunction{F} attribute.

Example

julia> model = Model();
@@ -1502,21 +1502,21 @@
 julia> typeof(objective_function(model, QuadExpr))
 QuadExpr (alias for GenericQuadExpr{Float64, GenericVariableRef{Float64}})

We see with the last two commands that even if the objective function is affine, as it is convertible to a quadratic function, it can be queried as a quadratic function and the result is quadratic.

However, it is not convertible to a variable:

julia> objective_function(model, VariableRef)
 ERROR: InexactError: convert(MathOptInterface.VariableIndex, 1.0 + 2.0 MOI.VariableIndex(1))
-[...]
source

objective_function_string

JuMP.objective_function_stringFunction
objective_function_string(mode, model::AbstractModel)::String

Return a String describing the objective function of the model.

Example

julia> model = Model();
+[...]
source

objective_function_string

JuMP.objective_function_stringFunction
objective_function_string(mode, model::AbstractModel)::String

Return a String describing the objective function of the model.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> @objective(model, Min, 2 * x);
 
 julia> objective_function_string(MIME("text/plain"), model)
-"2 x"
source

objective_function_type

objective_function_type

JuMP.objective_function_typeFunction
objective_function_type(model::GenericModel)::AbstractJuMPScalar

Return the type of the objective function.

This function is equivalent to querying the MOI.ObjectiveFunctionType attribute.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> @objective(model, Min, 2 * x + 1);
 
 julia> objective_function_type(model)
-AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
source

objective_sense

JuMP.objective_senseFunction
objective_sense(model::GenericModel)::MOI.OptimizationSense

Return the objective sense.

This function is equivalent to querying the MOI.ObjectiveSense attribute.

Example

julia> model = Model();
+AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
source

objective_sense

JuMP.objective_senseFunction
objective_sense(model::GenericModel)::MOI.OptimizationSense

Return the objective sense.

This function is equivalent to querying the MOI.ObjectiveSense attribute.

Example

julia> model = Model();
 
 julia> objective_sense(model)
 FEASIBILITY_SENSE::OptimizationSense = 2
@@ -1527,7 +1527,7 @@
 x
 
 julia> objective_sense(model)
-MAX_SENSE::OptimizationSense = 1
source

objective_value

JuMP.objective_valueFunction
objective_value(model::GenericModel; result::Int = 1)

Return the objective value associated with result index result of the most-recent solution returned by the solver.

For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

This function is equivalent to querying the MOI.ObjectiveValue attribute.

See also: result_count.

Example

julia> import HiGHS
+MAX_SENSE::OptimizationSense = 1
source

objective_value

JuMP.objective_valueFunction
objective_value(model::GenericModel; result::Int = 1)

Return the objective value associated with result index result of the most-recent solution returned by the solver.

For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

This function is equivalent to querying the MOI.ObjectiveValue attribute.

See also: result_count.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1545,7 +1545,7 @@
 julia> objective_value(model; result = 2)
 ERROR: Result index of attribute MathOptInterface.ObjectiveValue(2) out of bounds. There are currently 1 solution(s) in the model.
 Stacktrace:
-[...]
source

op_ifelse

JuMP.op_ifelseFunction
op_ifelse(a, x, y)

A function that falls back to ifelse(a, x, y), but when called with a JuMP variables or expression in the first argument, returns a GenericNonlinearExpr.

Example

julia> model = Model();
+[...]
source

op_ifelse

JuMP.op_ifelseFunction
op_ifelse(a, x, y)

A function that falls back to ifelse(a, x, y), but when called with a JuMP variables or expression in the first argument, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1556,14 +1556,14 @@
 ifelse(x, 1.0, 2.0)
 
 julia> op_ifelse(true, x, 2.0)
-x
source

op_string

JuMP.op_stringFunction
op_string(mime::MIME, x::GenericNonlinearExpr, ::Val{op}) where {op}

Return the string that should be printed for the operator op when function_string is called with mime and x.

Example

julia> model = Model();
+x
source

op_string

JuMP.op_stringFunction
op_string(mime::MIME, x::GenericNonlinearExpr, ::Val{op}) where {op}

Return the string that should be printed for the operator op when function_string is called with mime and x.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2], Bin);
 
 julia> f = @expression(model, x[1] || x[2]);
 
 julia> op_string(MIME("text/plain"), f, Val(:||))
-"||"
source

operator_to_set

JuMP.operator_to_setFunction
operator_to_set(error_fn::Function, ::Val{sense_symbol})

Converts a sense symbol to a set set such that @constraint(model, func sense_symbol 0) is equivalent to @constraint(model, func in set) for any func::AbstractJuMPScalar.

Example

Once a custom set is defined you can directly create a JuMP constraint with it:

julia> struct CustomSet{T} <: MOI.AbstractScalarSet
+"||"
source

operator_to_set

JuMP.operator_to_setFunction
operator_to_set(error_fn::Function, ::Val{sense_symbol})

Converts a sense symbol to a set set such that @constraint(model, func sense_symbol 0) is equivalent to @constraint(model, func in set) for any func::AbstractJuMPScalar.

Example

Once a custom set is defined you can directly create a JuMP constraint with it:

julia> struct CustomSet{T} <: MOI.AbstractScalarSet
            value::T
        end
 
@@ -1582,8 +1582,8 @@
 julia> MOIU.shift_constant(set::CustomSet, value) = CustomSet(set.value + value)
 
 julia> cref = @constraint(model, x ⊰ 1)
-x ∈ CustomSet{Float64}(1.0)

Note that the whole function is first moved to the right-hand side, then the sign is transformed into a set with zero constant and finally the constant is moved to the set with MOIU.shift_constant.

source

operator_warn

JuMP.operator_warnFunction
operator_warn(model::AbstractModel)
-operator_warn(model::GenericModel)

This function is called on the model whenever two affine expressions are added together without using destructive_add!, and at least one of the two expressions has more than 50 terms.

For the case of Model, if this function is called more than 20,000 times then a warning is generated once.

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

optimize!

JuMP.optimize!Function
optimize!(
+x ∈ CustomSet{Float64}(1.0)

Note that the whole function is first moved to the right-hand side, then the sign is transformed into a set with zero constant and finally the constant is moved to the set with MOIU.shift_constant.

source

operator_warn

JuMP.operator_warnFunction
operator_warn(model::AbstractModel)
+operator_warn(model::GenericModel)

This function is called on the model whenever two affine expressions are added together without using destructive_add!, and at least one of the two expressions has more than 50 terms.

For the case of Model, if this function is called more than 20,000 times then a warning is generated once.

This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

source

optimize!

JuMP.optimize!Function
optimize!(
     model::GenericModel;
     ignore_optimize_hook = (model.optimize_hook === nothing),
     kwargs...,
@@ -1603,7 +1603,7 @@
 my_optimize_hook (generic function with 1 method)
 
 julia> optimize!(model; foo = 2)
-Hook called with foo = 2
source

optimizer_index

optimizer_index

JuMP.optimizer_indexFunction
optimizer_index(x::GenericVariableRef)::MOI.VariableIndex
 optimizer_index(x::ConstraintRef{<:GenericModel})::MOI.ConstraintIndex

Return the variable or constraint index that corresponds to x in the associated model unsafe_backend(owner_model(x)).

This function should be used with unsafe_backend.

As a safer alternative, use backend and index. See the docstrings of backend and unsafe_backend for more details.

Throws

  • Throws NoOptimizer if no optimizer is set.
  • Throws an ErrorException if the optimizer is set but is not attached.
  • Throws an ErrorException if the index is bridged.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
@@ -1619,7 +1619,7 @@
 A HiGHS model with 1 columns and 0 rows.
 
 julia> optimizer_index(x)
-MOI.VariableIndex(1)
source

optimizer_with_attributes

JuMP.optimizer_with_attributesFunction
optimizer_with_attributes(optimizer_constructor, attrs::Pair...)

Groups an optimizer constructor with the list of attributes attrs. Note that it is equivalent to MOI.OptimizerWithAttributes.

When provided to the Model constructor or to set_optimizer, it creates an optimizer by calling optimizer_constructor(), and then sets the attributes using set_attribute.

See also: set_attribute, get_attribute.

Note

The string names of the attributes are specific to each solver. One should consult the solver's documentation to find the attributes of interest.

Example

julia> import HiGHS
+MOI.VariableIndex(1)
source

optimizer_with_attributes

JuMP.optimizer_with_attributesFunction
optimizer_with_attributes(optimizer_constructor, attrs::Pair...)

Groups an optimizer constructor with the list of attributes attrs. Note that it is equivalent to MOI.OptimizerWithAttributes.

When provided to the Model constructor or to set_optimizer, it creates an optimizer by calling optimizer_constructor(), and then sets the attributes using set_attribute.

See also: set_attribute, get_attribute.

Note

The string names of the attributes are specific to each solver. One should consult the solver's documentation to find the attributes of interest.

Example

julia> import HiGHS
 
 julia> optimizer = optimizer_with_attributes(
            HiGHS.Optimizer, "presolve" => "off", MOI.Silent() => true,
@@ -1631,12 +1631,12 @@
 
 julia> set_attribute(model, "presolve", "off")
 
-julia> set_attribute(model, MOI.Silent(), true)
source

owner_model

JuMP.owner_modelFunction
owner_model(s::AbstractJuMPScalar)

Return the model owning the scalar s.

Example

julia> model = Model();
+julia> set_attribute(model, MOI.Silent(), true)
source

owner_model

JuMP.owner_modelFunction
owner_model(s::AbstractJuMPScalar)

Return the model owning the scalar s.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> owner_model(x) === model
-true
source

parameter_value

parameter_value

JuMP.parameter_valueFunction
parameter_value(x::GenericVariableRef)

Return the value of the parameter x.

Errors if x is not a parameter.

See also ParameterRef, is_parameter, set_parameter_value.

Example

julia> model = Model();
 
 julia> @variable(model, p in Parameter(2))
 p
@@ -1647,23 +1647,23 @@
 julia> set_parameter_value(p, 2.5)
 
 julia> parameter_value(p)
-2.5
source

parse_constraint

JuMP.parse_constraintFunction
parse_constraint(error_fn::Function, expr::Expr)

The entry-point for all constraint-related parsing.

Arguments

  • The error_fn function is passed everywhere to provide better error messages
  • expr comes from the @constraint macro. There are two possibilities:
    • @constraint(model, expr)
    • @constraint(model, name[args], expr)
    In both cases, expr is the main component of the constraint.

Supported syntax

JuMP currently supports the following expr objects:

  • lhs <= rhs
  • lhs == rhs
  • lhs >= rhs
  • l <= body <= u
  • u >= body >= l
  • lhs ⟂ rhs
  • lhs in rhs
  • lhs ∈ rhs
  • z --> {constraint}
  • !z --> {constraint}
  • z <--> {constraint}
  • !z <--> {constraint}
  • z => {constraint}
  • !z => {constraint}

as well as all broadcasted variants.

Extensions

The infrastructure behind parse_constraint is extendable. See parse_constraint_head and parse_constraint_call for details.

source

parse_constraint_call

parse_constraint

JuMP.parse_constraintFunction
parse_constraint(error_fn::Function, expr::Expr)

The entry-point for all constraint-related parsing.

Arguments

  • The error_fn function is passed everywhere to provide better error messages
  • expr comes from the @constraint macro. There are two possibilities:
    • @constraint(model, expr)
    • @constraint(model, name[args], expr)
    In both cases, expr is the main component of the constraint.

Supported syntax

JuMP currently supports the following expr objects:

  • lhs <= rhs
  • lhs == rhs
  • lhs >= rhs
  • l <= body <= u
  • u >= body >= l
  • lhs ⟂ rhs
  • lhs in rhs
  • lhs ∈ rhs
  • z --> {constraint}
  • !z --> {constraint}
  • z <--> {constraint}
  • !z <--> {constraint}
  • z => {constraint}
  • !z => {constraint}

as well as all broadcasted variants.

Extensions

The infrastructure behind parse_constraint is extendable. See parse_constraint_head and parse_constraint_call for details.

source

parse_constraint_call

JuMP.parse_constraint_callFunction
parse_constraint_call(
     error_fn::Function,
     is_vectorized::Bool,
     ::Val{op},
     args...,
-)

Implement this method to intercept the parsing of a :call expression with operator op.

Warning

Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

Arguments

  • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
  • is_vectorized: a boolean to indicate if op should be broadcast or not
  • op: the first element of the .args field of the Expr to intercept
  • args...: the .args field of the Expr.

Returns

This function must return:

  • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
  • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

See also: parse_constraint_head, build_constraint

source
parse_constraint_call(
+)

Implement this method to intercept the parsing of a :call expression with operator op.

Warning

Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

Arguments

  • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
  • is_vectorized: a boolean to indicate if op should be broadcast or not
  • op: the first element of the .args field of the Expr to intercept
  • args...: the .args field of the Expr.

Returns

This function must return:

  • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
  • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

See also: parse_constraint_head, build_constraint

source
parse_constraint_call(
     error_fn::Function,
     vectorized::Bool,
     ::Val{op},
     lhs,
     rhs,
-) where {op}

Fallback handler for binary operators. These might be infix operators like @constraint(model, lhs op rhs), or normal operators like @constraint(model, op(lhs, rhs)).

In both cases, we rewrite as lhs - rhs in operator_to_set(error_fn, op).

See operator_to_set for details.

source

parse_constraint_head

JuMP.parse_constraint_headFunction
parse_constraint_head(error_fn::Function, ::Val{head}, args...)

Implement this method to intercept the parsing of an expression with head head.

Warning

Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

Arguments

  • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
  • head: the .head field of the Expr to intercept
  • args...: the .args field of the Expr.

Returns

This function must return:

  • is_vectorized::Bool: whether the expression represents a broadcasted expression like x .<= 1
  • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
  • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

Existing implementations

JuMP currently implements:

  • ::Val{:call}, which forwards calls to parse_constraint_call
  • ::Val{:comparison}, which handles the special case of l <= body <= u.

See also: parse_constraint_call, build_constraint

source

parse_one_operator_variable

JuMP.parse_one_operator_variableFunction
parse_one_operator_variable(
+) where {op}

Fallback handler for binary operators. These might be infix operators like @constraint(model, lhs op rhs), or normal operators like @constraint(model, op(lhs, rhs)).

In both cases, we rewrite as lhs - rhs in operator_to_set(error_fn, op).

See operator_to_set for details.

source

parse_constraint_head

JuMP.parse_constraint_headFunction
parse_constraint_head(error_fn::Function, ::Val{head}, args...)

Implement this method to intercept the parsing of an expression with head head.

Warning

Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

Arguments

  • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
  • head: the .head field of the Expr to intercept
  • args...: the .args field of the Expr.

Returns

This function must return:

  • is_vectorized::Bool: whether the expression represents a broadcasted expression like x .<= 1
  • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
  • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

Existing implementations

JuMP currently implements:

  • ::Val{:call}, which forwards calls to parse_constraint_call
  • ::Val{:comparison}, which handles the special case of l <= body <= u.

See also: parse_constraint_call, build_constraint

source

parse_one_operator_variable

JuMP.parse_one_operator_variableFunction
parse_one_operator_variable(
     error_fn::Function,
     info_expr::_VariableInfoExpr,
     sense::Val{S},
     value,
-) where {S}

Update infoexr for a variable expression in the @variable macro of the form variable name S value.

source

parse_ternary_variable

JuMP.parse_ternary_variableFunction
parse_ternary_variable(error_fn, info_expr, lhs_sense, lhs, rhs_sense, rhs)

A hook for JuMP extensions to intercept the parsing of a :comparison expression, which has the form lhs lhs_sense variable rhs_sense rhs.

source

parse_variable

JuMP.parse_variableFunction
parse_variable(error_fn::Function, ::_VariableInfoExpr, args...)

A hook for extensions to intercept the parsing of inequality constraints in the @variable macro.

source

primal_feasibility_report

JuMP.primal_feasibility_reportFunction
primal_feasibility_report(
+) where {S}

Update infoexr for a variable expression in the @variable macro of the form variable name S value.

source

parse_ternary_variable

JuMP.parse_ternary_variableFunction
parse_ternary_variable(error_fn, info_expr, lhs_sense, lhs, rhs_sense, rhs)

A hook for JuMP extensions to intercept the parsing of a :comparison expression, which has the form lhs lhs_sense variable rhs_sense rhs.

source

parse_variable

JuMP.parse_variableFunction
parse_variable(error_fn::Function, ::_VariableInfoExpr, args...)

A hook for extensions to intercept the parsing of inequality constraints in the @variable macro.

source

primal_feasibility_report

JuMP.primal_feasibility_reportFunction
primal_feasibility_report(
     model::GenericModel{T},
     point::AbstractDict{GenericVariableRef{T},T} = _last_primal_solution(model),
     atol::T = zero(T),
@@ -1674,7 +1674,7 @@
 
 julia> primal_feasibility_report(model, Dict(x => 0.2))
 Dict{Any, Float64} with 1 entry:
-  x ≥ 0.5 => 0.3
source
primal_feasibility_report(
+  x ≥ 0.5 => 0.3
source
primal_feasibility_report(
     point::Function,
     model::GenericModel{T};
     atol::T = zero(T),
@@ -1687,30 +1687,30 @@
            return start_value(v)
        end
 Dict{Any, Float64} with 1 entry:
-  x ≤ 1 => 0.3
source

primal_status

primal_status

JuMP.primal_statusFunction
primal_status(model::GenericModel; result::Int = 1)

Return a MOI.ResultStatusCode describing the status of the most recent primal solution of the solver (that is, the MOI.PrimalStatus attribute) associated with the result index result.

See also: result_count.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
 julia> primal_status(model; result = 2)
-NO_SOLUTION::ResultStatusCode = 0
source
JuMP.print_active_bridgesFunction
print_active_bridges([io::IO = stdout,] model::GenericModel)

Print a list of the variable, constraint, and objective bridges that are currently used in the model.

source
print_active_bridges([io::IO = stdout,] model::GenericModel, ::Type{F}) where {F}

Print a list of bridges required for an objective function of type F.

source
print_active_bridges(
+NO_SOLUTION::ResultStatusCode = 0
source
JuMP.print_active_bridgesFunction
print_active_bridges([io::IO = stdout,] model::GenericModel)

Print a list of the variable, constraint, and objective bridges that are currently used in the model.

source
print_active_bridges([io::IO = stdout,] model::GenericModel, ::Type{F}) where {F}

Print a list of bridges required for an objective function of type F.

source
print_active_bridges(
     [io::IO = stdout,]
     model::GenericModel,
     F::Type,
     S::Type{<:MOI.AbstractSet},
-)

Print a list of bridges required for a constraint of type F-in-S.

source
print_active_bridges(
+)

Print a list of bridges required for a constraint of type F-in-S.

source
print_active_bridges(
     [io::IO = stdout,]
     model::GenericModel,
     S::Type{<:MOI.AbstractSet},
-)

Print a list of bridges required to add a variable constrained to the set S.

source
JuMP.print_bridge_graphFunction
 print_bridge_graph([io::IO,] model::GenericModel)

Print the hyper-graph containing all variable, constraint, and objective types that could be obtained by bridging the variables, constraints, and objectives that are present in the model.

Warning

This function is intended for advanced users. If you want to see only the bridges that are currently used, use print_active_bridges instead.

Explanation of output

Each node in the hyper-graph corresponds to a variable, constraint, or objective type.

  • Variable nodes are indicated by [ ]
  • Constraint nodes are indicated by ( )
  • Objective nodes are indicated by | |

The number inside each pair of brackets is an index of the node in the hyper-graph.

Note that this hyper-graph is the full list of possible transformations. When the bridged model is created, we select the shortest hyper-path(s) from this graph, so many nodes may be un-used.

For more information, see Legat, B., Dowson, O., Garcia, J., and Lubin, M. (2020). "MathOptInterface: a data structure for mathematical optimization problems." URL: https://arxiv.org/abs/2002.03447

source

quad_terms

JuMP.quad_termsFunction
quad_terms(quad::GenericQuadExpr{C,V})

Provides an iterator over tuples (coefficient::C, var_1::V, var_2::V) in the quadratic part of the quadratic expression.

source

raw_status

JuMP.raw_statusFunction
raw_status(model::GenericModel)

Return the reason why the solver stopped in its own words (that is, the MathOptInterface model attribute MOI.RawStatusString).

Example

julia> import Ipopt
+)

Print a list of bridges required to add a variable constrained to the set S.

source
JuMP.print_bridge_graphFunction
 print_bridge_graph([io::IO,] model::GenericModel)

Print the hyper-graph containing all variable, constraint, and objective types that could be obtained by bridging the variables, constraints, and objectives that are present in the model.

Warning

This function is intended for advanced users. If you want to see only the bridges that are currently used, use print_active_bridges instead.

Explanation of output

Each node in the hyper-graph corresponds to a variable, constraint, or objective type.

  • Variable nodes are indicated by [ ]
  • Constraint nodes are indicated by ( )
  • Objective nodes are indicated by | |

The number inside each pair of brackets is an index of the node in the hyper-graph.

Note that this hyper-graph is the full list of possible transformations. When the bridged model is created, we select the shortest hyper-path(s) from this graph, so many nodes may be un-used.

For more information, see Legat, B., Dowson, O., Garcia, J., and Lubin, M. (2020). "MathOptInterface: a data structure for mathematical optimization problems." URL: https://arxiv.org/abs/2002.03447

source

quad_terms

JuMP.quad_termsFunction
quad_terms(quad::GenericQuadExpr{C,V})

Provides an iterator over tuples (coefficient::C, var_1::V, var_2::V) in the quadratic part of the quadratic expression.

source

raw_status

JuMP.raw_statusFunction
raw_status(model::GenericModel)

Return the reason why the solver stopped in its own words (that is, the MathOptInterface model attribute MOI.RawStatusString).

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
 julia> raw_status(model)
-"optimize not called"
source

read_from_file

read_from_file

JuMP.read_from_fileFunction
read_from_file(
     filename::String;
     format::MOI.FileFormats.FileFormat = MOI.FileFormats.FORMAT_AUTOMATIC,
     kwargs...,
-)

Return a JuMP model read from filename in the format format.

If the filename ends in .gz, it will be uncompressed using GZip. If the filename ends in .bz2, it will be uncompressed using BZip2.

Other kwargs are passed to the Model constructor of the chosen format.

source

reduced_cost

JuMP.reduced_costFunction
reduced_cost(x::GenericVariableRef{T})::T where {T}

Return the reduced cost associated with variable x.

One interpretation of the reduced cost is that it is the change in the objective from an infinitesimal relaxation of the variable bounds.

This method is equivalent to querying the shadow price of the active variable bound (if one exists and is active).

See also: shadow_price.

Example

julia> import HiGHS
+)

Return a JuMP model read from filename in the format format.

If the filename ends in .gz, it will be uncompressed using GZip. If the filename ends in .bz2, it will be uncompressed using BZip2.

Other kwargs are passed to the Model constructor of the chosen format.

source

reduced_cost

JuMP.reduced_costFunction
reduced_cost(x::GenericVariableRef{T})::T where {T}

Return the reduced cost associated with variable x.

One interpretation of the reduced cost is that it is the change in the objective from an infinitesimal relaxation of the variable bounds.

This method is equivalent to querying the shadow price of the active variable bound (if one exists and is active).

See also: shadow_price.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1726,7 +1726,7 @@
 true
 
 julia> reduced_cost(x)
-2.0
source

relative_gap

JuMP.relative_gapFunction
relative_gap(model::GenericModel)

Return the final relative optimality gap after a call to optimize!(model).

Exact value depends upon implementation of MOI.RelativeGap by the particular solver used for optimization.

This function is equivalent to querying the MOI.RelativeGap attribute.

Example

julia> import HiGHS
+2.0
source

relative_gap

JuMP.relative_gapFunction
relative_gap(model::GenericModel)

Return the final relative optimality gap after a call to optimize!(model).

Exact value depends upon implementation of MOI.RelativeGap by the particular solver used for optimization.

This function is equivalent to querying the MOI.RelativeGap attribute.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -1739,7 +1739,7 @@
 julia> optimize!(model)
 
 julia> relative_gap(model)
-0.0
source

relax_integrality

JuMP.relax_integralityFunction
relax_integrality(model::GenericModel)

Modifies model to "relax" all binary and integrality constraints on variables. Specifically,

  • Binary constraints are deleted, and variable bounds are tightened if necessary to ensure the variable is constrained to the interval $[0, 1]$.
  • Integrality constraints are deleted without modifying variable bounds.
  • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
  • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

Example

julia> model = Model();
+0.0
source

relax_integrality

JuMP.relax_integralityFunction
relax_integrality(model::GenericModel)

Modifies model to "relax" all binary and integrality constraints on variables. Specifically,

  • Binary constraints are deleted, and variable bounds are tightened if necessary to ensure the variable is constrained to the interval $[0, 1]$.
  • Integrality constraints are deleted without modifying variable bounds.
  • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
  • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

Example

julia> model = Model();
 
 julia> @variable(model, x, Bin);
 
@@ -1765,7 +1765,7 @@
  y ≥ 1
  y ≤ 10
  y integer
- x binary
source

relax_with_penalty!

relax_with_penalty!

JuMP.relax_with_penalty!Function
relax_with_penalty!(
     model::GenericModel{T},
     [penalties::Dict{ConstraintRef,T}];
     [default::Union{Nothing,Real} = nothing,]
@@ -1808,7 +1808,7 @@
 Subject to
  c2 : 3 x + _[2] ≥ 0
  c1 : 2 x ≤ -1
- _[2] ≥ 0
source

remove_bridge

remove_bridge

JuMP.remove_bridgeFunction
remove_bridge(
     model::GenericModel{S},
     BT::Type{<:MOI.Bridges.AbstractBridge};
     coefficient_type::Type{T} = S,
@@ -1828,17 +1828,17 @@
            model,
            MOI.Bridges.Constraint.NumberConversionBridge;
            coefficient_type = Complex{Float64},
-       )
source

reshape_set

JuMP.reshape_setFunction
reshape_set(vectorized_set::MOI.AbstractSet, shape::AbstractShape)

Return a set in its original shape shape given its vectorized form vectorized_form.

Example

Given a SymmetricMatrixShape of vectorized form [1, 2, 3] in MOI.PositiveSemidefinieConeTriangle(2), the following code returns the set of the original constraint Symmetric(Matrix[1 2; 2 3]) in PSDCone():

julia> reshape_set(MOI.PositiveSemidefiniteConeTriangle(2), SymmetricMatrixShape(2))
-PSDCone()
source

reshape_vector

JuMP.reshape_vectorFunction
reshape_vector(vectorized_form::Vector, shape::AbstractShape)

Return an object in its original shape shape given its vectorized form vectorized_form.

Example

Given a SymmetricMatrixShape of vectorized form [1, 2, 3], the following code returns the matrix Symmetric(Matrix[1 2; 2 3]):

julia> reshape_vector([1, 2, 3], SymmetricMatrixShape(2))
+       )
source

reshape_set

JuMP.reshape_setFunction
reshape_set(vectorized_set::MOI.AbstractSet, shape::AbstractShape)

Return a set in its original shape shape given its vectorized form vectorized_form.

Example

Given a SymmetricMatrixShape of vectorized form [1, 2, 3] in MOI.PositiveSemidefinieConeTriangle(2), the following code returns the set of the original constraint Symmetric(Matrix[1 2; 2 3]) in PSDCone():

julia> reshape_set(MOI.PositiveSemidefiniteConeTriangle(2), SymmetricMatrixShape(2))
+PSDCone()
source

reshape_vector

JuMP.reshape_vectorFunction
reshape_vector(vectorized_form::Vector, shape::AbstractShape)

Return an object in its original shape shape given its vectorized form vectorized_form.

Example

Given a SymmetricMatrixShape of vectorized form [1, 2, 3], the following code returns the matrix Symmetric(Matrix[1 2; 2 3]):

julia> reshape_vector([1, 2, 3], SymmetricMatrixShape(2))
 2×2 LinearAlgebra.Symmetric{Int64, Matrix{Int64}}:
  1  2
- 2  3
source

result_count

JuMP.result_countFunction
result_count(model::GenericModel)

Return the number of results available to query after a call to optimize!.

Example

julia> import Ipopt
+ 2  3
source

result_count

JuMP.result_countFunction
result_count(model::GenericModel)

Return the number of results available to query after a call to optimize!.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
 julia> result_count(model)
-0
source

reverse_sense

JuMP.reverse_senseFunction
reverse_sense(::Val{T}) where {T}

Given an (in)equality symbol T, return a new Val object with the opposite (in)equality symbol.

This function is intended for use in JuMP extensions.

Example

julia> reverse_sense(Val(:>=))
-Val{:<=}()
source

set_attribute

reverse_sense

JuMP.reverse_senseFunction
reverse_sense(::Val{T}) where {T}

Given an (in)equality symbol T, return a new Val object with the opposite (in)equality symbol.

This function is intended for use in JuMP extensions.

Example

julia> reverse_sense(Val(:>=))
+Val{:<=}()
source

set_attribute

JuMP.set_attributeFunction
set_attribute(model::GenericModel, attr::MOI.AbstractModelAttribute, value)
 set_attribute(x::GenericVariableRef, attr::MOI.AbstractVariableAttribute, value)
 set_attribute(cr::ConstraintRef, attr::MOI.AbstractConstraintAttribute, value)

Set the value of a solver-specifc attribute attr to value.

This is equivalent to calling MOI.set with the associated MOI model and, for variables and constraints, with the associated MOI.VariableIndex or MOI.ConstraintIndex.

Example

julia> model = Model();
 
@@ -1852,7 +1852,7 @@
 
 julia> set_attribute(x, MOI.VariableName(), "x_new")
 
-julia> set_attribute(c, MOI.ConstraintName(), "c_new")
source
set_attribute(
+julia> set_attribute(c, MOI.ConstraintName(), "c_new")
source
set_attribute(
     model::Union{GenericModel,MOI.OptimizerWithAttributes},
     attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
     value,
@@ -1868,7 +1868,7 @@
 
 julia> set_attribute(opt, "output_flag", true)
 
-julia> set_attribute(opt, MOI.RawOptimizerAttribute("output_flag"), false)
source

set_attributes

JuMP.set_attributesFunction
set_attributes(
+julia> set_attribute(opt, MOI.RawOptimizerAttribute("output_flag"), false)
source

set_attributes

JuMP.set_attributesFunction
set_attributes(
     destination::Union{
         GenericModel,
         MOI.OptimizerWithAttributes,
@@ -1886,7 +1886,7 @@
 
 julia> set_attribute(model, "tol", 1e-4)
 
-julia> set_attribute(model, "max_iter", 100)
source

set_binary

JuMP.set_binaryFunction
set_binary(v::GenericVariableRef)

Add a constraint on the variable v that it must take values in the set $\{0,1\}$.

See also BinaryRef, is_binary, unset_binary.

Example

julia> model = Model();
+julia> set_attribute(model, "max_iter", 100)
source

set_binary

JuMP.set_binaryFunction
set_binary(v::GenericVariableRef)

Add a constraint on the variable v that it must take values in the set $\{0,1\}$.

See also BinaryRef, is_binary, unset_binary.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1896,7 +1896,7 @@
 julia> set_binary(x)
 
 julia> is_binary(x)
-true
source

set_dual_start_value

JuMP.set_dual_start_valueFunction
set_dual_start_value(con_ref::ConstraintRef, value)

Set the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref to value.

To remove a dual start value set it to nothing.

See also dual_start_value.

Example

julia> model = Model();
+true
source

set_dual_start_value

JuMP.set_dual_start_valueFunction
set_dual_start_value(con_ref::ConstraintRef, value)

Set the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref to value.

To remove a dual start value set it to nothing.

See also dual_start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 2.0);
 
@@ -1911,7 +1911,7 @@
 
 julia> set_dual_start_value(c, nothing)
 
-julia> dual_start_value(c)
source

set_integer

set_integer

JuMP.set_integerFunction
set_integer(variable_ref::GenericVariableRef)

Add an integrality constraint on the variable variable_ref.

See also IntegerRef, is_integer, unset_integer.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1921,7 +1921,7 @@
 julia> set_integer(x)
 
 julia> is_integer(x)
-true
source

set_lower_bound

set_lower_bound

set_name

JuMP.set_nameFunction
set_name(con_ref::ConstraintRef, s::AbstractString)

Set a constraint's name attribute.

Example

julia> model = Model();
+2.0
source

set_name

JuMP.set_nameFunction
set_name(con_ref::ConstraintRef, s::AbstractString)

Set a constraint's name attribute.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -1944,7 +1944,7 @@
 "my_constraint"
 
 julia> c
-my_constraint : [2 x] ∈ Nonnegatives()
source
set_name(v::GenericVariableRef, s::AbstractString)

Set a variable's name attribute.

Example

julia> model = Model();
+my_constraint : [2 x] ∈ Nonnegatives()
source
set_name(v::GenericVariableRef, s::AbstractString)

Set a variable's name attribute.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -1955,7 +1955,7 @@
 x_foo
 
 julia> name(x)
-"x_foo"
source

set_normalized_coefficient

set_normalized_coefficient

JuMP.set_normalized_coefficientFunction
set_normalized_coefficient(
     constraint::ConstraintRef,
     variable::GenericVariableRef,
     value::Number,
@@ -1970,7 +1970,7 @@
 julia> set_normalized_coefficient(con, x, 4)
 
 julia> con
-con : 4 x ≤ 2
source
set_normalized_coefficient(
+con : 4 x ≤ 2
source
set_normalized_coefficient(
     constraints::AbstractVector{<:ConstraintRef},
     variables::AbstractVector{<:GenericVariableRef},
     values::AbstractVector{<:Number},
@@ -1988,7 +1988,7 @@
 julia> set_normalized_coefficient([con, con], [x, y], [6, 7])
 
 julia> con
-con : 6 x + 7 y ≤ 2
source
set_normalized_coefficient(
+con : 6 x + 7 y ≤ 2
source
set_normalized_coefficient(
     con_ref::ConstraintRef,
     variable::AbstractVariableRef,
     new_coefficients::Vector{Tuple{Int64,T}},
@@ -2003,7 +2003,7 @@
 julia> set_normalized_coefficient(con, x, [(1, 2.0), (2, 5.0)])
 
 julia> con
-con : [2 x, 5 x] ∈ MathOptInterface.Nonnegatives(2)
source
set_normalized_coefficient(
+con : [2 x, 5 x] ∈ MathOptInterface.Nonnegatives(2)
source
set_normalized_coefficient(
     constraint::ConstraintRef,
     variable_1:GenericVariableRef,
     variable_2:GenericVariableRef,
@@ -2020,7 +2020,7 @@
 julia> set_normalized_coefficient(con, x[1], x[2], 5)
 
 julia> con
-con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
source
set_normalized_coefficient(
+con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
source
set_normalized_coefficient(
     constraints::AbstractVector{<:ConstraintRef},
     variables_1:AbstractVector{<:GenericVariableRef},
     variables_2:AbstractVector{<:GenericVariableRef},
@@ -2035,7 +2035,7 @@
 julia> set_normalized_coefficient([con, con], [x[1], x[1]], [x[1], x[2]], [4, 5])
 
 julia> con
-con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
source

set_normalized_rhs

JuMP.set_normalized_rhsFunction
set_normalized_rhs(constraint::ConstraintRef, value::Number)

Set the right-hand side term of constraint to value.

Note that prior to this step, JuMP will aggregate all constant terms onto the right-hand side of the constraint. For example, given a constraint 2x + 1 <= 2, set_normalized_rhs(con, 4) will create the constraint 2x <= 4, not 2x + 1 <= 4.

Example

julia> model = Model();
+con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
source

set_normalized_rhs

JuMP.set_normalized_rhsFunction
set_normalized_rhs(constraint::ConstraintRef, value::Number)

Set the right-hand side term of constraint to value.

Note that prior to this step, JuMP will aggregate all constant terms onto the right-hand side of the constraint. For example, given a constraint 2x + 1 <= 2, set_normalized_rhs(con, 4) will create the constraint 2x <= 4, not 2x + 1 <= 4.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -2045,7 +2045,7 @@
 julia> set_normalized_rhs(con, 4)
 
 julia> con
-con : 2 x ≤ 4
source
set_normalized_rhs(
+con : 2 x ≤ 4
source
set_normalized_rhs(
     constraints::AbstractVector{<:ConstraintRef},
     values::AbstractVector{<:Number}
 )

Set the right-hand side terms of all constraints to values.

Note that prior to this step, JuMP will aggregate all constant terms onto the right-hand side of the constraint. For example, given a constraint 2x + 1 <= 2, set_normalized_rhs([con], [4]) will create the constraint 2x <= 4, not 2x + 1 <= 4.

Example

julia> model = Model();
@@ -2064,12 +2064,12 @@
 con1 : 2 x ≤ 4
 
 julia> con2
-con2 : 3 x ≤ 5
source

set_objective

set_objective

JuMP.set_objectiveFunction
set_objective(model::AbstractModel, sense::MOI.OptimizationSense, func)

The functional equivalent of the @objective macro.

Sets the objective sense and objective function simultaneously, and is equivalent to calling set_objective_sense and set_objective_function separately.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
 
-julia> set_objective(model, MIN_SENSE, x)
source

set_objective_coefficient

set_objective_coefficient

JuMP.set_objective_coefficientFunction
set_objective_coefficient(
     model::GenericModel,
     variable::GenericVariableRef,
     coefficient::Real,
@@ -2083,7 +2083,7 @@
 julia> set_objective_coefficient(model, x, 3)
 
 julia> objective_function(model)
-3 x + 1
source
set_objective_coefficient(
+3 x + 1
source
set_objective_coefficient(
     model::GenericModel,
     variables::Vector{<:GenericVariableRef},
     coefficients::Vector{<:Real},
@@ -2099,7 +2099,7 @@
 julia> set_objective_coefficient(model, [x, y], [5, 4])
 
 julia> objective_function(model)
-5 x + 4 y + 1
source
set_objective_coefficient(
+5 x + 4 y + 1
source
set_objective_coefficient(
     model::GenericModel{T},
     variable_1::GenericVariableRef{T},
     variable_2::GenericVariableRef{T},
@@ -2116,7 +2116,7 @@
 julia> set_objective_coefficient(model, x[1], x[2], 3)
 
 julia> objective_function(model)
-2 x[1]² + 3 x[1]*x[2]
source
set_objective_coefficient(
+2 x[1]² + 3 x[1]*x[2]
source
set_objective_coefficient(
     model::GenericModel{T},
     variables_1::AbstractVector{<:GenericVariableRef{T}},
     variables_2::AbstractVector{<:GenericVariableRef{T}},
@@ -2131,7 +2131,7 @@
 julia> set_objective_coefficient(model, [x[1], x[1]], [x[1], x[2]], [2, 3])
 
 julia> objective_function(model)
-2 x[1]² + 3 x[1]*x[2]
source

set_objective_function

set_objective_function

JuMP.set_objective_functionFunction
set_objective_function(model::GenericModel, func::MOI.AbstractFunction)
 set_objective_function(model::GenericModel, func::AbstractJuMPScalar)
 set_objective_function(model::GenericModel, func::Real)
 set_objective_function(model::GenericModel, func::Vector{<:AbstractJuMPScalar})

Sets the objective function of the model to the given function.

See set_objective_sense to set the objective sense.

These are low-level functions; the recommended way to set the objective is with the @objective macro.

Example

julia> model = Model();
@@ -2146,7 +2146,7 @@
 julia> set_objective_function(model, 2 * x + 1)
 
 julia> objective_function(model)
-2 x + 1
source

set_objective_sense

JuMP.set_objective_senseFunction
set_objective_sense(model::GenericModel, sense::MOI.OptimizationSense)

Sets the objective sense of the model to the given sense.

See set_objective_function to set the objective function.

These are low-level functions; the recommended way to set the objective is with the @objective macro.

Example

julia> model = Model();
+2 x + 1
source

set_objective_sense

JuMP.set_objective_senseFunction
set_objective_sense(model::GenericModel, sense::MOI.OptimizationSense)

Sets the objective sense of the model to the given sense.

See set_objective_function to set the objective function.

These are low-level functions; the recommended way to set the objective is with the @objective macro.

Example

julia> model = Model();
 
 julia> objective_sense(model)
 FEASIBILITY_SENSE::OptimizationSense = 2
@@ -2154,7 +2154,7 @@
 julia> set_objective_sense(model, MOI.MAX_SENSE)
 
 julia> objective_sense(model)
-MAX_SENSE::OptimizationSense = 1
source

set_optimize_hook

JuMP.set_optimize_hookFunction
set_optimize_hook(model::GenericModel, f::Union{Function,Nothing})

Set the function f as the optimize hook for model.

f should have a signature f(model::GenericModel; kwargs...), where the kwargs are those passed to optimize!.

Notes

  • The optimize hook should generally modify the model, or some external state in some way, and then call optimize!(model; ignore_optimize_hook = true) to optimize the problem, bypassing the hook.
  • Use set_optimize_hook(model, nothing) to unset an optimize hook.

Example

julia> model = Model();
+MAX_SENSE::OptimizationSense = 1
source

set_optimize_hook

JuMP.set_optimize_hookFunction
set_optimize_hook(model::GenericModel, f::Union{Function,Nothing})

Set the function f as the optimize hook for model.

f should have a signature f(model::GenericModel; kwargs...), where the kwargs are those passed to optimize!.

Notes

  • The optimize hook should generally modify the model, or some external state in some way, and then call optimize!(model; ignore_optimize_hook = true) to optimize the problem, bypassing the hook.
  • Use set_optimize_hook(model, nothing) to unset an optimize hook.

Example

julia> model = Model();
 
 julia> function my_hook(model::Model; kwargs...)
            println(kwargs)
@@ -2171,7 +2171,7 @@
 Base.Pairs{Symbol, Bool, Tuple{Symbol}, @NamedTuple{test_arg::Bool}}(:test_arg => 1)
 Calling with `ignore_optimize_hook = true`
 ERROR: NoOptimizer()
-[...]
source

set_optimizer

set_optimizer

JuMP.set_optimizerFunction
set_optimizer(
     model::GenericModel,
     optimizer_factory;
     add_bridges::Bool = true,
@@ -2181,7 +2181,7 @@
 
 julia> set_optimizer(model, () -> HiGHS.Optimizer())
 
-julia> set_optimizer(model, HiGHS.Optimizer; add_bridges = false)
source

set_parameter_value

set_parameter_value

JuMP.set_parameter_valueFunction
set_parameter_value(x::GenericVariableRef, value)

Update the parameter constraint on the variable x to value.

Errors if x is not a parameter.

See also ParameterRef, is_parameter, parameter_value.

Example

julia> model = Model();
 
 julia> @variable(model, p in Parameter(2))
 p
@@ -2192,7 +2192,7 @@
 julia> set_parameter_value(p, 2.5)
 
 julia> parameter_value(p)
-2.5
source

set_silent

JuMP.set_silentFunction
set_silent(model::GenericModel)

Takes precedence over any other attribute controlling verbosity and requires the solver to produce no output.

See also: unset_silent.

Example

julia> import Ipopt
+2.5
source

set_silent

JuMP.set_silentFunction
set_silent(model::GenericModel)

Takes precedence over any other attribute controlling verbosity and requires the solver to produce no output.

See also: unset_silent.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -2204,7 +2204,7 @@
 julia> unset_silent(model)
 
 julia> get_attribute(model, MOI.Silent())
-false
source

set_start_value

set_start_value

JuMP.set_start_valueFunction
set_start_value(con_ref::ConstraintRef, value)

Set the primal start value (MOI.ConstraintPrimalStart) of the constraint con_ref to value.

To remove a primal start value set it to nothing.

See also start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 2.0);
 
@@ -2219,7 +2219,7 @@
 
 julia> set_start_value(c, nothing)
 
-julia> start_value(c)
source
set_start_value(variable::GenericVariableRef, value::Union{Real,Nothing})

Set the start value (MOI.VariablePrimalStart) of the variable to value.

Pass nothing to unset the start value.

Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

See also: has_start_value, start_value.

Example

julia> model = Model();
+julia> start_value(c)
source
set_start_value(variable::GenericVariableRef, value::Union{Real,Nothing})

Set the start value (MOI.VariablePrimalStart) of the variable to value.

Pass nothing to unset the start value.

Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

See also: has_start_value, start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 1.5);
 
@@ -2245,13 +2245,13 @@
 true
 
 julia> start_value(y)
-2.0
source

set_start_values

set_start_values

JuMP.set_start_valuesFunction
set_start_values(
     model::GenericModel;
     variable_primal_start::Union{Nothing,Function} = value,
     constraint_primal_start::Union{Nothing,Function} = value,
     constraint_dual_start::Union{Nothing,Function} = dual,
     nonlinear_dual_start::Union{Nothing,Function} = nonlinear_dual_start_value,
-)

Set the primal and dual starting values in model using the functions provided.

If any keyword argument is nothing, the corresponding start value is skipped.

If the optimizer does not support setting the starting value, the value will be skipped.

variable_primal_start

This function controls the primal starting solution for the variables. It is equivalent to calling set_start_value for each variable, or setting the MOI.VariablePrimalStart attribute.

If it is a function, it must have the form variable_primal_start(x::VariableRef) that maps each variable x to the starting primal value.

The default is value.

constraint_primal_start

This function controls the primal starting solution for the constraints. It is equivalent to calling set_start_value for each constraint, or setting the MOI.ConstraintPrimalStart attribute.

If it is a function, it must have the form constraint_primal_start(ci::ConstraintRef) that maps each constraint ci to the starting primal value.

The default is value.

constraint_dual_start

This function controls the dual starting solution for the constraints. It is equivalent to calling set_dual_start_value for each constraint, or setting the MOI.ConstraintDualStart attribute.

If it is a function, it must have the form constraint_dual_start(ci::ConstraintRef) that maps each constraint ci to the starting dual value.

The default is dual.

nonlinear_dual_start

This function controls the dual starting solution for the nonlinear constraints It is equivalent to calling set_nonlinear_dual_start_value.

If it is a function, it must have the form nonlinear_dual_start(model::GenericModel) that returns a vector corresponding to the dual start of the constraints.

The default is nonlinear_dual_start_value.

source

set_string_names_on_creation

JuMP.set_string_names_on_creationFunction
set_string_names_on_creation(model::GenericModel, value::Bool)

Set the default argument of the set_string_name keyword in the @variable and @constraint macros to value.

The set_string_name keyword is used to determine whether to assign String names to all variables and constraints in model.

By default, value is true. However, for larger models calling set_string_names_on_creation(model, false) can improve performance at the cost of reducing the readability of printing and solver log messages.

Example

julia> import HiGHS
+)

Set the primal and dual starting values in model using the functions provided.

If any keyword argument is nothing, the corresponding start value is skipped.

If the optimizer does not support setting the starting value, the value will be skipped.

variable_primal_start

This function controls the primal starting solution for the variables. It is equivalent to calling set_start_value for each variable, or setting the MOI.VariablePrimalStart attribute.

If it is a function, it must have the form variable_primal_start(x::VariableRef) that maps each variable x to the starting primal value.

The default is value.

constraint_primal_start

This function controls the primal starting solution for the constraints. It is equivalent to calling set_start_value for each constraint, or setting the MOI.ConstraintPrimalStart attribute.

If it is a function, it must have the form constraint_primal_start(ci::ConstraintRef) that maps each constraint ci to the starting primal value.

The default is value.

constraint_dual_start

This function controls the dual starting solution for the constraints. It is equivalent to calling set_dual_start_value for each constraint, or setting the MOI.ConstraintDualStart attribute.

If it is a function, it must have the form constraint_dual_start(ci::ConstraintRef) that maps each constraint ci to the starting dual value.

The default is dual.

nonlinear_dual_start

This function controls the dual starting solution for the nonlinear constraints It is equivalent to calling set_nonlinear_dual_start_value.

If it is a function, it must have the form nonlinear_dual_start(model::GenericModel) that returns a vector corresponding to the dual start of the constraints.

The default is nonlinear_dual_start_value.

source

set_string_names_on_creation

JuMP.set_string_names_on_creationFunction
set_string_names_on_creation(model::GenericModel, value::Bool)

Set the default argument of the set_string_name keyword in the @variable and @constraint macros to value.

The set_string_name keyword is used to determine whether to assign String names to all variables and constraints in model.

By default, value is true. However, for larger models calling set_string_names_on_creation(model, false) can improve performance at the cost of reducing the readability of printing and solver log messages.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -2261,7 +2261,7 @@
 julia> set_string_names_on_creation(model, false)
 
 julia> set_string_names_on_creation(model)
-false
source

set_time_limit_sec

set_time_limit_sec

set_upper_bound

set_upper_bound

shadow_price

JuMP.shadow_priceFunction
shadow_price(con_ref::ConstraintRef)

Return the change in the objective from an infinitesimal relaxation of the constraint.

The shadow price is computed from dual and can be queried only when has_duals is true and the objective sense is MIN_SENSE or MAX_SENSE (not FEASIBILITY_SENSE).

See also reduced_cost.

Comparison to dual

The shadow prices differ at most in sign from the dual value depending on the objective sense. The differences are summarized in the table:

MinMax
f(x) <= b+1-1
f(x) >= b-1+1

Notes

  • The function simply translates signs from dual and does not validate the conditions needed to guarantee the sensitivity interpretation of the shadow price. The caller is responsible, for example, for checking whether the solver converged to an optimal primal-dual pair or a proof of infeasibility.
  • The computation is based on the current objective sense of the model. If this has changed since the last solve, the results will be incorrect.
  • Relaxation of equality constraints (and hence the shadow price) is defined based on which sense of the equality constraint is active.

Example

julia> import HiGHS
+2.0
source

shadow_price

JuMP.shadow_priceFunction
shadow_price(con_ref::ConstraintRef)

Return the change in the objective from an infinitesimal relaxation of the constraint.

The shadow price is computed from dual and can be queried only when has_duals is true and the objective sense is MIN_SENSE or MAX_SENSE (not FEASIBILITY_SENSE).

See also reduced_cost.

Comparison to dual

The shadow prices differ at most in sign from the dual value depending on the objective sense. The differences are summarized in the table:

MinMax
f(x) <= b+1-1
f(x) >= b-1+1

Notes

  • The function simply translates signs from dual and does not validate the conditions needed to guarantee the sensitivity interpretation of the shadow price. The caller is responsible, for example, for checking whether the solver converged to an optimal primal-dual pair or a proof of infeasibility.
  • The computation is based on the current objective sense of the model. If this has changed since the last solve, the results will be incorrect.
  • Relaxation of equality constraints (and hence the shadow price) is defined based on which sense of the equality constraint is active.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -2303,7 +2303,7 @@
 true
 
 julia> shadow_price(c)
-2.0
source

shape

JuMP.shapeFunction
shape(c::AbstractConstraint)::AbstractShape

Return the shape of the constraint c.

Example

julia> model = Model();
+2.0
source

shape

JuMP.shapeFunction
shape(c::AbstractConstraint)::AbstractShape

Return the shape of the constraint c.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -2315,20 +2315,20 @@
 julia> d = @constraint(model, x in SOS1());
 
 julia> shape(constraint_object(d))
-VectorShape()
source

show_backend_summary

JuMP.show_backend_summaryFunction
show_backend_summary(io::IO, model::GenericModel)

Print a summary of the optimizer backing model.

Extensions

AbstractModels should implement this method.

Example

julia> model = Model();
+VectorShape()
source

show_backend_summary

JuMP.show_backend_summaryFunction
show_backend_summary(io::IO, model::GenericModel)

Print a summary of the optimizer backing model.

Extensions

AbstractModels should implement this method.

Example

julia> model = Model();
 
 julia> show_backend_summary(stdout, model)
 Model mode: AUTOMATIC
 CachingOptimizer state: NO_OPTIMIZER
-Solver name: No optimizer attached.
source

show_constraints_summary

JuMP.show_constraints_summaryFunction
show_constraints_summary(io::IO, model::AbstractModel)

Write to io a summary of the number of constraints.

Extensions

AbstractModels should implement this method.

Example

julia> model = Model();
+Solver name: No optimizer attached.
source

show_constraints_summary

JuMP.show_constraints_summaryFunction
show_constraints_summary(io::IO, model::AbstractModel)

Write to io a summary of the number of constraints.

Extensions

AbstractModels should implement this method.

Example

julia> model = Model();
 
 julia> @variable(model, x >= 0);
 
 julia> show_constraints_summary(stdout, model)
-`VariableRef`-in-`MathOptInterface.GreaterThan{Float64}`: 1 constraint
source

show_objective_function_summary

JuMP.show_objective_function_summaryFunction
show_objective_function_summary(io::IO, model::AbstractModel)

Write to io a summary of the objective function type.

Extensions

AbstractModels should implement this method.

Example

julia> model = Model();
+`VariableRef`-in-`MathOptInterface.GreaterThan{Float64}`: 1 constraint
source

show_objective_function_summary

JuMP.show_objective_function_summaryFunction
show_objective_function_summary(io::IO, model::AbstractModel)

Write to io a summary of the objective function type.

Extensions

AbstractModels should implement this method.

Example

julia> model = Model();
 
 julia> show_objective_function_summary(stdout, model)
-Objective function type: AffExpr
source

simplex_iterations

JuMP.simplex_iterationsFunction
simplex_iterations(model::GenericModel)

If available, returns the cumulative number of simplex iterations during the most-recent optimization (the MOI.SimplexIterations attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
+Objective function type: AffExpr
source

simplex_iterations

JuMP.simplex_iterationsFunction
simplex_iterations(model::GenericModel)

If available, returns the cumulative number of simplex iterations during the most-recent optimization (the MOI.SimplexIterations attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -2337,7 +2337,7 @@
 julia> optimize!(model)
 
 julia> simplex_iterations(model)
-0
source

solution_summary

JuMP.solution_summaryFunction
solution_summary(model::GenericModel; result::Int = 1, verbose::Bool = false)

Return a struct that can be used print a summary of the solution in result result.

If verbose=true, write out the primal solution for every variable and the dual solution for every constraint, excluding those with empty names.

Example

When called at the REPL, the summary is automatically printed:

julia> model = Model();
+0
source

solution_summary

JuMP.solution_summaryFunction
solution_summary(model::GenericModel; result::Int = 1, verbose::Bool = false)

Return a struct that can be used print a summary of the solution in result result.

If verbose=true, write out the primal solution for every variable and the dual solution for every constraint, excluding those with empty names.

Example

When called at the REPL, the summary is automatically printed:

julia> model = Model();
 
 julia> solution_summary(model)
 * Solver : No optimizer attached.
@@ -2373,7 +2373,7 @@
   Primal status      : NO_SOLUTION
   Dual status        : NO_SOLUTION
 
-* Work counters
source

solve_time

JuMP.solve_timeFunction
solve_time(model::GenericModel)

If available, returns the solve time in wall-clock seconds reported by the solver (the MOI.SolveTimeSec attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
+* Work counters
source

solve_time

JuMP.solve_timeFunction
solve_time(model::GenericModel)

If available, returns the solve time in wall-clock seconds reported by the solver (the MOI.SolveTimeSec attribute).

Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

Example

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer);
 
@@ -2382,7 +2382,7 @@
 julia> optimize!(model)
 
 julia> solve_time(model)
-1.0488089174032211e-5
source

solver_name

JuMP.solver_nameFunction
solver_name(model::GenericModel)

If available, returns the MOI.SolverName property of the underlying optimizer.

Returns "No optimizer attached." in AUTOMATIC or MANUAL modes when no optimizer is attached.

Returns "SolverName() attribute not implemented by the optimizer." if the attribute is not implemented.

Example

julia> import Ipopt
+1.0488089174032211e-5
source

solver_name

JuMP.solver_nameFunction
solver_name(model::GenericModel)

If available, returns the MOI.SolverName property of the underlying optimizer.

Returns "No optimizer attached." in AUTOMATIC or MANUAL modes when no optimizer is attached.

Returns "SolverName() attribute not implemented by the optimizer." if the attribute is not implemented.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -2397,7 +2397,7 @@
 julia> model = Model(MOI.FileFormats.MPS.Model);
 
 julia> solver_name(model)
-"SolverName() attribute not implemented by the optimizer."
source

start_value

JuMP.start_valueFunction
start_value(con_ref::ConstraintRef)

Return the primal start value (MOI.ConstraintPrimalStart) of the constraint con_ref.

If no primal start value has been set, start_value will return nothing.

See also set_start_value.

Example

julia> model = Model();
+"SolverName() attribute not implemented by the optimizer."
source

start_value

JuMP.start_valueFunction
start_value(con_ref::ConstraintRef)

Return the primal start value (MOI.ConstraintPrimalStart) of the constraint con_ref.

If no primal start value has been set, start_value will return nothing.

See also set_start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 2.0);
 
@@ -2412,7 +2412,7 @@
 
 julia> set_start_value(c, nothing)
 
-julia> start_value(c)
source
start_value(v::GenericVariableRef)

Return the start value (MOI.VariablePrimalStart) of the variable v.

Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

See also: has_start_value, set_start_value.

Example

julia> model = Model();
+julia> start_value(c)
source
start_value(v::GenericVariableRef)

Return the start value (MOI.VariablePrimalStart) of the variable v.

Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

See also: has_start_value, set_start_value.

Example

julia> model = Model();
 
 julia> @variable(model, x, start = 1.5);
 
@@ -2433,12 +2433,12 @@
 true
 
 julia> start_value(y)
-2.0
source

termination_status

termination_status

time_limit_sec

time_limit_sec

JuMP.time_limit_secFunction
time_limit_sec(model::GenericModel)

Return the time limit (in seconds) of the model.

Returns nothing if unset.

See also: set_time_limit_sec, unset_time_limit_sec.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -2451,7 +2451,7 @@
 
 julia> unset_time_limit_sec(model)
 
-julia> time_limit_sec(model)
source

triangle_vec

JuMP.triangle_vecFunction
triangle_vec(matrix::Matrix)

Return the upper triangle of a matrix concatenated into a vector in the order required by JuMP and MathOptInterface for Triangle sets.

Example

julia> model = Model();
+julia> time_limit_sec(model)
source

triangle_vec

JuMP.triangle_vecFunction
triangle_vec(matrix::Matrix)

Return the upper triangle of a matrix concatenated into a vector in the order required by JuMP and MathOptInterface for Triangle sets.

Example

julia> model = Model();
 
 julia> @variable(model, X[1:3, 1:3], Symmetric);
 
@@ -2459,7 +2459,7 @@
 t
 
 julia> @constraint(model, [t; triangle_vec(X)] in MOI.RootDetConeTriangle(3))
-[t, X[1,1], X[1,2], X[2,2], X[1,3], X[2,3], X[3,3]] ∈ MathOptInterface.RootDetConeTriangle(3)
source

unfix

JuMP.unfixFunction
unfix(v::GenericVariableRef)

Delete the fixing constraint of a variable.

Error if one does not exist.

See also FixRef, is_fixed, fix_value, fix.

Example

julia> model = Model();
+[t, X[1,1], X[1,2], X[2,2], X[1,3], X[2,3], X[3,3]] ∈ MathOptInterface.RootDetConeTriangle(3)
source

unfix

JuMP.unfixFunction
unfix(v::GenericVariableRef)

Delete the fixing constraint of a variable.

Error if one does not exist.

See also FixRef, is_fixed, fix_value, fix.

Example

julia> model = Model();
 
 julia> @variable(model, x == 1);
 
@@ -2469,7 +2469,7 @@
 julia> unfix(x)
 
 julia> is_fixed(x)
-false
source

unregister

JuMP.unregisterFunction
unregister(model::GenericModel, key::Symbol)

Unregister the name key from model so that a new variable, constraint, or expression can be created with the same key.

Note that this will not delete the object model[key]; it will just remove the reference at model[key]. To delete the object, use delete as well.

See also: delete, object_dictionary.

Example

julia> model = Model();
+false
source

unregister

JuMP.unregisterFunction
unregister(model::GenericModel, key::Symbol)

Unregister the name key from model so that a new variable, constraint, or expression can be created with the same key.

Note that this will not delete the object model[key]; it will just remove the reference at model[key]. To delete the object, use delete as well.

See also: delete, object_dictionary.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -2496,7 +2496,7 @@
 x
 
 julia> num_variables(model)
-2
source

unsafe_backend

JuMP.unsafe_backendFunction
unsafe_backend(model::GenericModel)

Return the innermost optimizer associated with the JuMP model model.

This function should only be used by advanced users looking to access low-level solver-specific functionality. It has a high-risk of incorrect usage. We strongly suggest you use the alternative suggested below.

See also: backend.

To obtain the index of a variable or constraint in the unsafe backend, use optimizer_index.

Unsafe behavior

This function is unsafe for two main reasons.

First, the formulation and order of variables and constraints in the unsafe backend may be different to the variables and constraints in model. This can happen because of bridges, or because the solver requires the variables or constraints in a specific order. In addition, the variable or constraint index returned by index at the JuMP level may be different to the index of the corresponding variable or constraint in the unsafe_backend. There is no solution to this. Use the alternative suggested below instead.

Second, the unsafe_backend may be empty, or lack some modifications made to the JuMP model. Thus, before calling unsafe_backend you should first call MOI.Utilities.attach_optimizer to ensure that the backend is synchronized with the JuMP model.

julia> import HiGHS
+2
source

unsafe_backend

JuMP.unsafe_backendFunction
unsafe_backend(model::GenericModel)

Return the innermost optimizer associated with the JuMP model model.

This function should only be used by advanced users looking to access low-level solver-specific functionality. It has a high-risk of incorrect usage. We strongly suggest you use the alternative suggested below.

See also: backend.

To obtain the index of a variable or constraint in the unsafe backend, use optimizer_index.

Unsafe behavior

This function is unsafe for two main reasons.

First, the formulation and order of variables and constraints in the unsafe backend may be different to the variables and constraints in model. This can happen because of bridges, or because the solver requires the variables or constraints in a specific order. In addition, the variable or constraint index returned by index at the JuMP level may be different to the index of the corresponding variable or constraint in the unsafe_backend. There is no solution to this. Use the alternative suggested below instead.

Second, the unsafe_backend may be empty, or lack some modifications made to the JuMP model. Thus, before calling unsafe_backend you should first call MOI.Utilities.attach_optimizer to ensure that the backend is synchronized with the JuMP model.

julia> import HiGHS
 
 julia> model = Model(HiGHS.Optimizer)
 A JuMP Model
@@ -2537,7 +2537,7 @@
 A HiGHS model with 1 columns and 0 rows.
 
 julia> index(x)
-MOI.VariableIndex(1)
source

unset_binary

unset_binary

JuMP.unset_binaryFunction
unset_binary(variable_ref::GenericVariableRef)

Remove the binary constraint on the variable variable_ref.

See also BinaryRef, is_binary, set_binary.

Example

julia> model = Model();
 
 julia> @variable(model, x, Bin);
 
@@ -2547,7 +2547,7 @@
 julia> unset_binary(x)
 
 julia> is_binary(x)
-false
source

unset_integer

unset_integer

JuMP.unset_integerFunction
unset_integer(variable_ref::GenericVariableRef)

Remove the integrality constraint on the variable variable_ref.

Errors if one does not exist.

See also IntegerRef, is_integer, set_integer.

Example

julia> model = Model();
 
 julia> @variable(model, x, Int);
 
@@ -2557,7 +2557,7 @@
 julia> unset_integer(x)
 
 julia> is_integer(x)
-false
source

unset_silent

JuMP.unset_silentFunction
unset_silent(model::GenericModel)

Neutralize the effect of the set_silent function and let the solver attributes control the verbosity.

See also: set_silent.

Example

julia> import Ipopt
+false
source

unset_silent

JuMP.unset_silentFunction
unset_silent(model::GenericModel)

Neutralize the effect of the set_silent function and let the solver attributes control the verbosity.

See also: set_silent.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -2569,7 +2569,7 @@
 julia> unset_silent(model)
 
 julia> get_attribute(model, MOI.Silent())
-false
source

unset_time_limit_sec

unset_time_limit_sec

JuMP.unset_time_limit_secFunction
unset_time_limit_sec(model::GenericModel)

Unset the time limit of the solver.

See also: set_time_limit_sec, time_limit_sec.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -2582,19 +2582,19 @@
 
 julia> unset_time_limit_sec(model)
 
-julia> time_limit_sec(model)
source

upper_bound

upper_bound

value

JuMP.valueFunction
value(con_ref::ConstraintRef; result::Int = 1)

Return the primal value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

That is, if con_ref is the reference of a constraint func-in-set, it returns the value of func evaluated at the value of the variables (given by value(::GenericVariableRef)).

Use has_values to check if a result exists before asking for values.

See also: result_count.

Note

For scalar constraints, the constant is moved to the set so it is not taken into account in the primal value of the constraint. For instance, the constraint @constraint(model, 2x + 3y + 1 == 5) is transformed into 2x + 3y-in-MOI.EqualTo(4) so the value returned by this function is the evaluation of 2x + 3y.

source
value(var_value::Function, con_ref::ConstraintRef)

Evaluate the primal value of the constraint con_ref using var_value(v) as the value for each variable v.

source
value(v::GenericVariableRef; result = 1)

Return the value of variable v associated with result index result of the most-recent returned by the solver.

Use has_values to check if a result exists before asking for values.

See also: result_count.

source
value(var_value::Function, v::GenericVariableRef)

Evaluate the value of the variable v as var_value(v).

source
value(var_value::Function, ex::GenericAffExpr)

Evaluate ex using var_value(v) as the value for each variable v.

source
value(v::GenericAffExpr; result::Int = 1)

Return the value of the GenericAffExpr v associated with result index result of the most-recent solution returned by the solver.

See also: result_count.

source
value(var_value::Function, ex::GenericQuadExpr)

Evaluate ex using var_value(v) as the value for each variable v.

source
value(v::GenericQuadExpr; result::Int = 1)

Return the value of the GenericQuadExpr v associated with result index result of the most-recent solution returned by the solver.

Replaces getvalue for most use cases.

See also: result_count.

source
value(p::NonlinearParameter)

Return the current value stored in the nonlinear parameter p.

Example

julia> model = Model();
+1.0
source

value

JuMP.valueFunction
value(con_ref::ConstraintRef; result::Int = 1)

Return the primal value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

That is, if con_ref is the reference of a constraint func-in-set, it returns the value of func evaluated at the value of the variables (given by value(::GenericVariableRef)).

Use has_values to check if a result exists before asking for values.

See also: result_count.

Note

For scalar constraints, the constant is moved to the set so it is not taken into account in the primal value of the constraint. For instance, the constraint @constraint(model, 2x + 3y + 1 == 5) is transformed into 2x + 3y-in-MOI.EqualTo(4) so the value returned by this function is the evaluation of 2x + 3y.

source
value(var_value::Function, con_ref::ConstraintRef)

Evaluate the primal value of the constraint con_ref using var_value(v) as the value for each variable v.

source
value(v::GenericVariableRef; result = 1)

Return the value of variable v associated with result index result of the most-recent returned by the solver.

Use has_values to check if a result exists before asking for values.

See also: result_count.

source
value(var_value::Function, v::GenericVariableRef)

Evaluate the value of the variable v as var_value(v).

source
value(var_value::Function, ex::GenericAffExpr)

Evaluate ex using var_value(v) as the value for each variable v.

source
value(v::GenericAffExpr; result::Int = 1)

Return the value of the GenericAffExpr v associated with result index result of the most-recent solution returned by the solver.

See also: result_count.

source
value(var_value::Function, ex::GenericQuadExpr)

Evaluate ex using var_value(v) as the value for each variable v.

source
value(v::GenericQuadExpr; result::Int = 1)

Return the value of the GenericQuadExpr v associated with result index result of the most-recent solution returned by the solver.

Replaces getvalue for most use cases.

See also: result_count.

source
value(p::NonlinearParameter)

Return the current value stored in the nonlinear parameter p.

Example

julia> model = Model();
 
 julia> @NLparameter(model, p == 10)
 p == 10.0
 
 julia> value(p)
-10.0
source
value(ex::NonlinearExpression; result::Int = 1)

Return the value of the NonlinearExpression ex associated with result index result of the most-recent solution returned by the solver.

See also: result_count.

source
value(var_value::Function, ex::NonlinearExpression)

Evaluate ex using var_value(v) as the value for each variable v.

source
value(c::NonlinearConstraintRef; result::Int = 1)

Return the value of the NonlinearConstraintRef c associated with result index result of the most-recent solution returned by the solver.

See also: result_count.

source
value(var_value::Function, c::NonlinearConstraintRef)

Evaluate c using var_value(v) as the value for each variable v.

source

value_type

JuMP.value_typeFunction
value_type(::Type{<:Union{AbstractModel,AbstractVariableRef}})

Return the return type of value for variables of that model. It defaults to Float64 if it is not implemented.

Example

julia> value_type(GenericModel{BigFloat})
-BigFloat
source

variable_by_name

JuMP.variable_by_nameFunction
variable_by_name(
+10.0
source
value(ex::NonlinearExpression; result::Int = 1)

Return the value of the NonlinearExpression ex associated with result index result of the most-recent solution returned by the solver.

See also: result_count.

source
value(var_value::Function, ex::NonlinearExpression)

Evaluate ex using var_value(v) as the value for each variable v.

source
value(c::NonlinearConstraintRef; result::Int = 1)

Return the value of the NonlinearConstraintRef c associated with result index result of the most-recent solution returned by the solver.

See also: result_count.

source
value(var_value::Function, c::NonlinearConstraintRef)

Evaluate c using var_value(v) as the value for each variable v.

source

value_type

JuMP.value_typeFunction
value_type(::Type{<:Union{AbstractModel,AbstractVariableRef}})

Return the return type of value for variables of that model. It defaults to Float64 if it is not implemented.

Example

julia> value_type(GenericModel{BigFloat})
+BigFloat
source

variable_by_name

JuMP.variable_by_nameFunction
variable_by_name(
     model::AbstractModel,
     name::String,
 )::Union{AbstractVariableRef,Nothing}

Returns the reference of the variable with name attribute name or Nothing if no variable has this name attribute. Throws an error if several variables have name as their name attribute.

Example

julia> model = Model();
@@ -2637,12 +2637,12 @@
  u[2]
 
 julia> variable_by_name(model, "u[2]")
-u[2]
source

variable_ref_type

JuMP.variable_ref_typeFunction
variable_ref_type(::Union{F,Type{F}}) where {F}

A helper function used internally by JuMP and some JuMP extensions. Returns the variable type associated with the model or expression type F.

source

vectorize

JuMP.vectorizeFunction
vectorize(matrix::AbstractMatrix, ::Shape)

Convert the matrix into a vector according to Shape.

source

write_to_file

variable_ref_type

JuMP.variable_ref_typeFunction
variable_ref_type(::Union{F,Type{F}}) where {F}

A helper function used internally by JuMP and some JuMP extensions. Returns the variable type associated with the model or expression type F.

source

vectorize

JuMP.vectorizeFunction
vectorize(matrix::AbstractMatrix, ::Shape)

Convert the matrix into a vector according to Shape.

source

write_to_file

JuMP.write_to_fileFunction
write_to_file(
     model::GenericModel,
     filename::String;
     format::MOI.FileFormats.FileFormat = MOI.FileFormats.FORMAT_AUTOMATIC,
     kwargs...,
-)

Write the JuMP model model to filename in the format format.

If the filename ends in .gz, it will be compressed using GZip. If the filename ends in .bz2, it will be compressed using BZip2.

Other kwargs are passed to the Model constructor of the chosen format.

source

AbstractConstraint

JuMP.AbstractConstraintType
abstract type AbstractConstraint

An abstract base type for all constraint types. AbstractConstraints store the function and set directly, unlike ConstraintRefs that are merely references to constraints stored in a model. AbstractConstraints do not need to be attached to a model.

source

AbstractJuMPScalar

JuMP.AbstractJuMPScalarType
AbstractJuMPScalar <: MutableArithmetics.AbstractMutable

Abstract base type for all scalar types

The subtyping of AbstractMutable will allow calls of some Base functions to be redirected to a method in MA that handles type promotion more carefully (for example the promotion in sparse matrix products in SparseArrays usually does not work for JuMP types) and exploits the mutability of AffExpr and QuadExpr.

source

AbstractModel

JuMP.AbstractModelType
AbstractModel

An abstract type that should be subtyped for users creating JuMP extensions.

source

AbstractScalarSet

JuMP.AbstractScalarSetType
AbstractScalarSet

An abstract type for defining new scalar sets in JuMP.

Implement moi_set(::AbstractScalarSet) to convert the type into an MOI set.

See also: moi_set.

source

AbstractShape

AbstractVariable

AbstractVariableRef

JuMP.AbstractVariableRefType
AbstractVariableRef

Variable returned by add_variable. Affine (resp. quadratic) operations with variables of type V<:AbstractVariableRef and coefficients of type T create a GenericAffExpr{T,V} (resp. GenericQuadExpr{T,V}).

source

AbstractVectorSet

JuMP.AbstractVectorSetType
AbstractVectorSet

An abstract type for defining new sets in JuMP.

Implement moi_set(::AbstractVectorSet, dim::Int) to convert the type into an MOI set.

See also: moi_set.

source

AffExpr

ArrayShape

JuMP.ArrayShapeType
ArrayShape{N}(dims::NTuple{N,Int}) where {N}

An AbstractShape that represents array-valued constraints.

Example

julia> model = Model();
+)

Write the JuMP model model to filename in the format format.

If the filename ends in .gz, it will be compressed using GZip. If the filename ends in .bz2, it will be compressed using BZip2.

Other kwargs are passed to the Model constructor of the chosen format.

source

AbstractConstraint

JuMP.AbstractConstraintType
abstract type AbstractConstraint

An abstract base type for all constraint types. AbstractConstraints store the function and set directly, unlike ConstraintRefs that are merely references to constraints stored in a model. AbstractConstraints do not need to be attached to a model.

source

AbstractJuMPScalar

JuMP.AbstractJuMPScalarType
AbstractJuMPScalar <: MutableArithmetics.AbstractMutable

Abstract base type for all scalar types

The subtyping of AbstractMutable will allow calls of some Base functions to be redirected to a method in MA that handles type promotion more carefully (for example the promotion in sparse matrix products in SparseArrays usually does not work for JuMP types) and exploits the mutability of AffExpr and QuadExpr.

source

AbstractModel

JuMP.AbstractModelType
AbstractModel

An abstract type that should be subtyped for users creating JuMP extensions.

source

AbstractScalarSet

JuMP.AbstractScalarSetType
AbstractScalarSet

An abstract type for defining new scalar sets in JuMP.

Implement moi_set(::AbstractScalarSet) to convert the type into an MOI set.

See also: moi_set.

source

AbstractShape

AbstractVariable

AbstractVariableRef

JuMP.AbstractVariableRefType
AbstractVariableRef

Variable returned by add_variable. Affine (resp. quadratic) operations with variables of type V<:AbstractVariableRef and coefficients of type T create a GenericAffExpr{T,V} (resp. GenericQuadExpr{T,V}).

source

AbstractVectorSet

JuMP.AbstractVectorSetType
AbstractVectorSet

An abstract type for defining new sets in JuMP.

Implement moi_set(::AbstractVectorSet, dim::Int) to convert the type into an MOI set.

See also: moi_set.

source

AffExpr

ArrayShape

JuMP.ArrayShapeType
ArrayShape{N}(dims::NTuple{N,Int}) where {N}

An AbstractShape that represents array-valued constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2, 1:3]);
 
@@ -2651,12 +2651,12 @@
  x[2,1]  x[2,2]  x[2,3]] ∈ Nonnegatives()
 
 julia> shape(constraint_object(c))
-ArrayShape{2}((2, 3))
source

BinaryRef

JuMP.BinaryRefFunction
BinaryRef(v::GenericVariableRef)

Return a constraint reference to the constraint constraining v to be binary. Errors if one does not exist.

See also is_binary, set_binary, unset_binary.

Example

julia> model = Model();
+ArrayShape{2}((2, 3))
source

BinaryRef

JuMP.BinaryRefFunction
BinaryRef(v::GenericVariableRef)

Return a constraint reference to the constraint constraining v to be binary. Errors if one does not exist.

See also is_binary, set_binary, unset_binary.

Example

julia> model = Model();
 
 julia> @variable(model, x, Bin);
 
 julia> BinaryRef(x)
-x binary
source

BridgeableConstraint

BridgeableConstraint

JuMP.BridgeableConstraintType
BridgeableConstraint(
     constraint::C,
     bridge_type::B;
     coefficient_type::Type{T} = Float64,
@@ -2671,7 +2671,7 @@
 )
     constraint = ScalarConstraint(func, set)
     return BridgeableConstraint(constraint, CustomBridge)
-end

Note

JuMP extensions should extend JuMP.build_constraint only if they also defined CustomSet, for three reasons:

  1. It is problematic if multiple extensions overload the same JuMP method.
  2. A missing method will not inform the users that they forgot to load the extension module defining the build_constraint method.
  3. Defining a method where neither the function nor any of the argument types are defined in the package is called type piracy and is discouraged in the Julia style guide.
source

ComplexPlane

JuMP.ComplexPlaneType
ComplexPlane

Complex plane object that can be used to create a complex variable in the @variable macro.

Example

Consider the following example:

julia> model = Model();
+end

Note

JuMP extensions should extend JuMP.build_constraint only if they also defined CustomSet, for three reasons:

  1. It is problematic if multiple extensions overload the same JuMP method.
  2. A missing method will not inform the users that they forgot to load the extension module defining the build_constraint method.
  3. Defining a method where neither the function nor any of the argument types are defined in the package is called type piracy and is discouraged in the Julia style guide.
source

ComplexPlane

JuMP.ComplexPlaneType
ComplexPlane

Complex plane object that can be used to create a complex variable in the @variable macro.

Example

Consider the following example:

julia> model = Model();
 
 julia> @variable(model, x in ComplexPlane())
 real(x) + imag(x) im
@@ -2679,7 +2679,7 @@
 julia> all_variables(model)
 2-element Vector{VariableRef}:
  real(x)
- imag(x)

We see in the output of the last command that two real variables were created. The Julia variable x binds to an affine expression in terms of these two variables that parametrize the complex plane.

source

ComplexVariable

ConstraintNotOwned

JuMP.ConstraintNotOwnedType
struct ConstraintNotOwned{C<:ConstraintRef} <: Exception
+ imag(x)

We see in the output of the last command that two real variables were created. The Julia variable x binds to an affine expression in terms of these two variables that parametrize the complex plane.

source

ComplexVariable

ConstraintNotOwned

JuMP.ConstraintNotOwnedType
struct ConstraintNotOwned{C<:ConstraintRef} <: Exception
     constraint_ref::C
 end

An error thrown when the constraint constraint_ref was used in a model different to owner_model(constraint_ref).

Example

julia> model = Model();
 
@@ -2693,12 +2693,12 @@
 julia> MOI.get(model_new, MOI.ConstraintName(), c)
 ERROR: ConstraintNotOwned{ConstraintRef{Model, MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.GreaterThan{Float64}}, ScalarShape}}(c : x ≥ 0)
 Stacktrace:
-[...]
source

ConstraintRef

FixRef

JuMP.FixRefFunction
FixRef(v::GenericVariableRef)

Return a constraint reference to the constraint fixing the value of v.

Errors if one does not exist.

See also is_fixed, fix_value, fix, unfix.

Example

julia> model = Model();
+[...]
source

ConstraintRef

FixRef

JuMP.FixRefFunction
FixRef(v::GenericVariableRef)

Return a constraint reference to the constraint fixing the value of v.

Errors if one does not exist.

See also is_fixed, fix_value, fix, unfix.

Example

julia> model = Model();
 
 julia> @variable(model, x == 1);
 
 julia> FixRef(x)
-x = 1
source

GenericAffExpr

GenericAffExpr

JuMP.GenericAffExprType
mutable struct GenericAffExpr{CoefType,VarType} <: AbstractJuMPScalar
     constant::CoefType
     terms::OrderedDict{VarType,CoefType}
 end

An expression type representing an affine expression of the form: $\sum a_i x_i + c$.

Fields

  • .constant: the constant c in the expression.
  • .terms: an OrderedDict, with keys of VarType and values of CoefType describing the sparse vector a.

Example

julia> model = Model();
@@ -2714,13 +2714,13 @@
 julia> expr.terms
 OrderedCollections.OrderedDict{VariableRef, Float64} with 2 entries:
   x[2] => 1.0
-  x[1] => 3.0
source

GenericModel

GenericModel

JuMP.GenericModelType
GenericModel{T}(
     [optimizer_factory;]
     add_bridges::Bool = true,
 ) where {T<:Real}

Create a new instance of a JuMP model.

If optimizer_factory is provided, the model is initialized with the optimizer returned by MOI.instantiate(optimizer_factory).

If optimizer_factory is not provided, use set_optimizer to set the optimizer before calling optimize!.

If add_bridges, JuMP adds a MOI.Bridges.LazyBridgeOptimizer to automatically reformulate the problem into a form supported by the optimizer.

Value type T

Passing a type other than Float64 as the value type T is an advanced operation. The value type must match that expected by the chosen optimizer. Consult the optimizers documentation for details.

If not documented, assume that the optimizer supports only Float64.

Choosing an unsupported value type will throw an MOI.UnsupportedConstraint or an MOI.UnsupportedAttribute error, the timing of which (during the model construction or during a call to optimize!) depends on how the solver is interfaced to JuMP.

Example

julia> model = GenericModel{BigFloat}();
 
 julia> typeof(model)
-GenericModel{BigFloat}
source

GenericNonlinearExpr

GenericNonlinearExpr

JuMP.GenericNonlinearExprType
GenericNonlinearExpr{V}(head::Symbol, args::Vector{Any})
 GenericNonlinearExpr{V}(head::Symbol, args::Any...)

The scalar-valued nonlinear function head(args...), represented as a symbolic expression tree, with the call operator head and ordered arguments in args.

V is the type of AbstractVariableRef present in the expression, and is used to help dispatch JuMP extensions.

head

The head::Symbol must be an operator supported by the model.

The default list of supported univariate operators is given by:

and the default list of supported multivariate operators is given by:

Additional operators can be add using @operator.

See the full list of operators supported by a MOI.ModelLike by querying the MOI.ListOfSupportedNonlinearOperators attribute.

args

The vector args contains the arguments to the nonlinear function. If the operator is univariate, it must contain one element. Otherwise, it may contain multiple elements.

Given a subtype of AbstractVariableRef, V, for GenericNonlinearExpr{V}, each element must be one of the following:

where T<:Real and T == value_type(V).

Unsupported operators

If the optimizer does not support head, an MOI.UnsupportedNonlinearOperator error will be thrown.

There is no guarantee about when this error will be thrown; it may be thrown when the function is first added to the model, or it may be thrown when optimize! is called.

Example

To represent the function $f(x) = sin(x)^2$, do:

julia> model = Model();
 
 julia> @variable(model, x)
@@ -2734,7 +2734,7 @@
            GenericNonlinearExpr{VariableRef}(:sin, x),
            2.0,
        )
-sin(x) ^ 2.0
source

GenericQuadExpr

GenericQuadExpr

JuMP.GenericQuadExprType
mutable struct GenericQuadExpr{CoefType,VarType} <: AbstractJuMPScalar
     aff::GenericAffExpr{CoefType,VarType}
     terms::OrderedDict{UnorderedPair{VarType}, CoefType}
 end

An expression type representing an quadratic expression of the form: $\sum q_{i,j} x_i x_j + \sum a_i x_i + c$.

Fields

  • .aff: an GenericAffExpr representing the affine portion of the expression.
  • .terms: an OrderedDict, with keys of UnorderedPair{VarType} and values of CoefType, describing the sparse list of terms q.

Example

julia> model = Model();
@@ -2750,16 +2750,16 @@
 julia> expr.terms
 OrderedCollections.OrderedDict{UnorderedPair{VariableRef}, Float64} with 2 entries:
   UnorderedPair{VariableRef}(x[1], x[1]) => 2.0
-  UnorderedPair{VariableRef}(x[1], x[2]) => 1.0
source

GenericReferenceMap

JuMP.GenericReferenceMapType
GenericReferenceMap{T}

Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

source

GenericVariableRef

JuMP.GenericVariableRefType
GenericVariableRef{T} <: AbstractVariableRef

Holds a reference to the model and the corresponding MOI.VariableIndex.

source

GreaterThanZero

JuMP.GreaterThanZeroType
GreaterThanZero()

A struct used to intercept when >= or is used in a macro via operator_to_set.

This struct is not the same as Nonnegatives so that we can disambiguate x >= y and x - y in Nonnegatives().

This struct is not intended for general usage, but it may be useful to some JuMP extensions.

Example

julia> operator_to_set(error, Val(:>=))
-GreaterThanZero()
source

HermitianMatrixAdjointShape

HermitianMatrixShape

GenericReferenceMap

JuMP.GenericReferenceMapType
GenericReferenceMap{T}

Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

source

GenericVariableRef

JuMP.GenericVariableRefType
GenericVariableRef{T} <: AbstractVariableRef

Holds a reference to the model and the corresponding MOI.VariableIndex.

source

GreaterThanZero

JuMP.GreaterThanZeroType
GreaterThanZero()

A struct used to intercept when >= or is used in a macro via operator_to_set.

This struct is not the same as Nonnegatives so that we can disambiguate x >= y and x - y in Nonnegatives().

This struct is not intended for general usage, but it may be useful to some JuMP extensions.

Example

julia> operator_to_set(error, Val(:>=))
+GreaterThanZero()
source

HermitianMatrixAdjointShape

HermitianMatrixShape

JuMP.HermitianMatrixShapeType
HermitianMatrixShape(
     side_dimension::Int;
     needs_adjoint_dual::Bool = false,
-)

The shape object for a Hermitian square matrix of side_dimension rows and columns.

The vectorized form corresponds to MOI.HermitianPositiveSemidefiniteConeTriangle.

needs_adjoint_dual

By default, the dual_shape of HermitianMatrixShape is also HermitianMatrixShape. This is true for cases such as a LinearAlgebra.Hermitian matrix in HermitianPSDCone.

However, JuMP also supports LinearAlgebra.Hermitian matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

source

HermitianMatrixSpace

JuMP.HermitianMatrixSpaceType
HermitianMatrixSpace()

Use in the @variable macro to constrain a matrix of variables to be hermitian.

Example

julia> model = Model();
+)

The shape object for a Hermitian square matrix of side_dimension rows and columns.

The vectorized form corresponds to MOI.HermitianPositiveSemidefiniteConeTriangle.

needs_adjoint_dual

By default, the dual_shape of HermitianMatrixShape is also HermitianMatrixShape. This is true for cases such as a LinearAlgebra.Hermitian matrix in HermitianPSDCone.

However, JuMP also supports LinearAlgebra.Hermitian matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

source

HermitianMatrixSpace

JuMP.HermitianMatrixSpaceType
HermitianMatrixSpace()

Use in the @variable macro to constrain a matrix of variables to be hermitian.

Example

julia> model = Model();
 
 julia> @variable(model, Q[1:2, 1:2] in HermitianMatrixSpace())
 2×2 LinearAlgebra.Hermitian{GenericAffExpr{ComplexF64, VariableRef}, Matrix{GenericAffExpr{ComplexF64, VariableRef}}}:
  real(Q[1,1])                    real(Q[1,2]) + imag(Q[1,2]) im
- real(Q[1,2]) - imag(Q[1,2]) im  real(Q[2,2])
source

HermitianPSDCone

JuMP.HermitianPSDConeType
HermitianPSDCone

Hermitian positive semidefinite cone object that can be used to create a Hermitian positive semidefinite square matrix in the @variable and @constraint macros.

Example

Consider the following example:

julia> model = Model();
+ real(Q[1,2]) - imag(Q[1,2]) im  real(Q[2,2])
source

HermitianPSDCone

JuMP.HermitianPSDConeType
HermitianPSDCone

Hermitian positive semidefinite cone object that can be used to create a Hermitian positive semidefinite square matrix in the @variable and @constraint macros.

Example

Consider the following example:

julia> model = Model();
 
 julia> @variable(model, H[1:3, 1:3] in HermitianPSDCone())
 3×3 LinearAlgebra.Hermitian{GenericAffExpr{ComplexF64, VariableRef}, Matrix{GenericAffExpr{ComplexF64, VariableRef}}}:
@@ -2781,18 +2781,18 @@
 
 julia> all_constraints(model, Vector{VariableRef}, MOI.HermitianPositiveSemidefiniteConeTriangle)
 1-element Vector{ConstraintRef{Model, MathOptInterface.ConstraintIndex{MathOptInterface.VectorOfVariables, MathOptInterface.HermitianPositiveSemidefiniteConeTriangle}}}:
- [real(H[1,1]), real(H[1,2]), real(H[2,2]), real(H[1,3]), real(H[2,3]), real(H[3,3]), imag(H[1,2]), imag(H[1,3]), imag(H[2,3])] ∈ MathOptInterface.HermitianPositiveSemidefiniteConeTriangle(3)

We see in the output of the last commands that 9 real variables were created. The matrix H constrains affine expressions in terms of these 9 variables that parametrize a Hermitian matrix.

source

IntegerRef

JuMP.IntegerRefFunction
IntegerRef(v::GenericVariableRef)

Return a constraint reference to the constraint constraining v to be integer.

Errors if one does not exist.

See also is_integer, set_integer, unset_integer.

Example

julia> model = Model();
+ [real(H[1,1]), real(H[1,2]), real(H[2,2]), real(H[1,3]), real(H[2,3]), real(H[3,3]), imag(H[1,2]), imag(H[1,3]), imag(H[2,3])] ∈ MathOptInterface.HermitianPositiveSemidefiniteConeTriangle(3)

We see in the output of the last commands that 9 real variables were created. The matrix H constrains affine expressions in terms of these 9 variables that parametrize a Hermitian matrix.

source

IntegerRef

JuMP.IntegerRefFunction
IntegerRef(v::GenericVariableRef)

Return a constraint reference to the constraint constraining v to be integer.

Errors if one does not exist.

See also is_integer, set_integer, unset_integer.

Example

julia> model = Model();
 
 julia> @variable(model, x, Int);
 
 julia> IntegerRef(x)
-x integer
source

LPMatrixData

LessThanZero

JuMP.LessThanZeroType
GreaterThanZero()

A struct used to intercept when <= or is used in a macro via operator_to_set.

This struct is not the same as Nonpositives so that we can disambiguate x <= y and x - y in Nonpositives().

This struct is not intended for general usage, but it may be useful to some JuMP extensions.

Example

julia> operator_to_set(error, Val(:<=))
-LessThanZero()
source

LinearTermIterator

JuMP.LinearTermIteratorType
LinearTermIterator{GAE<:GenericAffExpr}

A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable) in the GenericAffExpr.

source

LowerBoundRef

LPMatrixData

LessThanZero

JuMP.LessThanZeroType
GreaterThanZero()

A struct used to intercept when <= or is used in a macro via operator_to_set.

This struct is not the same as Nonpositives so that we can disambiguate x <= y and x - y in Nonpositives().

This struct is not intended for general usage, but it may be useful to some JuMP extensions.

Example

julia> operator_to_set(error, Val(:<=))
+LessThanZero()
source

LinearTermIterator

JuMP.LinearTermIteratorType
LinearTermIterator{GAE<:GenericAffExpr}

A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable) in the GenericAffExpr.

source

LowerBoundRef

Model

JuMP.ModelType
Model([optimizer_factory;] add_bridges::Bool = true)

Create a new instance of a JuMP model.

If optimizer_factory is provided, the model is initialized with thhe optimizer returned by MOI.instantiate(optimizer_factory).

If optimizer_factory is not provided, use set_optimizer to set the optimizer before calling optimize!.

If add_bridges, JuMP adds a MOI.Bridges.LazyBridgeOptimizer to automatically reformulate the problem into a form supported by the optimizer.

Example

julia> import Ipopt
+x ≥ 1
source

Model

JuMP.ModelType
Model([optimizer_factory;] add_bridges::Bool = true)

Create a new instance of a JuMP model.

If optimizer_factory is provided, the model is initialized with thhe optimizer returned by MOI.instantiate(optimizer_factory).

If optimizer_factory is not provided, use set_optimizer to set the optimizer before calling optimize!.

If add_bridges, JuMP adds a MOI.Bridges.LazyBridgeOptimizer to automatically reformulate the problem into a form supported by the optimizer.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
@@ -2803,16 +2803,16 @@
 
 julia> import MultiObjectiveAlgorithms as MOA
 
-julia> model = Model(() -> MOA.Optimizer(HiGHS.Optimizer); add_bridges = false);
source

ModelMode

JuMP.ModelModeType
ModelMode

An enum to describe the state of the CachingOptimizer inside a JuMP model.

See also: mode.

Values

Possible values are:

  • [AUTOMATIC]: moi_backend field holds a CachingOptimizer in AUTOMATIC mode.
  • [MANUAL]: moi_backend field holds a CachingOptimizer in MANUAL mode.
  • [DIRECT]: moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.
source

NLPEvaluator

JuMP.NLPEvaluatorFunction
NLPEvaluator(
+julia> model = Model(() -> MOA.Optimizer(HiGHS.Optimizer); add_bridges = false);
source

ModelMode

JuMP.ModelModeType
ModelMode

An enum to describe the state of the CachingOptimizer inside a JuMP model.

See also: mode.

Values

Possible values are:

  • [AUTOMATIC]: moi_backend field holds a CachingOptimizer in AUTOMATIC mode.
  • [MANUAL]: moi_backend field holds a CachingOptimizer in MANUAL mode.
  • [DIRECT]: moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.
source

NLPEvaluator

JuMP.NLPEvaluatorFunction
NLPEvaluator(
     model::Model,
     _differentiation_backend::MOI.Nonlinear.AbstractAutomaticDifferentiation =
         MOI.Nonlinear.SparseReverseMode(),
-)

Return an MOI.AbstractNLPEvaluator constructed from model

Warning

Before using, you must initialize the evaluator using MOI.initialize.

Experimental

These features may change or be removed in any future version of JuMP.

Pass _differentiation_backend to specify the differentiation backend used to compute derivatives.

source

NoOptimizer

JuMP.NoOptimizerType
struct NoOptimizer <: Exception end

An error thrown when no optimizer is set and one is required.

The optimizer can be provided to the Model constructor or by calling set_optimizer.

Example

julia> model = Model();
+)

Return an MOI.AbstractNLPEvaluator constructed from model

Warning

Before using, you must initialize the evaluator using MOI.initialize.

Experimental

These features may change or be removed in any future version of JuMP.

Pass _differentiation_backend to specify the differentiation backend used to compute derivatives.

source

NoOptimizer

JuMP.NoOptimizerType
struct NoOptimizer <: Exception end

An error thrown when no optimizer is set and one is required.

The optimizer can be provided to the Model constructor or by calling set_optimizer.

Example

julia> model = Model();
 
 julia> optimize!(model)
 ERROR: NoOptimizer()
 Stacktrace:
-[...]
source

NonlinearExpr

NonlinearOperator

JuMP.NonlinearOperatorType
NonlinearOperator(func::Function, head::Symbol)

A callable struct (functor) representing a function named head.

When called with AbstractJuMPScalars, the struct returns a GenericNonlinearExpr.

When called with non-JuMP types, the struct returns the evaluation of func(args...).

Unless head is special-cased by the optimizer, the operator must have already been added to the model using add_nonlinear_operator or @operator.

Example

julia> model = Model();
+[...]
source

NonlinearExpr

NonlinearOperator

JuMP.NonlinearOperatorType
NonlinearOperator(func::Function, head::Symbol)

A callable struct (functor) representing a function named head.

When called with AbstractJuMPScalars, the struct returns a GenericNonlinearExpr.

When called with non-JuMP types, the struct returns the evaluation of func(args...).

Unless head is special-cased by the optimizer, the operator must have already been added to the model using add_nonlinear_operator or @operator.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -2836,7 +2836,7 @@
 op_f(x)
 
 julia> bar(2.0)
-4.0
source

Nonnegatives

JuMP.NonnegativesType
Nonnegatives()

The JuMP equivalent of the MOI.Nonnegatives set, in which the dimension is inferred from the corresponding function.

Example

julia> model = Model();
+4.0
source

Nonnegatives

JuMP.NonnegativesType
Nonnegatives()

The JuMP equivalent of the MOI.Nonnegatives set, in which the dimension is inferred from the corresponding function.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2])
 2-element Vector{VariableRef}:
@@ -2851,7 +2851,7 @@
 julia> b = [5, 6];
 
 julia> @constraint(model, A * x >= b)
-[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonnegatives()
source

Nonpositives

JuMP.NonpositivesType
Nonpositives()

The JuMP equivalent of the MOI.Nonpositives set, in which the dimension is inferred from the corresponding function.

Example

julia> model = Model();
+[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonnegatives()
source

Nonpositives

JuMP.NonpositivesType
Nonpositives()

The JuMP equivalent of the MOI.Nonpositives set, in which the dimension is inferred from the corresponding function.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2])
 2-element Vector{VariableRef}:
@@ -2866,14 +2866,14 @@
 julia> b = [5, 6];
 
 julia> @constraint(model, A * x <= b)
-[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonpositives()
source

OptimizationSense

OptimizeNotCalled

JuMP.OptimizeNotCalledType
struct OptimizeNotCalled <: Exception end

An error thrown when a result attribute cannot be queried before optimize! is called.

Example

julia> import Ipopt
+[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonpositives()
source

OptimizationSense

OptimizeNotCalled

JuMP.OptimizeNotCalledType
struct OptimizeNotCalled <: Exception end

An error thrown when a result attribute cannot be queried before optimize! is called.

Example

julia> import Ipopt
 
 julia> model = Model(Ipopt.Optimizer);
 
 julia> objective_value(model)
 ERROR: OptimizeNotCalled()
 Stacktrace:
-[...]
source

PSDCone

JuMP.PSDConeType
PSDCone

Positive semidefinite cone object that can be used to constrain a square matrix to be positive semidefinite in the @constraint macro.

If the matrix has type Symmetric then the columns vectorization (the vector obtained by concatenating the columns) of its upper triangular part is constrained to belong to the MOI.PositiveSemidefiniteConeTriangle set, otherwise its column vectorization is constrained to belong to the MOI.PositiveSemidefiniteConeSquare set.

Example

Non-symmetric case:

julia> model = Model();
+[...]
source

PSDCone

JuMP.PSDConeType
PSDCone

Positive semidefinite cone object that can be used to constrain a square matrix to be positive semidefinite in the @constraint macro.

If the matrix has type Symmetric then the columns vectorization (the vector obtained by concatenating the columns) of its upper triangular part is constrained to belong to the MOI.PositiveSemidefiniteConeTriangle set, otherwise its column vectorization is constrained to belong to the MOI.PositiveSemidefiniteConeSquare set.

Example

Non-symmetric case:

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -2914,7 +2914,7 @@
  x - 4
 
 julia> moi_set(constraint_object(cref))
-MathOptInterface.PositiveSemidefiniteConeTriangle(2)
source

Parameter

JuMP.ParameterType
Parameter(value)

A short-cut for the MOI.Parameter set.

Example

julia> model = Model();
+MathOptInterface.PositiveSemidefiniteConeTriangle(2)
source

Parameter

JuMP.ParameterType
Parameter(value)

A short-cut for the MOI.Parameter set.

Example

julia> model = Model();
 
 julia> @variable(model, x in Parameter(2))
 x
@@ -2922,7 +2922,7 @@
 julia> print(model)
 Feasibility
 Subject to
- x ∈ MathOptInterface.Parameter{Float64}(2.0)
source

ParameterRef

ParameterRef

JuMP.ParameterRefFunction
ParameterRef(x::GenericVariableRef)

Return a constraint reference to the constraint constraining x to be a parameter.

Errors if one does not exist.

See also is_parameter, set_parameter_value, parameter_value.

Example

julia> model = Model();
 
 julia> @variable(model, p in Parameter(2))
 p
@@ -2935,7 +2935,7 @@
 julia> ParameterRef(x)
 ERROR: Variable x is not a parameter.
 Stacktrace:
-[...]
source

QuadExpr

QuadTermIterator

JuMP.QuadTermIteratorType
QuadTermIterator{GQE<:GenericQuadExpr}

A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable, variable) in the GenericQuadExpr.

source

ReferenceMap

JuMP.ReferenceMapType
GenericReferenceMap{T}

Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

source

ResultStatusCode

JuMP.ResultStatusCodeType
ResultStatusCode

An Enum of possible values for the PrimalStatus and DualStatus attributes.

The values indicate how to interpret the result vector.

Values

Possible values are:

  • NO_SOLUTION: the result vector is empty.
  • FEASIBLE_POINT: the result vector is a feasible point.
  • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
  • INFEASIBLE_POINT: the result vector is an infeasible point.
  • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
  • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
  • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
  • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
  • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
  • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
source

RotatedSecondOrderCone

JuMP.RotatedSecondOrderConeType
RotatedSecondOrderCone

Rotated second order cone object that can be used to constrain the square of the euclidean norm of a vector x to be less than or equal to $2tu$ where t and u are nonnegative scalars. This is a shortcut for the MOI.RotatedSecondOrderCone.

Example

The following constrains $\|(x-1, x-2)\|^2_2 \le 2tx$ and $t, x \ge 0$:

julia> model = Model();
+[...]
source

QuadExpr

QuadTermIterator

JuMP.QuadTermIteratorType
QuadTermIterator{GQE<:GenericQuadExpr}

A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable, variable) in the GenericQuadExpr.

source

ReferenceMap

JuMP.ReferenceMapType
GenericReferenceMap{T}

Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

source

ResultStatusCode

JuMP.ResultStatusCodeType
ResultStatusCode

An Enum of possible values for the PrimalStatus and DualStatus attributes.

The values indicate how to interpret the result vector.

Values

Possible values are:

  • NO_SOLUTION: the result vector is empty.
  • FEASIBLE_POINT: the result vector is a feasible point.
  • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
  • INFEASIBLE_POINT: the result vector is an infeasible point.
  • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
  • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
  • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
  • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
  • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
  • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
source

RotatedSecondOrderCone

JuMP.RotatedSecondOrderConeType
RotatedSecondOrderCone

Rotated second order cone object that can be used to constrain the square of the euclidean norm of a vector x to be less than or equal to $2tu$ where t and u are nonnegative scalars. This is a shortcut for the MOI.RotatedSecondOrderCone.

Example

The following constrains $\|(x-1, x-2)\|^2_2 \le 2tx$ and $t, x \ge 0$:

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -2944,7 +2944,7 @@
 t
 
 julia> @constraint(model, [t, x, x-1, x-2] in RotatedSecondOrderCone())
-[t, x, x - 1, x - 2] ∈ MathOptInterface.RotatedSecondOrderCone(4)
source

SOS1

JuMP.SOS1Type
SOS1(weights = Real[])

The SOS1 (Special Ordered Set of Type 1) set constrains a vector x to the set where at most one variable can take a non-zero value, and all other elements are zero.

The weights vector, if specified, induces an ordering of the variables; as such, it should contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

This is a shortcut for the MOI.SOS1 set.

Example

julia> model = Model();
+[t, x, x - 1, x - 2] ∈ MathOptInterface.RotatedSecondOrderCone(4)
source

SOS1

JuMP.SOS1Type
SOS1(weights = Real[])

The SOS1 (Special Ordered Set of Type 1) set constrains a vector x to the set where at most one variable can take a non-zero value, and all other elements are zero.

The weights vector, if specified, induces an ordering of the variables; as such, it should contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

This is a shortcut for the MOI.SOS1 set.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:3] in SOS1([4.1, 3.2, 5.0]))
 3-element Vector{VariableRef}:
@@ -2955,7 +2955,7 @@
 julia> print(model)
 Feasibility
 Subject to
- [x[1], x[2], x[3]] ∈ MathOptInterface.SOS1{Float64}([4.1, 3.2, 5.0])
source

SOS2

JuMP.SOS2Type
SOS2(weights = Real[])

The SOS2 (Special Ordered Set of Type 2) set constrains a vector x to the set where at most two variables can take a non-zero value, and all other elements are zero. In addition, the two non-zero values must be consecutive given the ordering of the x vector induced by weights.

The weights vector, if specified, induces an ordering of the variables; as such, it must contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

This is a shortcut for the MOI.SOS2 set.

Example

julia> model = Model();
+ [x[1], x[2], x[3]] ∈ MathOptInterface.SOS1{Float64}([4.1, 3.2, 5.0])
source

SOS2

JuMP.SOS2Type
SOS2(weights = Real[])

The SOS2 (Special Ordered Set of Type 2) set constrains a vector x to the set where at most two variables can take a non-zero value, and all other elements are zero. In addition, the two non-zero values must be consecutive given the ordering of the x vector induced by weights.

The weights vector, if specified, induces an ordering of the variables; as such, it must contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

This is a shortcut for the MOI.SOS2 set.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:3] in SOS2([4.1, 3.2, 5.0]))
 3-element Vector{VariableRef}:
@@ -2966,7 +2966,7 @@
 julia> print(model)
 Feasibility
 Subject to
- [x[1], x[2], x[3]] ∈ MathOptInterface.SOS2{Float64}([4.1, 3.2, 5.0])
source

ScalarConstraint

JuMP.ScalarConstraintType
struct ScalarConstraint

The data for a scalar constraint.

See also the documentation on JuMP's representation of constraints for more background.

Fields

  • .func: field contains a JuMP object representing the function
  • .set: field contains the MOI set

Example

A scalar constraint:

julia> model = Model();
+ [x[1], x[2], x[3]] ∈ MathOptInterface.SOS2{Float64}([4.1, 3.2, 5.0])
source

ScalarConstraint

JuMP.ScalarConstraintType
struct ScalarConstraint

The data for a scalar constraint.

See also the documentation on JuMP's representation of constraints for more background.

Fields

  • .func: field contains a JuMP object representing the function
  • .set: field contains the MOI set

Example

A scalar constraint:

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -2983,14 +2983,14 @@
 2 x
 
 julia> object.set
-MathOptInterface.LessThan{Float64}(1.0)
source

ScalarShape

ScalarShape

JuMP.ScalarShapeType
ScalarShape()

An AbstractShape that represents scalar constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
 julia> c = @constraint(model, x[2] <= 1);
 
 julia> shape(constraint_object(c))
-ScalarShape()
source

ScalarVariable

SecondOrderCone

JuMP.SecondOrderConeType
SecondOrderCone

Second order cone object that can be used to constrain the euclidean norm of a vector x to be less than or equal to a nonnegative scalar t. This is a shortcut for the MOI.SecondOrderCone.

Example

The following constrains $\|(x-1, x-2)\|_2 \le t$ and $t \ge 0$:

julia> model = Model();
+ScalarShape()
source

ScalarVariable

SecondOrderCone

JuMP.SecondOrderConeType
SecondOrderCone

Second order cone object that can be used to constrain the euclidean norm of a vector x to be less than or equal to a nonnegative scalar t. This is a shortcut for the MOI.SecondOrderCone.

Example

The following constrains $\|(x-1, x-2)\|_2 \le t$ and $t \ge 0$:

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -2999,7 +2999,7 @@
 t
 
 julia> @constraint(model, [t, x-1, x-2] in SecondOrderCone())
-[t, x - 1, x - 2] ∈ MathOptInterface.SecondOrderCone(3)
source

Semicontinuous

JuMP.SemicontinuousType
Semicontinuous(lower, upper)

A short-cut for the MOI.Semicontinuous set.

This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

Example

julia> model = Model();
+[t, x - 1, x - 2] ∈ MathOptInterface.SecondOrderCone(3)
source

Semicontinuous

JuMP.SemicontinuousType
Semicontinuous(lower, upper)

A short-cut for the MOI.Semicontinuous set.

This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

Example

julia> model = Model();
 
 julia> @variable(model, x in Semicontinuous(1, 2))
 x
@@ -3007,7 +3007,7 @@
 julia> print(model)
 Feasibility
 Subject to
- x ∈ MathOptInterface.Semicontinuous{Int64}(1, 2)
source

Semiinteger

JuMP.SemiintegerType
Semiinteger(lower, upper)

A short-cut for the MOI.Semiinteger set.

This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

Example

julia> model = Model();
+ x ∈ MathOptInterface.Semicontinuous{Int64}(1, 2)
source

Semiinteger

JuMP.SemiintegerType
Semiinteger(lower, upper)

A short-cut for the MOI.Semiinteger set.

This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

Example

julia> model = Model();
 
 julia> @variable(model, x in Semiinteger(3, 5))
 x
@@ -3015,12 +3015,12 @@
 julia> print(model)
 Feasibility
 Subject to
- x ∈ MathOptInterface.Semiinteger{Int64}(3, 5)
source

SensitivityReport

SkewSymmetricMatrixShape

JuMP.SkewSymmetricMatrixShapeType
SkewSymmetricMatrixShape

Shape object for a skew symmetric square matrix of side_dimension rows and columns. The vectorized form contains the entries of the upper-right triangular part of the matrix (without the diagonal) given column by column (or equivalently, the entries of the lower-left triangular part given row by row). The diagonal is zero.

source

SkewSymmetricMatrixSpace

JuMP.SkewSymmetricMatrixSpaceType
SkewSymmetricMatrixSpace()

Use in the @variable macro to constrain a matrix of variables to be skew-symmetric.

Example

julia> model = Model();
+ x ∈ MathOptInterface.Semiinteger{Int64}(3, 5)
source

SensitivityReport

SkewSymmetricMatrixShape

JuMP.SkewSymmetricMatrixShapeType
SkewSymmetricMatrixShape

Shape object for a skew symmetric square matrix of side_dimension rows and columns. The vectorized form contains the entries of the upper-right triangular part of the matrix (without the diagonal) given column by column (or equivalently, the entries of the lower-left triangular part given row by row). The diagonal is zero.

source

SkewSymmetricMatrixSpace

JuMP.SkewSymmetricMatrixSpaceType
SkewSymmetricMatrixSpace()

Use in the @variable macro to constrain a matrix of variables to be skew-symmetric.

Example

julia> model = Model();
 
 julia> @variable(model, Q[1:2, 1:2] in SkewSymmetricMatrixSpace())
 2×2 Matrix{AffExpr}:
  0        Q[1,2]
- -Q[1,2]  0
source

SkipModelConvertScalarSetWrapper

JuMP.SkipModelConvertScalarSetWrapperType
SkipModelConvertScalarSetWrapper(set::MOI.AbstractScalarSet)

JuMP uses model_convert to automatically promote MOI.AbstractScalarSet sets to the same value_type as the model.

In cases there this is undesirable, wrap the set in SkipModelConvertScalarSetWrapper to pass the set un-changed to the solver.

Warning

This struct is intended for use internally by JuMP extensions. You should not need to use it in regular JuMP code.

Example

julia> model = Model();
+ -Q[1,2]  0
source

SkipModelConvertScalarSetWrapper

JuMP.SkipModelConvertScalarSetWrapperType
SkipModelConvertScalarSetWrapper(set::MOI.AbstractScalarSet)

JuMP uses model_convert to automatically promote MOI.AbstractScalarSet sets to the same value_type as the model.

In cases there this is undesirable, wrap the set in SkipModelConvertScalarSetWrapper to pass the set un-changed to the solver.

Warning

This struct is intended for use internally by JuMP extensions. You should not need to use it in regular JuMP code.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3028,15 +3028,15 @@
 x = 0.5
 
 julia> @constraint(model, x in SkipModelConvertScalarSetWrapper(MOI.EqualTo(1 // 2)))
-x = 1//2
source

SquareMatrixShape

JuMP.SquareMatrixShapeType
SquareMatrixShape

Shape object for a square matrix of side_dimension rows and columns. The vectorized form contains the entries of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

source

SymmetricMatrixAdjointShape

SymmetricMatrixShape

SquareMatrixShape

JuMP.SquareMatrixShapeType
SquareMatrixShape

Shape object for a square matrix of side_dimension rows and columns. The vectorized form contains the entries of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

source

SymmetricMatrixAdjointShape

SymmetricMatrixShape

JuMP.SymmetricMatrixShapeType
SymmetricMatrixShape(
     side_dimension::Int;
     needs_adjoint_dual::Bool = false,
-)

The shape object for a symmetric square matrix of side_dimension rows and columns.

The vectorized form contains the entries of the upper-right triangular part of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

needs_adjoint_dual

By default, the dual_shape of SymmetricMatrixShape is also SymmetricMatrixShape. This is true for cases such as a LinearAlgebra.Symmetric matrix in PSDCone.

However, JuMP also supports LinearAlgebra.Symmetric matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

source

SymmetricMatrixSpace

JuMP.SymmetricMatrixSpaceType
SymmetricMatrixSpace()

Use in the @variable macro to constrain a matrix of variables to be symmetric.

Example

julia> model = Model();
+)

The shape object for a symmetric square matrix of side_dimension rows and columns.

The vectorized form contains the entries of the upper-right triangular part of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

needs_adjoint_dual

By default, the dual_shape of SymmetricMatrixShape is also SymmetricMatrixShape. This is true for cases such as a LinearAlgebra.Symmetric matrix in PSDCone.

However, JuMP also supports LinearAlgebra.Symmetric matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

source

SymmetricMatrixSpace

JuMP.SymmetricMatrixSpaceType
SymmetricMatrixSpace()

Use in the @variable macro to constrain a matrix of variables to be symmetric.

Example

julia> model = Model();
 
 julia> @variable(model, Q[1:2, 1:2] in SymmetricMatrixSpace())
 2×2 LinearAlgebra.Symmetric{VariableRef, Matrix{VariableRef}}:
  Q[1,1]  Q[1,2]
- Q[1,2]  Q[2,2]
source

TerminationStatusCode

JuMP.TerminationStatusCodeType
TerminationStatusCode

An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

Values

Possible values are:

  • OPTIMIZE_NOT_CALLED: The algorithm has not started.
  • OPTIMAL: The algorithm found a globally optimal solution.
  • INFEASIBLE: The algorithm concluded that no feasible solution exists.
  • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
  • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
  • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
  • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
  • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
  • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
  • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
  • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
  • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
  • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
  • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
  • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
  • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
  • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
  • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
  • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
  • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
  • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
  • INVALID_MODEL: The algorithm stopped because the model is invalid.
  • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
  • INTERRUPTED: The algorithm stopped because of an interrupt signal.
  • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
source

UnorderedPair

TerminationStatusCode

JuMP.TerminationStatusCodeType
TerminationStatusCode

An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

Values

Possible values are:

  • OPTIMIZE_NOT_CALLED: The algorithm has not started.
  • OPTIMAL: The algorithm found a globally optimal solution.
  • INFEASIBLE: The algorithm concluded that no feasible solution exists.
  • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
  • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
  • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
  • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
  • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
  • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
  • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
  • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
  • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
  • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
  • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
  • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
  • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
  • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
  • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
  • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
  • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
  • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
  • INVALID_MODEL: The algorithm stopped because the model is invalid.
  • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
  • INTERRUPTED: The algorithm stopped because of an interrupt signal.
  • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
source

UnorderedPair

JuMP.UnorderedPairType
UnorderedPair(a::T, b::T)

A wrapper type used by GenericQuadExpr with fields .a and .b.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -3045,12 +3045,12 @@
 
 julia> expr.terms
 OrderedCollections.OrderedDict{UnorderedPair{VariableRef}, Float64} with 1 entry:
-  UnorderedPair{VariableRef}(x[1], x[2]) => 2.0
source

UpperBoundRef

UpperBoundRef

VariableConstrainedOnCreation

JuMP.VariableConstrainedOnCreationType
VariableConstrainedOnCreation <: AbstractVariable

Variable scalar_variables constrained to belong to set.

Adding this variable can be understood as doing:

function JuMP.add_variable(
+x ≤ 1
source

VariableConstrainedOnCreation

JuMP.VariableConstrainedOnCreationType
VariableConstrainedOnCreation <: AbstractVariable

Variable scalar_variables constrained to belong to set.

Adding this variable can be understood as doing:

function JuMP.add_variable(
     model::GenericModel,
     variable::VariableConstrainedOnCreation,
     names,
@@ -3058,9 +3058,9 @@
     var_ref = add_variable(model, variable.scalar_variable, name)
     add_constraint(model, VectorConstraint(var_ref, variable.set))
     return var_ref
-end

but adds the variables with MOI.add_constrained_variable(model, variable.set) instead.

source

VariableInfo

JuMP.VariableInfoType
VariableInfo{S,T,U,V}

A struct by JuMP internally when creating variables. This may also be used by JuMP extensions to create new types of variables.

See also: ScalarVariable.

source

VariableNotOwned

JuMP.VariableNotOwnedType
struct VariableNotOwned{V<:AbstractVariableRef} <: Exception
+end

but adds the variables with MOI.add_constrained_variable(model, variable.set) instead.

source

VariableInfo

JuMP.VariableInfoType
VariableInfo{S,T,U,V}

A struct by JuMP internally when creating variables. This may also be used by JuMP extensions to create new types of variables.

See also: ScalarVariable.

source

VariableNotOwned

JuMP.VariableNotOwnedType
struct VariableNotOwned{V<:AbstractVariableRef} <: Exception
     variable::V
-end

The variable variable was used in a model different to owner_model(variable).

source

VariableRef

JuMP.VariableRefType
GenericVariableRef{T} <: AbstractVariableRef

Holds a reference to the model and the corresponding MOI.VariableIndex.

source

VariablesConstrainedOnCreation

JuMP.VariablesConstrainedOnCreationType
VariablesConstrainedOnCreation <: AbstractVariable

Vector of variables scalar_variables constrained to belong to set. Adding this variable can be thought as doing:

function JuMP.add_variable(
+end

The variable variable was used in a model different to owner_model(variable).

source

VariableRef

JuMP.VariableRefType
GenericVariableRef{T} <: AbstractVariableRef

Holds a reference to the model and the corresponding MOI.VariableIndex.

source

VariablesConstrainedOnCreation

JuMP.VariablesConstrainedOnCreationType
VariablesConstrainedOnCreation <: AbstractVariable

Vector of variables scalar_variables constrained to belong to set. Adding this variable can be thought as doing:

function JuMP.add_variable(
     model::GenericModel,
     variable::VariablesConstrainedOnCreation,
     names,
@@ -3069,7 +3069,7 @@
     var_refs = add_variable.(model, variable.scalar_variables, v_names)
     add_constraint(model, VectorConstraint(var_refs, variable.set))
     return reshape_vector(var_refs, variable.shape)
-end

but adds the variables with MOI.add_constrained_variables(model, variable.set) instead. See the MOI documentation for the difference between adding the variables with MOI.add_constrained_variables and adding them with MOI.add_variables and adding the constraint separately.

source

VectorConstraint

JuMP.VectorConstraintType
struct VectorConstraint

The data for a vector constraint.

See also the documentation on JuMP's representation of constraints.

Fields

  • func: field contains a JuMP object representing the function
  • set: field contains the MOI set.
  • shape: field contains an AbstractShape matching the form in which the constraint was constructed (for example, by using matrices or flat vectors).

Example

julia> model = Model();
+end

but adds the variables with MOI.add_constrained_variables(model, variable.set) instead. See the MOI documentation for the difference between adding the variables with MOI.add_constrained_variables and adding them with MOI.add_variables and adding the constraint separately.

source

VectorConstraint

JuMP.VectorConstraintType
struct VectorConstraint

The data for a vector constraint.

See also the documentation on JuMP's representation of constraints.

Fields

  • func: field contains a JuMP object representing the function
  • set: field contains the MOI set.
  • shape: field contains an AbstractShape matching the form in which the constraint was constructed (for example, by using matrices or flat vectors).

Example

julia> model = Model();
 
 julia> @variable(model, x[1:3]);
 
@@ -3092,14 +3092,14 @@
 MathOptInterface.SecondOrderCone(3)
 
 julia> object.shape
-VectorShape()
source

VectorShape

VectorShape

JuMP.VectorShapeType
VectorShape()

An AbstractShape that represents vector-valued constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
 julia> c = @constraint(model, x in SOS1());
 
 julia> shape(constraint_object(c))
-VectorShape()
source

Zeros

JuMP.ZerosType
Zeros()

The JuMP equivalent of the MOI.Zeros set, in which the dimension is inferred from the corresponding function.

Example

julia> model = Model();
+VectorShape()
source

Zeros

JuMP.ZerosType
Zeros()

The JuMP equivalent of the MOI.Zeros set, in which the dimension is inferred from the corresponding function.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2])
 2-element Vector{VariableRef}:
@@ -3114,7 +3114,7 @@
 julia> b = [5, 6];
 
 julia> @constraint(model, A * x == b)
-[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Zeros()
source

ALMOST_DUAL_INFEASIBLE

ALMOST_INFEASIBLE

ALMOST_LOCALLY_SOLVED

JuMP.ALMOST_LOCALLY_SOLVEDConstant
ALMOST_LOCALLY_SOLVED::TerminationStatusCode

An instance of the TerminationStatusCode enum.

ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.

source

ALMOST_OPTIMAL

AUTOMATIC

DIRECT

JuMP.DIRECTConstant

moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.

source

DUAL_INFEASIBLE

JuMP.DUAL_INFEASIBLEConstant
DUAL_INFEASIBLE::TerminationStatusCode

An instance of the TerminationStatusCode enum.

DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

source

FEASIBILITY_SENSE

FEASIBLE_POINT

INFEASIBILITY_CERTIFICATE

JuMP.INFEASIBILITY_CERTIFICATEConstant
INFEASIBILITY_CERTIFICATE::ResultStatusCode

An instance of the ResultStatusCode enum.

INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

source

INFEASIBLE

INFEASIBLE_OR_UNBOUNDED

JuMP.INFEASIBLE_OR_UNBOUNDEDConstant
INFEASIBLE_OR_UNBOUNDED::TerminationStatusCode

An instance of the TerminationStatusCode enum.

INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.

source

INFEASIBLE_POINT

INTERRUPTED

INVALID_MODEL

INVALID_OPTION

ITERATION_LIMIT

LOCALLY_INFEASIBLE

JuMP.LOCALLY_INFEASIBLEConstant
LOCALLY_INFEASIBLE::TerminationStatusCode

An instance of the TerminationStatusCode enum.

LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

source

LOCALLY_SOLVED

JuMP.LOCALLY_SOLVEDConstant
LOCALLY_SOLVED::TerminationStatusCode

An instance of the TerminationStatusCode enum.

LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

source

MANUAL

JuMP.MANUALConstant

moi_backend field holds a CachingOptimizer in MANUAL mode.

source

MAX_SENSE

MEMORY_LIMIT

MIN_SENSE

NEARLY_FEASIBLE_POINT

NEARLY_INFEASIBILITY_CERTIFICATE

NEARLY_REDUCTION_CERTIFICATE

NODE_LIMIT

JuMP.NODE_LIMITConstant
NODE_LIMIT::TerminationStatusCode

An instance of the TerminationStatusCode enum.

NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.

source

NORM_LIMIT

NO_SOLUTION

NUMERICAL_ERROR

OBJECTIVE_LIMIT

OPTIMAL

OPTIMIZE_NOT_CALLED

OTHER_ERROR

JuMP.OTHER_ERRORConstant
OTHER_ERROR::TerminationStatusCode

An instance of the TerminationStatusCode enum.

OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.

source

OTHER_LIMIT

OTHER_RESULT_STATUS

JuMP.OTHER_RESULT_STATUSConstant
OTHER_RESULT_STATUS::ResultStatusCode

An instance of the ResultStatusCode enum.

OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above

source

REDUCTION_CERTIFICATE

JuMP.REDUCTION_CERTIFICATEConstant
REDUCTION_CERTIFICATE::ResultStatusCode

An instance of the ResultStatusCode enum.

REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

source

SLOW_PROGRESS

JuMP.SLOW_PROGRESSConstant
SLOW_PROGRESS::TerminationStatusCode

An instance of the TerminationStatusCode enum.

SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.

source

SOLUTION_LIMIT

JuMP.SOLUTION_LIMITConstant
SOLUTION_LIMIT::TerminationStatusCode

An instance of the TerminationStatusCode enum.

SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

source

TIME_LIMIT

UNKNOWN_RESULT_STATUS

op_and

JuMP.op_andConstant
op_and(x, y)

A function that falls back to x & y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
+[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Zeros()
source

ALMOST_DUAL_INFEASIBLE

ALMOST_INFEASIBLE

ALMOST_LOCALLY_SOLVED

JuMP.ALMOST_LOCALLY_SOLVEDConstant
ALMOST_LOCALLY_SOLVED::TerminationStatusCode

An instance of the TerminationStatusCode enum.

ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.

source

ALMOST_OPTIMAL

AUTOMATIC

DIRECT

JuMP.DIRECTConstant

moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.

source

DUAL_INFEASIBLE

JuMP.DUAL_INFEASIBLEConstant
DUAL_INFEASIBLE::TerminationStatusCode

An instance of the TerminationStatusCode enum.

DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

source

FEASIBILITY_SENSE

FEASIBLE_POINT

INFEASIBILITY_CERTIFICATE

JuMP.INFEASIBILITY_CERTIFICATEConstant
INFEASIBILITY_CERTIFICATE::ResultStatusCode

An instance of the ResultStatusCode enum.

INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

source

INFEASIBLE

INFEASIBLE_OR_UNBOUNDED

JuMP.INFEASIBLE_OR_UNBOUNDEDConstant
INFEASIBLE_OR_UNBOUNDED::TerminationStatusCode

An instance of the TerminationStatusCode enum.

INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.

source

INFEASIBLE_POINT

INTERRUPTED

INVALID_MODEL

INVALID_OPTION

ITERATION_LIMIT

LOCALLY_INFEASIBLE

JuMP.LOCALLY_INFEASIBLEConstant
LOCALLY_INFEASIBLE::TerminationStatusCode

An instance of the TerminationStatusCode enum.

LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

source

LOCALLY_SOLVED

JuMP.LOCALLY_SOLVEDConstant
LOCALLY_SOLVED::TerminationStatusCode

An instance of the TerminationStatusCode enum.

LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

source

MANUAL

JuMP.MANUALConstant

moi_backend field holds a CachingOptimizer in MANUAL mode.

source

MAX_SENSE

MEMORY_LIMIT

MIN_SENSE

NEARLY_FEASIBLE_POINT

NEARLY_INFEASIBILITY_CERTIFICATE

NEARLY_REDUCTION_CERTIFICATE

NODE_LIMIT

JuMP.NODE_LIMITConstant
NODE_LIMIT::TerminationStatusCode

An instance of the TerminationStatusCode enum.

NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.

source

NORM_LIMIT

NO_SOLUTION

NUMERICAL_ERROR

OBJECTIVE_LIMIT

OPTIMAL

OPTIMIZE_NOT_CALLED

OTHER_ERROR

JuMP.OTHER_ERRORConstant
OTHER_ERROR::TerminationStatusCode

An instance of the TerminationStatusCode enum.

OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.

source

OTHER_LIMIT

OTHER_RESULT_STATUS

JuMP.OTHER_RESULT_STATUSConstant
OTHER_RESULT_STATUS::ResultStatusCode

An instance of the ResultStatusCode enum.

OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above

source

REDUCTION_CERTIFICATE

JuMP.REDUCTION_CERTIFICATEConstant
REDUCTION_CERTIFICATE::ResultStatusCode

An instance of the ResultStatusCode enum.

REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

source

SLOW_PROGRESS

JuMP.SLOW_PROGRESSConstant
SLOW_PROGRESS::TerminationStatusCode

An instance of the TerminationStatusCode enum.

SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.

source

SOLUTION_LIMIT

JuMP.SOLUTION_LIMITConstant
SOLUTION_LIMIT::TerminationStatusCode

An instance of the TerminationStatusCode enum.

SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

source

TIME_LIMIT

UNKNOWN_RESULT_STATUS

op_and

JuMP.op_andConstant
op_and(x, y)

A function that falls back to x & y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3122,7 +3122,7 @@
 false
 
 julia> op_and(true, x)
-true && x
source

op_equal_to

JuMP.op_equal_toConstant
op_equal_to(x, y)

A function that falls back to x == y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
+true && x
source

op_equal_to

JuMP.op_equal_toConstant
op_equal_to(x, y)

A function that falls back to x == y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3130,7 +3130,7 @@
 true
 
 julia> op_equal_to(x, 2)
-x == 2
source

op_greater_than_or_equal_to

op_greater_than_or_equal_to

JuMP.op_greater_than_or_equal_toConstant
op_greater_than_or_equal_to(x, y)

A function that falls back to x >= y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3138,7 +3138,7 @@
 true
 
 julia> op_greater_than_or_equal_to(x, 2)
-x >= 2
source

op_less_than_or_equal_to

op_less_than_or_equal_to

JuMP.op_less_than_or_equal_toConstant
op_less_than_or_equal_to(x, y)

A function that falls back to x <= y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3146,7 +3146,7 @@
 true
 
 julia> op_less_than_or_equal_to(x, 2)
-x <= 2
source

op_or

JuMP.op_orConstant
op_or(x, y)

A function that falls back to x | y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
+x <= 2
source

op_or

JuMP.op_orConstant
op_or(x, y)

A function that falls back to x | y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3154,7 +3154,7 @@
 true
 
 julia> op_or(true, x)
-true || x
source

op_strictly_greater_than

op_strictly_greater_than

JuMP.op_strictly_greater_thanConstant
op_strictly_greater_than(x, y)

A function that falls back to x > y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3162,7 +3162,7 @@
 false
 
 julia> op_strictly_greater_than(x, 2)
-x > 2
source

op_strictly_less_than

op_strictly_less_than

JuMP.op_strictly_less_thanConstant
op_strictly_less_than(x, y)

A function that falls back to x < y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3170,7 +3170,7 @@
 true
 
 julia> op_strictly_less_than(x, 2)
-x < 2
source

Base.empty!(::GenericModel)

Base.empty!Method
empty!(model::GenericModel)::GenericModel

Empty the model, that is, remove all variables, constraints and model attributes but not optimizer attributes. Always return the argument.

Note: removes extensions data.

Example

julia> model = Model();
+x < 2
source

Base.empty!(::GenericModel)

Base.empty!Method
empty!(model::GenericModel)::GenericModel

Empty the model, that is, remove all variables, constraints and model attributes but not optimizer attributes. Always return the argument.

Note: removes extensions data.

Example

julia> model = Model();
 
 julia> @variable(model, x[1:2]);
 
@@ -3190,7 +3190,7 @@
 Subject to
 
 julia> isempty(model)
-true
source

Base.isempty(::GenericModel)

Base.isemptyMethod
isempty(model::GenericModel)

Verifies whether the model is empty, that is, whether the MOI backend is empty and whether the model is in the same state as at its creation, apart from optimizer attributes.

Example

julia> model = Model();
+true
source

Base.isempty(::GenericModel)

Base.isemptyMethod
isempty(model::GenericModel)

Verifies whether the model is empty, that is, whether the MOI backend is empty and whether the model is in the same state as at its creation, apart from optimizer attributes.

Example

julia> model = Model();
 
 julia> isempty(model)
 true
@@ -3198,7 +3198,7 @@
 julia> @variable(model, x[1:2]);
 
 julia> isempty(model)
-false
source

Base.copy(::AbstractModel)

Base.copyMethod
copy(model::AbstractModel)

Return a copy of the model model. It is similar to copy_model except that it does not return the mapping between the references of model and its copy.

Note

Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

Example

In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

julia> model = Model();
+false
source

Base.copy(::AbstractModel)

Base.copyMethod
copy(model::AbstractModel)

Return a copy of the model model. It is similar to copy_model except that it does not return the mapping between the references of model and its copy.

Note

Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

Example

In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -3212,12 +3212,12 @@
 x
 
 julia> cref_new = model[:cref]
-cref : x = 2
source

Base.write(::IO, ::GenericModel; ::MOI.FileFormats.FileFormat)

Base.write(::IO, ::GenericModel; ::MOI.FileFormats.FileFormat)

Base.writeMethod
Base.write(
     io::IO,
     model::GenericModel;
     format::MOI.FileFormats.FileFormat = MOI.FileFormats.FORMAT_MOF,
     kwargs...,
-)

Write the JuMP model model to io in the format format.

Other kwargs are passed to the Model constructor of the chosen format.

source

MOI.Utilities.reset_optimizer(::GenericModel)

MOI.Utilities.drop_optimizer(::GenericModel)

MOI.Utilities.attach_optimizer(::GenericModel)

@NLconstraint

JuMP.@NLconstraintMacro
@NLconstraint(model::GenericModel, expr)

Add a constraint described by the nonlinear expression expr. See also @constraint.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraint with @constraint.

Example

julia> model = Model();
+)

Write the JuMP model model to io in the format format.

Other kwargs are passed to the Model constructor of the chosen format.

source

MOI.Utilities.reset_optimizer(::GenericModel)

MOI.Utilities.drop_optimizer(::GenericModel)

MOI.Utilities.attach_optimizer(::GenericModel)

@NLconstraint

JuMP.@NLconstraintMacro
@NLconstraint(model::GenericModel, expr)

Add a constraint described by the nonlinear expression expr. See also @constraint.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraint with @constraint.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -3229,7 +3229,7 @@
 3-element Vector{NonlinearConstraintRef{ScalarShape}}:
  (sin(1.0 * x) - 1.0 / 1.0) - 0.0 ≤ 0
  (sin(2.0 * x) - 1.0 / 2.0) - 0.0 ≤ 0
- (sin(3.0 * x) - 1.0 / 3.0) - 0.0 ≤ 0
source

@NLconstraints

JuMP.@NLconstraintsMacro
@NLconstraints(model, args...)

Adds multiple nonlinear constraints to model at once, in the same fashion as the @NLconstraint macro.

The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the constraints that were defined.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraints with @constraints.

Example

julia> model = Model();
+ (sin(3.0 * x) - 1.0 / 3.0) - 0.0 ≤ 0
source

@NLconstraints

JuMP.@NLconstraintsMacro
@NLconstraints(model, args...)

Adds multiple nonlinear constraints to model at once, in the same fashion as the @NLconstraint macro.

The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the constraints that were defined.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraints with @constraints.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3245,7 +3245,7 @@
            t >= sqrt(x^2 + y^2)
            [i = 1:2], z[i] <= log(a[i])
        end)
-((t - sqrt(x ^ 2.0 + y ^ 2.0)) - 0.0 ≥ 0, NonlinearConstraintRef{ScalarShape}[(z[1] - log(4.0)) - 0.0 ≤ 0, (z[2] - log(5.0)) - 0.0 ≤ 0])
source

@NLexpression

JuMP.@NLexpressionMacro
@NLexpression(args...)

Efficiently build a nonlinear expression which can then be inserted in other nonlinear constraints and the objective. See also [@expression].

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpression with @expression.

Example

julia> model = Model();
+((t - sqrt(x ^ 2.0 + y ^ 2.0)) - 0.0 ≥ 0, NonlinearConstraintRef{ScalarShape}[(z[1] - log(4.0)) - 0.0 ≤ 0, (z[2] - log(5.0)) - 0.0 ≤ 0])
source

@NLexpression

JuMP.@NLexpressionMacro
@NLexpression(args...)

Efficiently build a nonlinear expression which can then be inserted in other nonlinear constraints and the objective. See also [@expression].

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpression with @expression.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -3266,7 +3266,7 @@
  subexpression[4]: sin(3.0 * x)
 
 julia> my_expr_2 = @NLexpression(model, log(1 + sum(exp(my_expr_1[i]) for i in 1:2)))
-subexpression[5]: log(1.0 + (exp(subexpression[2]) + exp(subexpression[3])))
source

@NLexpressions

JuMP.@NLexpressionsMacro
@NLexpressions(model, args...)

Adds multiple nonlinear expressions to model at once, in the same fashion as the @NLexpression macro.

The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the expressions that were defined.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpressions with @expressions.

Example

julia> model = Model();
+subexpression[5]: log(1.0 + (exp(subexpression[2]) + exp(subexpression[3])))
source

@NLexpressions

JuMP.@NLexpressionsMacro
@NLexpressions(model, args...)

Adds multiple nonlinear expressions to model at once, in the same fashion as the @NLexpression macro.

The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

The macro returns a tuple containing the expressions that were defined.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpressions with @expressions.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
@@ -3280,7 +3280,7 @@
            my_expr, sqrt(x^2 + y^2)
            my_expr_1[i = 1:2], log(a[i]) - z[i]
        end)
-(subexpression[1]: sqrt(x ^ 2.0 + y ^ 2.0), NonlinearExpression[subexpression[2]: log(4.0) - z[1], subexpression[3]: log(5.0) - z[2]])
source

@NLobjective

JuMP.@NLobjectiveMacro
@NLobjective(model, sense, expression)

Add a nonlinear objective to model with optimization sense sense. sense must be Max or Min.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLobjective with @objective.

Example

julia> model = Model();
+(subexpression[1]: sqrt(x ^ 2.0 + y ^ 2.0), NonlinearExpression[subexpression[2]: log(4.0) - z[1], subexpression[3]: log(5.0) - z[2]])
source

@NLobjective

JuMP.@NLobjectiveMacro
@NLobjective(model, sense, expression)

Add a nonlinear objective to model with optimization sense sense. sense must be Max or Min.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLobjective with @objective.

Example

julia> model = Model();
 
 julia> @variable(model, x)
 x
@@ -3289,7 +3289,7 @@
 
 julia> print(model)
 Max 2.0 * x + 1.0 + sin(x)
-Subject to
source

@NLparameter

JuMP.@NLparameterMacro
@NLparameter(model, param == value)

Create and return a nonlinear parameter param attached to the model model with initial value set to value. Nonlinear parameters may be used only in nonlinear expressions.

Example

julia> model = Model();
+Subject to
source

@NLparameter

JuMP.@NLparameterMacro
@NLparameter(model, param == value)

Create and return a nonlinear parameter param attached to the model model with initial value set to value. Nonlinear parameters may be used only in nonlinear expressions.

Example

julia> model = Model();
 
 julia> @NLparameter(model, x == 10)
 x == 10.0
@@ -3319,7 +3319,7 @@
  parameter[3] == 6.0
 
 julia> value(y[2])
-4.0
source

@NLparameters

JuMP.@NLparametersMacro
 @NLparameters(model, args...)

Create and return multiple nonlinear parameters attached to model model, in the same fashion as @NLparameter macro.

The model must be the first argument, and multiple parameters can be added on multiple lines wrapped in a begin ... end block. Distinct parameters need to be placed on separate lines as in the following example.

The macro returns a tuple containing the parameters that were defined.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace a call like

@NLparameters(model, begin
+4.0
source

@NLparameters

JuMP.@NLparametersMacro
 @NLparameters(model, args...)

Create and return multiple nonlinear parameters attached to model model, in the same fashion as @NLparameter macro.

The model must be the first argument, and multiple parameters can be added on multiple lines wrapped in a begin ... end block. Distinct parameters need to be placed on separate lines as in the following example.

The macro returns a tuple containing the parameters that were defined.

Compat

This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace a call like

@NLparameters(model, begin
     p == value
 end)

with

@variables(model, begin
     p in Parameter(value)
@@ -3331,17 +3331,17 @@
        end);
 
 julia> value(x)
-10.0
source

add_nonlinear_constraint

JuMP.add_nonlinear_constraintFunction
add_nonlinear_constraint(model::Model, expr::Expr)

Add a nonlinear constraint described by the Julia expression ex to model.

This function is most useful if the expression ex is generated programmatically, and you cannot use @NLconstraint.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

Notes

  • You must interpolate the variables directly into the expression expr.

Example

julia> model = Model();
+10.0
source

add_nonlinear_constraint

JuMP.add_nonlinear_constraintFunction
add_nonlinear_constraint(model::Model, expr::Expr)

Add a nonlinear constraint described by the Julia expression ex to model.

This function is most useful if the expression ex is generated programmatically, and you cannot use @NLconstraint.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

Notes

  • You must interpolate the variables directly into the expression expr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> add_nonlinear_constraint(model, :($(x) + $(x)^2 <= 1))
-(x + x ^ 2.0) - 1.0 ≤ 0
source

add_nonlinear_expression

JuMP.add_nonlinear_expressionFunction
add_nonlinear_expression(model::Model, expr::Expr)

Add a nonlinear expression expr to model.

This function is most useful if the expression expr is generated programmatically, and you cannot use @NLexpression.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

Notes

  • You must interpolate the variables directly into the expression expr.

Example

julia> model = Model();
+(x + x ^ 2.0) - 1.0 ≤ 0
source

add_nonlinear_expression

JuMP.add_nonlinear_expressionFunction
add_nonlinear_expression(model::Model, expr::Expr)

Add a nonlinear expression expr to model.

This function is most useful if the expression expr is generated programmatically, and you cannot use @NLexpression.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

Notes

  • You must interpolate the variables directly into the expression expr.

Example

julia> model = Model();
 
 julia> @variable(model, x);
 
 julia> add_nonlinear_expression(model, :($(x) + $(x)^2))
-subexpression[1]: x + x ^ 2.0
source

add_nonlinear_parameter

JuMP.add_nonlinear_parameterFunction
add_nonlinear_parameter(model::Model, value::Real)

Add an anonymous parameter to the model.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

all_nonlinear_constraints

get_optimizer_attribute

add_nonlinear_parameter

JuMP.add_nonlinear_parameterFunction
add_nonlinear_parameter(model::Model, value::Real)

Add an anonymous parameter to the model.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

all_nonlinear_constraints

get_optimizer_attribute

JuMP.get_optimizer_attributeFunction
get_optimizer_attribute(
     model::Union{GenericModel,MOI.OptimizerWithAttributes},
     attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
 )

Return the value associated with the solver-specific attribute attr.

If attr is an AbstractString, this is equivalent to get_optimizer_attribute(model, MOI.RawOptimizerAttribute(name)).

Compat

This method will remain in all v1.X releases of JuMP, but it may be removed in a future v2.0 release. We recommend using get_attribute instead.

See also: set_optimizer_attribute, set_optimizer_attributes.

Example

julia> import Ipopt
@@ -3349,18 +3349,18 @@
 julia> model = Model(Ipopt.Optimizer);
 
 julia> get_optimizer_attribute(model, MOI.Silent())
-false
source

nonlinear_constraint_string

nonlinear_constraint_string

JuMP.nonlinear_constraint_stringFunction
nonlinear_constraint_string(
     model::GenericModel,
     mode::MIME,
     c::_NonlinearConstraint,
-)

Return a string representation of the nonlinear constraint c belonging to model, given the mode.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

nonlinear_dual_start_value

nonlinear_expr_string

JuMP.nonlinear_expr_stringFunction
nonlinear_expr_string(
+)

Return a string representation of the nonlinear constraint c belonging to model, given the mode.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

nonlinear_dual_start_value

nonlinear_expr_string

JuMP.nonlinear_expr_stringFunction
nonlinear_expr_string(
     model::GenericModel,
     mode::MIME,
     c::MOI.Nonlinear.Expression,
-)

Return a string representation of the nonlinear expression c belonging to model, given the mode.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

nonlinear_model

JuMP.nonlinear_modelFunction
nonlinear_model(
+)

Return a string representation of the nonlinear expression c belonging to model, given the mode.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

nonlinear_model

JuMP.nonlinear_modelFunction
nonlinear_model(
     model::GenericModel;
     force::Bool = false,
-)::Union{MOI.Nonlinear.Model,Nothing}

If model has nonlinear components, return a MOI.Nonlinear.Model, otherwise return nothing.

If force, always return a MOI.Nonlinear.Model, and if one does not exist for the model, create an empty one.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

num_nonlinear_constraints

register

JuMP.registerFunction
register(
+)::Union{MOI.Nonlinear.Model,Nothing}

If model has nonlinear components, return a MOI.Nonlinear.Model, otherwise return nothing.

If force, always return a MOI.Nonlinear.Model, and if one does not exist for the model, create an empty one.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source

num_nonlinear_constraints

register

JuMP.registerFunction
register(
     model::Model,
     op::Symbol,
     dimension::Integer,
@@ -3388,7 +3388,7 @@
 
 julia> register(model, :g, 2, g; autodiff = true)
 
-julia> @NLobjective(model, Min, g(x[1], x[2]))
source
register(
+julia> @NLobjective(model, Min, g(x[1], x[2]))
source
register(
     model::Model,
     s::Symbol,
     dimension::Integer,
@@ -3427,7 +3427,7 @@
 
 julia> register(model, :g, 2, g, ∇g)
 
-julia> @NLobjective(model, Min, g(x[1], x[2]))
source
register(
+julia> @NLobjective(model, Min, g(x[1], x[2]))
source
register(
     model::Model,
     s::Symbol,
     dimension::Integer,
@@ -3451,7 +3451,7 @@
 julia> register(model, :foo, 1, f, ∇f, ∇²f)
 
 julia> @NLobjective(model, Min, foo(x))
-
source

set_nonlinear_dual_start_value

set_nonlinear_dual_start_value

JuMP.set_nonlinear_dual_start_valueFunction
set_nonlinear_dual_start_value(
     model::Model,
     start::Union{Nothing,Vector{Float64}},
 )

Set the value of the MOI attribute MOI.NLPBlockDualStart.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

The start vector corresponds to the Lagrangian duals of the nonlinear constraints, in the order given by all_nonlinear_constraints. That is, you must pass a single start vector corresponding to all of the nonlinear constraints in a single function call; you cannot set the dual start value of nonlinear constraints one-by-one. The example below demonstrates how to use all_nonlinear_constraints to create a mapping between the nonlinear constraint references and the start vector.

Pass nothing to unset a previous start.

Example

julia> model = Model();
@@ -3474,7 +3474,7 @@
 julia> nonlinear_dual_start_value(model)
 2-element Vector{Float64}:
  -1.0
-  1.0
source

set_nonlinear_objective

set_nonlinear_objective

JuMP.set_nonlinear_objectiveFunction
set_nonlinear_objective(
     model::Model,
     sense::MOI.OptimizationSense,
     expr::Expr,
@@ -3482,17 +3482,17 @@
 
 julia> @variable(model, x);
 
-julia> set_nonlinear_objective(model, MIN_SENSE, :($(x) + $(x)^2))
source

set_normalized_coefficients

set_normalized_coefficients

JuMP.set_normalized_coefficientsFunction
set_normalized_coefficients(
     constraint::ConstraintRef{<:AbstractModel,<:MOI.ConstraintIndex{F}},
     variable::AbstractVariableRef,
     new_coefficients::Vector{Tuple{Int64,T}},
-) where {T,F<:Union{MOI.VectorAffineFunction{T},MOI.VectorQuadraticFunction{T}}}

A deprecated method that now redirects to set_normalized_coefficient.

source

set_optimizer_attribute

set_optimizer_attribute

JuMP.set_optimizer_attributeFunction
set_optimizer_attribute(
     model::Union{GenericModel,MOI.OptimizerWithAttributes},
     attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
     value,
 )

Set the solver-specific attribute attr in model to value.

If attr is an AbstractString, this is equivalent to set_optimizer_attribute(model, MOI.RawOptimizerAttribute(name), value).

Compat

This method will remain in all v1.X releases of JuMP, but it may be removed in a future v2.0 release. We recommend using set_attribute instead.

See also: set_optimizer_attributes, get_optimizer_attribute.

Example

julia> model = Model();
 
-julia> set_optimizer_attribute(model, MOI.Silent(), true)
source

set_optimizer_attributes

set_optimizer_attributes

JuMP.set_optimizer_attributesFunction
set_optimizer_attributes(
     model::Union{GenericModel,MOI.OptimizerWithAttributes},
     pairs::Pair...,
 )

Given a list of attribute => value pairs, calls set_optimizer_attribute(model, attribute, value) for each pair.

Compat

This method will remain in all v1.X releases of JuMP, but it may be removed in a future v2.0 release. We recommend using set_attributes instead.

See also: set_optimizer_attribute, get_optimizer_attribute.

Example

julia> import Ipopt
@@ -3505,7 +3505,7 @@
 
 julia> set_optimizer_attribute(model, "tol", 1e-4)
 
-julia> set_optimizer_attribute(model, "max_iter", 100)
source

set_value

JuMP.set_valueFunction
set_value(p::NonlinearParameter, v::Number)

Store the value v in the nonlinear parameter p.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

Example

julia> model = Model();
+julia> set_optimizer_attribute(model, "max_iter", 100)
source

set_value

JuMP.set_valueFunction
set_value(p::NonlinearParameter, v::Number)

Store the value v in the nonlinear parameter p.

Compat

This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

Example

julia> model = Model();
 
 julia> @NLparameter(model, p == 0)
 p == 0.0
@@ -3514,4 +3514,4 @@
 5
 
 julia> value(p)
-5.0
source

NonlinearConstraintIndex

NonlinearConstraintRef

NonlinearExpression

NonlinearParameter

JuMP.NonlinearParameterType
NonlinearParameter <: AbstractJuMPScalar

A struct to represent a nonlinear parameter.

Create a parameter using @NLparameter.

Compat

This type is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source
+5.0source

NonlinearConstraintIndex

NonlinearConstraintRef

NonlinearExpression

NonlinearParameter

JuMP.NonlinearParameterType
NonlinearParameter <: AbstractJuMPScalar

A struct to represent a nonlinear parameter.

Create a parameter using @NLparameter.

Compat

This type is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

source
diff --git a/previews/PR3838/background/algebraic_modeling_languages/index.html b/previews/PR3838/background/algebraic_modeling_languages/index.html index 9e4242b397f..d63ad2269c7 100644 --- a/previews/PR3838/background/algebraic_modeling_languages/index.html +++ b/previews/PR3838/background/algebraic_modeling_languages/index.html @@ -138,4 +138,4 @@ julia> highs_knapsack([1.0, 2.0], [0.5, 0.5], 1.25) 2-element Vector{Float64}: 0.0 - 2.0

We've now gone from a algebraic model that looked identical to the mathematical model we started with, to a verbose function that uses HiGHS-specific functionality.

The difference between algebraic_knapsack and highs_knapsack highlights the benefit that algebraic modeling languages provide to users. Moreover, if we used a different solver, the solver-specific function would be entirely different. A key benefit of an algebraic modeling language is that you can change the solver without needing to rewrite the model.

+ 2.0

We've now gone from a algebraic model that looked identical to the mathematical model we started with, to a verbose function that uses HiGHS-specific functionality.

The difference between algebraic_knapsack and highs_knapsack highlights the benefit that algebraic modeling languages provide to users. Moreover, if we used a different solver, the solver-specific function would be entirely different. A key benefit of an algebraic modeling language is that you can change the solver without needing to rewrite the model.

diff --git a/previews/PR3838/background/bibliography/index.html b/previews/PR3838/background/bibliography/index.html index 705ebdb509c..5214487c390 100644 --- a/previews/PR3838/background/bibliography/index.html +++ b/previews/PR3838/background/bibliography/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

Bibliography

+

Bibliography

diff --git a/previews/PR3838/changelog/index.html b/previews/PR3838/changelog/index.html index 02109acd6bc..271fef31885 100644 --- a/previews/PR3838/changelog/index.html +++ b/previews/PR3838/changelog/index.html @@ -12,4 +12,4 @@ new_b = backend(model)
  • All usages of @SDconstraint are deprecated. The new syntax is @constraint(model, X >= Y, PSDCone()).
  • Creating a DenseAxisArray with a Number as an axis will now display a warning. This catches a common error in which users write @variable(model, x[length(S)]) instead of @variable(model, x[1:length(S)]).
  • The caching_mode argument to Model, for example, Model(caching_mode = MOIU.MANUAL) mode has been removed. For more control over the optimizer, use direct_model instead.
  • The previously deprecated lp_objective_perturbation_range and lp_rhs_perturbation_range functions have been removed. Use lp_sensitivity_report instead.
  • The .m fields of NonlinearExpression and NonlinearParameter have been renamed to .model.
  • Infinite variable bounds are now ignored. Thus, @variable(model, x <= Inf) will show has_upper_bound(x) == false. Previously, these bounds were passed through to the solvers which caused numerical issues for solvers expecting finite bounds.
  • The variable_type and constraint_type functions were removed. This should only affect users who previously wrote JuMP extensions. The functions can be deleted without consequence.
  • The internal functions moi_mode, moi_bridge_constraints, moi_add_constraint, and moi_add_to_function_constant are no longer exported.
  • The un-used method Containers.generate_container has been deleted.
  • The Containers API has been refactored, and _build_ref_sets is now public as Containers.build_ref_sets.
  • The parse_constraint_ methods for extending @constraint at parse time have been refactored in a breaking way. Consult the Extensions documentation for more details and examples.
  • Added

    • The TerminationStatusCode and ResultStatusCode enums are now exported by JuMP. Prefer termination_status(model) == OPTIMAL instead of == MOI.OPTIMAL, although the MOI. prefix way still works.
    • Copy a x::DenseAxisArray to an Array by calling Array(x).
    • NonlinearExpression is now a subtype of AbstractJuMPScalar
    • Constraints such as @constraint(model, x + 1 in MOI.Integer()) are now supported.
    • primal_feasibility_report now accepts a function as the first argument.
    • Scalar variables @variable(model, x[1:2] in MOI.Integer()) creates two variables, both of which are constrained to be in the set MOI.Integer.
    • Conic constraints can now be specified as inequalities under a different partial ordering. So @constraint(model, x - y in MOI.Nonnegatives()) can now be written as @constraint(model, x >= y, MOI.Nonnegatives()).
    • Names are now set for vectorized constraints.

    Fixed

    • Fixed a performance issue when show was called on a SparseAxisArray with a large number of elements.
    • Fixed a bug displaying barrier and simplex iterations in solution_summary.
    • Fixed a bug by implementing hash for DenseAxisArray and SparseAxisArray.
    • Names are now only set if the solver supports them. Previously, this prevented solvers such as Ipopt from being used with direct_model.
    • MutableArithmetics.Zero is converted into a 0.0 before being returned to the user. Previously, some calls to @expression would return the undocumented MutableArithmetics.Zero() object. One example is summing over an empty set @expression(model, sum(x[i] for i in 1:0)). You will now get 0.0 instead.
    • AffExpr and QuadExpr can now be used with == 0 instead of iszero. This fixes a number of issues relating to Julia standard libraries such as LinearAlgebra and SparseArrays.
    • Fixed a bug when registering a user-defined function with splatting.

    Other

    • The documentation is now available as a PDF.
    • The documentation now includes a full copy of the MathOptInterface documentation to make it easy to link concepts between the docs. (The MathOptInterface documentation has also been significantly improved.)
    • The documentation contains a large number of improvements and clarifications on a range of topics. Thanks to @sshin23, @DilumAluthge, and @jlwether.
    • The documentation is now built with Julia 1.6 instead of 1.0.
    • Various error messages have been improved to be more readable.

    Version 0.21.10 (September 4, 2021)

    Added

    • Added add_NL_expression
    • add_NL_xxx functions now support AffExpr and QuadExpr as terms

    Fixed

    • Fixed a bug in solution_summary
    • Fixed a bug in relax_integrality

    Other

    • Improved error message in lp_sensitivity_report

    Version 0.21.9 (August 1, 2021)

    Added

    • Containers now support arbitrary container types by passing the type to the container keyword and overloading Containers.container.
    • is_valid now supports nonlinear constraints
    • Added unsafe_backend for querying the inner-most optimizer of a JuMP model.
    • Nonlinear parameters now support the plural @NLparameters macro.
    • Containers (for example, DenseAxisArray) can now be used in vector-valued constraints.

    Other

    • Various improvements to the documentation.

    Version 0.21.8 (May 8, 2021)

    Added

    • The @constraint macro is now extendable in the same way as @variable.
    • AffExpr and QuadExpr can now be used in nonlinear macros.

    Fixed

    • Fixed a bug in lp_sensitivity_report.
    • Fixed an inference issue when creating empty SparseAxisArrays.

    Version 0.21.7 (April 12, 2021)

    Added

    • Added primal_feasibility_report, which can be used to check whether a primal point satisfies primal feasibility.
    • Added coefficient, which returns the coefficient associated with a variable in affine and quadratic expressions.
    • Added copy_conflict, which returns the IIS of an infeasible model.
    • Added solution_summary, which returns (and prints) a struct containing a summary of the solution.
    • Allow AbstractVector in vector constraints instead of just Vector.
    • Added latex_formulation(model) which returns an object representing the latex formulation of a model. Use print(latex_formulation(model)) to print the formulation as a string.
    • User-defined functions in nonlinear expressions are now automatically registered to aid quick model prototyping. However, a warning is printed to encourage the manual registration.
    • DenseAxisArray's now support broadcasting over multiple arrays.
    • Container indices can now be iterators of Base.SizeUnknown.

    Fixed

    • Fixed bug in rad2deg and deg2rad in nonlinear expressions.
    • Fixed a MethodError bug in Containers when forcing container type.
    • Allow partial slicing of a DenseAxisArray, resolving an issue from 2014.
    • Fixed a bug printing variable names in IJulia.
    • Ending an IJulia cell with model now prints a summary of the model (like in the REPL) not the latex formulation. Use print(model) to print the latex formulation.
    • Fixed a bug when copying models containing nested arrays.

    Other

    • Tutorials are now part of the documentation, and more refactoring has taken place.
    • Added JuliaFormatter added as a code formatter.
    • Added some precompilation statements to reduce initial latency.
    • Various improvements to error messages to make them more helpful.
    • Improved performance of value(::NonlinearExpression).
    • Improved performance of fix(::VariableRef).

    Version 0.21.6 (January 29, 2021)

    Added

    • Added support for skew symmetric variables via @variable(model, X[1:2, 1:2] in SkewSymmetricMatrixSpace()).
    • lp_sensitivity_report has been added which significantly improves the performance of querying the sensitivity summary of an LP. lp_objective_perturbation_range and lp_rhs_perturbation_range are deprecated.
    • Dual warm-starts are now supported with set_dual_start_value and dual_start_value.
    • (\in<tab>) can now be used in macros instead of = or in.
    • Use haskey(model::Model, key::Symbol) to check if a name key is registered in a model.
    • Added unregister(model::Model, key::Symbol) to unregister a name key from model.
    • Added callback_node_status for use in callbacks.
    • Added print_bridge_graph to visualize the bridging graph generated by MathOptInterface.
    • Improved error message for containers with duplicate indices.

    Fixed

    • Various fixes to pass tests on Julia 1.6.
    • Fixed a bug in the printing of nonlinear expressions in IJulia.
    • Fixed a bug when nonlinear expressions are passed to user-defined functions.
    • Some internal functions that were previously exported are now no longer exported.
    • Fixed a bug when relaxing a fixed binary variable.
    • Fixed a StackOverflowError that occurred when SparseAxisArrays had a large number of elements.
    • Removed an unnecessary type assertion in list_of_constraint_types.
    • Fixed a bug when copying models with registered expressions.

    Other

    • The documentation has been significantly overhauled. It now has distinct sections for the manual, API reference, and examples. The existing examples in /examples have now been moved to /docs/src/examples and rewritten using Literate.jl, and they are now included in the documentation.
    • JuliaFormatter has been applied to most of the codebase. This will continue to roll out over time, as we fix upstream issues in the formatter, and will eventually become compulsory.
    • The root cause of a large number of method invalidations has been resolved.
    • We switched continuous integration from Travis and Appveyor to GitHub Actions.

    Version 0.21.5 (September 18, 2020)

    Fixed

    • Fixed deprecation warnings
    • Throw DimensionMismatch for incompatibly sized functions and sets
    • Unify treatment of keys(x) on JuMP containers

    Version 0.21.4 (September 14, 2020)

    Added

    • Add debug info when adding unsupported constraints
    • Add relax_integrality for solving continuous relaxation
    • Allow querying constraint conflicts

    Fixed

    • Dispatch on Real for MOI.submit
    • Implement copy for CustomSet in tests
    • Don't export private macros
    • Fix invalid assertion in nonlinear
    • Error if constraint has NaN right-hand side
    • Improve speed of tests
    • Lots of work modularizing files in /test
    • Improve line numbers in macro error messages
    • Print nonlinear subexpressions
    • Various documentation updates
    • Dependency updates:
      • Datastructures 0.18
      • MathOptFormat v0.5
      • Prep for MathOptInterface 0.9.15

    Version 0.21.3 (June 18, 2020)

    • Added Special Order Sets (SOS1 and SOS2) to JuMP with default weights to ease the creation of such constraints (#2212).
    • Added functions simplex_iterations, barrier_iterations and node_count (#2201).
    • Added function reduced_cost (#2205).
    • Implemented callback_value for affine and quadratic expressions (#2231).
    • Support MutableArithmetics.Zero in objective and constraints (#2219).
    • Documentation improvements:
      • Mention tutorials in the docs (#2223).
      • Update COIN-OR links (#2242).
      • Explicit link to the documentation of MOI.FileFormats (#2253).
      • Typo fixes (#2261).
    • Containers improvements:
      • Fix Base.map for DenseAxisArray (#2235).
      • Throw BoundsError if number of indices is incorrect for DenseAxisArray and SparseAxisArray (#2240).
    • Extensibility improvements:
      • Implement a set_objective method fallback that redirects to set_objective_sense and set_objective_function (#2247).
      • Add parse_constraint method with arbitrary number of arguments (#2051).
      • Add parse_constraint_expr and parse_constraint_head (#2228).

    Version 0.21.2 (April 2, 2020)

    • Added relative_gap() to access MOI.RelativeGap() attribute (#2199).
    • Documentation fixes:
      • Added link to source for docstrings in the documentation (#2207).
      • Added docstring for @variables macro (#2216).
      • Typo fixes (#2177, #2184, #2182).
    • Implementation of methods for Base functions:
      • Implemented Base.empty! for JuMP.Model (#2198).
      • Implemented Base.conj for JuMP scalar types (#2209).

    Fixed

    • Fixed sum of expression with scalar product in macro (#2178).
    • Fixed writing of nonlinear models to MathOptFormat (#2181).
    • Fixed construction of empty SparseAxisArray (#2179).
    • Fixed constraint with zero function (#2188).

    Version 0.21.1 (Feb 18, 2020)

    • Improved the clarity of the with_optimizer deprecation warning.

    Version 0.21.0 (Feb 16, 2020)

    Breaking

    • Deprecated with_optimizer (#2090, #2084, #2141). You can replace with_optimizer by either nothing, optimizer_with_attributes or a closure:

      • replace with_optimizer(Ipopt.Optimizer) by Ipopt.Optimizer.
      • replace with_optimizer(Ipopt.Optimizer, max_cpu_time=60.0) by optimizer_with_attributes(Ipopt.Optimizer, "max_cpu_time" => 60.0).
      • replace with_optimizer(Gurobi.Optimizer, env) by () -> Gurobi.Optimizer(env).
      • replace with_optimizer(Gurobi.Optimizer, env, Presolve=0) by optimizer_with_attributes(() -> Gurobi.Optimizer(env), "Presolve" => 0).

      alternatively to optimizer_with_attributes, you can also set the attributes separately with set_optimizer_attribute.

    • Renamed set_parameter and set_parameters to set_optimizer_attribute and set_optimizer_attributes (#2150).

    • Broadcast should now be explicit inside macros. @SDconstraint(model, x >= 1) and @constraint(model, x + 1 in SecondOrderCone()) now throw an error instead of broadcasting 1 along the dimension of x (#2107).

    • @SDconstraint(model, x >= 0) is now equivalent to @constraint(model, x in PSDCone()) instead of @constraint(model, (x .- 0) in PSDCone()) (#2107).

    • The macros now create the containers with map instead of for loops, as a consequence, containers created by @expression can now have any element type and containers of constraint references now have concrete element types when possible. This fixes a long-standing issue where @expression could only be used to generate a collection of linear expressions. Now it works for quadratic expressions as well (#2070).

    • Calling deepcopy(::AbstractModel) now throws an error.

    • The constraint name is now printed in the model string (#2108).

    Added

    • Added support for solver-independent and solver-specific callbacks (#2101).
    • Added write_to_file and read_from_file, supported formats are CBF, LP, MathOptFormat, MPS and SDPA (#2114).
    • Added support for complementarity constraints (#2132).
    • Added support for indicator constraints (#2092).
    • Added support for querying multiple solutions with the result keyword (#2100).
    • Added support for constraining variables on creation (#2128).
    • Added method delete that deletes a vector of variables at once if it is supported by the underlying solver (#2135).
    • The arithmetic between JuMP expression has be refactored into the MutableArithmetics package (#2107).
    • Improved error on complex values in NLP (#1978).
    • Added an example of column generation (#2010).

    Fixed

    • Incorrect coefficients generated when using Symmetric variables (#2102)

    Version 0.20.1 (Oct 18, 2019)

    • Add sections on @variables and @constraints in the documentation (#2062).
    • Fixed product of sparse matrices for Julia v1.3 (#2063).
    • Added set_objective_coefficient to modify the coefficient of a linear term of the objective function (#2008).
    • Added set_time_limit_sec, unset_time_limit_sec and time_limit_sec to set and query the time limit for the solver in seconds (#2053).

    Version 0.20.0 (Aug 24, 2019)

    • Documentation updates.
    • Numerous bug fixes.
    • Better error messages (#1977, #1978, #1997, #2017).
    • Performance improvements (#1947, #2032).
    • Added LP sensitivity summary functions lp_objective_perturbation_range and lp_rhs_perturbation_range (#1917).
    • Added functions dual_objective_value, raw_status and set_parameter.
    • Added function set_objective_coefficient to modify the coefficient of a linear term of the objective (#2008).
    • Added functions set_normalized_rhs, normalized_rhs, and add_to_function_constant to modify and get the constant part of a constraint (#1935, #1960).
    • Added functions set_normalized_coefficient and normalized_coefficient to modify and get the coefficient of a linear term of a constraint (#1935, #1960).
    • Numerous other improvements in MOI 0.9, see the NEWS.md file of MOI for more details.

    Version 0.19.2 (June 8, 2019)

    • Fix a bug in derivatives that could arise in models with nested nonlinear subexpressions.

    Version 0.19.1 (May 12, 2019)

    • Usability and performance improvements.
    • Bug fixes.

    Version 0.19.0 (February 15, 2019)

    JuMP 0.19 contains significant breaking changes.

    Breaking

    • JuMP's abstraction layer for communicating with solvers changed from MathProgBase (MPB) to MathOptInterface (MOI). MOI addresses many longstanding design issues. (See @mlubin's slides from JuMP-dev 2018.) JuMP 0.19 is compatible only with solvers that have been updated for MOI. See the installation guide for a list of solvers that have and have not yet been updated.

    • Most solvers have been renamed to PackageName.Optimizer. For example, GurobiSolver() is now Gurobi.Optimizer.

    • Solvers are no longer added to a model via Model(solver = XXX(kwargs...)). Instead use Model(with_optimizer(XXX, kwargs...)). For example, Model(with_optimizer(Gurobi.Optimizer, OutputFlag=0)).

    • JuMP containers (for example, the objects returned by @variable) have been redesigned. Containers.SparseAxisArray replaces JuMPDict, JuMPArray was rewritten (inspired by AxisArrays) and renamed Containers.DenseAxisArray, and you can now request a container type with the container= keyword to the macros. See the corresponding documentation for more details.

    • The statuses returned by solvers have changed. See the possible status values here. The MOI statuses are much richer than the MPB statuses and can be used to distinguish between previously indistinguishable cases (for example, did the solver have a feasible solution when it stopped because of the time limit?).

    • Starting values are separate from result values. Use value to query the value of a variable in a solution. Use start_value and set_start_value to get and set an initial starting point provided to the solver. The solutions from previous solves are no longer automatically set as the starting points for the next solve.

    • The data structures for affine and quadratic expressions AffExpr and QuadExpr have changed. Internally, terms are stored in dictionaries instead of lists. Duplicate coefficients can no longer exist. Accessors and iteration methods have changed.

    • JuMPNLPEvaluator no longer includes the linear and quadratic parts of the model in the evaluation calls. These are now handled separately to allow NLP solvers that support various types of constraints.

    • JuMP solver-independent callbacks have been replaced by solver-specific callbacks. See your favorite solver for more details. (See the note below: No solver-specific callbacks are implemented yet.)

    • The norm() syntax is no longer recognized inside macros. Use the SecondOrderCone() set instead.

    • JuMP no longer performs automatic transformation between special quadratic forms and second-order cone constraints. Support for these constraint classes depends on the solver.

    • The symbols :Min and :Max are no longer used as optimization senses. Instead, JuMP uses the OptimizationSense enum from MathOptInterface. @objective(model, Max, ...), @objective(model, Min, ...), @NLobjective(model, Max, ...), and @objective(model, Min, ...) remain valid, but @objective(m, :Max, ...) is no longer accepted.

    • The sign conventions for duals has changed in some cases for consistency with conic duality (see the documentation). The shadow_price helper method returns duals with signs that match conventional LP interpretations of dual values as sensitivities of the objective value to relaxations of constraints.

    • @constraintref is no longer defined. Instead, create the appropriate container to hold constraint references manually. For example,

      constraints = Dict() # Optionally, specify types for improved performance.
       for i in 1:N
         constraints[i] = @constraint(model, ...)
      -end
    • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

    • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

    Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    +end
  • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

  • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

  • Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    diff --git a/previews/PR3838/developers/checklists/index.html b/previews/PR3838/developers/checklists/index.html index c886ca606bf..b878f5d9d4f 100644 --- a/previews/PR3838/developers/checklists/index.html +++ b/previews/PR3838/developers/checklists/index.html @@ -69,4 +69,4 @@ - [ ] Implement `vectorize(data, ::NewShape)::Vector` - [ ] Implement `reshape_vector(vector, ::NewShape)` - [ ] Implement `dual_shape`, or verify that the shape is self-dual - - [ ] Add the tests from https://github.com/jump-dev/JuMP.jl/pull/3816 + - [ ] Add the tests from https://github.com/jump-dev/JuMP.jl/pull/3816 diff --git a/previews/PR3838/developers/contributing/index.html b/previews/PR3838/developers/contributing/index.html index 60e4b7e2b6f..1afb7906374 100644 --- a/previews/PR3838/developers/contributing/index.html +++ b/previews/PR3838/developers/contributing/index.html @@ -25,4 +25,4 @@ $ git checkout master -$ git pull
    Note

    If you have suggestions to improve this guide, please make a pull request. It's particularly helpful if you do this after your first pull request because you'll know all the parts that could be explained better.

    +$ git pull
    Note

    If you have suggestions to improve this guide, please make a pull request. It's particularly helpful if you do this after your first pull request because you'll know all the parts that could be explained better.

    diff --git a/previews/PR3838/developers/custom_solver_binaries/index.html b/previews/PR3838/developers/custom_solver_binaries/index.html index 4a06a826079..a0abf996c83 100644 --- a/previews/PR3838/developers/custom_solver_binaries/index.html +++ b/previews/PR3838/developers/custom_solver_binaries/index.html @@ -90,4 +90,4 @@ libCbc_path = "/usr/local/Cellar/cbc/2.10.5/lib/libCbc.3.10.5" libOsiCbc_path = "/usr/local/Cellar/cbc/2.10.5/lib/libOsiCbc.3.10.5" libcbcsolver_path = "/usr/local/Cellar/cbc/2.10.5/lib/libCbcSolver.3.10.5"
    Info

    Note that capitalization matters, so libcbcsolver_path corresponds to libCbcSolver.3.10.5.

    Override entire artifact

    To use the homebrew install as our custom binary we add the following to ~/.julia/artifacts/Overrides.toml:

    # Override for Cbc_jll
    -e481bc81db5e229ba1f52b2b4bd57484204b1b06 = "/usr/local/Cellar/cbc/2.10.5"
    +e481bc81db5e229ba1f52b2b4bd57484204b1b06 = "/usr/local/Cellar/cbc/2.10.5" diff --git a/previews/PR3838/developers/extensions/index.html b/previews/PR3838/developers/extensions/index.html index b4450ffb81f..474d54b0289 100644 --- a/previews/PR3838/developers/extensions/index.html +++ b/previews/PR3838/developers/extensions/index.html @@ -305,4 +305,4 @@ _function_barrier(names, model, F, S) end return names -end
    Note

    It is important to explicitly type the F and S arguments. If you leave them untyped, for example, function _function_barrier(names, model, F, S), Julia will not specialize the function calls and performance will not be improved.

    +end
    Note

    It is important to explicitly type the F and S arguments. If you leave them untyped, for example, function _function_barrier(names, model, F, S), Julia will not specialize the function calls and performance will not be improved.

    diff --git a/previews/PR3838/developers/roadmap/index.html b/previews/PR3838/developers/roadmap/index.html index e62456ad283..a12b42b46be 100644 --- a/previews/PR3838/developers/roadmap/index.html +++ b/previews/PR3838/developers/roadmap/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Development roadmap

    The JuMP developers have compiled this roadmap document to share their plans and goals with the JuMP community. Contributions to roadmap issues are especially invited.

    Most of these issues will require changes to both JuMP and MathOptInterface, and are non-trivial in their implementation. They are in no particular order, but represent broad themes that we see as areas in which JuMP could be improved.

    • Support nonlinear expressions with vector-valued inputs and outputs. There are a few related components:
      • Representing terms like log(det(X)) as necessary for Convex.jl
      • Automatic differentiation of terms with vector inputs and outputs
      • User-defined functions with vector–as opposed to scalar–inputs, which is particularly useful for optimal control problems
      • User-defined functions with vector outputs, avoiding the need for User-defined operators with vector outputs
    • Add support for modeling with SI units. The UnitJuMP.jl extension is a good proof of concept for what this would look like. We want to make units a first-class concept in JuMP. See #1350 for more details.

    Completed

    +

    Development roadmap

    The JuMP developers have compiled this roadmap document to share their plans and goals with the JuMP community. Contributions to roadmap issues are especially invited.

    Most of these issues will require changes to both JuMP and MathOptInterface, and are non-trivial in their implementation. They are in no particular order, but represent broad themes that we see as areas in which JuMP could be improved.

    • Support nonlinear expressions with vector-valued inputs and outputs. There are a few related components:
      • Representing terms like log(det(X)) as necessary for Convex.jl
      • Automatic differentiation of terms with vector inputs and outputs
      • User-defined functions with vector–as opposed to scalar–inputs, which is particularly useful for optimal control problems
      • User-defined functions with vector outputs, avoiding the need for User-defined operators with vector outputs
    • Add support for modeling with SI units. The UnitJuMP.jl extension is a good proof of concept for what this would look like. We want to make units a first-class concept in JuMP. See #1350 for more details.

    Completed

    diff --git a/previews/PR3838/developers/style/index.html b/previews/PR3838/developers/style/index.html index 04755c9e66d..a33d88c3e23 100644 --- a/previews/PR3838/developers/style/index.html +++ b/previews/PR3838/developers/style/index.html @@ -182,4 +182,4 @@ end # module TestPkg -TestPkg.runtests()

    Break the tests into multiple files, with one module per file, so that subsets of the codebase can be tested by calling include with the relevant file.

    +TestPkg.runtests()

    Break the tests into multiple files, with one module per file, so that subsets of the codebase can be tested by calling include with the relevant file.

    diff --git a/previews/PR3838/extensions/DimensionalData/index.html b/previews/PR3838/extensions/DimensionalData/index.html index afefaba531a..511e45907b7 100644 --- a/previews/PR3838/extensions/DimensionalData/index.html +++ b/previews/PR3838/extensions/DimensionalData/index.html @@ -48,4 +48,4 @@ ↓ j Categorical{String} ["a", "b"] ForwardOrdered └──────────────────────────────────────────────────────────────────────────────┘ "a" x[2,a] + x[3,a] + x[4,a] ≤ 1 - "b" x[2,b] + x[3,b] + x[4,b] ≤ 1

    Documentation

    See the DimensionalData.jl documentation for more details on the syntax and features of DimensionalData.DimArray.

    + "b" x[2,b] + x[3,b] + x[4,b] ≤ 1

    Documentation

    See the DimensionalData.jl documentation for more details on the syntax and features of DimensionalData.DimArray.

    diff --git a/previews/PR3838/extensions/introduction/index.html b/previews/PR3838/extensions/introduction/index.html index 710cbf17bac..321cf6aee69 100644 --- a/previews/PR3838/extensions/introduction/index.html +++ b/previews/PR3838/extensions/introduction/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Introduction

    This section of the documentation contains brief documentation for some popular JuMP extensions. The list of extensions is not exhaustive, but instead is intended to help you discover popular JuMP extensions, and to give you an overview of the types of extensions that are possible to write with JuMP.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new extensions

    Written an extension? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    Weak dependencies

    Some extensions listed in this section are implemented using the weak dependency feature added to Julia in v1.9. These extensions are activated if and only if you have JuMP and the other package loaded into your current scope with using or import.

    Compat

    Using a weak dependency requires Julia v1.9 or later.

    +

    Introduction

    This section of the documentation contains brief documentation for some popular JuMP extensions. The list of extensions is not exhaustive, but instead is intended to help you discover popular JuMP extensions, and to give you an overview of the types of extensions that are possible to write with JuMP.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new extensions

    Written an extension? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    Weak dependencies

    Some extensions listed in this section are implemented using the weak dependency feature added to Julia in v1.9. These extensions are activated if and only if you have JuMP and the other package loaded into your current scope with using or import.

    Compat

    Using a weak dependency requires Julia v1.9 or later.

    diff --git a/previews/PR3838/index.html b/previews/PR3838/index.html index a681a6ceb37..2c1686f5b04 100644 --- a/previews/PR3838/index.html +++ b/previews/PR3838/index.html @@ -32,4 +32,4 @@ journal = {Mathematical Programming Computation}, year = {2023}, doi = {10.1007/s12532-023-00239-3} -}

    NumFOCUS

    NumFOCUS logo

    JuMP is a Sponsored Project of NumFOCUS, a 501(c)(3) nonprofit charity in the United States. NumFOCUS provides JuMP with fiscal, legal, and administrative support to help ensure the health and sustainability of the project. Visit numfocus.org for more information.

    You can support JuMP by donating.

    Donations to JuMP are managed by NumFOCUS. For donors in the United States, your gift is tax-deductible to the extent provided by law. As with any donation, you should consult with your tax adviser about your particular tax situation.

    JuMP's largest expense is the annual JuMP-dev workshop. Donations will help us provide travel support for JuMP-dev attendees and take advantage of other opportunities that arise to support JuMP development.

    License

    JuMP is licensed under the MPL-2.0 software license. Consult the license and the Mozilla FAQ for more information. In addition, JuMP is typically used in conjunction with solver packages and extensions which have their own licences. Consult their package repositories for the specific licenses that apply.

    +}

    NumFOCUS

    NumFOCUS logo

    JuMP is a Sponsored Project of NumFOCUS, a 501(c)(3) nonprofit charity in the United States. NumFOCUS provides JuMP with fiscal, legal, and administrative support to help ensure the health and sustainability of the project. Visit numfocus.org for more information.

    You can support JuMP by donating.

    Donations to JuMP are managed by NumFOCUS. For donors in the United States, your gift is tax-deductible to the extent provided by law. As with any donation, you should consult with your tax adviser about your particular tax situation.

    JuMP's largest expense is the annual JuMP-dev workshop. Donations will help us provide travel support for JuMP-dev attendees and take advantage of other opportunities that arise to support JuMP development.

    License

    JuMP is licensed under the MPL-2.0 software license. Consult the license and the Mozilla FAQ for more information. In addition, JuMP is typically used in conjunction with solver packages and extensions which have their own licences. Consult their package repositories for the specific licenses that apply.

    diff --git a/previews/PR3838/installation/index.html b/previews/PR3838/installation/index.html index 238189bbbd4..9e71e7435d5 100644 --- a/previews/PR3838/installation/index.html +++ b/previews/PR3838/installation/index.html @@ -28,4 +28,4 @@ [4076af6c] ↓ JuMP v0.21.5 ⇒ v0.18.6 [707a9f91] + JuMPeR v0.6.0 Updating `~/jump_example/Manifest.toml` - ... lines omitted ...

    JuMPeR gets added at version 0.6.0 (+ JuMPeR v0.6.0), but JuMP gets downgraded from 0.21.5 to 0.18.6 (↓ JuMP v0.21.5 ⇒ v0.18.6)! The reason for this is that JuMPeR doesn't support a version of JuMP newer than 0.18.6.

    Tip

    Pay careful attention to the output of the package manager when adding new packages, especially when you see a package being downgraded.

    + ... lines omitted ...

    JuMPeR gets added at version 0.6.0 (+ JuMPeR v0.6.0), but JuMP gets downgraded from 0.21.5 to 0.18.6 (↓ JuMP v0.21.5 ⇒ v0.18.6)! The reason for this is that JuMPeR doesn't support a version of JuMP newer than 0.18.6.

    Tip

    Pay careful attention to the output of the package manager when adding new packages, especially when you see a package being downgraded.

    diff --git a/previews/PR3838/manual/callbacks/index.html b/previews/PR3838/manual/callbacks/index.html index 1e75af6d54a..2332cf6942d 100644 --- a/previews/PR3838/manual/callbacks/index.html +++ b/previews/PR3838/manual/callbacks/index.html @@ -84,4 +84,4 @@ end my_callback_function (generic function with 1 method) -julia> set_attribute(model, MOI.HeuristicCallback(), my_callback_function)

    The third argument to submit is a vector of JuMP variables, and the fourth argument is a vector of values corresponding to each variable.

    MOI.submit returns an enum that depends on whether the solver accepted the solution. The possible return codes are:

    • MOI.HEURISTIC_SOLUTION_ACCEPTED
    • MOI.HEURISTIC_SOLUTION_REJECTED
    • MOI.HEURISTIC_SOLUTION_UNKNOWN
    Warning

    Some solvers may accept partial solutions. Others require a feasible integer solution for every variable. If in doubt, provide a complete solution.

    Info

    The heuristic solution callback may be called at fractional nodes in the branch-and-bound tree. There is no guarantee that the callback is called at every fractional primal solution.

    +julia> set_attribute(model, MOI.HeuristicCallback(), my_callback_function)

    The third argument to submit is a vector of JuMP variables, and the fourth argument is a vector of values corresponding to each variable.

    MOI.submit returns an enum that depends on whether the solver accepted the solution. The possible return codes are:

    • MOI.HEURISTIC_SOLUTION_ACCEPTED
    • MOI.HEURISTIC_SOLUTION_REJECTED
    • MOI.HEURISTIC_SOLUTION_UNKNOWN
    Warning

    Some solvers may accept partial solutions. Others require a feasible integer solution for every variable. If in doubt, provide a complete solution.

    Info

    The heuristic solution callback may be called at fractional nodes in the branch-and-bound tree. There is no guarantee that the callback is called at every fractional primal solution.

    diff --git a/previews/PR3838/manual/complex/index.html b/previews/PR3838/manual/complex/index.html index b87a3908965..261aaed0cc5 100644 --- a/previews/PR3838/manual/complex/index.html +++ b/previews/PR3838/manual/complex/index.html @@ -197,4 +197,4 @@ julia> @constraint(model, H in HermitianPSDCone()) [x[1] im - -im -x[2]] ∈ HermitianPSDCone()
    Note

    The matrix H in H in HermitianPSDCone() must be a LinearAlgebra.Hermitian matrix type. A build_constraint error will be thrown if the matrix is a different matrix type.

    + -im -x[2]] ∈ HermitianPSDCone()
    Note

    The matrix H in H in HermitianPSDCone() must be a LinearAlgebra.Hermitian matrix type. A build_constraint error will be thrown if the matrix is a different matrix type.

    diff --git a/previews/PR3838/manual/constraints/index.html b/previews/PR3838/manual/constraints/index.html index ee0bb50871b..0fd9c3f173c 100644 --- a/previews/PR3838/manual/constraints/index.html +++ b/previews/PR3838/manual/constraints/index.html @@ -801,4 +801,4 @@ (x[1] == x[2]) - 0.0 = 0 julia> @constraint(model, x[1] == x[2] := rhs) -x[1] == x[2] = false +x[1] == x[2] = false diff --git a/previews/PR3838/manual/containers/index.html b/previews/PR3838/manual/containers/index.html index 365126d4081..1b133b0d8d1 100644 --- a/previews/PR3838/manual/containers/index.html +++ b/previews/PR3838/manual/containers/index.html @@ -232,4 +232,4 @@ julia> Containers.@container([i = 1:2, j = 1:4; condition(i, j)], i + j) JuMP.Containers.SparseAxisArray{Int64, 2, Tuple{Int64, Int64}} with 2 entries: [1, 2] = 3 - [1, 4] = 5 + [1, 4] = 5 diff --git a/previews/PR3838/manual/expressions/index.html b/previews/PR3838/manual/expressions/index.html index 8061d3c091f..ca23208a262 100644 --- a/previews/PR3838/manual/expressions/index.html +++ b/previews/PR3838/manual/expressions/index.html @@ -227,4 +227,4 @@ julia> x 2-element Vector{AffExpr}: 1.1 - 0

    Note that for large expressions this will be slower due to the allocation of additional temporary objects.

    + 0

    Note that for large expressions this will be slower due to the allocation of additional temporary objects.

    diff --git a/previews/PR3838/manual/models/index.html b/previews/PR3838/manual/models/index.html index bc9d897c965..f9f83ad196e 100644 --- a/previews/PR3838/manual/models/index.html +++ b/previews/PR3838/manual/models/index.html @@ -313,4 +313,4 @@ If you expected the solver to support your problem, you may have an error in your formulation. Otherwise, consider using a different solver. The list of available solvers, along with the problem types they support, is available at https://jump.dev/JuMP.jl/stable/installation/#Supported-solvers. -Stacktrace:
    Warning

    Another downside of direct mode is that the behavior of querying solution information after modifying the problem is solver-specific. This can lead to errors, or the solver silently returning an incorrect value. See OptimizeNotCalled errors for more information.

    +Stacktrace:
    Warning

    Another downside of direct mode is that the behavior of querying solution information after modifying the problem is solver-specific. This can lead to errors, or the solver silently returning an incorrect value. See OptimizeNotCalled errors for more information.

    diff --git a/previews/PR3838/manual/nlp/index.html b/previews/PR3838/manual/nlp/index.html index 67621e41fc9..caecc071201 100644 --- a/previews/PR3838/manual/nlp/index.html +++ b/previews/PR3838/manual/nlp/index.html @@ -344,4 +344,4 @@ f1(x[1]) - 1.0 ≤ 0 f2(x[1], x[2]) - 1.0 ≤ 0 f3(x[2], x[3], x[4]) - 1.0 ≤ 0 - f4(x[1], x[3], x[4], x[5]) - 1.0 ≤ 0

    Known performance issues

    The macro-based input to JuMP's nonlinear interface can cause a performance issue if you:

    1. write a macro with a large number (hundreds) of terms
    2. call that macro from within a function instead of from the top-level in global scope.

    The first issue does not depend on the number of resulting terms in the mathematical expression, but rather the number of terms in the Julia Expr representation of that expression. For example, the expression sum(x[i] for i in 1:1_000_000) contains one million mathematical terms, but the Expr representation is just a single sum.

    The most common cause, other than a lot of tedious typing, is if you write a program that automatically writes a JuMP model as a text file, which you later execute. One example is MINLPlib.jl which automatically transpiled models in the GAMS scalar format into JuMP examples.

    As a rule of thumb, if you are writing programs to automatically generate expressions for the JuMP macros, you should target the Raw expression input instead. For more information, read MathOptInterface Issue#1997.

    + f4(x[1], x[3], x[4], x[5]) - 1.0 ≤ 0

    Known performance issues

    The macro-based input to JuMP's nonlinear interface can cause a performance issue if you:

    1. write a macro with a large number (hundreds) of terms
    2. call that macro from within a function instead of from the top-level in global scope.

    The first issue does not depend on the number of resulting terms in the mathematical expression, but rather the number of terms in the Julia Expr representation of that expression. For example, the expression sum(x[i] for i in 1:1_000_000) contains one million mathematical terms, but the Expr representation is just a single sum.

    The most common cause, other than a lot of tedious typing, is if you write a program that automatically writes a JuMP model as a text file, which you later execute. One example is MINLPlib.jl which automatically transpiled models in the GAMS scalar format into JuMP examples.

    As a rule of thumb, if you are writing programs to automatically generate expressions for the JuMP macros, you should target the Raw expression input instead. For more information, read MathOptInterface Issue#1997.

    diff --git a/previews/PR3838/manual/nonlinear/index.html b/previews/PR3838/manual/nonlinear/index.html index 5ed5d3c46cd..61c6189fee2 100644 --- a/previews/PR3838/manual/nonlinear/index.html +++ b/previews/PR3838/manual/nonlinear/index.html @@ -301,4 +301,4 @@ julia> ForwardDiff.gradient(x -> my_operator_good(x...), [1.0, 2.0]) 2-element Vector{Float64}: 2.0 - 4.0 + 4.0 diff --git a/previews/PR3838/manual/objective/index.html b/previews/PR3838/manual/objective/index.html index fa37a08f52b..3051fb6a088 100644 --- a/previews/PR3838/manual/objective/index.html +++ b/previews/PR3838/manual/objective/index.html @@ -179,4 +179,4 @@ 2 x[1] julia> @constraint(model, obj3 <= 2.0) -x[1] + x[2] ≤ 2 +x[1] + x[2] ≤ 2 diff --git a/previews/PR3838/manual/solutions/index.html b/previews/PR3838/manual/solutions/index.html index c656cb0a4b4..ee600574d86 100644 --- a/previews/PR3838/manual/solutions/index.html +++ b/previews/PR3838/manual/solutions/index.html @@ -434,4 +434,4 @@ x integer => 0.1

    You can also use the functional form, where the first argument is a function that maps variables to their primal values:

    julia> optimize!(model)
     
     julia> primal_feasibility_report(v -> value(v), model)
    -Dict{Any, Float64}()
    +Dict{Any, Float64}() diff --git a/previews/PR3838/manual/variables/index.html b/previews/PR3838/manual/variables/index.html index d36420d0f08..30fbc44c406 100644 --- a/previews/PR3838/manual/variables/index.html +++ b/previews/PR3838/manual/variables/index.html @@ -639,4 +639,4 @@ p*x julia> typeof(px) -QuadExpr (alias for GenericQuadExpr{Float64, GenericVariableRef{Float64}})

    When to use a parameter

    Parameters are most useful when solving nonlinear models in a sequence:

    julia> using JuMP, Ipopt
    julia> model = Model(Ipopt.Optimizer);
    julia> set_silent(model)
    julia> @variable(model, x)x
    julia> @variable(model, p in Parameter(1.0))p
    julia> @objective(model, Min, (x - p)^2)x² - 2 p*x + p²
    julia> optimize!(model)
    julia> value(x)1.0
    julia> set_parameter_value(p, 5.0)
    julia> optimize!(model)
    julia> value(x)5.0

    Using parameters can be faster than creating a new model from scratch with updated data because JuMP is able to avoid repeating a number of steps in processing the model before handing it off to the solver.

    +QuadExpr (alias for GenericQuadExpr{Float64, GenericVariableRef{Float64}})

    When to use a parameter

    Parameters are most useful when solving nonlinear models in a sequence:

    julia> using JuMP, Ipopt
    julia> model = Model(Ipopt.Optimizer);
    julia> set_silent(model)
    julia> @variable(model, x)x
    julia> @variable(model, p in Parameter(1.0))p
    julia> @objective(model, Min, (x - p)^2)x² - 2 p*x + p²
    julia> optimize!(model)
    julia> value(x)1.0
    julia> set_parameter_value(p, 5.0)
    julia> optimize!(model)
    julia> value(x)5.0

    Using parameters can be faster than creating a new model from scratch with updated data because JuMP is able to avoid repeating a number of steps in processing the model before handing it off to the solver.

    diff --git a/previews/PR3838/moi/background/duality/index.html b/previews/PR3838/moi/background/duality/index.html index a5e81971cd2..cd177147e08 100644 --- a/previews/PR3838/moi/background/duality/index.html +++ b/previews/PR3838/moi/background/duality/index.html @@ -81,4 +81,4 @@ \max & \sum b_k y_k \\ \text{s.t.} \;\; & C+C^\top - \sum (A_k+A_k^\top) y_k \in \mathcal{S}_+ \\ & C-C^\top - \sum(A_k-A_k^\top) y_k = 0 -\end{align}\]

    and we recover $Z = X + X^\top$.

    +\end{align}\]

    and we recover $Z = X + X^\top$.

    diff --git a/previews/PR3838/moi/background/infeasibility_certificates/index.html b/previews/PR3838/moi/background/infeasibility_certificates/index.html index 5b9d12e5caf..760ea8e48cf 100644 --- a/previews/PR3838/moi/background/infeasibility_certificates/index.html +++ b/previews/PR3838/moi/background/infeasibility_certificates/index.html @@ -29,4 +29,4 @@ \end{align}\]

    and:

    \[-\sum_{i=1}^m b_i^\top (y_i + \eta d_i) > -\sum_{i=1}^m b_i^\top y_i,\]

    for any feasible dual solution $y$. The latter simplifies to $-\sum_{i=1}^m b_i^\top d_i > 0$. For a maximization problem, the inequality is $\sum_{i=1}^m b_i^\top d_i < 0$. (Note that these are the same inequality, modulo a - sign.)

    If the solver has found a certificate of primal infeasibility:

    Note

    The choice of whether to scale the ray $d$ to have magnitude 1 is left to the solver.

    Infeasibility certificates of variable bounds

    Many linear solvers (for example, Gurobi) do not provide explicit access to the primal infeasibility certificate of a variable bound. However, given a set of linear constraints:

    \[\begin{align} l_A \le A x \le u_A \\ l_x \le x \le u_x, -\end{align}\]

    the primal certificate of the variable bounds can be computed using the primal certificate associated with the affine constraints, $d$. (Note that $d$ will have one element for each row of the $A$ matrix, and that some or all of the elements in the vectors $l_A$ and $u_A$ may be $\pm \infty$. If both $l_A$ and $u_A$ are finite for some row, the corresponding element in `d must be 0.)

    Given $d$, compute $\bar{d} = d^\top A$. If the bound is finite, a certificate for the lower variable bound of $x_i$ is $\max\{\bar{d}_i, 0\}$, and a certificate for the upper variable bound is $\min\{\bar{d}_i, 0\}$.

    +\end{align}\]

    the primal certificate of the variable bounds can be computed using the primal certificate associated with the affine constraints, $d$. (Note that $d$ will have one element for each row of the $A$ matrix, and that some or all of the elements in the vectors $l_A$ and $u_A$ may be $\pm \infty$. If both $l_A$ and $u_A$ are finite for some row, the corresponding element in `d must be 0.)

    Given $d$, compute $\bar{d} = d^\top A$. If the bound is finite, a certificate for the lower variable bound of $x_i$ is $\max\{\bar{d}_i, 0\}$, and a certificate for the upper variable bound is $\min\{\bar{d}_i, 0\}$.

    diff --git a/previews/PR3838/moi/background/motivation/index.html b/previews/PR3838/moi/background/motivation/index.html index d8d395f4e7d..a422c33f448 100644 --- a/previews/PR3838/moi/background/motivation/index.html +++ b/previews/PR3838/moi/background/motivation/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Motivation

    MathOptInterface (MOI) is a replacement for MathProgBase, the first-generation abstraction layer for mathematical optimization previously used by JuMP and Convex.jl.

    To address a number of limitations of MathProgBase, MOI is designed to:

    • Be simple and extensible
      • unifying linear, quadratic, and conic optimization,
      • seamlessly facilitating extensions to essentially arbitrary constraints and functions (for example, indicator constraints, complementarity constraints, and piecewise-linear functions)
    • Be fast
      • by allowing access to a solver's in-memory representation of a problem without writing intermediate files (when possible)
      • by using multiple dispatch and avoiding requiring containers of non-concrete types
    • Allow a solver to return multiple results (for example, a pool of solutions)
    • Allow a solver to return extra arbitrary information via attributes (for example, variable- and constraint-wise membership in an irreducible inconsistent subset for infeasibility analysis)
    • Provide a greatly expanded set of status codes explaining what happened during the optimization procedure
    • Enable a solver to more precisely specify which problem classes it supports
    • Enable both primal and dual warm starts
    • Enable adding and removing both variables and constraints by indices that are not required to be consecutive
    • Enable any modification that the solver supports to an existing model
    • Avoid requiring the solver wrapper to store an additional copy of the problem data
    +

    Motivation

    MathOptInterface (MOI) is a replacement for MathProgBase, the first-generation abstraction layer for mathematical optimization previously used by JuMP and Convex.jl.

    To address a number of limitations of MathProgBase, MOI is designed to:

    • Be simple and extensible
      • unifying linear, quadratic, and conic optimization,
      • seamlessly facilitating extensions to essentially arbitrary constraints and functions (for example, indicator constraints, complementarity constraints, and piecewise-linear functions)
    • Be fast
      • by allowing access to a solver's in-memory representation of a problem without writing intermediate files (when possible)
      • by using multiple dispatch and avoiding requiring containers of non-concrete types
    • Allow a solver to return multiple results (for example, a pool of solutions)
    • Allow a solver to return extra arbitrary information via attributes (for example, variable- and constraint-wise membership in an irreducible inconsistent subset for infeasibility analysis)
    • Provide a greatly expanded set of status codes explaining what happened during the optimization procedure
    • Enable a solver to more precisely specify which problem classes it supports
    • Enable both primal and dual warm starts
    • Enable adding and removing both variables and constraints by indices that are not required to be consecutive
    • Enable any modification that the solver supports to an existing model
    • Avoid requiring the solver wrapper to store an additional copy of the problem data
    diff --git a/previews/PR3838/moi/background/naming_conventions/index.html b/previews/PR3838/moi/background/naming_conventions/index.html index 5b4234796e9..6a4d1225147 100644 --- a/previews/PR3838/moi/background/naming_conventions/index.html +++ b/previews/PR3838/moi/background/naming_conventions/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Naming conventions

    MOI follows several conventions for naming functions and structures. These should also be followed by packages extending MOI.

    Sets

    Sets encode the structure of constraints. Their names should follow the following conventions:

    • Abstract types in the set hierarchy should begin with Abstract and end in Set, for example, AbstractScalarSet, AbstractVectorSet.
    • Vector-valued conic sets should end with Cone, for example, NormInfinityCone, SecondOrderCone.
    • Vector-valued Cartesian products should be plural and not end in Cone, for example, Nonnegatives, not NonnegativeCone.
    • Matrix-valued conic sets should provide two representations: ConeSquare and ConeTriangle, for example, RootDetConeTriangle and RootDetConeSquare. See Matrix cones for more details.
    • Scalar sets should be singular, not plural, for example, Integer, not Integers.
    • As much as possible, the names should follow established conventions in the domain where this set is used: for instance, convex sets should have names close to those of CVX, and constraint-programming sets should follow MiniZinc's constraints.
    +

    Naming conventions

    MOI follows several conventions for naming functions and structures. These should also be followed by packages extending MOI.

    Sets

    Sets encode the structure of constraints. Their names should follow the following conventions:

    • Abstract types in the set hierarchy should begin with Abstract and end in Set, for example, AbstractScalarSet, AbstractVectorSet.
    • Vector-valued conic sets should end with Cone, for example, NormInfinityCone, SecondOrderCone.
    • Vector-valued Cartesian products should be plural and not end in Cone, for example, Nonnegatives, not NonnegativeCone.
    • Matrix-valued conic sets should provide two representations: ConeSquare and ConeTriangle, for example, RootDetConeTriangle and RootDetConeSquare. See Matrix cones for more details.
    • Scalar sets should be singular, not plural, for example, Integer, not Integers.
    • As much as possible, the names should follow established conventions in the domain where this set is used: for instance, convex sets should have names close to those of CVX, and constraint-programming sets should follow MiniZinc's constraints.
    diff --git a/previews/PR3838/moi/changelog/index.html b/previews/PR3838/moi/changelog/index.html index 47a37337079..aa21af60ee4 100644 --- a/previews/PR3838/moi/changelog/index.html +++ b/previews/PR3838/moi/changelog/index.html @@ -31,4 +31,4 @@ end write(path, s) end -end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    +end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    diff --git a/previews/PR3838/moi/developer/checklists/index.html b/previews/PR3838/moi/developer/checklists/index.html index 1796d50c199..a3b27f1bbdd 100644 --- a/previews/PR3838/moi/developer/checklists/index.html +++ b/previews/PR3838/moi/developer/checklists/index.html @@ -112,4 +112,4 @@ ## Documentation - - [ ] The version fields are updated in `docs/src/submodules/FileFormats/overview.md` + - [ ] The version fields are updated in `docs/src/submodules/FileFormats/overview.md` diff --git a/previews/PR3838/moi/index.html b/previews/PR3838/moi/index.html index 9922310ce3b..bc496f06a74 100644 --- a/previews/PR3838/moi/index.html +++ b/previews/PR3838/moi/index.html @@ -10,4 +10,4 @@ year={2021}, doi={10.1287/ijoc.2021.1067}, publisher={INFORMS} -}

    A preprint of this paper is freely available.

    +}

    A preprint of this paper is freely available.

    diff --git a/previews/PR3838/moi/manual/constraints/index.html b/previews/PR3838/moi/manual/constraints/index.html index 8a66bf33d3c..87675b53fc0 100644 --- a/previews/PR3838/moi/manual/constraints/index.html +++ b/previews/PR3838/moi/manual/constraints/index.html @@ -23,4 +23,4 @@ false

    Constraint attributes

    The following attributes are available for constraints:

    Get and set these attributes using get and set.

    julia> MOI.set(model, MOI.ConstraintName(), c, "con_c")
     
     julia> MOI.get(model, MOI.ConstraintName(), c)
    -"con_c"

    Constraints by function-set pairs

    Below is a list of common constraint types and how they are represented as function-set pairs in MOI. In the notation below, $x$ is a vector of decision variables, $x_i$ is a scalar decision variable, $\alpha, \beta$ are scalar constants, $a, b$ are constant vectors, A is a constant matrix and $\mathbb{R}_+$ (resp. $\mathbb{R}_-$) is the set of non-negative (resp. non-positive) real numbers.

    Linear constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $a^Tx \le \beta$ScalarAffineFunctionLessThan
    $a^Tx \ge \alpha$ScalarAffineFunctionGreaterThan
    $a^Tx = \beta$ScalarAffineFunctionEqualTo
    $\alpha \le a^Tx \le \beta$ScalarAffineFunctionInterval
    $x_i \le \beta$VariableIndexLessThan
    $x_i \ge \alpha$VariableIndexGreaterThan
    $x_i = \beta$VariableIndexEqualTo
    $\alpha \le x_i \le \beta$VariableIndexInterval
    $Ax + b \in \mathbb{R}_+^n$VectorAffineFunctionNonnegatives
    $Ax + b \in \mathbb{R}_-^n$VectorAffineFunctionNonpositives
    $Ax + b = 0$VectorAffineFunctionZeros

    By convention, solvers are not expected to support nonzero constant terms in the ScalarAffineFunctions the first four rows of the preceding table because they are redundant with the parameters of the sets. For example, encode $2x + 1 \le 2$ as $2x \le 1$.

    Constraints with VariableIndex in LessThan, GreaterThan, EqualTo, or Interval sets have a natural interpretation as variable bounds. As such, it is typically not natural to impose multiple lower- or upper-bounds on the same variable, and the solver interfaces will throw respectively LowerBoundAlreadySet or UpperBoundAlreadySet.

    Moreover, adding two VariableIndex constraints on the same variable with the same set is impossible because they share the same index as it is the index of the variable, see ConstraintIndex.

    It is natural, however, to impose upper- and lower-bounds separately as two different constraints on a single variable. The difference between imposing bounds by using a single Interval constraint and by using separate LessThan and GreaterThan constraints is that the latter will allow the solver to return separate dual multipliers for the two bounds, while the former will allow the solver to return only a single dual for the interval constraint.

    Conic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\lVert Ax + b\rVert_2 \le c^Tx + d$VectorAffineFunctionSecondOrderCone
    $y \ge \lVert x \rVert_2$VectorOfVariablesSecondOrderCone
    $2yz \ge \lVert x \rVert_2^2, y,z \ge 0$VectorOfVariablesRotatedSecondOrderCone
    $(a_1^Tx + b_1,a_2^Tx + b_2,a_3^Tx + b_3) \in \mathcal{E}$VectorAffineFunctionExponentialCone
    $A(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeTriangle
    $B(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeSquare
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeTriangle
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeSquare

    where $\mathcal{E}$ is the exponential cone (see ExponentialCone), $\mathcal{S}_+$ is the set of positive semidefinite symmetric matrices, $A$ is an affine map that outputs symmetric matrices and $B$ is an affine map that outputs square matrices.

    Quadratic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\frac{1}{2}x^TQx + a^Tx + b \ge 0$ScalarQuadraticFunctionGreaterThan
    $\frac{1}{2}x^TQx + a^Tx + b \le 0$ScalarQuadraticFunctionLessThan
    $\frac{1}{2}x^TQx + a^Tx + b = 0$ScalarQuadraticFunctionEqualTo
    Bilinear matrix inequalityVectorQuadraticFunctionPositiveSemidefiniteCone...
    Note

    For more details on the internal format of the quadratic functions see ScalarQuadraticFunction or VectorQuadraticFunction.

    Discrete and logical constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $x_i \in \mathbb{Z}$VariableIndexInteger
    $x_i \in \{0,1\}$VariableIndexZeroOne
    $x_i \in \{0\} \cup [l,u]$VariableIndexSemicontinuous
    $x_i \in \{0\} \cup \{l,l+1,\ldots,u-1,u\}$VariableIndexSemiinteger
    At most one component of $x$ can be nonzeroVectorOfVariablesSOS1
    At most two components of $x$ can be nonzero, and if so they must be adjacent componentsVectorOfVariablesSOS2
    $y = 1 \implies a^T x \in S$VectorAffineFunctionIndicator

    JuMP mapping

    The following bullet points show examples of how JuMP constraints are translated into MOI function-set pairs:

    • @constraint(m, 2x + y <= 10) becomes ScalarAffineFunction-in-LessThan
    • @constraint(m, 2x + y >= 10) becomes ScalarAffineFunction-in-GreaterThan
    • @constraint(m, 2x + y == 10) becomes ScalarAffineFunction-in-EqualTo
    • @constraint(m, 0 <= 2x + y <= 10) becomes ScalarAffineFunction-in-Interval
    • @constraint(m, 2x + y in ArbitrarySet()) becomes ScalarAffineFunction-in-ArbitrarySet.

    Variable bounds are handled in a similar fashion:

    • @variable(m, x <= 1) becomes VariableIndex-in-LessThan
    • @variable(m, x >= 1) becomes VariableIndex-in-GreaterThan

    One notable difference is that a variable with an upper and lower bound is translated into two constraints, rather than an interval, that is:

    • @variable(m, 0 <= x <= 1) becomes VariableIndex-in-LessThan and VariableIndex-in-GreaterThan.
    +"con_c"

    Constraints by function-set pairs

    Below is a list of common constraint types and how they are represented as function-set pairs in MOI. In the notation below, $x$ is a vector of decision variables, $x_i$ is a scalar decision variable, $\alpha, \beta$ are scalar constants, $a, b$ are constant vectors, A is a constant matrix and $\mathbb{R}_+$ (resp. $\mathbb{R}_-$) is the set of non-negative (resp. non-positive) real numbers.

    Linear constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $a^Tx \le \beta$ScalarAffineFunctionLessThan
    $a^Tx \ge \alpha$ScalarAffineFunctionGreaterThan
    $a^Tx = \beta$ScalarAffineFunctionEqualTo
    $\alpha \le a^Tx \le \beta$ScalarAffineFunctionInterval
    $x_i \le \beta$VariableIndexLessThan
    $x_i \ge \alpha$VariableIndexGreaterThan
    $x_i = \beta$VariableIndexEqualTo
    $\alpha \le x_i \le \beta$VariableIndexInterval
    $Ax + b \in \mathbb{R}_+^n$VectorAffineFunctionNonnegatives
    $Ax + b \in \mathbb{R}_-^n$VectorAffineFunctionNonpositives
    $Ax + b = 0$VectorAffineFunctionZeros

    By convention, solvers are not expected to support nonzero constant terms in the ScalarAffineFunctions the first four rows of the preceding table because they are redundant with the parameters of the sets. For example, encode $2x + 1 \le 2$ as $2x \le 1$.

    Constraints with VariableIndex in LessThan, GreaterThan, EqualTo, or Interval sets have a natural interpretation as variable bounds. As such, it is typically not natural to impose multiple lower- or upper-bounds on the same variable, and the solver interfaces will throw respectively LowerBoundAlreadySet or UpperBoundAlreadySet.

    Moreover, adding two VariableIndex constraints on the same variable with the same set is impossible because they share the same index as it is the index of the variable, see ConstraintIndex.

    It is natural, however, to impose upper- and lower-bounds separately as two different constraints on a single variable. The difference between imposing bounds by using a single Interval constraint and by using separate LessThan and GreaterThan constraints is that the latter will allow the solver to return separate dual multipliers for the two bounds, while the former will allow the solver to return only a single dual for the interval constraint.

    Conic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\lVert Ax + b\rVert_2 \le c^Tx + d$VectorAffineFunctionSecondOrderCone
    $y \ge \lVert x \rVert_2$VectorOfVariablesSecondOrderCone
    $2yz \ge \lVert x \rVert_2^2, y,z \ge 0$VectorOfVariablesRotatedSecondOrderCone
    $(a_1^Tx + b_1,a_2^Tx + b_2,a_3^Tx + b_3) \in \mathcal{E}$VectorAffineFunctionExponentialCone
    $A(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeTriangle
    $B(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeSquare
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeTriangle
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeSquare

    where $\mathcal{E}$ is the exponential cone (see ExponentialCone), $\mathcal{S}_+$ is the set of positive semidefinite symmetric matrices, $A$ is an affine map that outputs symmetric matrices and $B$ is an affine map that outputs square matrices.

    Quadratic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\frac{1}{2}x^TQx + a^Tx + b \ge 0$ScalarQuadraticFunctionGreaterThan
    $\frac{1}{2}x^TQx + a^Tx + b \le 0$ScalarQuadraticFunctionLessThan
    $\frac{1}{2}x^TQx + a^Tx + b = 0$ScalarQuadraticFunctionEqualTo
    Bilinear matrix inequalityVectorQuadraticFunctionPositiveSemidefiniteCone...
    Note

    For more details on the internal format of the quadratic functions see ScalarQuadraticFunction or VectorQuadraticFunction.

    Discrete and logical constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $x_i \in \mathbb{Z}$VariableIndexInteger
    $x_i \in \{0,1\}$VariableIndexZeroOne
    $x_i \in \{0\} \cup [l,u]$VariableIndexSemicontinuous
    $x_i \in \{0\} \cup \{l,l+1,\ldots,u-1,u\}$VariableIndexSemiinteger
    At most one component of $x$ can be nonzeroVectorOfVariablesSOS1
    At most two components of $x$ can be nonzero, and if so they must be adjacent componentsVectorOfVariablesSOS2
    $y = 1 \implies a^T x \in S$VectorAffineFunctionIndicator

    JuMP mapping

    The following bullet points show examples of how JuMP constraints are translated into MOI function-set pairs:

    • @constraint(m, 2x + y <= 10) becomes ScalarAffineFunction-in-LessThan
    • @constraint(m, 2x + y >= 10) becomes ScalarAffineFunction-in-GreaterThan
    • @constraint(m, 2x + y == 10) becomes ScalarAffineFunction-in-EqualTo
    • @constraint(m, 0 <= 2x + y <= 10) becomes ScalarAffineFunction-in-Interval
    • @constraint(m, 2x + y in ArbitrarySet()) becomes ScalarAffineFunction-in-ArbitrarySet.

    Variable bounds are handled in a similar fashion:

    • @variable(m, x <= 1) becomes VariableIndex-in-LessThan
    • @variable(m, x >= 1) becomes VariableIndex-in-GreaterThan

    One notable difference is that a variable with an upper and lower bound is translated into two constraints, rather than an interval, that is:

    • @variable(m, 0 <= x <= 1) becomes VariableIndex-in-LessThan and VariableIndex-in-GreaterThan.
    diff --git a/previews/PR3838/moi/manual/models/index.html b/previews/PR3838/moi/manual/models/index.html index 11dd1ea4afb..e2bf4379852 100644 --- a/previews/PR3838/moi/manual/models/index.html +++ b/previews/PR3838/moi/manual/models/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Models

    The most significant part of MOI is the definition of the model API that is used to specify an instance of an optimization problem (for example, by adding variables and constraints). Objects that implement the model API must inherit from the ModelLike abstract type.

    Notably missing from the model API is the method to solve an optimization problem. ModelLike objects may store an instance (for example, in memory or backed by a file format) without being linked to a particular solver. In addition to the model API, MOI defines AbstractOptimizer and provides methods to solve the model and interact with solutions. See the Solutions section for more details.

    Info

    Throughout the rest of the manual, model is used as a generic ModelLike, and optimizer is used as a generic AbstractOptimizer.

    Tip

    MOI does not export functions, but for brevity we often omit qualifying names with the MOI module. Best practice is to have

    import MathOptInterface as MOI

    and prefix all MOI methods with MOI. in user code. If a name is also available in base Julia, we always explicitly use the module prefix, for example, with MOI.get.

    Attributes

    Attributes are properties of the model that can be queried and modified. These include constants such as the number of variables in a model NumberOfVariables), and properties of variables and constraints such as the name of a variable (VariableName).

    There are four types of attributes:

    Some attributes are values that can be queried by the user but not modified, while other attributes can be modified by the user.

    All interactions with attributes occur through the get and set functions.

    Consult the docstrings of each attribute for information on what it represents.

    ModelLike API

    The following attributes are available:

    AbstractOptimizer API

    The following attributes are available:

    +

    Models

    The most significant part of MOI is the definition of the model API that is used to specify an instance of an optimization problem (for example, by adding variables and constraints). Objects that implement the model API must inherit from the ModelLike abstract type.

    Notably missing from the model API is the method to solve an optimization problem. ModelLike objects may store an instance (for example, in memory or backed by a file format) without being linked to a particular solver. In addition to the model API, MOI defines AbstractOptimizer and provides methods to solve the model and interact with solutions. See the Solutions section for more details.

    Info

    Throughout the rest of the manual, model is used as a generic ModelLike, and optimizer is used as a generic AbstractOptimizer.

    Tip

    MOI does not export functions, but for brevity we often omit qualifying names with the MOI module. Best practice is to have

    import MathOptInterface as MOI

    and prefix all MOI methods with MOI. in user code. If a name is also available in base Julia, we always explicitly use the module prefix, for example, with MOI.get.

    Attributes

    Attributes are properties of the model that can be queried and modified. These include constants such as the number of variables in a model NumberOfVariables), and properties of variables and constraints such as the name of a variable (VariableName).

    There are four types of attributes:

    Some attributes are values that can be queried by the user but not modified, while other attributes can be modified by the user.

    All interactions with attributes occur through the get and set functions.

    Consult the docstrings of each attribute for information on what it represents.

    ModelLike API

    The following attributes are available:

    AbstractOptimizer API

    The following attributes are available:

    diff --git a/previews/PR3838/moi/manual/modification/index.html b/previews/PR3838/moi/manual/modification/index.html index aea5e930c51..1868a91a222 100644 --- a/previews/PR3838/moi/manual/modification/index.html +++ b/previews/PR3838/moi/manual/modification/index.html @@ -152,4 +152,4 @@ ); julia> MOI.get(model, MOI.ConstraintFunction(), c) ≈ new_f -true +true diff --git a/previews/PR3838/moi/manual/solutions/index.html b/previews/PR3838/moi/manual/solutions/index.html index 735f15f0976..ff0aee62314 100644 --- a/previews/PR3838/moi/manual/solutions/index.html +++ b/previews/PR3838/moi/manual/solutions/index.html @@ -36,4 +36,4 @@ end rethrow(err) # Something else went wrong. Rethrow the error end -end +end diff --git a/previews/PR3838/moi/manual/standard_form/index.html b/previews/PR3838/moi/manual/standard_form/index.html index c8dfae2d365..3deb963de5b 100644 --- a/previews/PR3838/moi/manual/standard_form/index.html +++ b/previews/PR3838/moi/manual/standard_form/index.html @@ -7,4 +7,4 @@ & \min_{x \in \mathbb{R}^n} & f_0(x) \\ & \;\;\text{s.t.} & f_i(x) & \in \mathcal{S}_i & i = 1 \ldots m -\end{align}\]

    where:

    • the functions $f_0, f_1, \ldots, f_m$ are specified by AbstractFunction objects
    • the sets $\mathcal{S}_1, \ldots, \mathcal{S}_m$ are specified by AbstractSet objects
    Tip

    For more information on this standard form, read our paper.

    MOI defines some commonly used functions and sets, but the interface is extensible to other sets recognized by the solver.

    Functions

    The function types implemented in MathOptInterface.jl are:

    FunctionDescription
    VariableIndex$x_j$, the projection onto a single coordinate defined by a variable index $j$.
    VectorOfVariablesThe projection onto multiple coordinates (that is, extracting a sub-vector).
    ScalarAffineFunction$a^T x + b$, where $a$ is a vector and $b$ scalar.
    ScalarNonlinearFunction$f(x)$, where $f$ is a nonlinear function.
    VectorAffineFunction$A x + b$, where $A$ is a matrix and $b$ is a vector.
    ScalarQuadraticFunction$\frac{1}{2} x^T Q x + a^T x + b$, where $Q$ is a symmetric matrix, $a$ is a vector, and $b$ is a constant.
    VectorQuadraticFunctionA vector of scalar-valued quadratic functions.
    VectorNonlinearFunction$f(x)$, where $f$ is a vector-valued nonlinear function.

    Extensions for nonlinear programming are present but not yet well documented.

    One-dimensional sets

    The one-dimensional set types implemented in MathOptInterface.jl are:

    SetDescription
    LessThan(u)$(-\infty, u]$
    GreaterThan(l)$[l, \infty)$
    EqualTo(v)$\{v\}$
    Interval(l, u)$[l, u]$
    Integer()$\mathbb{Z}$
    ZeroOne()$\{ 0, 1 \}$
    Semicontinuous(l, u)$\{ 0\} \cup [l, u]$
    Semiinteger(l, u)$\{ 0\} \cup \{l,l+1,\ldots,u-1,u\}$

    Vector cones

    The vector-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    Reals(d)$\mathbb{R}^{d}$
    Zeros(d)$0^{d}$
    Nonnegatives(d)$\{ x \in \mathbb{R}^{d} : x \ge 0 \}$
    Nonpositives(d)$\{ x \in \mathbb{R}^{d} : x \le 0 \}$
    SecondOrderCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \lVert x \rVert_2 \}$
    RotatedSecondOrderCone(d)$\{ (t,u,x) \in \mathbb{R}^{d} : 2tu \ge \lVert x \rVert_2^2, t \ge 0,u \ge 0 \}$
    ExponentialCone()$\{ (x,y,z) \in \mathbb{R}^3 : y \exp (x/y) \le z, y > 0 \}$
    DualExponentialCone()$\{ (u,v,w) \in \mathbb{R}^3 : -u \exp (v/u) \le \exp(1) w, u < 0 \}$
    GeometricMeanCone(d)$\{ (t,x) \in \mathbb{R}^{1+n} : x \ge 0, t \le \sqrt[n]{x_1 x_2 \cdots x_n} \}$ where $n$ is $d - 1$
    PowerCone(α)$\{ (x,y,z) \in \mathbb{R}^3 : x^{\alpha} y^{1-\alpha} \ge |z|, x \ge 0,y \ge 0 \}$
    DualPowerCone(α)$\{ (u,v,w) \in \mathbb{R}^3 : \left(\frac{u}{\alpha}\right)^{\alpha}\left(\frac{v}{1-\alpha}\right)^{1-\alpha} \ge |w|, u,v \ge 0 \}$
    NormOneCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \sum_i \lvert x_i \rvert \}$
    NormInfinityCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \max_i \lvert x_i \rvert \}$
    RelativeEntropyCone(d)$\{ (u, v, w) \in \mathbb{R}^{d} : u \ge \sum_i w_i \log (\frac{w_i}{v_i}), v_i \ge 0, w_i \ge 0 \}$
    HyperRectangle(l, u)$\{x \in \bar{\mathbb{R}}^d: x_i \in [l_i, u_i] \forall i=1,\ldots,d\}$
    NormCone(p, d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \left(\sum\limits_i \lvert x_i \rvert^p\right)^{\frac{1}{p}} \}$

    Matrix cones

    The matrix-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    RootDetConeTriangle(d)$\{ (t,X) \in \mathbb{R}^{1+d(1+d)/2} : t \le \det(X)^{1/d}, X \mbox{ is the upper triangle of a PSD matrix} \}$
    RootDetConeSquare(d)$\{ (t,X) \in \mathbb{R}^{1+d^2} : t \le \det(X)^{1/d}, X \mbox{ is a PSD matrix} \}$
    PositiveSemidefiniteConeTriangle(d)$\{ X \in \mathbb{R}^{d(d+1)/2} : X \mbox{ is the upper triangle of a PSD matrix} \}$
    PositiveSemidefiniteConeSquare(d)$\{ X \in \mathbb{R}^{d^2} : X \mbox{ is a PSD matrix} \}$
    LogDetConeTriangle(d)$\{ (t,u,X) \in \mathbb{R}^{2+d(1+d)/2} : t \le u\log(\det(X/u)), X \mbox{ is the upper triangle of a PSD matrix}, u > 0 \}$
    LogDetConeSquare(d)$\{ (t,u,X) \in \mathbb{R}^{2+d^2} : t \le u \log(\det(X/u)), X \mbox{ is a PSD matrix}, u > 0 \}$
    NormSpectralCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sigma_1(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    NormNuclearCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sum_i \sigma_i(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    HermitianPositiveSemidefiniteConeTriangle(d)The cone of Hermitian positive semidefinite matrices, with
    side_dimension rows and columns.
    Scaled(S)The set S scaled so that Utilities.set_dot corresponds to LinearAlgebra.dot

    Some of these cones can take two forms: XXXConeTriangle and XXXConeSquare.

    In XXXConeTriangle sets, the matrix is assumed to be symmetric, and the elements are provided by a vector, in which the entries of the upper-right triangular part of the matrix are given column by column (or equivalently, the entries of the lower-left triangular part are given row by row).

    In XXXConeSquare sets, the entries of the matrix are given column by column (or equivalently, row by row), and the matrix is constrained to be symmetric. As an example, given a 2-by-2 matrix of variables X and a one-dimensional variable t, we can specify a root-det constraint as [t, X11, X12, X22] ∈ RootDetConeTriangle or [t, X11, X12, X21, X22] ∈ RootDetConeSquare.

    We provide both forms to enable flexibility for solvers who may natively support one or the other. Transformations between XXXConeTriangle and XXXConeSquare are handled by bridges, which removes the chance of conversion mistakes by users or solver developers.

    Multi-dimensional sets with combinatorial structure

    Other sets are vector-valued, with a particular combinatorial structure. Read their docstrings for more information on how to interpret them.

    SetDescription
    SOS1A Special Ordered Set (SOS) of Type I
    SOS2A Special Ordered Set (SOS) of Type II
    IndicatorA set to specify an indicator constraint
    ComplementsA set to specify a mixed complementarity constraint
    AllDifferentThe all_different global constraint
    BinPackingThe bin_packing global constraint
    CircuitThe circuit global constraint
    CountAtLeastThe at_least global constraint
    CountBelongsThe nvalue global constraint
    CountDistinctThe distinct global constraint
    CountGreaterThanThe count_gt global constraint
    CumulativeThe cumulative global constraint
    PathThe path global constraint
    TableThe table global constraint
    +\end{align}\]

    where:

    • the functions $f_0, f_1, \ldots, f_m$ are specified by AbstractFunction objects
    • the sets $\mathcal{S}_1, \ldots, \mathcal{S}_m$ are specified by AbstractSet objects
    Tip

    For more information on this standard form, read our paper.

    MOI defines some commonly used functions and sets, but the interface is extensible to other sets recognized by the solver.

    Functions

    The function types implemented in MathOptInterface.jl are:

    FunctionDescription
    VariableIndex$x_j$, the projection onto a single coordinate defined by a variable index $j$.
    VectorOfVariablesThe projection onto multiple coordinates (that is, extracting a sub-vector).
    ScalarAffineFunction$a^T x + b$, where $a$ is a vector and $b$ scalar.
    ScalarNonlinearFunction$f(x)$, where $f$ is a nonlinear function.
    VectorAffineFunction$A x + b$, where $A$ is a matrix and $b$ is a vector.
    ScalarQuadraticFunction$\frac{1}{2} x^T Q x + a^T x + b$, where $Q$ is a symmetric matrix, $a$ is a vector, and $b$ is a constant.
    VectorQuadraticFunctionA vector of scalar-valued quadratic functions.
    VectorNonlinearFunction$f(x)$, where $f$ is a vector-valued nonlinear function.

    Extensions for nonlinear programming are present but not yet well documented.

    One-dimensional sets

    The one-dimensional set types implemented in MathOptInterface.jl are:

    SetDescription
    LessThan(u)$(-\infty, u]$
    GreaterThan(l)$[l, \infty)$
    EqualTo(v)$\{v\}$
    Interval(l, u)$[l, u]$
    Integer()$\mathbb{Z}$
    ZeroOne()$\{ 0, 1 \}$
    Semicontinuous(l, u)$\{ 0\} \cup [l, u]$
    Semiinteger(l, u)$\{ 0\} \cup \{l,l+1,\ldots,u-1,u\}$

    Vector cones

    The vector-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    Reals(d)$\mathbb{R}^{d}$
    Zeros(d)$0^{d}$
    Nonnegatives(d)$\{ x \in \mathbb{R}^{d} : x \ge 0 \}$
    Nonpositives(d)$\{ x \in \mathbb{R}^{d} : x \le 0 \}$
    SecondOrderCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \lVert x \rVert_2 \}$
    RotatedSecondOrderCone(d)$\{ (t,u,x) \in \mathbb{R}^{d} : 2tu \ge \lVert x \rVert_2^2, t \ge 0,u \ge 0 \}$
    ExponentialCone()$\{ (x,y,z) \in \mathbb{R}^3 : y \exp (x/y) \le z, y > 0 \}$
    DualExponentialCone()$\{ (u,v,w) \in \mathbb{R}^3 : -u \exp (v/u) \le \exp(1) w, u < 0 \}$
    GeometricMeanCone(d)$\{ (t,x) \in \mathbb{R}^{1+n} : x \ge 0, t \le \sqrt[n]{x_1 x_2 \cdots x_n} \}$ where $n$ is $d - 1$
    PowerCone(α)$\{ (x,y,z) \in \mathbb{R}^3 : x^{\alpha} y^{1-\alpha} \ge |z|, x \ge 0,y \ge 0 \}$
    DualPowerCone(α)$\{ (u,v,w) \in \mathbb{R}^3 : \left(\frac{u}{\alpha}\right)^{\alpha}\left(\frac{v}{1-\alpha}\right)^{1-\alpha} \ge |w|, u,v \ge 0 \}$
    NormOneCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \sum_i \lvert x_i \rvert \}$
    NormInfinityCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \max_i \lvert x_i \rvert \}$
    RelativeEntropyCone(d)$\{ (u, v, w) \in \mathbb{R}^{d} : u \ge \sum_i w_i \log (\frac{w_i}{v_i}), v_i \ge 0, w_i \ge 0 \}$
    HyperRectangle(l, u)$\{x \in \bar{\mathbb{R}}^d: x_i \in [l_i, u_i] \forall i=1,\ldots,d\}$
    NormCone(p, d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \left(\sum\limits_i \lvert x_i \rvert^p\right)^{\frac{1}{p}} \}$

    Matrix cones

    The matrix-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    RootDetConeTriangle(d)$\{ (t,X) \in \mathbb{R}^{1+d(1+d)/2} : t \le \det(X)^{1/d}, X \mbox{ is the upper triangle of a PSD matrix} \}$
    RootDetConeSquare(d)$\{ (t,X) \in \mathbb{R}^{1+d^2} : t \le \det(X)^{1/d}, X \mbox{ is a PSD matrix} \}$
    PositiveSemidefiniteConeTriangle(d)$\{ X \in \mathbb{R}^{d(d+1)/2} : X \mbox{ is the upper triangle of a PSD matrix} \}$
    PositiveSemidefiniteConeSquare(d)$\{ X \in \mathbb{R}^{d^2} : X \mbox{ is a PSD matrix} \}$
    LogDetConeTriangle(d)$\{ (t,u,X) \in \mathbb{R}^{2+d(1+d)/2} : t \le u\log(\det(X/u)), X \mbox{ is the upper triangle of a PSD matrix}, u > 0 \}$
    LogDetConeSquare(d)$\{ (t,u,X) \in \mathbb{R}^{2+d^2} : t \le u \log(\det(X/u)), X \mbox{ is a PSD matrix}, u > 0 \}$
    NormSpectralCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sigma_1(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    NormNuclearCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sum_i \sigma_i(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    HermitianPositiveSemidefiniteConeTriangle(d)The cone of Hermitian positive semidefinite matrices, with
    side_dimension rows and columns.
    Scaled(S)The set S scaled so that Utilities.set_dot corresponds to LinearAlgebra.dot

    Some of these cones can take two forms: XXXConeTriangle and XXXConeSquare.

    In XXXConeTriangle sets, the matrix is assumed to be symmetric, and the elements are provided by a vector, in which the entries of the upper-right triangular part of the matrix are given column by column (or equivalently, the entries of the lower-left triangular part are given row by row).

    In XXXConeSquare sets, the entries of the matrix are given column by column (or equivalently, row by row), and the matrix is constrained to be symmetric. As an example, given a 2-by-2 matrix of variables X and a one-dimensional variable t, we can specify a root-det constraint as [t, X11, X12, X22] ∈ RootDetConeTriangle or [t, X11, X12, X21, X22] ∈ RootDetConeSquare.

    We provide both forms to enable flexibility for solvers who may natively support one or the other. Transformations between XXXConeTriangle and XXXConeSquare are handled by bridges, which removes the chance of conversion mistakes by users or solver developers.

    Multi-dimensional sets with combinatorial structure

    Other sets are vector-valued, with a particular combinatorial structure. Read their docstrings for more information on how to interpret them.

    SetDescription
    SOS1A Special Ordered Set (SOS) of Type I
    SOS2A Special Ordered Set (SOS) of Type II
    IndicatorA set to specify an indicator constraint
    ComplementsA set to specify a mixed complementarity constraint
    AllDifferentThe all_different global constraint
    BinPackingThe bin_packing global constraint
    CircuitThe circuit global constraint
    CountAtLeastThe at_least global constraint
    CountBelongsThe nvalue global constraint
    CountDistinctThe distinct global constraint
    CountGreaterThanThe count_gt global constraint
    CumulativeThe cumulative global constraint
    PathThe path global constraint
    TableThe table global constraint
    diff --git a/previews/PR3838/moi/manual/variables/index.html b/previews/PR3838/moi/manual/variables/index.html index 7e50d1b8b7e..d1c10ea9d94 100644 --- a/previews/PR3838/moi/manual/variables/index.html +++ b/previews/PR3838/moi/manual/variables/index.html @@ -14,4 +14,4 @@ false
    Warning

    Not all ModelLike models support deleting variables. A DeleteNotAllowed error is thrown if this is not supported.

    Variable attributes

    The following attributes are available for variables:

    Get and set these attributes using get and set.

    julia> MOI.set(model, MOI.VariableName(), x, "var_x")
     
     julia> MOI.get(model, MOI.VariableName(), x)
    -"var_x"
    +"var_x" diff --git a/previews/PR3838/moi/reference/callbacks/index.html b/previews/PR3838/moi/reference/callbacks/index.html index 07df1883126..9d3e809fed0 100644 --- a/previews/PR3838/moi/reference/callbacks/index.html +++ b/previews/PR3838/moi/reference/callbacks/index.html @@ -33,4 +33,4 @@ MOI.submit(optimizer, MOI.HeuristicSolution(callback_data), x, values) end -endsource
    MathOptInterface.HeuristicSolutionType
    HeuristicSolution(callback_data)

    Heuristically obtained feasible solution. The solution is submitted as variables, values where values[i] gives the value of variables[i], similarly to set. The submit call returns a HeuristicSolutionStatus indicating whether the provided solution was accepted or rejected.

    This can be submitted only from the HeuristicCallback. The field callback_data is a solver-specific callback type that is passed as the argument to the heuristic callback.

    Some solvers require a complete solution, others only partial solutions.

    source
    +endsource
    MathOptInterface.HeuristicSolutionType
    HeuristicSolution(callback_data)

    Heuristically obtained feasible solution. The solution is submitted as variables, values where values[i] gives the value of variables[i], similarly to set. The submit call returns a HeuristicSolutionStatus indicating whether the provided solution was accepted or rejected.

    This can be submitted only from the HeuristicCallback. The field callback_data is a solver-specific callback type that is passed as the argument to the heuristic callback.

    Some solvers require a complete solution, others only partial solutions.

    source
    diff --git a/previews/PR3838/moi/reference/constraints/index.html b/previews/PR3838/moi/reference/constraints/index.html index 23e040cbbdd..2b2a95763a0 100644 --- a/previews/PR3838/moi/reference/constraints/index.html +++ b/previews/PR3838/moi/reference/constraints/index.html @@ -13,4 +13,4 @@ model::ModelLike, ::Type{F}, ::Type{S}, -)::Bool where {F<:AbstractFunction,S<:AbstractSet}

    Return a Bool indicating whether model supports F-in-S constraints, that is, copy_to(model, src) does not throw UnsupportedConstraint when src contains F-in-S constraints. If F-in-S constraints are only not supported in specific circumstances, for example, F-in-S constraints cannot be combined with another type of constraint, it should still return true.

    source

    Attributes

    MathOptInterface.ConstraintNameType
    ConstraintName()

    A constraint attribute for a string identifying the constraint.

    It is valid for constraints variables to have the same name; however, constraints with duplicate names cannot be looked up using get, regardless of whether they have the same F-in-S type.

    ConstraintName has a default value of "" if not set.

    Notes

    You should not implement ConstraintName for VariableIndex constraints.

    source
    MathOptInterface.ConstraintPrimalType
    ConstraintPrimal(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's primal value in result result_index.

    If the constraint is f(x) in S, then in most cases the ConstraintPrimal is the value of f, evaluated at the corresponding VariablePrimal solution.

    However, some conic solvers reformulate b - Ax in S to s = b - Ax, s in S. These solvers may return the value of s for ConstraintPrimal, rather than b - Ax. (Although these are constrained by an equality constraint, due to numerical tolerances they may not be identical.)

    If the solver does not have a primal value for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintPrimal attribute.

    If result_index is omitted, it is 1 by default. See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintDualType
    ConstraintDual(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's dual value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a dual value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the ConstraintDual attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintBasisStatusType
    ConstraintBasisStatus(result_index::Int = 1)

    A constraint attribute for the BasisStatusCode of some constraint in result result_index, with respect to an available optimal solution basis. If result_index is omitted, it is 1 by default.

    If the solver does not have a basis status for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    Notes

    For the basis status of a variable, query VariableBasisStatus.

    ConstraintBasisStatus does not apply to VariableIndex constraints. You can infer the basis status of a VariableIndex constraint by looking at the result of VariableBasisStatus.

    source
    MathOptInterface.ConstraintFunctionType
    ConstraintFunction()

    A constraint attribute for the AbstractFunction object used to define the constraint.

    It is guaranteed to be equivalent but not necessarily identical to the function provided by the user.

    source
    MathOptInterface.CanonicalConstraintFunctionType
    CanonicalConstraintFunction()

    A constraint attribute for a canonical representation of the AbstractFunction object used to define the constraint.

    Getting this attribute is guaranteed to return a function that is equivalent but not necessarily identical to the function provided by the user.

    By default, MOI.get(model, MOI.CanonicalConstraintFunction(), ci) fallbacks to MOI.Utilities.canonical(MOI.get(model, MOI.ConstraintFunction(), ci)). However, if model knows that the constraint function is canonical then it can implement a specialized method that directly return the function without calling Utilities.canonical. Therefore, the value returned cannot be assumed to be a copy of the function stored in model. Moreover, Utilities.Model checks with Utilities.is_canonical whether the function stored internally is already canonical and if it's the case, then it returns the function stored internally instead of a copy.

    source
    MathOptInterface.BasisStatusCodeType
    BasisStatusCode

    An Enum of possible values for the ConstraintBasisStatus and VariableBasisStatus attributes, explaining the status of a given element with respect to an optimal solution basis.

    Notes

    • NONBASIC_AT_LOWER and NONBASIC_AT_UPPER should be used only for constraints with the Interval set. In this case, they are necessary to distinguish which side of the constraint is active. One-sided constraints (for example, LessThan and GreaterThan) should use NONBASIC instead of the NONBASIC_AT_* values. This restriction does not apply to VariableBasisStatus, which should return NONBASIC_AT_* regardless of whether the alternative bound exists.

    • In linear programs, SUPER_BASIC occurs when a variable with no bounds is not in the basis.

    Values

    Possible values are:

    source
    +)::Bool where {F<:AbstractFunction,S<:AbstractSet}

    Return a Bool indicating whether model supports F-in-S constraints, that is, copy_to(model, src) does not throw UnsupportedConstraint when src contains F-in-S constraints. If F-in-S constraints are only not supported in specific circumstances, for example, F-in-S constraints cannot be combined with another type of constraint, it should still return true.

    source

    Attributes

    MathOptInterface.ConstraintNameType
    ConstraintName()

    A constraint attribute for a string identifying the constraint.

    It is valid for constraints variables to have the same name; however, constraints with duplicate names cannot be looked up using get, regardless of whether they have the same F-in-S type.

    ConstraintName has a default value of "" if not set.

    Notes

    You should not implement ConstraintName for VariableIndex constraints.

    source
    MathOptInterface.ConstraintPrimalType
    ConstraintPrimal(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's primal value in result result_index.

    If the constraint is f(x) in S, then in most cases the ConstraintPrimal is the value of f, evaluated at the corresponding VariablePrimal solution.

    However, some conic solvers reformulate b - Ax in S to s = b - Ax, s in S. These solvers may return the value of s for ConstraintPrimal, rather than b - Ax. (Although these are constrained by an equality constraint, due to numerical tolerances they may not be identical.)

    If the solver does not have a primal value for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintPrimal attribute.

    If result_index is omitted, it is 1 by default. See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintDualType
    ConstraintDual(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's dual value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a dual value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the ConstraintDual attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintBasisStatusType
    ConstraintBasisStatus(result_index::Int = 1)

    A constraint attribute for the BasisStatusCode of some constraint in result result_index, with respect to an available optimal solution basis. If result_index is omitted, it is 1 by default.

    If the solver does not have a basis status for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    Notes

    For the basis status of a variable, query VariableBasisStatus.

    ConstraintBasisStatus does not apply to VariableIndex constraints. You can infer the basis status of a VariableIndex constraint by looking at the result of VariableBasisStatus.

    source
    MathOptInterface.ConstraintFunctionType
    ConstraintFunction()

    A constraint attribute for the AbstractFunction object used to define the constraint.

    It is guaranteed to be equivalent but not necessarily identical to the function provided by the user.

    source
    MathOptInterface.CanonicalConstraintFunctionType
    CanonicalConstraintFunction()

    A constraint attribute for a canonical representation of the AbstractFunction object used to define the constraint.

    Getting this attribute is guaranteed to return a function that is equivalent but not necessarily identical to the function provided by the user.

    By default, MOI.get(model, MOI.CanonicalConstraintFunction(), ci) fallbacks to MOI.Utilities.canonical(MOI.get(model, MOI.ConstraintFunction(), ci)). However, if model knows that the constraint function is canonical then it can implement a specialized method that directly return the function without calling Utilities.canonical. Therefore, the value returned cannot be assumed to be a copy of the function stored in model. Moreover, Utilities.Model checks with Utilities.is_canonical whether the function stored internally is already canonical and if it's the case, then it returns the function stored internally instead of a copy.

    source
    MathOptInterface.BasisStatusCodeType
    BasisStatusCode

    An Enum of possible values for the ConstraintBasisStatus and VariableBasisStatus attributes, explaining the status of a given element with respect to an optimal solution basis.

    Notes

    • NONBASIC_AT_LOWER and NONBASIC_AT_UPPER should be used only for constraints with the Interval set. In this case, they are necessary to distinguish which side of the constraint is active. One-sided constraints (for example, LessThan and GreaterThan) should use NONBASIC instead of the NONBASIC_AT_* values. This restriction does not apply to VariableBasisStatus, which should return NONBASIC_AT_* regardless of whether the alternative bound exists.

    • In linear programs, SUPER_BASIC occurs when a variable with no bounds is not in the basis.

    Values

    Possible values are:

    source
    diff --git a/previews/PR3838/moi/reference/errors/index.html b/previews/PR3838/moi/reference/errors/index.html index 805da1b4e5d..873ed788b22 100644 --- a/previews/PR3838/moi/reference/errors/index.html +++ b/previews/PR3838/moi/reference/errors/index.html @@ -57,4 +57,4 @@ julia> throw(MOI.UnsupportedNonlinearOperator(:black_box)) ERROR: MathOptInterface.UnsupportedNonlinearOperator: The nonlinear operator `:black_box` is not supported by the model. Stacktrace: -[...]source

    Note that setting the ConstraintFunction of a VariableIndex constraint is not allowed:

    +[...]source

    Note that setting the ConstraintFunction of a VariableIndex constraint is not allowed:

    diff --git a/previews/PR3838/moi/reference/models/index.html b/previews/PR3838/moi/reference/models/index.html index 77dea74e611..0a88f1dd986 100644 --- a/previews/PR3838/moi/reference/models/index.html +++ b/previews/PR3838/moi/reference/models/index.html @@ -7,7 +7,7 @@ model::MOI.ModelLike, attr::MOI.AbstractConstraintAttribute, bridge::AbstractBridge, -)

    Return the value of the attribute attr of the model model for the constraint bridged by bridge.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractOptimizerAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractModelAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(optimizer::AbstractOptimizer, attr::AbstractOptimizerAttribute)

    Return an attribute attr of the optimizer optimizer.

    get(model::ModelLike, attr::AbstractModelAttribute)

    Return an attribute attr of the model model.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::VariableIndex)

    If the attribute attr is set for the variable v in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::Vector{VariableIndex})

    Return a vector of attributes corresponding to each variable in the collection v in the model model.

    get(model::ModelLike, attr::AbstractConstraintAttribute, c::ConstraintIndex)

    If the attribute attr is set for the constraint c in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(
    +)

    Return the value of the attribute attr of the model model for the constraint bridged by bridge.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractOptimizerAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractModelAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(optimizer::AbstractOptimizer, attr::AbstractOptimizerAttribute)

    Return an attribute attr of the optimizer optimizer.

    get(model::ModelLike, attr::AbstractModelAttribute)

    Return an attribute attr of the model model.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::VariableIndex)

    If the attribute attr is set for the variable v in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::Vector{VariableIndex})

    Return a vector of attributes corresponding to each variable in the collection v in the model model.

    get(model::ModelLike, attr::AbstractConstraintAttribute, c::ConstraintIndex)

    If the attribute attr is set for the constraint c in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(
         model::ModelLike,
         attr::AbstractConstraintAttribute,
         c::Vector{ConstraintIndex{F,S}},
    @@ -131,4 +131,4 @@
     MOI.get(model, MOI.RelativeGapTolerance())  # returns 1e-3
     # ... and the relative gap of the obtained solution is smaller or equal to the
     # tolerance
    -MOI.get(model, MOI.RelativeGap())  # should return something ≤ 1e-3
    Warning

    The mathematical definition of "relative gap", and its allowed range, are solver-dependent. Typically, solvers expect a value between 0.0 and 1.0.

    source

    List of attributes useful for optimizers

    MathOptInterface.TerminationStatusCodeType
    TerminationStatusCode

    An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

    Values

    Possible values are:

    • OPTIMIZE_NOT_CALLED: The algorithm has not started.
    • OPTIMAL: The algorithm found a globally optimal solution.
    • INFEASIBLE: The algorithm concluded that no feasible solution exists.
    • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
    • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
    • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
    • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
    • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
    • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
    • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
    • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
    • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
    • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
    • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
    • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
    • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
    • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
    • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
    • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
    • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
    • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
    • INVALID_MODEL: The algorithm stopped because the model is invalid.
    • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
    • INTERRUPTED: The algorithm stopped because of an interrupt signal.
    • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
    source
    MathOptInterface.DUAL_INFEASIBLEConstant
    DUAL_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

    source
    MathOptInterface.LOCALLY_SOLVEDConstant
    LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

    source
    MathOptInterface.LOCALLY_INFEASIBLEConstant
    LOCALLY_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

    source
    MathOptInterface.SOLUTION_LIMITConstant
    SOLUTION_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

    source
    MathOptInterface.DualStatusType
    DualStatus(result_index::Int = 1)

    A model attribute for the ResultStatusCode of the dual result result_index. If result_index is omitted, it defaults to 1.

    See ResultCount for information on how the results are ordered.

    If result_index is larger than the value of ResultCount then NO_SOLUTION is returned.

    source
    MathOptInterface.ResultCountType
    ResultCount()

    A model attribute for the number of results available.

    Order of solutions

    A number of attributes contain an index, result_index, which is used to refer to one of the available results. Thus, result_index must be an integer between 1 and the number of available results.

    As a general rule, the first result (result_index=1) is the most important result (for example, an optimal solution or an infeasibility certificate). Other results will typically be alternate solutions that the solver found during the search for the first result.

    If a (local) optimal solution is available, that is, TerminationStatus is OPTIMAL or LOCALLY_SOLVED, the first result must correspond to the (locally) optimal solution. Other results may be alternative optimal solutions, or they may be other suboptimal solutions; use ObjectiveValue to distinguish between them.

    If a primal or dual infeasibility certificate is available, that is, TerminationStatus is INFEASIBLE or DUAL_INFEASIBLE and the corresponding PrimalStatus or DualStatus is INFEASIBILITY_CERTIFICATE, then the first result must be a certificate. Other results may be alternate certificates, or infeasible points.

    source
    MathOptInterface.ObjectiveValueType
    ObjectiveValue(result_index::Int = 1)

    A model attribute for the objective value of the primal solution result_index.

    If the solver does not have a primal value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.DualObjectiveValueType
    DualObjectiveValue(result_index::Int = 1)

    A model attribute for the value of the objective function of the dual problem for the result_indexth dual result.

    If the solver does not have a dual value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the DualObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.RelativeGapType
    RelativeGap()

    A model attribute for the final relative optimality gap.

    Warning

    The definition of this gap is solver-dependent. However, most solvers implementing this attribute define the relative gap as some variation of $\frac{|b-f|}{|f|}$, where $b$ is the best bound and $f$ is the best feasible objective value.

    source
    MathOptInterface.SimplexIterationsType
    SimplexIterations()

    A model attribute for the cumulative number of simplex iterations during the optimization process.

    For a mixed-integer program (MIP), the return value is the total simplex iterations for all nodes.

    source
    MathOptInterface.NodeCountType
    NodeCount()

    A model attribute for the total number of branch-and-bound nodes explored while solving a mixed-integer program (MIP).

    source

    ResultStatusCode

    MathOptInterface.ResultStatusCodeType
    ResultStatusCode

    An Enum of possible values for the PrimalStatus and DualStatus attributes.

    The values indicate how to interpret the result vector.

    Values

    Possible values are:

    • NO_SOLUTION: the result vector is empty.
    • FEASIBLE_POINT: the result vector is a feasible point.
    • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
    • INFEASIBLE_POINT: the result vector is an infeasible point.
    • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
    • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
    • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
    • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
    • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
    • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
    source
    MathOptInterface.INFEASIBILITY_CERTIFICATEConstant
    INFEASIBILITY_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

    source
    MathOptInterface.REDUCTION_CERTIFICATEConstant
    REDUCTION_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

    source

    Conflict Status

    MathOptInterface.compute_conflict!Function
    compute_conflict!(optimizer::AbstractOptimizer)

    Computes a minimal subset of constraints such that the model with the other constraint removed is still infeasible.

    Some solvers call a set of conflicting constraints an Irreducible Inconsistent Subsystem (IIS).

    See also ConflictStatus and ConstraintConflictStatus.

    Note

    If the model is modified after a call to compute_conflict!, the implementor is not obliged to purge the conflict. Any calls to the above attributes may return values for the original conflict without a warning. Similarly, when modifying the model, the conflict can be discarded.

    source
    MathOptInterface.ConflictStatusCodeType
    ConflictStatusCode

    An Enum of possible values for the ConflictStatus attribute. This attribute is meant to explain the reason why the conflict finder stopped executing in the most recent call to compute_conflict!.

    Possible values are:

    • COMPUTE_CONFLICT_NOT_CALLED: the function compute_conflict! has not yet been called
    • NO_CONFLICT_EXISTS: there is no conflict because the problem is feasible
    • NO_CONFLICT_FOUND: the solver could not find a conflict
    • CONFLICT_FOUND: at least one conflict could be found
    source
    MathOptInterface.ConflictParticipationStatusCodeType
    ConflictParticipationStatusCode

    An Enum of possible values for the ConstraintConflictStatus attribute. This attribute is meant to indicate whether a given constraint participates or not in the last computed conflict.

    Values

    Possible values are:

    • NOT_IN_CONFLICT: the constraint does not participate in the conflict
    • IN_CONFLICT: the constraint participates in the conflict
    • MAYBE_IN_CONFLICT: the constraint may participate in the conflict, the solver was not able to prove that the constraint can be excluded from the conflict
    source
    +MOI.get(model, MOI.RelativeGap()) # should return something ≤ 1e-3
    Warning

    The mathematical definition of "relative gap", and its allowed range, are solver-dependent. Typically, solvers expect a value between 0.0 and 1.0.

    source

    List of attributes useful for optimizers

    MathOptInterface.TerminationStatusCodeType
    TerminationStatusCode

    An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

    Values

    Possible values are:

    • OPTIMIZE_NOT_CALLED: The algorithm has not started.
    • OPTIMAL: The algorithm found a globally optimal solution.
    • INFEASIBLE: The algorithm concluded that no feasible solution exists.
    • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
    • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
    • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
    • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
    • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
    • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
    • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
    • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
    • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
    • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
    • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
    • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
    • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
    • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
    • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
    • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
    • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
    • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
    • INVALID_MODEL: The algorithm stopped because the model is invalid.
    • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
    • INTERRUPTED: The algorithm stopped because of an interrupt signal.
    • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
    source
    MathOptInterface.DUAL_INFEASIBLEConstant
    DUAL_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

    source
    MathOptInterface.LOCALLY_SOLVEDConstant
    LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

    source
    MathOptInterface.LOCALLY_INFEASIBLEConstant
    LOCALLY_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

    source
    MathOptInterface.SOLUTION_LIMITConstant
    SOLUTION_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

    source
    MathOptInterface.DualStatusType
    DualStatus(result_index::Int = 1)

    A model attribute for the ResultStatusCode of the dual result result_index. If result_index is omitted, it defaults to 1.

    See ResultCount for information on how the results are ordered.

    If result_index is larger than the value of ResultCount then NO_SOLUTION is returned.

    source
    MathOptInterface.ResultCountType
    ResultCount()

    A model attribute for the number of results available.

    Order of solutions

    A number of attributes contain an index, result_index, which is used to refer to one of the available results. Thus, result_index must be an integer between 1 and the number of available results.

    As a general rule, the first result (result_index=1) is the most important result (for example, an optimal solution or an infeasibility certificate). Other results will typically be alternate solutions that the solver found during the search for the first result.

    If a (local) optimal solution is available, that is, TerminationStatus is OPTIMAL or LOCALLY_SOLVED, the first result must correspond to the (locally) optimal solution. Other results may be alternative optimal solutions, or they may be other suboptimal solutions; use ObjectiveValue to distinguish between them.

    If a primal or dual infeasibility certificate is available, that is, TerminationStatus is INFEASIBLE or DUAL_INFEASIBLE and the corresponding PrimalStatus or DualStatus is INFEASIBILITY_CERTIFICATE, then the first result must be a certificate. Other results may be alternate certificates, or infeasible points.

    source
    MathOptInterface.ObjectiveValueType
    ObjectiveValue(result_index::Int = 1)

    A model attribute for the objective value of the primal solution result_index.

    If the solver does not have a primal value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.DualObjectiveValueType
    DualObjectiveValue(result_index::Int = 1)

    A model attribute for the value of the objective function of the dual problem for the result_indexth dual result.

    If the solver does not have a dual value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the DualObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.RelativeGapType
    RelativeGap()

    A model attribute for the final relative optimality gap.

    Warning

    The definition of this gap is solver-dependent. However, most solvers implementing this attribute define the relative gap as some variation of $\frac{|b-f|}{|f|}$, where $b$ is the best bound and $f$ is the best feasible objective value.

    source
    MathOptInterface.SimplexIterationsType
    SimplexIterations()

    A model attribute for the cumulative number of simplex iterations during the optimization process.

    For a mixed-integer program (MIP), the return value is the total simplex iterations for all nodes.

    source
    MathOptInterface.NodeCountType
    NodeCount()

    A model attribute for the total number of branch-and-bound nodes explored while solving a mixed-integer program (MIP).

    source

    ResultStatusCode

    MathOptInterface.ResultStatusCodeType
    ResultStatusCode

    An Enum of possible values for the PrimalStatus and DualStatus attributes.

    The values indicate how to interpret the result vector.

    Values

    Possible values are:

    • NO_SOLUTION: the result vector is empty.
    • FEASIBLE_POINT: the result vector is a feasible point.
    • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
    • INFEASIBLE_POINT: the result vector is an infeasible point.
    • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
    • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
    • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
    • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
    • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
    • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
    source
    MathOptInterface.INFEASIBILITY_CERTIFICATEConstant
    INFEASIBILITY_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

    source
    MathOptInterface.REDUCTION_CERTIFICATEConstant
    REDUCTION_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

    source

    Conflict Status

    MathOptInterface.compute_conflict!Function
    compute_conflict!(optimizer::AbstractOptimizer)

    Computes a minimal subset of constraints such that the model with the other constraint removed is still infeasible.

    Some solvers call a set of conflicting constraints an Irreducible Inconsistent Subsystem (IIS).

    See also ConflictStatus and ConstraintConflictStatus.

    Note

    If the model is modified after a call to compute_conflict!, the implementor is not obliged to purge the conflict. Any calls to the above attributes may return values for the original conflict without a warning. Similarly, when modifying the model, the conflict can be discarded.

    source
    MathOptInterface.ConflictStatusCodeType
    ConflictStatusCode

    An Enum of possible values for the ConflictStatus attribute. This attribute is meant to explain the reason why the conflict finder stopped executing in the most recent call to compute_conflict!.

    Possible values are:

    • COMPUTE_CONFLICT_NOT_CALLED: the function compute_conflict! has not yet been called
    • NO_CONFLICT_EXISTS: there is no conflict because the problem is feasible
    • NO_CONFLICT_FOUND: the solver could not find a conflict
    • CONFLICT_FOUND: at least one conflict could be found
    source
    MathOptInterface.ConflictParticipationStatusCodeType
    ConflictParticipationStatusCode

    An Enum of possible values for the ConstraintConflictStatus attribute. This attribute is meant to indicate whether a given constraint participates or not in the last computed conflict.

    Values

    Possible values are:

    • NOT_IN_CONFLICT: the constraint does not participate in the conflict
    • IN_CONFLICT: the constraint participates in the conflict
    • MAYBE_IN_CONFLICT: the constraint may participate in the conflict, the solver was not able to prove that the constraint can be excluded from the conflict
    source
    diff --git a/previews/PR3838/moi/reference/modification/index.html b/previews/PR3838/moi/reference/modification/index.html index 2623edae284..9107942c488 100644 --- a/previews/PR3838/moi/reference/modification/index.html +++ b/previews/PR3838/moi/reference/modification/index.html @@ -32,4 +32,4 @@ )

    A struct used to request a change in the quadratic coefficient of a ScalarQuadraticFunction.

    Scaling factors

    A ScalarQuadraticFunction has an implicit 0.5 scaling factor in front of the Q matrix. This modification applies to terms in the Q matrix.

    If variable_1 == variable_2, this modification sets the corresponding diagonal element of the Q matrix to new_coefficient.

    If variable_1 != variable_2, this modification is equivalent to setting both the corresponding upper- and lower-triangular elements of the Q matrix to new_coefficient.

    As a consequence:

    • to modify the term x^2 to become 2x^2, new_coefficient must be 4
    • to modify the term xy to become 2xy, new_coefficient must be 2
    source +) where {T}

    A struct used to request a change in the linear coefficients of a single variable in a vector-valued function.

    New coefficients are specified by (output_index, coefficient) tuples.

    Applicable to VectorAffineFunction and VectorQuadraticFunction.

    source diff --git a/previews/PR3838/moi/reference/nonlinear/index.html b/previews/PR3838/moi/reference/nonlinear/index.html index f2d1817d6f3..82c289bedb5 100644 --- a/previews/PR3838/moi/reference/nonlinear/index.html +++ b/previews/PR3838/moi/reference/nonlinear/index.html @@ -425,4 +425,4 @@ :(x[MOI.VariableIndex(1)] * x[MOI.VariableIndex(2)] * x[MOI.VariableIndex(3)] * x[MOI.VariableIndex(4)] >= 25.0) julia> MOI.constraint_expr(evaluator, 2) -:(x[MOI.VariableIndex(1)] ^ 2 + x[MOI.VariableIndex(2)] ^ 2 + x[MOI.VariableIndex(3)] ^ 2 + x[MOI.VariableIndex(4)] ^ 2 == 40.0)source +:(x[MOI.VariableIndex(1)] ^ 2 + x[MOI.VariableIndex(2)] ^ 2 + x[MOI.VariableIndex(3)] ^ 2 + x[MOI.VariableIndex(4)] ^ 2 == 40.0)source diff --git a/previews/PR3838/moi/reference/standard_form/index.html b/previews/PR3838/moi/reference/standard_form/index.html index 03575aa80d6..2b8039ea077 100644 --- a/previews/PR3838/moi/reference/standard_form/index.html +++ b/previews/PR3838/moi/reference/standard_form/index.html @@ -944,4 +944,4 @@ MOI.VectorOfVariables([t; vec(X)]), MOI.RootDetConeSquare(2), ) -MathOptInterface.ConstraintIndex{MathOptInterface.VectorOfVariables, MathOptInterface.RootDetConeSquare}(1)source +MathOptInterface.ConstraintIndex{MathOptInterface.VectorOfVariables, MathOptInterface.RootDetConeSquare}(1)source diff --git a/previews/PR3838/moi/reference/variables/index.html b/previews/PR3838/moi/reference/variables/index.html index 65b30f1c80b..9dfb716eb71 100644 --- a/previews/PR3838/moi/reference/variables/index.html +++ b/previews/PR3838/moi/reference/variables/index.html @@ -25,4 +25,4 @@ )::Bool

    Return a Bool indicating whether model supports constraining a variable to belong to a set of type S either on creation of the variable with add_constrained_variable or after the variable is created with add_constraint.

    By default, this function falls back to supports_add_constrained_variables(model, Reals) && supports_constraint(model, MOI.VariableIndex, S) which is the correct definition for most models.

    Example

    Suppose that a solver supports only two kind of variables: binary variables and continuous variables with a lower bound. If the solver decides not to support VariableIndex-in-Binary and VariableIndex-in-GreaterThan constraints, it only has to implement add_constrained_variable for these two sets which prevents the user to add both a binary constraint and a lower bound on the same variable. Moreover, if the user adds a VariableIndex-in-GreaterThan constraint, implementing this interface (that is, supports_add_constrained_variables) enables the constraint to be transparently bridged into a supported constraint.

    source
    MathOptInterface.supports_add_constrained_variablesFunction
    supports_add_constrained_variables(
         model::ModelLike,
         S::Type{<:AbstractVectorSet}
    -)::Bool

    Return a Bool indicating whether model supports constraining a vector of variables to belong to a set of type S either on creation of the vector of variables with add_constrained_variables or after the variable is created with add_constraint.

    By default, if S is Reals then this function returns true and otherwise, it falls back to supports_add_constrained_variables(model, Reals) && supports_constraint(model, MOI.VectorOfVariables, S) which is the correct definition for most models.

    Example

    In the standard conic form (see Duality), the variables are grouped into several cones and the constraints are affine equality constraints. If Reals is not one of the cones supported by the solvers then it needs to implement supports_add_constrained_variables(::Optimizer, ::Type{Reals}) = false as free variables are not supported. The solvers should then implement supports_add_constrained_variables(::Optimizer, ::Type{<:SupportedCones}) = true where SupportedCones is the union of all cone types that are supported; it does not have to implement the method supports_constraint(::Type{VectorOfVariables}, Type{<:SupportedCones}) as it should return false and it's the default. This prevents the user to constrain the same variable in two different cones. When a VectorOfVariables-in-S is added, the variables of the vector have already been created so they already belong to given cones. If bridges are enabled, the constraint will therefore be bridged by adding slack variables in S and equality constraints ensuring that the slack variables are equal to the corresponding variables of the given constraint function.

    Note that there may also be sets for which !supports_add_constrained_variables(model, S) and supports_constraint(model, MOI.VectorOfVariables, S). For instance, suppose a solver supports positive semidefinite variable constraints and two types of variables: binary variables and nonnegative variables. Then the solver should support adding VectorOfVariables-in-PositiveSemidefiniteConeTriangle constraints, but it should not support creating variables constrained to belong to the PositiveSemidefiniteConeTriangle because the variables in PositiveSemidefiniteConeTriangle should first be created as either binary or non-negative.

    source
    MathOptInterface.is_validMethod
    is_valid(model::ModelLike, index::Index)::Bool

    Return a Bool indicating whether this index refers to a valid object in the model model.

    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, index::Index)

    Delete the referenced object from the model. Throw DeleteNotAllowed if if index cannot be deleted.

    The following modifications also take effect if Index is VariableIndex:

    • If index used in the objective function, it is removed from the function, that is, it is substituted for zero.
    • For each func-in-set constraint of the model:
      • If func isa VariableIndex and func == index then the constraint is deleted.
      • If func isa VectorOfVariables and index in func.variables then
        • if length(func.variables) == 1 is one, the constraint is deleted;
        • if length(func.variables) > 1 and supports_dimension_update(set) then then the variable is removed from func and set is replaced by update_dimension(set, MOI.dimension(set) - 1).
        • Otherwise, a DeleteNotAllowed error is thrown.
      • Otherwise, the variable is removed from func, that is, it is substituted for zero.
    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, indices::Vector{R<:Index}) where {R}

    Delete the referenced objects in the vector indices from the model. It may be assumed that R is a concrete type. The default fallback sequentially deletes the individual items in indices, although specialized implementations may be more efficient.

    source

    Attributes

    MathOptInterface.VariableNameType
    VariableName()

    A variable attribute for a string identifying the variable. It is valid for two variables to have the same name; however, variables with duplicate names cannot be looked up using get. It has a default value of "" if not set`.

    source
    MathOptInterface.VariablePrimalStartType
    VariablePrimalStart()

    A variable attribute for the initial assignment to some primal variable's value that the optimizer may use to warm-start the solve. May be a number or nothing (unset).

    source
    MathOptInterface.VariablePrimalType
    VariablePrimal(result_index::Int = 1)

    A variable attribute for the assignment to some primal variable's value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a primal value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariablePrimal attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.VariableBasisStatusType
    VariableBasisStatus(result_index::Int = 1)

    A variable attribute for the BasisStatusCode of a variable in result result_index, with respect to an available optimal solution basis.

    If the solver does not have a basis status for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariableBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    source
    +)::Bool

    Return a Bool indicating whether model supports constraining a vector of variables to belong to a set of type S either on creation of the vector of variables with add_constrained_variables or after the variable is created with add_constraint.

    By default, if S is Reals then this function returns true and otherwise, it falls back to supports_add_constrained_variables(model, Reals) && supports_constraint(model, MOI.VectorOfVariables, S) which is the correct definition for most models.

    Example

    In the standard conic form (see Duality), the variables are grouped into several cones and the constraints are affine equality constraints. If Reals is not one of the cones supported by the solvers then it needs to implement supports_add_constrained_variables(::Optimizer, ::Type{Reals}) = false as free variables are not supported. The solvers should then implement supports_add_constrained_variables(::Optimizer, ::Type{<:SupportedCones}) = true where SupportedCones is the union of all cone types that are supported; it does not have to implement the method supports_constraint(::Type{VectorOfVariables}, Type{<:SupportedCones}) as it should return false and it's the default. This prevents the user to constrain the same variable in two different cones. When a VectorOfVariables-in-S is added, the variables of the vector have already been created so they already belong to given cones. If bridges are enabled, the constraint will therefore be bridged by adding slack variables in S and equality constraints ensuring that the slack variables are equal to the corresponding variables of the given constraint function.

    Note that there may also be sets for which !supports_add_constrained_variables(model, S) and supports_constraint(model, MOI.VectorOfVariables, S). For instance, suppose a solver supports positive semidefinite variable constraints and two types of variables: binary variables and nonnegative variables. Then the solver should support adding VectorOfVariables-in-PositiveSemidefiniteConeTriangle constraints, but it should not support creating variables constrained to belong to the PositiveSemidefiniteConeTriangle because the variables in PositiveSemidefiniteConeTriangle should first be created as either binary or non-negative.

    source
    MathOptInterface.is_validMethod
    is_valid(model::ModelLike, index::Index)::Bool

    Return a Bool indicating whether this index refers to a valid object in the model model.

    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, index::Index)

    Delete the referenced object from the model. Throw DeleteNotAllowed if if index cannot be deleted.

    The following modifications also take effect if Index is VariableIndex:

    • If index used in the objective function, it is removed from the function, that is, it is substituted for zero.
    • For each func-in-set constraint of the model:
      • If func isa VariableIndex and func == index then the constraint is deleted.
      • If func isa VectorOfVariables and index in func.variables then
        • if length(func.variables) == 1 is one, the constraint is deleted;
        • if length(func.variables) > 1 and supports_dimension_update(set) then then the variable is removed from func and set is replaced by update_dimension(set, MOI.dimension(set) - 1).
        • Otherwise, a DeleteNotAllowed error is thrown.
      • Otherwise, the variable is removed from func, that is, it is substituted for zero.
    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, indices::Vector{R<:Index}) where {R}

    Delete the referenced objects in the vector indices from the model. It may be assumed that R is a concrete type. The default fallback sequentially deletes the individual items in indices, although specialized implementations may be more efficient.

    source

    Attributes

    MathOptInterface.VariableNameType
    VariableName()

    A variable attribute for a string identifying the variable. It is valid for two variables to have the same name; however, variables with duplicate names cannot be looked up using get. It has a default value of "" if not set`.

    source
    MathOptInterface.VariablePrimalStartType
    VariablePrimalStart()

    A variable attribute for the initial assignment to some primal variable's value that the optimizer may use to warm-start the solve. May be a number or nothing (unset).

    source
    MathOptInterface.VariablePrimalType
    VariablePrimal(result_index::Int = 1)

    A variable attribute for the assignment to some primal variable's value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a primal value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariablePrimal attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.VariableBasisStatusType
    VariableBasisStatus(result_index::Int = 1)

    A variable attribute for the BasisStatusCode of a variable in result result_index, with respect to an available optimal solution basis.

    If the solver does not have a basis status for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariableBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    source
    diff --git a/previews/PR3838/moi/release_notes/index.html b/previews/PR3838/moi/release_notes/index.html index a1555ef2607..08db63fd61f 100644 --- a/previews/PR3838/moi/release_notes/index.html +++ b/previews/PR3838/moi/release_notes/index.html @@ -31,4 +31,4 @@ end write(path, s) end -end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    +end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    diff --git a/previews/PR3838/moi/submodules/Benchmarks/overview/index.html b/previews/PR3838/moi/submodules/Benchmarks/overview/index.html index 9c47217ea02..4ddf114a163 100644 --- a/previews/PR3838/moi/submodules/Benchmarks/overview/index.html +++ b/previews/PR3838/moi/submodules/Benchmarks/overview/index.html @@ -21,4 +21,4 @@ MOI.Benchmarks.compare_against_baseline( suite, "current"; directory = "/tmp", verbose = true -)

    This comparison will create a report detailing improvements and regressions.

    +)

    This comparison will create a report detailing improvements and regressions.

    diff --git a/previews/PR3838/moi/submodules/Benchmarks/reference/index.html b/previews/PR3838/moi/submodules/Benchmarks/reference/index.html index 0a1872d6397..88a0c32d90b 100644 --- a/previews/PR3838/moi/submodules/Benchmarks/reference/index.html +++ b/previews/PR3838/moi/submodules/Benchmarks/reference/index.html @@ -18,4 +18,4 @@ )

    Run all benchmarks in suite and compare against files called name in directory that were created by a call to create_baseline.

    A report summarizing the comparison is written to report_filename in directory.

    Extra kwargs are based to BenchmarkTools.run.

    Examples

    my_suite = suite(() -> GLPK.Optimizer())
     compare_against_baseline(
         my_suite, "glpk_master"; directory = "/tmp", verbose = true
    -)
    source +)source diff --git a/previews/PR3838/moi/submodules/Bridges/implementation/index.html b/previews/PR3838/moi/submodules/Bridges/implementation/index.html index 033fada7f29..6671376c97c 100644 --- a/previews/PR3838/moi/submodules/Bridges/implementation/index.html +++ b/previews/PR3838/moi/submodules/Bridges/implementation/index.html @@ -33,4 +33,4 @@ Subject to: ScalarAffineFunction{Int64}-in-LessThan{Int64} - (0) - (1) x <= (-1) + (0) - (1) x <= (-1) diff --git a/previews/PR3838/moi/submodules/Bridges/list_of_bridges/index.html b/previews/PR3838/moi/submodules/Bridges/list_of_bridges/index.html index 617c2a394c1..4a2abad69ab 100644 --- a/previews/PR3838/moi/submodules/Bridges/list_of_bridges/index.html +++ b/previews/PR3838/moi/submodules/Bridges/list_of_bridges/index.html @@ -128,4 +128,4 @@ & & & x_{11} & x_{12} & x_{13} \\ & & & & x_{22} & x_{23} \\ & & & & & x_{33} -\end{bmatrix}\]

    is positive semidefinite.

    The bridge achieves this reformulation by adding a new set of variables in MOI.PositiveSemidefiniteConeTriangle(6), and then adding three groups of equality constraints to:

    • constrain the two x blocks to be equal
    • force the diagonal of the y blocks to be 0
    • force the lower triangular of the y block to be the negative of the upper triangle.
    source
    MathOptInterface.Bridges.Variable.RSOCtoPSDBridgeType
    RSOCtoPSDBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoPSDBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ where $t, u \ge 0$ into $Y \succeq 0$, with the substitution rule: $Y = \left[\begin{array}{c c}t & x^\top \\ x & 2u \mathbf{I}\end{array}\right].$

    Additional bounds are added to ensure the off-diagonals of the $2uI$ submatrix are 0, and linear constraints are added to ensure the diagonal of $2uI$ takes the same values.

    As a special case, if $|x|| = 0$, then RSOCtoPSDBridge reformulates into $(t, u) \in \mathbb{R}_+$.

    Source node

    RSOCtoPSDBridge supports:

    Target nodes

    RSOCtoPSDBridge creates:

    source
    MathOptInterface.Bridges.Variable.RSOCtoSOCBridgeType
    RSOCtoSOCBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoSOCBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ into $||v||_2 \le w$, with the substitution rules $t = \frac{w}{\sqrt 2} + \frac{v_1}{\sqrt 2}$, $u = \frac{w}{\sqrt 2} - \frac{v_1}{\sqrt 2}$, and $x = (v_2,\ldots,v_N)$.

    Source node

    RSOCtoSOCBridge supports:

    Target node

    RSOCtoSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SOCtoRSOCBridgeType
    SOCtoRSOCBridge{T} <: Bridges.Variable.AbstractBridge

    SOCtoRSOCBridge implements the following reformulation:

    • $||x||_2 \le t$ into $2uv \ge ||w||_2^2$, with the substitution rules $t = \frac{u}{\sqrt 2} + \frac{v}{\sqrt 2}$, $x = (\frac{u}{\sqrt 2} - \frac{v}{\sqrt 2}, w)$.

    Assumptions

    • SOCtoRSOCBridge assumes that $|x| \ge 1$.

    Source node

    SOCtoRSOCBridge supports:

    Target node

    SOCtoRSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SetMapBridgeType
    abstract type SetMapBridge{T,S1,S2} <: AbstractBridge end

    Consider two type of sets, S1 and S2, and a linear mapping A such that the image of a set of type S1 under A is a set of type S2.

    A SetMapBridge{T,S1,S2} is a bridge that substitutes constrained variables in S2 into the image through A of constrained variables in S1.

    The linear map A is described by:

    Implementing a method for these two functions is sufficient to bridge constrained variables. However, in order for the getters and setters of attributes such as dual solutions and starting values to work as well, a method for the following functions must be implemented:

    See the docstrings of each function to see which feature would be missing if it was not implemented for a given bridge.

    source
    MathOptInterface.Bridges.Variable.VectorizeBridgeType
    VectorizeBridge{T,S} <: Bridges.Variable.AbstractBridge

    VectorizeBridge implements the following reformulations:

    • $x \ge a$ into $[y] \in \mathbb{R}_+$ with the substitution rule $x = a + y$
    • $x \le a$ into $[y] \in \mathbb{R}_-$ with the substitution rule $x = a + y$
    • $x == a$ into $[y] \in \{0\}$ with the substitution rule $x = a + y$

    where T is the coefficient type of a + y.

    Source node

    VectorizeBridge supports:

    Target nodes

    VectorizeBridge creates:

    source
    MathOptInterface.Bridges.Variable.ZerosBridgeType
    ZerosBridge{T} <: Bridges.Variable.AbstractBridge

    ZerosBridge implements the following reformulation:

    • $x \in \{0\}$ into the substitution rule $x = 0$,

    where T is the coefficient type of 0.

    Source node

    ZerosBridge supports:

    Target nodes

    ZerosBridge does not create target nodes. It replaces all instances of x with 0 via substitution. This means that no variables are created in the underlying model.

    Caveats

    The bridged variables are similar to parameters with zero values. Parameters with non-zero values can be created with constrained variables in MOI.EqualTo by combining a VectorizeBridge and this bridge.

    However, functions modified by ZerosBridge cannot be unbridged. That is, for a given function, we cannot determine if the bridged variables were used.

    A related implication is that this bridge does not support MOI.ConstraintDual. However, if a MOI.Utilities.CachingOptimizer is used, the dual can be determined by the bridged optimizer using MOI.Utilities.get_fallback because the caching optimizer records the unbridged function.

    source
    +\end{bmatrix}\]

    is positive semidefinite.

    The bridge achieves this reformulation by adding a new set of variables in MOI.PositiveSemidefiniteConeTriangle(6), and then adding three groups of equality constraints to:

    • constrain the two x blocks to be equal
    • force the diagonal of the y blocks to be 0
    • force the lower triangular of the y block to be the negative of the upper triangle.
    source
    MathOptInterface.Bridges.Variable.RSOCtoPSDBridgeType
    RSOCtoPSDBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoPSDBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ where $t, u \ge 0$ into $Y \succeq 0$, with the substitution rule: $Y = \left[\begin{array}{c c}t & x^\top \\ x & 2u \mathbf{I}\end{array}\right].$

    Additional bounds are added to ensure the off-diagonals of the $2uI$ submatrix are 0, and linear constraints are added to ensure the diagonal of $2uI$ takes the same values.

    As a special case, if $|x|| = 0$, then RSOCtoPSDBridge reformulates into $(t, u) \in \mathbb{R}_+$.

    Source node

    RSOCtoPSDBridge supports:

    Target nodes

    RSOCtoPSDBridge creates:

    source
    MathOptInterface.Bridges.Variable.RSOCtoSOCBridgeType
    RSOCtoSOCBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoSOCBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ into $||v||_2 \le w$, with the substitution rules $t = \frac{w}{\sqrt 2} + \frac{v_1}{\sqrt 2}$, $u = \frac{w}{\sqrt 2} - \frac{v_1}{\sqrt 2}$, and $x = (v_2,\ldots,v_N)$.

    Source node

    RSOCtoSOCBridge supports:

    Target node

    RSOCtoSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SOCtoRSOCBridgeType
    SOCtoRSOCBridge{T} <: Bridges.Variable.AbstractBridge

    SOCtoRSOCBridge implements the following reformulation:

    • $||x||_2 \le t$ into $2uv \ge ||w||_2^2$, with the substitution rules $t = \frac{u}{\sqrt 2} + \frac{v}{\sqrt 2}$, $x = (\frac{u}{\sqrt 2} - \frac{v}{\sqrt 2}, w)$.

    Assumptions

    • SOCtoRSOCBridge assumes that $|x| \ge 1$.

    Source node

    SOCtoRSOCBridge supports:

    Target node

    SOCtoRSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SetMapBridgeType
    abstract type SetMapBridge{T,S1,S2} <: AbstractBridge end

    Consider two type of sets, S1 and S2, and a linear mapping A such that the image of a set of type S1 under A is a set of type S2.

    A SetMapBridge{T,S1,S2} is a bridge that substitutes constrained variables in S2 into the image through A of constrained variables in S1.

    The linear map A is described by:

    Implementing a method for these two functions is sufficient to bridge constrained variables. However, in order for the getters and setters of attributes such as dual solutions and starting values to work as well, a method for the following functions must be implemented:

    See the docstrings of each function to see which feature would be missing if it was not implemented for a given bridge.

    source
    MathOptInterface.Bridges.Variable.VectorizeBridgeType
    VectorizeBridge{T,S} <: Bridges.Variable.AbstractBridge

    VectorizeBridge implements the following reformulations:

    • $x \ge a$ into $[y] \in \mathbb{R}_+$ with the substitution rule $x = a + y$
    • $x \le a$ into $[y] \in \mathbb{R}_-$ with the substitution rule $x = a + y$
    • $x == a$ into $[y] \in \{0\}$ with the substitution rule $x = a + y$

    where T is the coefficient type of a + y.

    Source node

    VectorizeBridge supports:

    Target nodes

    VectorizeBridge creates:

    source
    MathOptInterface.Bridges.Variable.ZerosBridgeType
    ZerosBridge{T} <: Bridges.Variable.AbstractBridge

    ZerosBridge implements the following reformulation:

    • $x \in \{0\}$ into the substitution rule $x = 0$,

    where T is the coefficient type of 0.

    Source node

    ZerosBridge supports:

    Target nodes

    ZerosBridge does not create target nodes. It replaces all instances of x with 0 via substitution. This means that no variables are created in the underlying model.

    Caveats

    The bridged variables are similar to parameters with zero values. Parameters with non-zero values can be created with constrained variables in MOI.EqualTo by combining a VectorizeBridge and this bridge.

    However, functions modified by ZerosBridge cannot be unbridged. That is, for a given function, we cannot determine if the bridged variables were used.

    A related implication is that this bridge does not support MOI.ConstraintDual. However, if a MOI.Utilities.CachingOptimizer is used, the dual can be determined by the bridged optimizer using MOI.Utilities.get_fallback because the caching optimizer records the unbridged function.

    source
    diff --git a/previews/PR3838/moi/submodules/Bridges/overview/index.html b/previews/PR3838/moi/submodules/Bridges/overview/index.html index 70fcfef650a..d6e3b7fbb50 100644 --- a/previews/PR3838/moi/submodules/Bridges/overview/index.html +++ b/previews/PR3838/moi/submodules/Bridges/overview/index.html @@ -66,4 +66,4 @@ julia> MOI.get(inner_optimizer, MOI.ListOfConstraintTypesPresent()) 1-element Vector{Tuple{Type, Type}}: - (MathOptInterface.VariableIndex, MathOptInterface.Interval{Float64}) + (MathOptInterface.VariableIndex, MathOptInterface.Interval{Float64}) diff --git a/previews/PR3838/moi/submodules/Bridges/reference/index.html b/previews/PR3838/moi/submodules/Bridges/reference/index.html index 641b95154f8..259161db8dc 100644 --- a/previews/PR3838/moi/submodules/Bridges/reference/index.html +++ b/previews/PR3838/moi/submodules/Bridges/reference/index.html @@ -219,4 +219,4 @@ cost::Int, )

    As an alternative to variable_node, add a virtual edge to graph that represents adding a free variable, followed by a constraint of type constraint_node, with bridging cost cost.

    Why is this needed?

    Variables can either be added as a variable constrained on creation, or as a free variable which then has a constraint added to it.

    source
    MathOptInterface.Bridges.bridge_indexFunction
    bridge_index(graph::Graph, node::VariableNode)::Int
     bridge_index(graph::Graph, node::ConstraintNode)::Int
    -bridge_index(graph::Graph, node::ObjectiveNode)::Int

    Return the optimal index of the bridge to chose from node.

    source
    MathOptInterface.Bridges.is_variable_edge_bestFunction
    is_variable_edge_best(graph::Graph, node::VariableNode)::Bool

    Return a Bool indicating whether node should be added as a variable constrained on creation, or as a free variable followed by a constraint.

    source
    +bridge_index(graph::Graph, node::ObjectiveNode)::Int

    Return the optimal index of the bridge to chose from node.

    source
    MathOptInterface.Bridges.is_variable_edge_bestFunction
    is_variable_edge_best(graph::Graph, node::VariableNode)::Bool

    Return a Bool indicating whether node should be added as a variable constrained on creation, or as a free variable followed by a constraint.

    source
    diff --git a/previews/PR3838/moi/submodules/FileFormats/overview/index.html b/previews/PR3838/moi/submodules/FileFormats/overview/index.html index 490c33369e0..e41d35fd8f1 100644 --- a/previews/PR3838/moi/submodules/FileFormats/overview/index.html +++ b/previews/PR3838/moi/submodules/FileFormats/overview/index.html @@ -158,4 +158,4 @@ path: [variables][1] instance: Dict{String, Any}("NaMe" => "x") schema key: required -schema value: Any["name"] +schema value: Any["name"] diff --git a/previews/PR3838/moi/submodules/FileFormats/reference/index.html b/previews/PR3838/moi/submodules/FileFormats/reference/index.html index 0049127e965..85ef58e490d 100644 --- a/previews/PR3838/moi/submodules/FileFormats/reference/index.html +++ b/previews/PR3838/moi/submodules/FileFormats/reference/index.html @@ -19,4 +19,4 @@ \end{align}\]

    In other words, the standard conic form contains nonnegative and positive semidefinite variables with equality constraints. That is, in the MathOptInterface's terminology, MOI.VectorOfVariables-in-MOI.Nonnegatives, MOI.VectorOfVariables-in-MOI.PositiveSemidefiniteConeTriangle and MOI.ScalarAffineFunction-in-MOI.EqualTo constraints.

    If a model is in standard conic form, use Dualization.jl to transform it into the geometric conic form before writting it. Otherwise, the nonnegative (resp. positive semidefinite) variables will be bridged into free variables with affine constraints constraining them to belong to the nonnegative orthant (resp. positive semidefinite cone) by the MOI.Bridges.Constraint.VectorFunctionizeBridge. Moreover, equality constraints will be bridged into pairs of affine constraints in the nonnegative orthant by the MOI.Bridges.Constraint.SplitIntervalBridge and then the MOI.Bridges.Constraint.VectorizeBridge.

    If a solver is in standard conic form, use Dualization.jl to transform the model read into standard conic form before copying it to the solver. Otherwise, the free variables will be bridged into pairs of variables in the nonnegative orthant by the MOI.Bridges.Variable.FreeBridge and affine constraints will be bridged into equality constraints by creating a slack variable by the MOI.Bridges.Constraint.VectorSlackBridge.

    source

    Other helpers

    MathOptInterface.FileFormats.NL.SolFileResultsType
    SolFileResults(filename::String, model::Model)

    Parse the .sol file filename created by solving model and return a SolFileResults struct.

    The returned struct supports the MOI.get API for querying result attributes such as MOI.TerminationStatus, MOI.VariablePrimal, and MOI.ConstraintDual.

    source
    SolFileResults(
         raw_status::String,
         termination_status::MOI.TerminationStatusCode,
    -)

    Return a SolFileResults struct with MOI.RawStatusString set to raw_status, MOI.TerminationStatus set to termination_status, and MOI.PrimalStatus and MOI.DualStatus set to NO_SOLUTION.

    All other attributes are un-set.

    source
    +)

    Return a SolFileResults struct with MOI.RawStatusString set to raw_status, MOI.TerminationStatus set to termination_status, and MOI.PrimalStatus and MOI.DualStatus set to NO_SOLUTION.

    All other attributes are un-set.

    source diff --git a/previews/PR3838/moi/submodules/Nonlinear/overview/index.html b/previews/PR3838/moi/submodules/Nonlinear/overview/index.html index c42769e1ffa..64732c91b9d 100644 --- a/previews/PR3838/moi/submodules/Nonlinear/overview/index.html +++ b/previews/PR3838/moi/submodules/Nonlinear/overview/index.html @@ -184,4 +184,4 @@ Node(NODE_VARIABLE, 1, 1), ], [2.0], - );

    The ordering of the nodes in the tape must satisfy two rules:

    • The children of a node must appear after the parent. This means that the tape is ordered topologically, so that a reverse pass of the nodes evaluates all children nodes before their parent
    • The arguments for a CALL node are ordered in the tape based on the order in which they appear in the function call.

    Design goals

    This is less readable than the other options, but does this data structure meet our design goals?

    Instead of a heap-allocated object for each node, we only have two Vectors for each expression, nodes and values, as well as two constant vectors for the OPERATORS. In addition, all fields are concretely typed, and there are no Union or Any types.

    For our third goal, it is not easy to identify the children of a node, but it is easy to identify the parent of any node. Therefore, we can use Nonlinear.adjacency_matrix to compute a sparse matrix that maps parents to their children.

    The design in practice

    In practice, Node and Expression are exactly Nonlinear.Node and Nonlinear.Expression. However, Nonlinear.NodeType has more fields to account for comparison operators such as :>= and :<=, logic operators such as :&& and :||, nonlinear parameters, and nested subexpressions.

    Moreover, instead of storing the operators as global constants, they are stored in Nonlinear.OperatorRegistry, and it also stores a vector of logic operators and a vector of comparison operators. In addition to Nonlinear.DEFAULT_UNIVARIATE_OPERATORS and Nonlinear.DEFAULT_MULTIVARIATE_OPERATORS, you can register user-defined functions using Nonlinear.register_operator.

    Nonlinear.Model is a struct that stores the Nonlinear.OperatorRegistry, as well as a list of parameters and subexpressions in the model.

    ReverseAD

    Nonlinear.ReverseAD is a submodule for computing derivatives of a nonlinear optimization problem using sparse reverse-mode automatic differentiation (AD).

    This section does not attempt to explain how sparse reverse-mode AD works, but instead explains why MOI contains its own implementation, and highlights notable differences from similar packages.

    Warning

    Don't use the API in ReverseAD to compute derivatives. Instead, create a Nonlinear.Evaluator object with Nonlinear.SparseReverseMode as the backend, and then query the MOI API methods.

    Design goals

    The JuliaDiff organization maintains a list of packages for doing AD in Julia. At last count, there were at least ten packages——not including ReverseAD——for reverse-mode AD in Julia. ReverseAD exists because it has a different set of design goals.

    • Goal: handle scale and sparsity. The types of nonlinear optimization problems that MOI represents can be large scale (10^5 or more functions across 10^5 or more variables) with very sparse derivatives. The ability to compute a sparse Hessian matrix is essential. To the best of our knowledge, ReverseAD is the only reverse-mode AD system in Julia that handles sparsity by default.
    • Goal: limit the scope to improve robustness. Most other AD packages accept arbitrary Julia functions as input and then trace an expression graph using operator overloading. This means they must deal (or detect and ignore) with control flow, I/O, and other vagaries of Julia. In contrast, ReverseAD only accepts functions in the form of Nonlinear.Expression, which greatly limits the range of syntax that it must deal with. By reducing the scope of what we accept as input to functions relevant for mathematical optimization, we can provide a simpler implementation with various performance optimizations.
    • Goal: provide outputs which match what solvers expect. Other AD packages focus on differentiating individual Julia functions. In contrast, ReverseAD has a very specific use-case: to generate outputs needed by the MOI nonlinear API. This means it needs to efficiently compute sparse Hessians, and it needs subexpression handling to avoid recomputing subexpressions that are shared between functions.

    History

    ReverseAD started life as ReverseDiffSparse.jl, development of which began in early 2014(!). This was well before the other AD packages started development. Because we had a well-tested, working AD in JuMP, there was less motivation to contribute to and explore other AD packages. The lack of historical interaction also meant that other packages were not optimized for the types of problems that JuMP is built for (that is, large-scale sparse problems). When we first created MathOptInterface, we kept the AD in JuMP to simplify the transition, and post-poned the development of a first-class nonlinear interface in MathOptInterface.

    Prior to the introduction of Nonlinear, JuMP's nonlinear implementation was a confusing mix of functions and types spread across the code base and in the private _Derivatives submodule. This made it hard to swap the AD system for another. The main motivation for refactoring JuMP to create the Nonlinear submodule in MathOptInterface was to abstract the interface between JuMP and the AD system, allowing us to swap-in and test new AD systems in the future.

    + );

    The ordering of the nodes in the tape must satisfy two rules:

    • The children of a node must appear after the parent. This means that the tape is ordered topologically, so that a reverse pass of the nodes evaluates all children nodes before their parent
    • The arguments for a CALL node are ordered in the tape based on the order in which they appear in the function call.

    Design goals

    This is less readable than the other options, but does this data structure meet our design goals?

    Instead of a heap-allocated object for each node, we only have two Vectors for each expression, nodes and values, as well as two constant vectors for the OPERATORS. In addition, all fields are concretely typed, and there are no Union or Any types.

    For our third goal, it is not easy to identify the children of a node, but it is easy to identify the parent of any node. Therefore, we can use Nonlinear.adjacency_matrix to compute a sparse matrix that maps parents to their children.

    The design in practice

    In practice, Node and Expression are exactly Nonlinear.Node and Nonlinear.Expression. However, Nonlinear.NodeType has more fields to account for comparison operators such as :>= and :<=, logic operators such as :&& and :||, nonlinear parameters, and nested subexpressions.

    Moreover, instead of storing the operators as global constants, they are stored in Nonlinear.OperatorRegistry, and it also stores a vector of logic operators and a vector of comparison operators. In addition to Nonlinear.DEFAULT_UNIVARIATE_OPERATORS and Nonlinear.DEFAULT_MULTIVARIATE_OPERATORS, you can register user-defined functions using Nonlinear.register_operator.

    Nonlinear.Model is a struct that stores the Nonlinear.OperatorRegistry, as well as a list of parameters and subexpressions in the model.

    ReverseAD

    Nonlinear.ReverseAD is a submodule for computing derivatives of a nonlinear optimization problem using sparse reverse-mode automatic differentiation (AD).

    This section does not attempt to explain how sparse reverse-mode AD works, but instead explains why MOI contains its own implementation, and highlights notable differences from similar packages.

    Warning

    Don't use the API in ReverseAD to compute derivatives. Instead, create a Nonlinear.Evaluator object with Nonlinear.SparseReverseMode as the backend, and then query the MOI API methods.

    Design goals

    The JuliaDiff organization maintains a list of packages for doing AD in Julia. At last count, there were at least ten packages——not including ReverseAD——for reverse-mode AD in Julia. ReverseAD exists because it has a different set of design goals.

    • Goal: handle scale and sparsity. The types of nonlinear optimization problems that MOI represents can be large scale (10^5 or more functions across 10^5 or more variables) with very sparse derivatives. The ability to compute a sparse Hessian matrix is essential. To the best of our knowledge, ReverseAD is the only reverse-mode AD system in Julia that handles sparsity by default.
    • Goal: limit the scope to improve robustness. Most other AD packages accept arbitrary Julia functions as input and then trace an expression graph using operator overloading. This means they must deal (or detect and ignore) with control flow, I/O, and other vagaries of Julia. In contrast, ReverseAD only accepts functions in the form of Nonlinear.Expression, which greatly limits the range of syntax that it must deal with. By reducing the scope of what we accept as input to functions relevant for mathematical optimization, we can provide a simpler implementation with various performance optimizations.
    • Goal: provide outputs which match what solvers expect. Other AD packages focus on differentiating individual Julia functions. In contrast, ReverseAD has a very specific use-case: to generate outputs needed by the MOI nonlinear API. This means it needs to efficiently compute sparse Hessians, and it needs subexpression handling to avoid recomputing subexpressions that are shared between functions.

    History

    ReverseAD started life as ReverseDiffSparse.jl, development of which began in early 2014(!). This was well before the other AD packages started development. Because we had a well-tested, working AD in JuMP, there was less motivation to contribute to and explore other AD packages. The lack of historical interaction also meant that other packages were not optimized for the types of problems that JuMP is built for (that is, large-scale sparse problems). When we first created MathOptInterface, we kept the AD in JuMP to simplify the transition, and post-poned the development of a first-class nonlinear interface in MathOptInterface.

    Prior to the introduction of Nonlinear, JuMP's nonlinear implementation was a confusing mix of functions and types spread across the code base and in the private _Derivatives submodule. This made it hard to swap the AD system for another. The main motivation for refactoring JuMP to create the Nonlinear submodule in MathOptInterface was to abstract the interface between JuMP and the AD system, allowing us to swap-in and test new AD systems in the future.

    diff --git a/previews/PR3838/moi/submodules/Nonlinear/reference/index.html b/previews/PR3838/moi/submodules/Nonlinear/reference/index.html index c2e4344cda3..502e2eece6d 100644 --- a/previews/PR3838/moi/submodules/Nonlinear/reference/index.html +++ b/previews/PR3838/moi/submodules/Nonlinear/reference/index.html @@ -148,4 +148,4 @@ delete(model, c1) evaluator = Evaluator(model) MOI.initialize(evaluator, Symbol[]) -ordinal_index(model, c2) # Returns 1source +ordinal_index(model, c2) # Returns 1source diff --git a/previews/PR3838/moi/submodules/Test/overview/index.html b/previews/PR3838/moi/submodules/Test/overview/index.html index 637df606873..12002cd8bfc 100644 --- a/previews/PR3838/moi/submodules/Test/overview/index.html +++ b/previews/PR3838/moi/submodules/Test/overview/index.html @@ -167,4 +167,4 @@ ), ) return -end

    Finally, you also need to implement Test.version_added. If we added this test when the latest released version of MOI was v0.10.5, define:

    version_added(::typeof(test_unit_optimize!_twice)) = v"0.10.6"

    Step 6

    Commit the changes to git from ~/.julia/dev/MathOptInterface and submit the PR for review.

    Tip

    If you need help writing a test, open an issue on GitHub, or ask the Developer Chatroom.

    +end

    Finally, you also need to implement Test.version_added. If we added this test when the latest released version of MOI was v0.10.5, define:

    version_added(::typeof(test_unit_optimize!_twice)) = v"0.10.6"

    Step 6

    Commit the changes to git from ~/.julia/dev/MathOptInterface and submit the PR for review.

    Tip

    If you need help writing a test, open an issue on GitHub, or ask the Developer Chatroom.

    diff --git a/previews/PR3838/moi/submodules/Test/reference/index.html b/previews/PR3838/moi/submodules/Test/reference/index.html index a615f25becc..6f32e9fad56 100644 --- a/previews/PR3838/moi/submodules/Test/reference/index.html +++ b/previews/PR3838/moi/submodules/Test/reference/index.html @@ -61,4 +61,4 @@ \text{subject to}\ & x_1 * x_2 * x_3 * x_4 \ge 25 \\ & x_1^2 + x_2^2 + x_3^2 + x_4^2 = 40 \\ & 1 \le x_1, x_2, x_3, x_4 \le 5 -\end{aligned}\]

    The optimal solution is [1.000, 4.743, 3.821, 1.379].

    source +\end{aligned}\]

    The optimal solution is [1.000, 4.743, 3.821, 1.379].

    source diff --git a/previews/PR3838/moi/submodules/Utilities/overview/index.html b/previews/PR3838/moi/submodules/Utilities/overview/index.html index 368cd1e2473..a557487abc3 100644 --- a/previews/PR3838/moi/submodules/Utilities/overview/index.html +++ b/previews/PR3838/moi/submodules/Utilities/overview/index.html @@ -378,4 +378,4 @@ index_map = MOI.copy_to(dest, src) for (F, S) in MOI.get(src, MOI.ListOfConstraintTypesPresent()) function_barrier(dest, src, index_map[F, S]) -end +end diff --git a/previews/PR3838/moi/submodules/Utilities/reference/index.html b/previews/PR3838/moi/submodules/Utilities/reference/index.html index 931e169a1b6..7f6de2314fe 100644 --- a/previews/PR3838/moi/submodules/Utilities/reference/index.html +++ b/previews/PR3838/moi/submodules/Utilities/reference/index.html @@ -91,7 +91,7 @@ typeof(CleverDicts.key_to_index), typeof(CleverDicts.index_to_key), } -end

    A struct storing F-in-S constraints as a mapping between the constraint indices to the corresponding tuple of function and set.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_function_typesMacro
    Utilities.@struct_of_constraints_by_function_types(name, func_types...)

    Given a vector of n function types (F1, F2,..., Fn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of function type Fi.

    The expression Fi can also be a union in which case any constraint for which the function type is in the union is stored in the field with type Ci.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_set_typesMacro
    Utilities.@struct_of_constraints_by_set_types(name, func_types...)

    Given a vector of n set types (S1, S2,..., Sn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of set type Si. The expression Si can also be a union in which case any constraint for which the set type is in the union is stored in the field with type Ci. This can be useful if Ci is a MatrixOfConstraints in order to concatenate the coefficients of constraints of several different set types in the same matrix.

    source
    MathOptInterface.Utilities.struct_of_constraint_codeFunction
    struct_of_constraint_code(struct_name, types, field_types = nothing)

    Given a vector of n Union{SymbolFun,_UnionSymbolFS{SymbolFun}} or Union{SymbolSet,_UnionSymbolFS{SymbolSet}} in types, defines a subtype of StructOfConstraints of name name and which type parameters {T, F1, F2, ..., Fn} if field_types is nothing and a {T} otherwise. It contains n field where the ith field has type Ci if field_types is nothing and type field_types[i] otherwise. If types is vector of Union{SymbolFun,_UnionSymbolFS{SymbolFun}} (resp. Union{SymbolSet,_UnionSymbolFS{SymbolSet}}) then the constraints of that function (resp. set) type are stored in the corresponding field.

    This function is used by the macros @model, @struct_of_constraints_by_function_types and @struct_of_constraints_by_set_types.

    source

    Caching optimizer

    MathOptInterface.Utilities.CachingOptimizerType
    CachingOptimizer

    CachingOptimizer is an intermediate layer that stores a cache of the model and links it with an optimizer. It supports incremental model construction and modification even when the optimizer doesn't.

    Constructors

        CachingOptimizer(cache::MOI.ModelLike, optimizer::AbstractOptimizer)

    Creates a CachingOptimizer in AUTOMATIC mode, with the optimizer optimizer.

    The type of the optimizer returned is CachingOptimizer{typeof(optimizer), typeof(cache)} so it does not support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

        CachingOptimizer(cache::MOI.ModelLike, mode::CachingOptimizerMode)

    Creates a CachingOptimizer in the NO_OPTIMIZER state and mode mode.

    The type of the optimizer returned is CachingOptimizer{MOI.AbstractOptimizer,typeof(cache)} so it does support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

    About the type

    States

    A CachingOptimizer may be in one of three possible states (CachingOptimizerState):

    • NO_OPTIMIZER: The CachingOptimizer does not have any optimizer.
    • EMPTY_OPTIMIZER: The CachingOptimizer has an empty optimizer. The optimizer is not synchronized with the cached model.
    • ATTACHED_OPTIMIZER: The CachingOptimizer has an optimizer, and it is synchronized with the cached model.

    Modes

    A CachingOptimizer has two modes of operation (CachingOptimizerMode):

    • MANUAL: The only methods that change the state of the CachingOptimizer are Utilities.reset_optimizer, Utilities.drop_optimizer, and Utilities.attach_optimizer. Attempting to perform an operation in the incorrect state results in an error.
    • AUTOMATIC: The CachingOptimizer changes its state when necessary. For example, optimize! will automatically call attach_optimizer (an optimizer must have been previously set). Attempting to add a constraint or perform a modification not supported by the optimizer results in a drop to EMPTY_OPTIMIZER mode.
    source
    MathOptInterface.Utilities.attach_optimizerFunction
    attach_optimizer(model::CachingOptimizer)

    Attaches the optimizer to model, copying all model data into it. Can be called only from the EMPTY_OPTIMIZER state. If the copy succeeds, the CachingOptimizer will be in state ATTACHED_OPTIMIZER after the call, otherwise an error is thrown; see MOI.copy_to for more details on which errors can be thrown.

    source
    MOIU.attach_optimizer(model::GenericModel)

    Call MOIU.attach_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.reset_optimizerFunction
    reset_optimizer(m::CachingOptimizer, optimizer::MOI.AbstractOptimizer)

    Sets or resets m to have the given empty optimizer optimizer.

    Can be called from any state. An assertion error will be thrown if optimizer is not empty.

    The CachingOptimizer m will be in state EMPTY_OPTIMIZER after the call.

    source
    reset_optimizer(m::CachingOptimizer)

    Detaches and empties the current optimizer. Can be called from ATTACHED_OPTIMIZER or EMPTY_OPTIMIZER state. The CachingOptimizer will be in state EMPTY_OPTIMIZER after the call.

    source
    MOIU.reset_optimizer(model::GenericModel, optimizer::MOI.AbstractOptimizer)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MOIU.reset_optimizer(model::GenericModel)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.drop_optimizerFunction
    drop_optimizer(m::CachingOptimizer)

    Drops the optimizer, if one is present. Can be called from any state. The CachingOptimizer will be in state NO_OPTIMIZER after the call.

    source
    MOIU.drop_optimizer(model::GenericModel)

    Call MOIU.drop_optimizer on the backend of model.

    Cannot be called in direct mode.

    source

    Mock optimizer

    Printing

    MathOptInterface.Utilities.latex_formulationFunction
    latex_formulation(model::MOI.ModelLike; kwargs...)

    Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

    To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

    Possible keyword arguments are:

    • simplify_coefficients : Simplify coefficients if possible by omitting them or removing trailing zeros.
    • default_name : The name given to variables with an empty name.
    • print_types : Print the MOI type of each function and set for clarity.
    source

    Copy utilities

    MathOptInterface.Utilities.ModelFilterType
    ModelFilter(filter::Function, model::MOI.ModelLike)

    A layer to filter out various components of model.

    The filter function takes a single argument, which is each element from the list returned by the attributes below. It returns true if the element should be visible in the filtered model and false otherwise.

    The components that are filtered are:

    • Entire constraint types via:
      • MOI.ListOfConstraintTypesPresent
    • Individual constraints via:
      • MOI.ListOfConstraintIndices{F,S}
    • Specific attributes via:
      • MOI.ListOfModelAttributesSet
      • MOI.ListOfConstraintAttributesSet
      • MOI.ListOfVariableAttributesSet
    Warning

    The list of attributes filtered may change in a future release. You should write functions that are generic and not limited to the five types listed above. Thus, you should probably define a fallback filter(::Any) = true.

    See below for examples of how this works.

    Note

    This layer has a limited scope. It is intended by be used in conjunction with MOI.copy_to.

    Example: copy model excluding integer constraints

    Use the do syntax to provide a single function.

    filtered_src = MOI.Utilities.ModelFilter(src) do item
    +end

    A struct storing F-in-S constraints as a mapping between the constraint indices to the corresponding tuple of function and set.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_function_typesMacro
    Utilities.@struct_of_constraints_by_function_types(name, func_types...)

    Given a vector of n function types (F1, F2,..., Fn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of function type Fi.

    The expression Fi can also be a union in which case any constraint for which the function type is in the union is stored in the field with type Ci.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_set_typesMacro
    Utilities.@struct_of_constraints_by_set_types(name, func_types...)

    Given a vector of n set types (S1, S2,..., Sn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of set type Si. The expression Si can also be a union in which case any constraint for which the set type is in the union is stored in the field with type Ci. This can be useful if Ci is a MatrixOfConstraints in order to concatenate the coefficients of constraints of several different set types in the same matrix.

    source
    MathOptInterface.Utilities.struct_of_constraint_codeFunction
    struct_of_constraint_code(struct_name, types, field_types = nothing)

    Given a vector of n Union{SymbolFun,_UnionSymbolFS{SymbolFun}} or Union{SymbolSet,_UnionSymbolFS{SymbolSet}} in types, defines a subtype of StructOfConstraints of name name and which type parameters {T, F1, F2, ..., Fn} if field_types is nothing and a {T} otherwise. It contains n field where the ith field has type Ci if field_types is nothing and type field_types[i] otherwise. If types is vector of Union{SymbolFun,_UnionSymbolFS{SymbolFun}} (resp. Union{SymbolSet,_UnionSymbolFS{SymbolSet}}) then the constraints of that function (resp. set) type are stored in the corresponding field.

    This function is used by the macros @model, @struct_of_constraints_by_function_types and @struct_of_constraints_by_set_types.

    source

    Caching optimizer

    MathOptInterface.Utilities.CachingOptimizerType
    CachingOptimizer

    CachingOptimizer is an intermediate layer that stores a cache of the model and links it with an optimizer. It supports incremental model construction and modification even when the optimizer doesn't.

    Constructors

        CachingOptimizer(cache::MOI.ModelLike, optimizer::AbstractOptimizer)

    Creates a CachingOptimizer in AUTOMATIC mode, with the optimizer optimizer.

    The type of the optimizer returned is CachingOptimizer{typeof(optimizer), typeof(cache)} so it does not support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

        CachingOptimizer(cache::MOI.ModelLike, mode::CachingOptimizerMode)

    Creates a CachingOptimizer in the NO_OPTIMIZER state and mode mode.

    The type of the optimizer returned is CachingOptimizer{MOI.AbstractOptimizer,typeof(cache)} so it does support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

    About the type

    States

    A CachingOptimizer may be in one of three possible states (CachingOptimizerState):

    • NO_OPTIMIZER: The CachingOptimizer does not have any optimizer.
    • EMPTY_OPTIMIZER: The CachingOptimizer has an empty optimizer. The optimizer is not synchronized with the cached model.
    • ATTACHED_OPTIMIZER: The CachingOptimizer has an optimizer, and it is synchronized with the cached model.

    Modes

    A CachingOptimizer has two modes of operation (CachingOptimizerMode):

    • MANUAL: The only methods that change the state of the CachingOptimizer are Utilities.reset_optimizer, Utilities.drop_optimizer, and Utilities.attach_optimizer. Attempting to perform an operation in the incorrect state results in an error.
    • AUTOMATIC: The CachingOptimizer changes its state when necessary. For example, optimize! will automatically call attach_optimizer (an optimizer must have been previously set). Attempting to add a constraint or perform a modification not supported by the optimizer results in a drop to EMPTY_OPTIMIZER mode.
    source
    MathOptInterface.Utilities.attach_optimizerFunction
    attach_optimizer(model::CachingOptimizer)

    Attaches the optimizer to model, copying all model data into it. Can be called only from the EMPTY_OPTIMIZER state. If the copy succeeds, the CachingOptimizer will be in state ATTACHED_OPTIMIZER after the call, otherwise an error is thrown; see MOI.copy_to for more details on which errors can be thrown.

    source
    MOIU.attach_optimizer(model::GenericModel)

    Call MOIU.attach_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.reset_optimizerFunction
    reset_optimizer(m::CachingOptimizer, optimizer::MOI.AbstractOptimizer)

    Sets or resets m to have the given empty optimizer optimizer.

    Can be called from any state. An assertion error will be thrown if optimizer is not empty.

    The CachingOptimizer m will be in state EMPTY_OPTIMIZER after the call.

    source
    reset_optimizer(m::CachingOptimizer)

    Detaches and empties the current optimizer. Can be called from ATTACHED_OPTIMIZER or EMPTY_OPTIMIZER state. The CachingOptimizer will be in state EMPTY_OPTIMIZER after the call.

    source
    MOIU.reset_optimizer(model::GenericModel, optimizer::MOI.AbstractOptimizer)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MOIU.reset_optimizer(model::GenericModel)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.drop_optimizerFunction
    drop_optimizer(m::CachingOptimizer)

    Drops the optimizer, if one is present. Can be called from any state. The CachingOptimizer will be in state NO_OPTIMIZER after the call.

    source
    MOIU.drop_optimizer(model::GenericModel)

    Call MOIU.drop_optimizer on the backend of model.

    Cannot be called in direct mode.

    source

    Mock optimizer

    Printing

    MathOptInterface.Utilities.latex_formulationFunction
    latex_formulation(model::MOI.ModelLike; kwargs...)

    Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

    To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

    Possible keyword arguments are:

    • simplify_coefficients : Simplify coefficients if possible by omitting them or removing trailing zeros.
    • default_name : The name given to variables with an empty name.
    • print_types : Print the MOI type of each function and set for clarity.
    source

    Copy utilities

    MathOptInterface.Utilities.ModelFilterType
    ModelFilter(filter::Function, model::MOI.ModelLike)

    A layer to filter out various components of model.

    The filter function takes a single argument, which is each element from the list returned by the attributes below. It returns true if the element should be visible in the filtered model and false otherwise.

    The components that are filtered are:

    • Entire constraint types via:
      • MOI.ListOfConstraintTypesPresent
    • Individual constraints via:
      • MOI.ListOfConstraintIndices{F,S}
    • Specific attributes via:
      • MOI.ListOfModelAttributesSet
      • MOI.ListOfConstraintAttributesSet
      • MOI.ListOfVariableAttributesSet
    Warning

    The list of attributes filtered may change in a future release. You should write functions that are generic and not limited to the five types listed above. Thus, you should probably define a fallback filter(::Any) = true.

    See below for examples of how this works.

    Note

    This layer has a limited scope. It is intended by be used in conjunction with MOI.copy_to.

    Example: copy model excluding integer constraints

    Use the do syntax to provide a single function.

    filtered_src = MOI.Utilities.ModelFilter(src) do item
         return item != (MOI.VariableIndex, MOI.Integer)
     end
     MOI.copy_to(dest, filtered_src)

    Example: copy model excluding names

    Use type dispatch to simplify the implementation:

    my_filter(::Any) = true  # Note the generic fallback
    @@ -316,4 +316,4 @@
     For performance, it is recommended that the inner loop lies in a separate
     function to guarantee type-stability.
     
    -If you want an iterator of all current outer keys, use [`outer_keys`](@ref).
    source
    +If you want an iterator of all current outer keys, use [`outer_keys`](@ref).source diff --git a/previews/PR3838/moi/tutorials/bridging_constraint/index.html b/previews/PR3838/moi/tutorials/bridging_constraint/index.html index 1deabdf3a1e..1582d2b1ae5 100644 --- a/previews/PR3838/moi/tutorials/bridging_constraint/index.html +++ b/previews/PR3838/moi/tutorials/bridging_constraint/index.html @@ -103,4 +103,4 @@ end

    Bridge deletion

    When a bridge is deleted, the constraints it added must be deleted too.

    function delete(model::ModelLike, bridge::SignBridge)
         delete(model, bridge.constraint)
         return
    -end
    +end diff --git a/previews/PR3838/moi/tutorials/example/index.html b/previews/PR3838/moi/tutorials/example/index.html index 087a28b6dc4..37d30256f3a 100644 --- a/previews/PR3838/moi/tutorials/example/index.html +++ b/previews/PR3838/moi/tutorials/example/index.html @@ -46,4 +46,4 @@ 3-element Vector{Float64}: 1.0 1.0 - 1.0 + 1.0 diff --git a/previews/PR3838/moi/tutorials/implementing/index.html b/previews/PR3838/moi/tutorials/implementing/index.html index 8f080b9858f..5343da6f0b7 100644 --- a/previews/PR3838/moi/tutorials/implementing/index.html +++ b/previews/PR3838/moi/tutorials/implementing/index.html @@ -115,4 +115,4 @@ n = # Code to get NumberOfObjectives return n end

    Then, the user can write:

    model = Gurobi.Optimizer()
    -MOI.set(model, Gurobi.NumberofObjectives(), 3)
    +MOI.set(model, Gurobi.NumberofObjectives(), 3) diff --git a/previews/PR3838/moi/tutorials/latency/index.html b/previews/PR3838/moi/tutorials/latency/index.html index 0ca883db338..02b6475a423 100644 --- a/previews/PR3838/moi/tutorials/latency/index.html +++ b/previews/PR3838/moi/tutorials/latency/index.html @@ -130,4 +130,4 @@ end

    You can create a flame-graph via

    using SnoopCompile
     tinf = @snoopi_deep example_diet(GLPK.Optimizer, true)
     using ProfileView
    -ProfileView.view(flamegraph(tinf))

    Here's how things looked in mid-August 2021: flamegraph

    There are a few opportunities for improvement (non-red flames, particularly on the right). But the main problem is a large red (non-precompilable due to method ownership) flame.

    +ProfileView.view(flamegraph(tinf))

    Here's how things looked in mid-August 2021: flamegraph

    There are a few opportunities for improvement (non-red flames, particularly on the right). But the main problem is a large red (non-precompilable due to method ownership) flame.

    diff --git a/previews/PR3838/moi/tutorials/manipulating_expressions/index.html b/previews/PR3838/moi/tutorials/manipulating_expressions/index.html index 113e3f4b6a6..e9b6be8282f 100644 --- a/previews/PR3838/moi/tutorials/manipulating_expressions/index.html +++ b/previews/PR3838/moi/tutorials/manipulating_expressions/index.html @@ -23,4 +23,4 @@ 2-element Vector{MathOptInterface.ScalarAffineFunction{Int64}}: (2) + (1) MOI.VariableIndex(1) (4) + (2) MOI.VariableIndex(1)
    Note

    Utilities.eachscalar returns an iterator on the dimensions, which serves the same purpose as Utilities.scalarize.

    output_dimension returns the number of dimensions of the output of a function:

    julia> MOI.output_dimension(g)
    -2
    +2 diff --git a/previews/PR3838/moi/tutorials/mathprogbase/index.html b/previews/PR3838/moi/tutorials/mathprogbase/index.html index 816864619fd..c455ca71aee 100644 --- a/previews/PR3838/moi/tutorials/mathprogbase/index.html +++ b/previews/PR3838/moi/tutorials/mathprogbase/index.html @@ -55,4 +55,4 @@ objval = objective_value(model), sol = value.(x) ) -end +end diff --git a/previews/PR3838/packages/Alpine/index.html b/previews/PR3838/packages/Alpine/index.html index 4378af8a142..30295e93741 100644 --- a/previews/PR3838/packages/Alpine/index.html +++ b/previews/PR3838/packages/Alpine/index.html @@ -46,4 +46,4 @@ author={Kim, Jongeun and Richard, Jean-Philippe P. and Tawarmalani, Mohit}, eprinttype={Optimization Online}, date={2022} -} +} diff --git a/previews/PR3838/packages/AmplNLWriter/index.html b/previews/PR3838/packages/AmplNLWriter/index.html index 20810227807..17bbd8f277a 100644 --- a/previews/PR3838/packages/AmplNLWriter/index.html +++ b/previews/PR3838/packages/AmplNLWriter/index.html @@ -12,4 +12,4 @@ import Bonmin_jll model = Model(() -> AmplNLWriter.Optimizer(Bonmin_jll.amplexe)) set_attribute(model, "bonmin.nlp_log_level", 0)

    opt files

    Some options need to be specified via an .opt file.

    This file must be located in the current working directory whenever the model is solved.

    The .opt file must be named after the name of the solver, for example, bonmin.opt, and each line must contain an option name and the desired value, separated by a space.

    For example, to set the absolute and relative tolerances in Couenne to 1 and 0.05 respectively, the couenne.opt file should contain:

    allowable_gap 1
    -allowable_fraction_gap 0.05
    +allowable_fraction_gap 0.05 diff --git a/previews/PR3838/packages/BARON/index.html b/previews/PR3838/packages/BARON/index.html index b5d4943fc17..7867c651e0b 100644 --- a/previews/PR3838/packages/BARON/index.html +++ b/previews/PR3838/packages/BARON/index.html @@ -6,4 +6,4 @@

    BARON.jl

    Build Status codecov

    BARON.jl is a wrapper for BARON by The Optimization Firm.

    Affiliation

    This wrapper is maintained by the JuMP community and is not officially supported by The Optimization Firm.

    Getting help

    If you need help, please ask a question on the JuMP community forum.

    If you have a reproducible example of a bug, please open a GitHub issue.

    License

    BARON.jl is licensed under the MIT License.

    The underlying solver is a closed-source commercial product for which you must obtain a license from The Optimization Firm, although a small trial version is available for free.

    Installation

    First, download a copy of the BARON solver and unpack the executable in a location of your choosing.

    Once installed, set the BARON_EXEC environment variable pointing to the BARON executable (full path, including file name as it differs across platforms), and run Pkg.add("BARON"). For example:

    ENV["BARON_EXEC"] = "/path/to/baron.exe"
     using Pkg
     Pkg.add("BARON")

    The baronlice.txt license file should be placed in the same directory as the BARON executable, or in your current working directory.

    Use with JuMP

    using JuMP, BARON
    -model = Model(BARON.Optimizer)

    MathOptInterface API

    The BARON optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    +model = Model(BARON.Optimizer)

    MathOptInterface API

    The BARON optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    diff --git a/previews/PR3838/packages/BilevelJuMP/index.html b/previews/PR3838/packages/BilevelJuMP/index.html index c9b74dc574e..fdd163680f1 100644 --- a/previews/PR3838/packages/BilevelJuMP/index.html +++ b/previews/PR3838/packages/BilevelJuMP/index.html @@ -34,4 +34,4 @@ objective_value(model) # = 3 * (3.5 * 8/15) + 8/15 # = 6.13... value(x) # = 3.5 * 8/15 # = 1.86... -value(y) # = 8/15 # = 0.53... +value(y) # = 8/15 # = 0.53... diff --git a/previews/PR3838/packages/CDCS/index.html b/previews/PR3838/packages/CDCS/index.html index e553fcf4316..e437aae2e78 100644 --- a/previews/PR3838/packages/CDCS/index.html +++ b/previews/PR3838/packages/CDCS/index.html @@ -27,4 +27,4 @@ mat"cdcsInstall" end -julia> mat"savepath" +julia> mat"savepath" diff --git a/previews/PR3838/packages/CDDLib/index.html b/previews/PR3838/packages/CDDLib/index.html index 49fc74e54f5..f52f470b6b9 100644 --- a/previews/PR3838/packages/CDDLib/index.html +++ b/previews/PR3838/packages/CDDLib/index.html @@ -6,4 +6,4 @@

    CDDLib

    CDDLib.jl is a wrapper for cddlib.

    CDDLib.jl can be used with C API of cddlib, the higher level interface of Polyhedra.jl, or as a linear programming solver with JuMP or MathOptInterface.

    Problem description

    As written in the README of cddlib:

    The C-library cddlib is a C implementation of the Double Description Method of Motzkin et al. for generating all vertices (that is, extreme points) and extreme rays of a general convex polyhedron in R^d given by a system of linear inequalities:

    P = { x=(x1, ..., xd)^T :  b - A  x  >= 0 }

    where A is a given m x d real matrix, b is a given m-vector and 0 is the m-vector of all zeros.

    The program can be used for the reverse operation (that is, convex hull computation). This means that one can move back and forth between an inequality representation and a generator (that is, vertex and ray) representation of a polyhedron with cdd. Also, cdd can solve a linear programming problem, that is, a problem of maximizing and minimizing a linear function over P.

    License

    CDDLib.jl is licensed under the GPL v2 license.

    The underlying solver, cddlib/cddlib is also licensed under the GPL v2 license.

    Installation

    Install CDDLib.jl using the Julia package manager:

    import Pkg
     Pkg.add("CDDLib")

    Building the package will download binaries of cddlib that are provided by cddlib_jll.jl.

    Use with JuMP

    Use CDDLib.Optimizer{Float64} to use CDDLib.jl with JuMP:

    using JuMP, CDDLib
     model = Model(CDDLib.Optimizer{Float64})

    When using CDDLib.jl with MathOptInterface, you can pass a different number type:

    using MathOptInterface, CDDLib
    -model = CDDLib.Optimizer{Rational{BigInt}}()

    Debugging

    CDDLib.jl uses two global Boolean variables to enable debugging outputs: debug and log.

    You can query the value of debug and log with get_debug and get_log, and set their values with set_debug and set_log.

    +model = CDDLib.Optimizer{Rational{BigInt}}()

    Debugging

    CDDLib.jl uses two global Boolean variables to enable debugging outputs: debug and log.

    You can query the value of debug and log with get_debug and get_log, and set their values with set_debug and set_log.

    diff --git a/previews/PR3838/packages/COPT/index.html b/previews/PR3838/packages/COPT/index.html index 1da80512652..16c96767b68 100644 --- a/previews/PR3838/packages/COPT/index.html +++ b/previews/PR3838/packages/COPT/index.html @@ -39,4 +39,4 @@ @show value.(X) @show value.(z) @show shadow_price(c1) -@show shadow_price(c2) +@show shadow_price(c2) diff --git a/previews/PR3838/packages/COSMO/index.html b/previews/PR3838/packages/COSMO/index.html index 37e0efcece3..105dd899750 100644 --- a/previews/PR3838/packages/COSMO/index.html +++ b/previews/PR3838/packages/COSMO/index.html @@ -34,4 +34,4 @@ publisher = {Springer}, doi = {10.1007/s10957-021-01896-x}, url = {https://doi.org/10.1007/s10957-021-01896-x} -}

    The article is available under Open Access here.

    Contributing

    • Contributions are always welcome. Our style guide can be found here.
    • Current issues, tasks and future ideas are listed in Issues. Please report any issues or bugs that you encounter.
    • As an open source project we are also interested in any projects and applications that use COSMO. Please let us know by opening a GitHub issue.

    Python - Interface

    COSMO can also be called from Python. Take a look at: cosmo-python

    Licence 🔍

    This project is licensed under the Apache License - see the LICENSE.md file for details.

    +}

    The article is available under Open Access here.

    Contributing

    • Contributions are always welcome. Our style guide can be found here.
    • Current issues, tasks and future ideas are listed in Issues. Please report any issues or bugs that you encounter.
    • As an open source project we are also interested in any projects and applications that use COSMO. Please let us know by opening a GitHub issue.

    Python - Interface

    COSMO can also be called from Python. Take a look at: cosmo-python

    Licence 🔍

    This project is licensed under the Apache License - see the LICENSE.md file for details.

    diff --git a/previews/PR3838/packages/CPLEX/index.html b/previews/PR3838/packages/CPLEX/index.html index 240090076be..91ad0781183 100644 --- a/previews/PR3838/packages/CPLEX/index.html +++ b/previews/PR3838/packages/CPLEX/index.html @@ -163,4 +163,4 @@ x_optimal = value.(x) y_optimal = value.(y) println("x: $(x_optimal), y: $(y_optimal)") -end +end diff --git a/previews/PR3838/packages/CSDP/index.html b/previews/PR3838/packages/CSDP/index.html index e0410f78415..fe517386840 100644 --- a/previews/PR3838/packages/CSDP/index.html +++ b/previews/PR3838/packages/CSDP/index.html @@ -10,4 +10,4 @@ A(X) = a X ⪰ 0

    where A(X) = [⟨A_1, X⟩, ..., ⟨A_m, X⟩]. The corresponding dual is:

    min ⟨a, y⟩
          A'(y) - C = Z
    -             Z ⪰ 0

    where A'(y) = y_1A_1 + ... + y_mA_m

    Termination criteria

    CSDP will terminate successfully (or partially) in the following cases:

    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied:
      • primal feasibility tolerance: ||A(x) - a||_2 / (1 + ||a||_2) < axtol
      • dual feasibility tolerance: ||A'(y) - C - Z||_F / (1 + ||C||_F) < atytol
      • relative duality gap tolerance: gap / (1 + |⟨a, y⟩| + |⟨C, X⟩|) < objtol
        • objective duality gap: if usexygap is 0, gap = ⟨a, y⟩ - ⟨C, X⟩
        • XY duality gap: if usexygap is 1, gap = ⟨Z, X⟩
      then it returns 0.
    • If CSDP finds y and Z ⪰ 0 such that -⟨a, y⟩ / ||A'(y) - Z||_F > pinftol, it returns 1 with y such that ⟨a, y⟩ = -1.
    • If CSDP finds X ⪰ 0 such that ⟨C, X⟩ / ||A(X)||_2 > dinftol, it returns 2 with X such that ⟨C, X⟩ = 1.
    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied with 1000*axtol, 1000*atytol and 1000*objtol but at least one of them is not satisfied with axtol, atytol and objtol and cannot make progress, then it returns 3.

    In addition, if the printlevel option is at least 1, the following will be printed:

    • If the return code is 1, CSDP will print ⟨a, y⟩ and ||A'(y) - Z||_F
    • If the return code is 2, CSDP will print ⟨C, X⟩ and ||A(X)||_F
    • Otherwise, CSDP will print
      • the primal/dual objective value,
      • the relative primal/dual infeasibility,
      • the objective duality gap ⟨a, y⟩ - ⟨C, X⟩ and objective relative duality gap (⟨a, y⟩ - ⟨C, X⟩) / (1 + |⟨a, y⟩| + |⟨C, X⟩|),
      • the XY duality gap ⟨Z, X⟩ and XY relative duality gap ⟨Z, X⟩ / (1 + |⟨a, y⟩| + |⟨C, X⟩|)
      • and the DIMACS error measures.

    In theory, for feasible primal and dual solutions, ⟨a, y⟩ - ⟨C, X⟩ = ⟨Z, X⟩, so the objective and XY duality gap should be equivalent. However, in practice, there are sometimes solution which satisfy primal and dual feasibility tolerances but have objective duality gap which are not close to XY duality gap. In some cases, the objective duality gap may even become negative (hence the tweakgap option). This is the reason usexygap is 1 by default.

    CSDP considers that X ⪰ 0 (resp. Z ⪰ 0) is satisfied when the Cholesky factorizations can be computed. In practice, this is somewhat more conservative than simply requiring all eigenvalues to be nonnegative.

    Status

    The table below shows how the different CSDP statuses are converted to the MathOptInterface statuses.

    CSDP codeStateDescriptionMOI status
    0SuccessSDP solvedMOI.OPTIMAL
    1SuccessThe problem is primal infeasible, and we have a certificateMOI.INFEASIBLE
    2SuccessThe problem is dual infeasible, and we have a certificateMOI.DUAL_INFEASIBLE
    3Partial SuccessA solution has been found, but full accuracy was not achievedMOI.ALMOST_OPTIMAL
    4FailureMaximum iterations reachedMOI.ITERATION_LIMIT
    5FailureStuck at edge of primal feasibilityMOI.SLOW_PROGRESS
    6FailureStuck at edge of dual infeasibilityMOI.SLOW_PROGRESS
    7FailureLack of progressMOI.SLOW_PROGRESS
    8FailureX, Z, or O was singularMOI.NUMERICAL_ERROR
    9FailureDetected NaN or Inf valuesMOI.NUMERICAL_ERROR
    + Z ⪰ 0

    where A'(y) = y_1A_1 + ... + y_mA_m

    Termination criteria

    CSDP will terminate successfully (or partially) in the following cases:

    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied:
      • primal feasibility tolerance: ||A(x) - a||_2 / (1 + ||a||_2) < axtol
      • dual feasibility tolerance: ||A'(y) - C - Z||_F / (1 + ||C||_F) < atytol
      • relative duality gap tolerance: gap / (1 + |⟨a, y⟩| + |⟨C, X⟩|) < objtol
        • objective duality gap: if usexygap is 0, gap = ⟨a, y⟩ - ⟨C, X⟩
        • XY duality gap: if usexygap is 1, gap = ⟨Z, X⟩
      then it returns 0.
    • If CSDP finds y and Z ⪰ 0 such that -⟨a, y⟩ / ||A'(y) - Z||_F > pinftol, it returns 1 with y such that ⟨a, y⟩ = -1.
    • If CSDP finds X ⪰ 0 such that ⟨C, X⟩ / ||A(X)||_2 > dinftol, it returns 2 with X such that ⟨C, X⟩ = 1.
    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied with 1000*axtol, 1000*atytol and 1000*objtol but at least one of them is not satisfied with axtol, atytol and objtol and cannot make progress, then it returns 3.

    In addition, if the printlevel option is at least 1, the following will be printed:

    • If the return code is 1, CSDP will print ⟨a, y⟩ and ||A'(y) - Z||_F
    • If the return code is 2, CSDP will print ⟨C, X⟩ and ||A(X)||_F
    • Otherwise, CSDP will print
      • the primal/dual objective value,
      • the relative primal/dual infeasibility,
      • the objective duality gap ⟨a, y⟩ - ⟨C, X⟩ and objective relative duality gap (⟨a, y⟩ - ⟨C, X⟩) / (1 + |⟨a, y⟩| + |⟨C, X⟩|),
      • the XY duality gap ⟨Z, X⟩ and XY relative duality gap ⟨Z, X⟩ / (1 + |⟨a, y⟩| + |⟨C, X⟩|)
      • and the DIMACS error measures.

    In theory, for feasible primal and dual solutions, ⟨a, y⟩ - ⟨C, X⟩ = ⟨Z, X⟩, so the objective and XY duality gap should be equivalent. However, in practice, there are sometimes solution which satisfy primal and dual feasibility tolerances but have objective duality gap which are not close to XY duality gap. In some cases, the objective duality gap may even become negative (hence the tweakgap option). This is the reason usexygap is 1 by default.

    CSDP considers that X ⪰ 0 (resp. Z ⪰ 0) is satisfied when the Cholesky factorizations can be computed. In practice, this is somewhat more conservative than simply requiring all eigenvalues to be nonnegative.

    Status

    The table below shows how the different CSDP statuses are converted to the MathOptInterface statuses.

    CSDP codeStateDescriptionMOI status
    0SuccessSDP solvedMOI.OPTIMAL
    1SuccessThe problem is primal infeasible, and we have a certificateMOI.INFEASIBLE
    2SuccessThe problem is dual infeasible, and we have a certificateMOI.DUAL_INFEASIBLE
    3Partial SuccessA solution has been found, but full accuracy was not achievedMOI.ALMOST_OPTIMAL
    4FailureMaximum iterations reachedMOI.ITERATION_LIMIT
    5FailureStuck at edge of primal feasibilityMOI.SLOW_PROGRESS
    6FailureStuck at edge of dual infeasibilityMOI.SLOW_PROGRESS
    7FailureLack of progressMOI.SLOW_PROGRESS
    8FailureX, Z, or O was singularMOI.NUMERICAL_ERROR
    9FailureDetected NaN or Inf valuesMOI.NUMERICAL_ERROR
    diff --git a/previews/PR3838/packages/Cbc/index.html b/previews/PR3838/packages/Cbc/index.html index bcd9e5c4281..c9fdd5ffe50 100644 --- a/previews/PR3838/packages/Cbc/index.html +++ b/previews/PR3838/packages/Cbc/index.html @@ -9,4 +9,4 @@ set_attribute(model, "logLevel", 1)

    MathOptInterface API

    The COIN Branch-and-Cut (Cbc) optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    List of supported optimizer attributes:

    List of supported variable attributes:

    List of supported constraint attributes:

    Options

    Options are, unfortunately, not well documented.

    The following options are likely to be the most useful:

    ParameterExampleExplanation
    seconds60.0Solution timeout limit
    logLevel2Set to 0 to disable solution output
    maxSolutions1Terminate after this many feasible solutions have been found
    maxNodes1Terminate after this many branch-and-bound nodes have been evaluated
    allowableGap0.05Terminate after optimality gap is less than this value (on an absolute scale)
    ratioGap0.05Terminate after optimality gap is smaller than this relative fraction
    threads1Set the number of threads to use for parallel branch & bound

    The complete list of parameters can be found by running the cbc executable and typing ? at the prompt.

    Start the cbc executable from Julia as follows:

    using Cbc_jll
     Cbc_jll.cbc() do exe
         run(`$(exe)`)
    -end
    +end diff --git a/previews/PR3838/packages/Clarabel/index.html b/previews/PR3838/packages/Clarabel/index.html index 68de0a59b6d..12d52b2dc4b 100644 --- a/previews/PR3838/packages/Clarabel/index.html +++ b/previews/PR3838/packages/Clarabel/index.html @@ -33,4 +33,4 @@

    eprint={2405.12762}, archivePrefix={arXiv}, primaryClass={math.OC} -}

    License 🔍

    This project is licensed under the Apache License 2.0 - see the LICENSE.md file for details.

    +}

    License 🔍

    This project is licensed under the Apache License 2.0 - see the LICENSE.md file for details.

    diff --git a/previews/PR3838/packages/Clp/index.html b/previews/PR3838/packages/Clp/index.html index adfec9b3958..b360bccbe92 100644 --- a/previews/PR3838/packages/Clp/index.html +++ b/previews/PR3838/packages/Clp/index.html @@ -7,4 +7,4 @@ Pkg.add("Clp")

    In addition to installing the Clp.jl package, this will also download and install the Clp binaries. You do not need to install Clp separately.

    To use a custom binary, read the Custom solver binaries section of the JuMP documentation.

    Use with JuMP

    To use Clp with JuMP, use Clp.Optimizer:

    using JuMP, Clp
     model = Model(Clp.Optimizer)
     set_attribute(model, "LogLevel", 1)
    -set_attribute(model, "Algorithm", 4)

    MathOptInterface API

    The Clp optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Options are, unfortunately, not well documented.

    The following options are likely to be the most useful:

    ParameterExampleExplanation
    PrimalTolerance1e-7Primal feasibility tolerance
    DualTolerance1e-7Dual feasibility tolerance
    DualObjectiveLimit1e308When using dual simplex (where the objective is monotonically changing), terminate when the objective exceeds this limit
    MaximumIterations2147483647Terminate after performing this number of simplex iterations
    MaximumSeconds-1.0Terminate after this many seconds have passed. A negative value means no time limit
    LogLevel1Set to 1, 2, 3, or 4 for increasing output. Set to 0 to disable output
    PresolveType0Set to 1 to disable presolve
    SolveType5Solution method: dual simplex (0), primal simplex (1), sprint (2), barrier with crossover (3), barrier without crossover (4), automatic (5)
    InfeasibleReturn0Set to 1 to return as soon as the problem is found to be infeasible (by default, an infeasibility proof is computed as well)
    Scaling30 -off, 1 equilibrium, 2 geometric, 3 auto, 4 dynamic(later)
    Perturbation100switch on perturbation (50), automatic (100), don't try perturbing (102)

    C API

    The C API can be accessed via Clp.Clp_XXX functions, where the names and arguments are identical to the C API.

    +set_attribute(model, "Algorithm", 4)

    MathOptInterface API

    The Clp optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Options are, unfortunately, not well documented.

    The following options are likely to be the most useful:

    ParameterExampleExplanation
    PrimalTolerance1e-7Primal feasibility tolerance
    DualTolerance1e-7Dual feasibility tolerance
    DualObjectiveLimit1e308When using dual simplex (where the objective is monotonically changing), terminate when the objective exceeds this limit
    MaximumIterations2147483647Terminate after performing this number of simplex iterations
    MaximumSeconds-1.0Terminate after this many seconds have passed. A negative value means no time limit
    LogLevel1Set to 1, 2, 3, or 4 for increasing output. Set to 0 to disable output
    PresolveType0Set to 1 to disable presolve
    SolveType5Solution method: dual simplex (0), primal simplex (1), sprint (2), barrier with crossover (3), barrier without crossover (4), automatic (5)
    InfeasibleReturn0Set to 1 to return as soon as the problem is found to be infeasible (by default, an infeasibility proof is computed as well)
    Scaling30 -off, 1 equilibrium, 2 geometric, 3 auto, 4 dynamic(later)
    Perturbation100switch on perturbation (50), automatic (100), don't try perturbing (102)

    C API

    The C API can be accessed via Clp.Clp_XXX functions, where the names and arguments are identical to the C API.

    diff --git a/previews/PR3838/packages/DAQP/index.html b/previews/PR3838/packages/DAQP/index.html index 6d7c37366c4..10e616878f4 100644 --- a/previews/PR3838/packages/DAQP/index.html +++ b/previews/PR3838/packages/DAQP/index.html @@ -5,4 +5,4 @@ gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash});

    DAQP.jl

    DAQP.jl is a Julia wrapper for the Quadratic Programming solver DAQP.

    License

    DAQP.jl is licensed under the MIT license.

    The underlying solver, darnstrom/daqp is licensed under the MIT license.

    Installation

    Install DAQP.jl using the Julia package manager:

    import Pkg
     Pkg.add("DAQP")

    Use with JuMP

    To use DAQP with JuMP, do:

    using JuMP, DAQP
    -model = Model(DAQP.Optimizer)

    Documentation

    General information about the solver is available at https://darnstrom.github.io/daqp/, and specifics for the Julia interface are available at https://darnstrom.github.io/daqp/start/julia.

    +model = Model(DAQP.Optimizer)

    Documentation

    General information about the solver is available at https://darnstrom.github.io/daqp/, and specifics for the Julia interface are available at https://darnstrom.github.io/daqp/start/julia.

    diff --git a/previews/PR3838/packages/DSDP/index.html b/previews/PR3838/packages/DSDP/index.html index 7b5dd1d4973..bffd88e324b 100644 --- a/previews/PR3838/packages/DSDP/index.html +++ b/previews/PR3838/packages/DSDP/index.html @@ -8,4 +8,4 @@ model = Model(DSDP.Optimizer)

    MathOptInterface API

    The DSDP optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Compile your own binaries

    In order to compile your own libdsdp.so to be used of DSDP.jl, use the following

    OB_DIR=$(julia --project=. -e 'import OpenBLAS32_jll; println(OpenBLAS32_jll.OpenBLAS32_jll.artifact_dir)')
     OB="-L${LIBOB_DIR}/lib -lopenblas"
     make DSDPCFLAGS="-g -Wall -fPIC -DPIC" LAPACKBLAS="$OB" dsdplibrary
    -make DSDPCFLAGS="-g -Wall -fPIC -DPIC" LAPACKBLAS="$OB" SH_LD="${CC} ${CFLAGS} -Wall -fPIC -DPIC -shared $OB" oshared
    +make DSDPCFLAGS="-g -Wall -fPIC -DPIC" LAPACKBLAS="$OB" SH_LD="${CC} ${CFLAGS} -Wall -fPIC -DPIC -shared $OB" oshared diff --git a/previews/PR3838/packages/DiffOpt/index.html b/previews/PR3838/packages/DiffOpt/index.html index fdcb916d10a..062428e7703 100644 --- a/previews/PR3838/packages/DiffOpt/index.html +++ b/previews/PR3838/packages/DiffOpt/index.html @@ -20,4 +20,4 @@ # fetch the gradients grad_exp = MOI.get(model, DiffOpt.ReverseConstraintFunction(), cons) # -3 x - 1 constant(grad_exp) # -1 -coefficient(grad_exp, x) # -3

    GSOC2020

    DiffOpt began as a NumFOCUS sponsored Google Summer of Code (2020) project

    +coefficient(grad_exp, x) # -3

    GSOC2020

    DiffOpt began as a NumFOCUS sponsored Google Summer of Code (2020) project

    diff --git a/previews/PR3838/packages/DisjunctiveProgramming/index.html b/previews/PR3838/packages/DisjunctiveProgramming/index.html index dd177027323..08231e19a47 100644 --- a/previews/PR3838/packages/DisjunctiveProgramming/index.html +++ b/previews/PR3838/packages/DisjunctiveProgramming/index.html @@ -8,4 +8,4 @@ author={Perez, Hector D and Joshi, Shivank and Grossmann, Ignacio E}, journal={arXiv preprint arXiv:2304.10492}, year={2023} -} +} diff --git a/previews/PR3838/packages/Dualization/index.html b/previews/PR3838/packages/Dualization/index.html index 05685505032..9e98833cc86 100644 --- a/previews/PR3838/packages/Dualization/index.html +++ b/previews/PR3838/packages/Dualization/index.html @@ -10,4 +10,4 @@ dual_model = dualize(model)

    To solve the dual formulation of a JuMP model, create a dual_optimizer:

    using JuMP, Dualization, SCS
     model = Model(dual_optimizer(SCS.Optimizer))
     # ... build model ...
    -optimize!(model)  # Solves the dual instead of the primal

    Documentation

    The documentation for Dualization.jl includes a detailed description of the dual reformulation, along with examples and an API reference.

    +optimize!(model) # Solves the dual instead of the primal

    Documentation

    The documentation for Dualization.jl includes a detailed description of the dual reformulation, along with examples and an API reference.

    diff --git a/previews/PR3838/packages/EAGO/index.html b/previews/PR3838/packages/EAGO/index.html index 248873893dd..1d5608c3017 100644 --- a/previews/PR3838/packages/EAGO/index.html +++ b/previews/PR3838/packages/EAGO/index.html @@ -71,4 +71,4 @@ doi = {10.1080/10556788.2020.1786566}, URL = {https://doi.org/10.1080/10556788.2020.1786566}, eprint = {https://doi.org/10.1080/10556788.2020.1786566} -}

    References

    1. Mitsos, A., Chachuat, B., and Barton, P.I. McCormick-based relaxations of algorithms. SIAM Journal on Optimization. 20(2): 573—601 (2009).
    2. Khan, K.A., Watson, H.A.J., and Barton, P.I. Differentiable McCormick relaxations. Journal of Global Optimization. 67(4): 687—729 (2017).
    3. Stuber, M.D., Scott, J.K., and Barton, P.I.: Convex and concave relaxations of implicit functions. Optimization Methods and Software 30(3): 424—460 (2015).
    4. Wechsung, A., Scott, J.K., Watson, H.A.J., and Barton, P.I. Reverse propagation of McCormick relaxations. Journal of Global Optimization 63(1): 1—36 (2015).
    5. Bracken, J., and McCormick, G.P. Selected Applications of Nonlinear Programming. John Wiley and Sons, New York (1968).
    +}

    References

    1. Mitsos, A., Chachuat, B., and Barton, P.I. McCormick-based relaxations of algorithms. SIAM Journal on Optimization. 20(2): 573—601 (2009).
    2. Khan, K.A., Watson, H.A.J., and Barton, P.I. Differentiable McCormick relaxations. Journal of Global Optimization. 67(4): 687—729 (2017).
    3. Stuber, M.D., Scott, J.K., and Barton, P.I.: Convex and concave relaxations of implicit functions. Optimization Methods and Software 30(3): 424—460 (2015).
    4. Wechsung, A., Scott, J.K., Watson, H.A.J., and Barton, P.I. Reverse propagation of McCormick relaxations. Journal of Global Optimization 63(1): 1—36 (2015).
    5. Bracken, J., and McCormick, G.P. Selected Applications of Nonlinear Programming. John Wiley and Sons, New York (1968).
    diff --git a/previews/PR3838/packages/ECOS/index.html b/previews/PR3838/packages/ECOS/index.html index eb20e7c52a4..d57dd730831 100644 --- a/previews/PR3838/packages/ECOS/index.html +++ b/previews/PR3838/packages/ECOS/index.html @@ -6,4 +6,4 @@

    ECOS.jl

    Build Status codecov

    ECOS.jl is a wrapper for the ECOS solver.

    The wrapper has two components:

    Affiliation

    This wrapper is maintained by the JuMP community and is not a product of Embotech AG.

    License

    ECOS.jl is licensed under the MIT License.

    The underlying solver, embotech/ecos, is licensed under the GPL v3 license.

    Installation

    Install ECOS.jl using Pkg.add:

    import Pkg
     Pkg.add("ECOS")

    In addition to installing the ECOS.jl package, this will also download and install the ECOS binaries. You do not need to install ECOS separately.

    To use a custom binary, read the Custom solver binaries section of the JuMP documentation.

    Use with JuMP

    To use ECOS with JuMP, use ECOS.Optimizer:

    using JuMP, ECOS
     model = Model(ECOS.Optimizer)
    -set_attribute(model, "maxit", 100)

    MathOptInterface API

    The ECOS optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    The following options are supported:

    ParameterExplanation
    gammascaling the final step length
    deltaregularization parameter
    epsregularization threshold
    feastolprimal/dual infeasibility tolerance
    abstolabsolute tolerance on duality gap
    reltolrelative tolerance on duality gap
    feastol_inaccprimal/dual infeasibility relaxed tolerance
    abstol_inaccabsolute relaxed tolerance on duality gap
    reltol_inaccrelative relaxed tolerance on duality gap
    nitrefnumber of iterative refinement steps
    maxitmaximum number of iterations
    verboseverbosity bool for PRINTLEVEL < 3
    +set_attribute(model, "maxit", 100)

    MathOptInterface API

    The ECOS optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    The following options are supported:

    ParameterExplanation
    gammascaling the final step length
    deltaregularization parameter
    epsregularization threshold
    feastolprimal/dual infeasibility tolerance
    abstolabsolute tolerance on duality gap
    reltolrelative tolerance on duality gap
    feastol_inaccprimal/dual infeasibility relaxed tolerance
    abstol_inaccabsolute relaxed tolerance on duality gap
    reltol_inaccrelative relaxed tolerance on duality gap
    nitrefnumber of iterative refinement steps
    maxitmaximum number of iterations
    verboseverbosity bool for PRINTLEVEL < 3
    diff --git a/previews/PR3838/packages/GAMS/index.html b/previews/PR3838/packages/GAMS/index.html index a5abcb45408..785f33b0906 100644 --- a/previews/PR3838/packages/GAMS/index.html +++ b/previews/PR3838/packages/GAMS/index.html @@ -22,4 +22,4 @@ MOI.get(model, GAMS.GeneratedConstraintName(), c[2]) # returns eq2 MOI.get(model, GAMS.OriginalConstraintName("eq1")) # returns c[1] -MOI.get(model, GAMS.OriginalConstraintName("eq10")) # returns nothing

    Note that JuMP direct-mode is used.

    +MOI.get(model, GAMS.OriginalConstraintName("eq10")) # returns nothing

    Note that JuMP direct-mode is used.

    diff --git a/previews/PR3838/packages/GLPK/index.html b/previews/PR3838/packages/GLPK/index.html index 9bbce44c5c4..23fd1ebf285 100644 --- a/previews/PR3838/packages/GLPK/index.html +++ b/previews/PR3838/packages/GLPK/index.html @@ -36,4 +36,4 @@ @test primal_status(model) == MOI.FEASIBLE_POINT @test value(x) == 1 @test value(y) == 2 -@show reasons

    C API

    The C API can be accessed via GLPK.glp_XXX functions, where the names and arguments are identical to the C API. See the /tests folder for inspiration.

    Thread safety

    GLPK is not thread-safe and should not be used with multithreading.

    +@show reasons

    C API

    The C API can be accessed via GLPK.glp_XXX functions, where the names and arguments are identical to the C API. See the /tests folder for inspiration.

    Thread safety

    GLPK is not thread-safe and should not be used with multithreading.

    diff --git a/previews/PR3838/packages/Gurobi/index.html b/previews/PR3838/packages/Gurobi/index.html index f8dacc056fd..732c0146bfe 100644 --- a/previews/PR3838/packages/Gurobi/index.html +++ b/previews/PR3838/packages/Gurobi/index.html @@ -169,4 +169,4 @@ println(lower_bound(x[i])) end

    Common errors

    Using Gurobi v9.0 and you got an error like Q not PSD?

    You need to set the NonConvex parameter:

    model = Model(Gurobi.Optimizer)
     set_optimizer_attribute(model, "NonConvex", 2)

    Gurobi Error 1009: Version number is XX.X, license is for version XX.X

    Make sure that your license is correct for your Gurobi version. See the Gurobi documentation for details.

    Once you are sure that the license and Gurobi versions match, re-install Gurobi.jl by running:

    import Pkg
    -Pkg.build("Gurobi")
    +Pkg.build("Gurobi") diff --git a/previews/PR3838/packages/HiGHS/index.html b/previews/PR3838/packages/HiGHS/index.html index 786d158f7bc..c9703f3921b 100644 --- a/previews/PR3838/packages/HiGHS/index.html +++ b/previews/PR3838/packages/HiGHS/index.html @@ -10,4 +10,4 @@ set_attribute(model, "time_limit", 60.0)

    MathOptInterface API

    The HiGHS optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    See the HiGHS documentation for a full list of the available options.

    C API

    The C API can be accessed via HiGHS.Highs_xxx functions, where the names and arguments are identical to the C API.

    Threads

    HiGHS uses a global scheduler that is shared between threads.

    Before changing the number of threads using MOI.Threads(), you must call Highs_resetGlobalScheduler(1):

    using JuMP, HiGHS
     model = Model(HiGHS.Optimizer)
     Highs_resetGlobalScheduler(1)
    -set_attribute(model, MOI.NumberOfThreads(), 1)

    If modifying the number of HiGHS threads across different Julia threads, be sure to read the docstring of Highs_resetGlobalScheduler. In particular, resetting the scheduler is not thread-safe.

    +set_attribute(model, MOI.NumberOfThreads(), 1)

    If modifying the number of HiGHS threads across different Julia threads, be sure to read the docstring of Highs_resetGlobalScheduler. In particular, resetting the scheduler is not thread-safe.

    diff --git a/previews/PR3838/packages/Hypatia/index.html b/previews/PR3838/packages/Hypatia/index.html index ac160debe78..572e27d0eea 100644 --- a/previews/PR3838/packages/Hypatia/index.html +++ b/previews/PR3838/packages/Hypatia/index.html @@ -42,4 +42,4 @@ volume={15}, pages={53--101}, doi={https://doi.org/10.1007/s12532-022-00226-0} -} +} diff --git a/previews/PR3838/packages/InfiniteOpt/index.html b/previews/PR3838/packages/InfiniteOpt/index.html index 453690b4f00..25609e4fb9f 100644 --- a/previews/PR3838/packages/InfiniteOpt/index.html +++ b/previews/PR3838/packages/InfiniteOpt/index.html @@ -12,4 +12,4 @@ doi = {https://doi.org/10.1016/j.compchemeng.2021.107567}, url = {https://www.sciencedirect.com/science/article/pii/S0098135421003458}, author = {Joshua L. Pulsipher and Weiqi Zhang and Tyler J. Hongisto and Victor M. Zavala}, -}

    A pre-print version is freely available though arXiv.

    +}

    A pre-print version is freely available though arXiv.

    diff --git a/previews/PR3838/packages/Ipopt/index.html b/previews/PR3838/packages/Ipopt/index.html index ead3a77d9cc..2c6553c7ffd 100644 --- a/previews/PR3838/packages/Ipopt/index.html +++ b/previews/PR3838/packages/Ipopt/index.html @@ -124,4 +124,4 @@ LinearAlgebra.BLAS.lbt_forward(liblapack32) using Ipopt

    AppleAccelerate

    If you are using macOS ≥ v13.4 and you have AppleAccelerate.jl installed, add using AppleAccelerate to your code:

    using AppleAccelerate
     using Ipopt

    Display backends

    Check what backends are loaded using:

    import LinearAlgebra
    -LinearAlgebra.BLAS.lbt_get_config()
    +LinearAlgebra.BLAS.lbt_get_config() diff --git a/previews/PR3838/packages/Juniper/index.html b/previews/PR3838/packages/Juniper/index.html index d3718ade279..71c50a0973f 100644 --- a/previews/PR3838/packages/Juniper/index.html +++ b/previews/PR3838/packages/Juniper/index.html @@ -33,4 +33,4 @@ year="2018", publisher="Springer International Publishing", isbn="978-3-319-93031-2" -} +} diff --git a/previews/PR3838/packages/KNITRO/index.html b/previews/PR3838/packages/KNITRO/index.html index 7572a214126..d6d804a8063 100644 --- a/previews/PR3838/packages/KNITRO/index.html +++ b/previews/PR3838/packages/KNITRO/index.html @@ -10,4 +10,4 @@ set_attribute(model, "algorithm", 4)

    Use with AMPL

    To use KNITRO with AmplNLWriter.jl, use KNITRO.amplexe:

    using JuMP
     import AmplNLWriter
     import KNITRO
    -model = Model(() -> AmplNLWriter.Optimizer(KNITRO.amplexe, ["outlev=3"]))

    Use with other packages

    A variety of packages extend KNITRO.jl to support other optimization modeling systems. These include:

    MathOptInterface API

    The Knitro optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    A list of available options is provided in the KNITRO reference manual.

    Low-level wrapper

    The complete C API can be accessed via KNITRO.KN_xx functions, where the names and arguments are identical to the C API.

    See the KNITRO documentation for details.

    As general rules when converting from Julia to C:

    • When KNITRO requires a Ptr{T} that holds one element, like double *, use a Ref{T}().
    • When KNITRO requires a Ptr{T} that holds multiple elements, use a Vector{T}.
    • When KNITRO requires a double, use Cdouble
    • When KNITRO requires an int, use Cint
    • When KNITRO requires a NULL, use C_NULL

    Extensive examples using the C wrapper can be found in examples/.

    Breaking changes

    KNITRO.jl v0.14.0 introduced a number of breaking changes to the low-level C API. The main changes were:

    1. removing Julia-specific functions like KN_set_param. Use the C API functions like KN_set_int_param and KN_set_double_param_by_name.
    2. removing intermediate methods that tried to make the C API more Julia-like. For example, we have removed the KN_add_var method that returned the index of the variable. There is now only the method from the C API.

    If you have trouble updating, please open a GitHub issue.

    Multi-threading

    Due to limitations in the interaction between Julia and C, KNITRO.jl disables multi-threading if the problem is nonlinear. This will override any options such as par_numthreads that you may have set.

    If you are using the low-level API, opt-in to enable multi-threading by calling KN_solve(model.env) instead of KN_solve(model), where model is the value returned by model = KN_new(). Note that calling KN_solve(model.env) is an advanced operation because it requires all callbacks you provide to be threadsafe.

    Read GitHub issue #93 for more details.

    +model = Model(() -> AmplNLWriter.Optimizer(KNITRO.amplexe, ["outlev=3"]))

    Use with other packages

    A variety of packages extend KNITRO.jl to support other optimization modeling systems. These include:

    MathOptInterface API

    The Knitro optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    A list of available options is provided in the KNITRO reference manual.

    Low-level wrapper

    The complete C API can be accessed via KNITRO.KN_xx functions, where the names and arguments are identical to the C API.

    See the KNITRO documentation for details.

    As general rules when converting from Julia to C:

    • When KNITRO requires a Ptr{T} that holds one element, like double *, use a Ref{T}().
    • When KNITRO requires a Ptr{T} that holds multiple elements, use a Vector{T}.
    • When KNITRO requires a double, use Cdouble
    • When KNITRO requires an int, use Cint
    • When KNITRO requires a NULL, use C_NULL

    Extensive examples using the C wrapper can be found in examples/.

    Breaking changes

    KNITRO.jl v0.14.0 introduced a number of breaking changes to the low-level C API. The main changes were:

    1. removing Julia-specific functions like KN_set_param. Use the C API functions like KN_set_int_param and KN_set_double_param_by_name.
    2. removing intermediate methods that tried to make the C API more Julia-like. For example, we have removed the KN_add_var method that returned the index of the variable. There is now only the method from the C API.

    If you have trouble updating, please open a GitHub issue.

    Multi-threading

    Due to limitations in the interaction between Julia and C, KNITRO.jl disables multi-threading if the problem is nonlinear. This will override any options such as par_numthreads that you may have set.

    If you are using the low-level API, opt-in to enable multi-threading by calling KN_solve(model.env) instead of KN_solve(model), where model is the value returned by model = KN_new(). Note that calling KN_solve(model.env) is an advanced operation because it requires all callbacks you provide to be threadsafe.

    Read GitHub issue #93 for more details.

    diff --git a/previews/PR3838/packages/Loraine/index.html b/previews/PR3838/packages/Loraine/index.html index 180f133da17..a7723163499 100644 --- a/previews/PR3838/packages/Loraine/index.html +++ b/previews/PR3838/packages/Loraine/index.html @@ -37,4 +37,4 @@ www={https://hal.science/hal-04076509/} note={Preprint hal-04076509} year={2023} -}
    • 1https://www.youtube.com/watch?v=0D2wNf1lVrI
    +}
    • 1https://www.youtube.com/watch?v=0D2wNf1lVrI
    diff --git a/previews/PR3838/packages/MAiNGO/index.html b/previews/PR3838/packages/MAiNGO/index.html index b8d569b6ccf..2400aa4020c 100644 --- a/previews/PR3838/packages/MAiNGO/index.html +++ b/previews/PR3838/packages/MAiNGO/index.html @@ -94,4 +94,4 @@ findMAiNGO(preferred=MAiNGO.C_API) # switch back to MAiNGO_jll findMAiNGO(preferred=MAiNGO.MAINGO_JLL)

    The findMAiNGO() function takes several optional arguments, which can be passed as keyword-arguments:

    • verbose: boolean, whether or not progress on finding MAiNGO is reported. (Default value: false)
    • preferred: either MAiNGO.MAINGOJLL or MAiNGO.CAPI, determines whether jll binaries or custom installation of MAiNGO is preferred. Note that the C-API is always preferred to the standalone version. If a custom standalone version should be used, set this value to C-API and pass an empty string as the capi argument (see next). (Default value: MAINGOJLL)
    • capi: string, path to C-API file. If set, this overrides the environment variable MAINGOLIB.
    • standalone: string, path to standalone executable file. If set, this overrides the environment variable MAINGO_EXEC.

    For example, to use the C-API at a new location, one could call:

    using MAiNGO
    -findMAiNGO(preferred=MAiNGO.C_API, c_api="path\\to\\c\\api\\shared_parser.dll")

    Currently working:

    • Integer and binary variables.
    • Affine, Quadratic and nonlinear constraints and objectives.
    • Operations: min,max,*,/,+,-,-(unary), exp,log,abs,sqrt,^
      • Other operations are easy to add if supported by MathOptInterface,ALE and MAiNGO.
    • Writing problem defined in JuMP syntax to an ALE problem.txt and calling MAiNGO.exe on a specified path.
    • Alternatively using a C-API to call MAiNGO.

    Restrictions compared to using the Python or C++ interface

    It is assumed that all variables are bounded. This interface assumes that integer variables are bounded between -1e6 and 1e6. For real variables these bounds are -1e8 and 1e8.

    Other functionality such as special support for growing datasets or MPI parallelization is not currently supported via this wrapper. Additionally, constraint formulations are simply passed from their representation in JuMP/MathOptInterface to MAiNGO. As such, there is no way to make use of advanced techniques such as defining constraints that are only used for the relaxations, using special relaxations for functions used in thermodynamics and process engineering or formulating reduced space formulations.

    Tests

    A subset of test cases for MathOptInterface solvers can be run by running the script ./test/runtests.jl. The current release was tested in the following combinations:

    • Julia 1.8.5 and MathOptInterface v1.18.0
    • Julia 1.9.4 and MathOptInterface v1.23.0.
    +findMAiNGO(preferred=MAiNGO.C_API, c_api="path\\to\\c\\api\\shared_parser.dll")

    Currently working:

    • Integer and binary variables.
    • Affine, Quadratic and nonlinear constraints and objectives.
    • Operations: min,max,*,/,+,-,-(unary), exp,log,abs,sqrt,^
      • Other operations are easy to add if supported by MathOptInterface,ALE and MAiNGO.
    • Writing problem defined in JuMP syntax to an ALE problem.txt and calling MAiNGO.exe on a specified path.
    • Alternatively using a C-API to call MAiNGO.

    Restrictions compared to using the Python or C++ interface

    It is assumed that all variables are bounded. This interface assumes that integer variables are bounded between -1e6 and 1e6. For real variables these bounds are -1e8 and 1e8.

    Other functionality such as special support for growing datasets or MPI parallelization is not currently supported via this wrapper. Additionally, constraint formulations are simply passed from their representation in JuMP/MathOptInterface to MAiNGO. As such, there is no way to make use of advanced techniques such as defining constraints that are only used for the relaxations, using special relaxations for functions used in thermodynamics and process engineering or formulating reduced space formulations.

    Tests

    A subset of test cases for MathOptInterface solvers can be run by running the script ./test/runtests.jl. The current release was tested in the following combinations:

    • Julia 1.8.5 and MathOptInterface v1.18.0
    • Julia 1.9.4 and MathOptInterface v1.23.0.
    diff --git a/previews/PR3838/packages/MadNLP/index.html b/previews/PR3838/packages/MadNLP/index.html index 17ac5806dcb..01e90e7c904 100644 --- a/previews/PR3838/packages/MadNLP/index.html +++ b/previews/PR3838/packages/MadNLP/index.html @@ -43,4 +43,4 @@ author={Shin, Sungho and Coffrin, Carleton and Sundar, Kaarthik and Zavala, Victor M}, journal={arXiv preprint arXiv:2010.02404}, year={2020} -}

    Supporting MadNLP.jl

    +}

    Supporting MadNLP.jl

    diff --git a/previews/PR3838/packages/Manopt/index.html b/previews/PR3838/packages/Manopt/index.html index cd960361b2c..301c99868df 100644 --- a/previews/PR3838/packages/Manopt/index.html +++ b/previews/PR3838/packages/Manopt/index.html @@ -30,4 +30,4 @@ TITLE = {Manifolds.jl: An Extensible Julia Framework for Data Analysis on Manifolds}, VOLUME = {49}, YEAR = {2023} -}

    as well. Note that all citations are in BibLaTeX format.

    Manopt.jl belongs to the Manopt family:

    Did you use Manopt.jl somewhere? Let us know! We'd love to collect those here as well.

    +}

    as well. Note that all citations are in BibLaTeX format.

    Manopt.jl belongs to the Manopt family:

    Did you use Manopt.jl somewhere? Let us know! We'd love to collect those here as well.

    diff --git a/previews/PR3838/packages/MiniZinc/index.html b/previews/PR3838/packages/MiniZinc/index.html index 7143f6bb877..b42db7313be 100644 --- a/previews/PR3838/packages/MiniZinc/index.html +++ b/previews/PR3838/packages/MiniZinc/index.html @@ -53,4 +53,4 @@ @constraint(model, x in MOI.AllDifferent(3)) @objective(model, Max, sum(i * x[i] for i in 1:3)) optimize!(model) -@show value.(x)

    MathOptInterface API

    The MiniZinc Optimizer{T} supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Set options using MOI.RawOptimizerAttribute in MOI or set_attribute in JuMP.

    MiniZinc.jl supports the following options:

    • model_filename::String = "": the location at which to write out the .mzn file during optimization. This option can be helpful during debugging. If left empty, a temporary file will be used instead.

    • MOI.SolutionLimit: set this option to a positive integer to return up to the limit number of solutions.

    +@show value.(x)

    MathOptInterface API

    The MiniZinc Optimizer{T} supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Set options using MOI.RawOptimizerAttribute in MOI or set_attribute in JuMP.

    MiniZinc.jl supports the following options:

    • model_filename::String = "": the location at which to write out the .mzn file during optimization. This option can be helpful during debugging. If left empty, a temporary file will be used instead.

    • MOI.SolutionLimit: set this option to a positive integer to return up to the limit number of solutions.

    diff --git a/previews/PR3838/packages/MosekTools/index.html b/previews/PR3838/packages/MosekTools/index.html index 1000c4752e4..42772727f11 100644 --- a/previews/PR3838/packages/MosekTools/index.html +++ b/previews/PR3838/packages/MosekTools/index.html @@ -7,4 +7,4 @@ using MosekTools model = Model(Mosek.Optimizer) set_attribute(model, "QUIET", true) -set_attribute(model, "INTPNT_CO_TOL_DFEAS", 1e-7)

    Options

    The parameter QUIET is a special parameter that when set to true disables all Mosek printing output.

    All other parameters can be found in the Mosek documentation.

    Note that the prefix MSK_IPAR_ (for integer parameters), MSK_DPAR_ (for floating point parameters) or MSK_SPAR_ (for string parameters) are optional. If they are not given, they are inferred from the type of the value. For example, in the example above, as 1e-7 is a floating point number, the parameters name used is MSK_DPAR_INTPNT_CO_TOL_DFEAS.

    +set_attribute(model, "INTPNT_CO_TOL_DFEAS", 1e-7)

    Options

    The parameter QUIET is a special parameter that when set to true disables all Mosek printing output.

    All other parameters can be found in the Mosek documentation.

    Note that the prefix MSK_IPAR_ (for integer parameters), MSK_DPAR_ (for floating point parameters) or MSK_SPAR_ (for string parameters) are optional. If they are not given, they are inferred from the type of the value. For example, in the example above, as 1e-7 is a floating point number, the parameters name used is MSK_DPAR_INTPNT_CO_TOL_DFEAS.

    diff --git a/previews/PR3838/packages/MultiObjectiveAlgorithms/index.html b/previews/PR3838/packages/MultiObjectiveAlgorithms/index.html index 998fd200424..7144ebe7edc 100644 --- a/previews/PR3838/packages/MultiObjectiveAlgorithms/index.html +++ b/previews/PR3838/packages/MultiObjectiveAlgorithms/index.html @@ -9,4 +9,4 @@ import MultiObjectiveAlgorithms as MOA model = JuMP.Model(() -> MOA.Optimizer(HiGHS.Optimizer)) set_attribute(model, MOA.Algorithm(), MOA.Dichotomy()) -set_attribute(model, MOA.SolutionLimit(), 4)

    Replace HiGHS.Optimizer with an optimizer capable of solving a single-objective instance of your optimization problem.

    You may set additional optimizer attributes, the supported attributes depend on the choice of solution algorithm.

    Algorithm

    Set the algorithm using the MOA.Algorithm() attribute.

    The value must be one of the algorithms supported by MOA:

    • MOA.Chalmet()
    • MOA.Dichotomy()
    • MOA.DominguezRios()
    • MOA.EpsilonConstraint()
    • MOA.Hierarchical()
    • MOA.KirlikSayin()
    • MOA.Lexicographic() [default]
    • MOA.TambyVanderpooten()

    Consult their docstrings for details.

    Other optimizer attributes

    There are a number of optimizer attributes supported by the algorithms in MOA.

    Each algorithm supports only a subset of the attributes. Consult the algorithm's docstring for details on which attributes it supports, and how it uses them in the solution process.

    • MOA.EpsilonConstraintStep()
    • MOA.LexicographicAllPermutations()
    • MOA.ObjectiveAbsoluteTolerance(index::Int)
    • MOA.ObjectivePriority(index::Int)
    • MOA.ObjectiveRelativeTolerance(index::Int)
    • MOA.ObjectiveWeight(index::Int)
    • MOA.SolutionLimit()
    • MOI.TimeLimitSec()
    +set_attribute(model, MOA.SolutionLimit(), 4)

    Replace HiGHS.Optimizer with an optimizer capable of solving a single-objective instance of your optimization problem.

    You may set additional optimizer attributes, the supported attributes depend on the choice of solution algorithm.

    Algorithm

    Set the algorithm using the MOA.Algorithm() attribute.

    The value must be one of the algorithms supported by MOA:

    • MOA.Chalmet()
    • MOA.Dichotomy()
    • MOA.DominguezRios()
    • MOA.EpsilonConstraint()
    • MOA.Hierarchical()
    • MOA.KirlikSayin()
    • MOA.Lexicographic() [default]
    • MOA.TambyVanderpooten()

    Consult their docstrings for details.

    Other optimizer attributes

    There are a number of optimizer attributes supported by the algorithms in MOA.

    Each algorithm supports only a subset of the attributes. Consult the algorithm's docstring for details on which attributes it supports, and how it uses them in the solution process.

    • MOA.EpsilonConstraintStep()
    • MOA.LexicographicAllPermutations()
    • MOA.ObjectiveAbsoluteTolerance(index::Int)
    • MOA.ObjectivePriority(index::Int)
    • MOA.ObjectiveRelativeTolerance(index::Int)
    • MOA.ObjectiveWeight(index::Int)
    • MOA.SolutionLimit()
    • MOI.TimeLimitSec()
    diff --git a/previews/PR3838/packages/NEOSServer/index.html b/previews/PR3838/packages/NEOSServer/index.html index 0a6e69dcbe5..4da89b45189 100644 --- a/previews/PR3838/packages/NEOSServer/index.html +++ b/previews/PR3838/packages/NEOSServer/index.html @@ -27,4 +27,4 @@ results = neos_getFinalResults(server, job)

    Use with JuMP

    Use NEOSServer.jl with JuMP as follows:

    using JuMP, NEOSServer
     model = Model() do
         return NEOSServer.Optimizer(; email = "me@mydomain.com", solver = "Ipopt")
    -end

    Note: NEOSServer.Optimizer is limited to the following solvers:

    • "CPLEX"
    • "FICO-Xpress"
    • "Ipopt"
    • "Knitro"
    • "MOSEK"
    • "OCTERACT"
    • "SNOPT"

    NEOS Limits

    NEOS currently limits jobs to an 8 hour time limit, 3 GB of memory, and a 16 MB submission file. If your model exceeds these limits, NEOSServer.jl may be unable to return useful information to the user.

    +end

    Note: NEOSServer.Optimizer is limited to the following solvers:

    • "CPLEX"
    • "FICO-Xpress"
    • "Ipopt"
    • "Knitro"
    • "MOSEK"
    • "OCTERACT"
    • "SNOPT"

    NEOS Limits

    NEOS currently limits jobs to an 8 hour time limit, 3 GB of memory, and a 16 MB submission file. If your model exceeds these limits, NEOSServer.jl may be unable to return useful information to the user.

    diff --git a/previews/PR3838/packages/NLopt/index.html b/previews/PR3838/packages/NLopt/index.html index 68c3d52a335..666c7eafb95 100644 --- a/previews/PR3838/packages/NLopt/index.html +++ b/previews/PR3838/packages/NLopt/index.html @@ -120,4 +120,4 @@ opt = Opt(:LD_MMA, 2) # Define problem solutions[i] = optimize(opt, rand(2)) -end

    Author

    This module was initially written by Steven G. Johnson, with subsequent contributions by several other authors (see the git history).

    +end

    Author

    This module was initially written by Steven G. Johnson, with subsequent contributions by several other authors (see the git history).

    diff --git a/previews/PR3838/packages/OSQP/index.html b/previews/PR3838/packages/OSQP/index.html index c9f15d6f898..101f0bb28bd 100644 --- a/previews/PR3838/packages/OSQP/index.html +++ b/previews/PR3838/packages/OSQP/index.html @@ -6,4 +6,4 @@

    OSQP.jl

    Build Status codecov.io

    OSQP.jl is a Julia wrapper for OSQP: the Operator Splitting QP Solver.

    License

    OSQP.jl is licensed under the Apache-2.0 license.

    The upstream solver, osqp/osqp is also licensed under the Apache-2.0 license.

    Installation

    Install OSQP.jl using the Julia package manager

    import Pkg
     Pkg.add("OSQP")

    Problem class

    The OSQP (Operator Splitting Quadratic Program) solver is a numerical optimization package for solving problems in the form

    minimize        0.5 x' P x + q' x
     
    -subject to      l <= A x <= u

    where x in R^n is the optimization variable. The objective function is defined by a positive semidefinite matrix P in S^n_+ and vector q in R^n. The linear constraints are defined by matrix A in R^{m x n} and vectors l in R^m U {-inf}^m, u in R^m U {+inf}^m.

    Documentation

    Detailed documentation is available at https://osqp.org/.

    +subject to l <= A x <= u

    where x in R^n is the optimization variable. The objective function is defined by a positive semidefinite matrix P in S^n_+ and vector q in R^n. The linear constraints are defined by matrix A in R^{m x n} and vectors l in R^m U {-inf}^m, u in R^m U {+inf}^m.

    Documentation

    Detailed documentation is available at https://osqp.org/.

    diff --git a/previews/PR3838/packages/Optim/index.html b/previews/PR3838/packages/Optim/index.html index c653e222a9e..9e7e06979c0 100644 --- a/previews/PR3838/packages/Optim/index.html +++ b/previews/PR3838/packages/Optim/index.html @@ -105,4 +105,4 @@ number = {24}, pages = {615}, doi = {10.21105/joss.00615} -} +} diff --git a/previews/PR3838/packages/PATHSolver/index.html b/previews/PR3838/packages/PATHSolver/index.html index 6675f224e8b..223f8d5b518 100644 --- a/previews/PR3838/packages/PATHSolver/index.html +++ b/previews/PR3838/packages/PATHSolver/index.html @@ -165,4 +165,4 @@ 0.8 1.2

    Thread safety

    PATH is not thread-safe and there are no known work-arounds. Do not run it in parallel using Threads.@threads. See issue #62 for more details.

    Factorization methods

    By default, PATHSolver.jl will download the LUSOL shared library. To use LUSOL, set the following options:

    model = Model(PATHSolver.Optimizer)
     set_optimizer_attribute(model, "factorization_method", "blu_lusol")
    -set_optimizer_attribute(model, "factorization_library_name", PATHSolver.LUSOL_LIBRARY_PATH)

    To use factorization_method umfpack you will need the umfpack shared library that is available directly from the developers of that code for academic use.

    Manual installation

    By default PATHSolver.jl will download a copy of the libpath library. If you already have one installed and want to use that, set the PATH_JL_LOCATION environment variable to point to the libpath50.xx library.

    +set_optimizer_attribute(model, "factorization_library_name", PATHSolver.LUSOL_LIBRARY_PATH)

    To use factorization_method umfpack you will need the umfpack shared library that is available directly from the developers of that code for academic use.

    Manual installation

    By default PATHSolver.jl will download a copy of the libpath library. If you already have one installed and want to use that, set the PATH_JL_LOCATION environment variable to point to the libpath50.xx library.

    diff --git a/previews/PR3838/packages/Pajarito/index.html b/previews/PR3838/packages/Pajarito/index.html index 0dba1d2a080..2a24922dcf7 100644 --- a/previews/PR3838/packages/Pajarito/index.html +++ b/previews/PR3838/packages/Pajarito/index.html @@ -27,4 +27,4 @@ pages={249--293}, year={2020}, publisher={Springer} -}

    Note this paper describes a legacy MathProgBase version of Pajarito, which is available on the mathprogbase branch of this repository. Starting with version v0.8.0, Pajarito supports MathOptInterface instead of MathProgBase.

    +}

    Note this paper describes a legacy MathProgBase version of Pajarito, which is available on the mathprogbase branch of this repository. Starting with version v0.8.0, Pajarito supports MathOptInterface instead of MathProgBase.

    diff --git a/previews/PR3838/packages/ParametricOptInterface/index.html b/previews/PR3838/packages/ParametricOptInterface/index.html index f996aa33479..8815ccc8e3f 100644 --- a/previews/PR3838/packages/ParametricOptInterface/index.html +++ b/previews/PR3838/packages/ParametricOptInterface/index.html @@ -13,4 +13,4 @@ @objective(model, Min, 2x) optimize!(model) MOI.set(model, POI.ParameterValue(), p, 2.0) -optimize!(model)

    GSOC2020

    ParametricOptInterface began as a NumFOCUS sponsored Google Summer of Code (2020) project.

    +optimize!(model)

    GSOC2020

    ParametricOptInterface began as a NumFOCUS sponsored Google Summer of Code (2020) project.

    diff --git a/previews/PR3838/packages/Pavito/index.html b/previews/PR3838/packages/Pavito/index.html index 4b847591d9a..8314b28e35d 100644 --- a/previews/PR3838/packages/Pavito/index.html +++ b/previews/PR3838/packages/Pavito/index.html @@ -13,4 +13,4 @@ "cont_solver" => optimizer_with_attributes(Ipopt.Optimizer, "print_level" => 0), ), -)

    The algorithm implemented by Pavito itself is relatively simple; most of the hard work is performed by the MILP solver passed as mip_solver and the NLP solver passed as cont_solver.

    The performance of Pavito depends on these two types of solvers.

    For better performance, you should use a commercial MILP solver such as CPLEX or Gurobi.

    Options

    The following optimizer attributes can set to a Pavito.Optimizer to modify its behavior:

    • log_level::Int Verbosity flag: 0 for quiet, higher for basic solve info
    • timeout::Float64 Time limit for algorithm (in seconds)
    • rel_gap::Float64 Relative optimality gap termination condition
    • mip_solver_drives::Bool Let MILP solver manage convergence ("branch and cut")
    • mip_solver::MOI.OptimizerWithAttributes MILP solver
    • cont_solver::MOI.OptimizerWithAttributes Continuous NLP solver

    Pavito is not yet numerically robust and may require tuning of parameters to improve convergence.

    If the default parameters don't work for you, please let us know by opening an issue.

    For improved Pavito performance, MILP solver integrality tolerance and feasibility tolerances should typically be tightened, for example to 1e-8.

    Bug reports and support

    Please report any issues via the GitHub issue tracker. All types of issues are welcome and encouraged; this includes bug reports, documentation typos, feature requests, etc. The Optimization (Mathematical) category on Discourse is appropriate for general discussion.

    +)

    The algorithm implemented by Pavito itself is relatively simple; most of the hard work is performed by the MILP solver passed as mip_solver and the NLP solver passed as cont_solver.

    The performance of Pavito depends on these two types of solvers.

    For better performance, you should use a commercial MILP solver such as CPLEX or Gurobi.

    Options

    The following optimizer attributes can set to a Pavito.Optimizer to modify its behavior:

    • log_level::Int Verbosity flag: 0 for quiet, higher for basic solve info
    • timeout::Float64 Time limit for algorithm (in seconds)
    • rel_gap::Float64 Relative optimality gap termination condition
    • mip_solver_drives::Bool Let MILP solver manage convergence ("branch and cut")
    • mip_solver::MOI.OptimizerWithAttributes MILP solver
    • cont_solver::MOI.OptimizerWithAttributes Continuous NLP solver

    Pavito is not yet numerically robust and may require tuning of parameters to improve convergence.

    If the default parameters don't work for you, please let us know by opening an issue.

    For improved Pavito performance, MILP solver integrality tolerance and feasibility tolerances should typically be tightened, for example to 1e-8.

    Bug reports and support

    Please report any issues via the GitHub issue tracker. All types of issues are welcome and encouraged; this includes bug reports, documentation typos, feature requests, etc. The Optimization (Mathematical) category on Discourse is appropriate for general discussion.

    diff --git a/previews/PR3838/packages/Percival/index.html b/previews/PR3838/packages/Percival/index.html index f3ee3cbfd39..a281eedbd5f 100644 --- a/previews/PR3838/packages/Percival/index.html +++ b/previews/PR3838/packages/Percival/index.html @@ -22,4 +22,4 @@ [1.0], [1.0], ) -output = percival(nlp, verbose = 1)

    Bug reports and discussions

    If you think you found a bug, feel free to open an issue. Focused suggestions and requests can also be opened as issues. Before opening a pull request, start an issue or a discussion on the topic, please.

    If you want to ask a question not suited for a bug report, feel free to start a discussion here. This forum is for general discussion about this repository and the JuliaSmoothOptimizers, so questions about any of our packages are welcome.

    +output = percival(nlp, verbose = 1)

    Bug reports and discussions

    If you think you found a bug, feel free to open an issue. Focused suggestions and requests can also be opened as issues. Before opening a pull request, start an issue or a discussion on the topic, please.

    If you want to ask a question not suited for a bug report, feel free to start a discussion here. This forum is for general discussion about this repository and the JuliaSmoothOptimizers, so questions about any of our packages are welcome.

    diff --git a/previews/PR3838/packages/PiecewiseLinearOpt/index.html b/previews/PR3838/packages/PiecewiseLinearOpt/index.html index 5600143843b..1f43d9add62 100644 --- a/previews/PR3838/packages/PiecewiseLinearOpt/index.html +++ b/previews/PR3838/packages/PiecewiseLinearOpt/index.html @@ -41,4 +41,4 @@ (u, v) -> exp(u + v); method = :DisaggLogarithmic, ) -@objective(model, Min, z)

    Methods

    Supported univariate formulations:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic; default)
    • Disaggregated Logarithmic (:DisaggLogarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)

    Supported bivariate formulations for entire constraint:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Disaggregated Logarithmic (:DisaggLogarithmic)

    Also, you can use any univariate formulation for bivariate functions as well. They will be used to impose two axis-aligned SOS2 constraints, along with the "6-stencil" formulation for the triangle selection portion of the constraint. See the associated paper for more details. In particular, the following are also acceptable bivariate formulation choices:

    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)
    +@objective(model, Min, z)

    Methods

    Supported univariate formulations:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic; default)
    • Disaggregated Logarithmic (:DisaggLogarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)

    Supported bivariate formulations for entire constraint:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Disaggregated Logarithmic (:DisaggLogarithmic)

    Also, you can use any univariate formulation for bivariate functions as well. They will be used to impose two axis-aligned SOS2 constraints, along with the "6-stencil" formulation for the triangle selection portion of the constraint. See the associated paper for more details. In particular, the following are also acceptable bivariate formulation choices:

    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)
    diff --git a/previews/PR3838/packages/Plasmo/index.html b/previews/PR3838/packages/Plasmo/index.html index 2bd4df926c1..3fd79faac08 100644 --- a/previews/PR3838/packages/Plasmo/index.html +++ b/previews/PR3838/packages/Plasmo/index.html @@ -50,4 +50,4 @@ volume = {125}, year = {2019}, doi = {10.1016/j.compchemeng.2019.03.009} -}

    A pre-print of this paper can be found here

    +}

    A pre-print of this paper can be found here

    diff --git a/previews/PR3838/packages/PolyJuMP/index.html b/previews/PR3838/packages/PolyJuMP/index.html index 8fcda6c7777..e45c40ab8c5 100644 --- a/previews/PR3838/packages/PolyJuMP/index.html +++ b/previews/PR3838/packages/PolyJuMP/index.html @@ -17,4 +17,4 @@ model = Model(optimizer_with_attributes( PolyJuMP.KKT.Optimizer, "solver" => HomotopyContinuation.SemialgebraicSetsHCSolver(), -))

    Documentation

    Documentation for PolyJuMP.jl is included in the documentation for SumOfSquares.jl.

    +))

    Documentation

    Documentation for PolyJuMP.jl is included in the documentation for SumOfSquares.jl.

    diff --git a/previews/PR3838/packages/ProxSDP/index.html b/previews/PR3838/packages/ProxSDP/index.html index a73acdbda61..3c325fa8631 100644 --- a/previews/PR3838/packages/ProxSDP/index.html +++ b/previews/PR3838/packages/ProxSDP/index.html @@ -56,4 +56,4 @@ publisher = {Taylor & Francis}, doi = {10.1080/02331934.2020.1823387}, URL = {https://doi.org/10.1080/02331934.2020.1823387} -}

    The preprint version of the paper can be found here.

    Disclaimer

    • ProxSDP is a research software, therefore it should not be used in production.
    • Please open an issue if you find any problems, developers will try to fix and find alternatives.
    • There is no continuous development for 32-bit systems, the package should work, but might reach some issues.
    • ProxSDP assumes primal and dual feasibility.

    ROAD MAP

    • Support for exponential and power cones
    • Warm start
    +}

    The preprint version of the paper can be found here.

    Disclaimer

    • ProxSDP is a research software, therefore it should not be used in production.
    • Please open an issue if you find any problems, developers will try to fix and find alternatives.
    • There is no continuous development for 32-bit systems, the package should work, but might reach some issues.
    • ProxSDP assumes primal and dual feasibility.

    ROAD MAP

    • Support for exponential and power cones
    • Warm start
    diff --git a/previews/PR3838/packages/SCIP/index.html b/previews/PR3838/packages/SCIP/index.html index 14cbd6549be..ad5864916a7 100644 --- a/previews/PR3838/packages/SCIP/index.html +++ b/previews/PR3838/packages/SCIP/index.html @@ -10,4 +10,4 @@ Pkg.build("SCIP")

    Use with JuMP

    Use SCIP with JuMP as follows:

    using JuMP, SCIP
     model = Model(SCIP.Optimizer)
     set_attribute(model, "display/verblevel", 0)
    -set_attribute(model, "limits/gap", 0.05)

    Options

    See the SCIP documentation for a list of supported options.

    MathOptInterface API

    The SCIP optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Design considerations

    Wrapping the public API

    All of the public API methods are wrapped and available within the SCIP package. This includes the scip_*.h and pub_*.h headers that are collected in scip.h, as well as all default constraint handlers (cons_*.h.)

    The wrapped functions do not transform any data structures and work on the raw pointers (for example, SCIP* in C, Ptr{SCIP_} in Julia). Convenience wrapper functions based on Julia types are added as needed.

    Memory management

    Programming with SCIP requires dealing with variable and constraint objects that use reference counting for memory management.

    The SCIP.Optimizer wrapper type collects lists of SCIP_VAR* and SCIP_CONS* under the hood, and it releases all references when it is garbage collected itself (via finalize).

    When adding a variable (add_variable) or a constraint (add_linear_constraint), an integer index is returned. This index can be used to retrieve the SCIP_VAR* or SCIP_CONS* pointer via get_var and get_cons respectively.

    Supported nonlinear operators

    Supported operators in nonlinear expressions are as follows:

    • +
    • -
    • *
    • /
    • ^
    • sqrt
    • exp
    • log
    • abs
    • cos
    • sin
    +set_attribute(model, "limits/gap", 0.05)

    Options

    See the SCIP documentation for a list of supported options.

    MathOptInterface API

    The SCIP optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Design considerations

    Wrapping the public API

    All of the public API methods are wrapped and available within the SCIP package. This includes the scip_*.h and pub_*.h headers that are collected in scip.h, as well as all default constraint handlers (cons_*.h.)

    The wrapped functions do not transform any data structures and work on the raw pointers (for example, SCIP* in C, Ptr{SCIP_} in Julia). Convenience wrapper functions based on Julia types are added as needed.

    Memory management

    Programming with SCIP requires dealing with variable and constraint objects that use reference counting for memory management.

    The SCIP.Optimizer wrapper type collects lists of SCIP_VAR* and SCIP_CONS* under the hood, and it releases all references when it is garbage collected itself (via finalize).

    When adding a variable (add_variable) or a constraint (add_linear_constraint), an integer index is returned. This index can be used to retrieve the SCIP_VAR* or SCIP_CONS* pointer via get_var and get_cons respectively.

    Supported nonlinear operators

    Supported operators in nonlinear expressions are as follows:

    • +
    • -
    • *
    • /
    • ^
    • sqrt
    • exp
    • log
    • abs
    • cos
    • sin
    diff --git a/previews/PR3838/packages/SCS/index.html b/previews/PR3838/packages/SCS/index.html index eb1f25f680a..4228cf4904c 100644 --- a/previews/PR3838/packages/SCS/index.html +++ b/previews/PR3838/packages/SCS/index.html @@ -53,4 +53,4 @@ julia> SCS.is_available(SCS.GpuIndirectSolver) true

    The GpuIndirectSolver is available on Linux x86_64 platform only.

    Low-level wrapper

    SCS.jl provides a low-level interface to solve a problem directly, without interfacing through MathOptInterface.

    This is an advanced interface with a risk of incorrect usage. For new users, we recommend that you use the JuMP or Convex interfaces instead.

    SCS solves a problem of the form:

    minimize        1/2 * x' * P * x + c' * x
     subject to      A * x + s = b
    -                s in K

    where K is a product cone of:

    • zero cone
    • positive orthant { x | x ≥ 0 }
    • box cone { (t,x) | t*l ≤ x ≤ t*u}
    • second-order cone (SOC) { (t,x) | ||x||_2 ≤ t }
    • semi-definite cone (SDC) { X | X is psd }
    • exponential cone { (x,y,z) | y e^(x/y) ≤ z, y>0 }
    • power cone { (x,y,z) | x^a * y^(1-a) ≥ |z|, x ≥ 0, y ≥ 0 }
    • dual power cone { (u,v,w) | (u/a)^a * (v/(1-a))^(1-a) ≥ |w|, u ≥ 0, v ≥ 0 }.

    To solve this problem with SCS, call SCS.scs_solve; see the docstring for details.

    + s in K

    where K is a product cone of:

    • zero cone
    • positive orthant { x | x ≥ 0 }
    • box cone { (t,x) | t*l ≤ x ≤ t*u}
    • second-order cone (SOC) { (t,x) | ||x||_2 ≤ t }
    • semi-definite cone (SDC) { X | X is psd }
    • exponential cone { (x,y,z) | y e^(x/y) ≤ z, y>0 }
    • power cone { (x,y,z) | x^a * y^(1-a) ≥ |z|, x ≥ 0, y ≥ 0 }
    • dual power cone { (u,v,w) | (u/a)^a * (v/(1-a))^(1-a) ≥ |w|, u ≥ 0, v ≥ 0 }.

    To solve this problem with SCS, call SCS.scs_solve; see the docstring for details.

    diff --git a/previews/PR3838/packages/SDDP/index.html b/previews/PR3838/packages/SDDP/index.html index a9d0ac02b46..2235be55444 100644 --- a/previews/PR3838/packages/SDDP/index.html +++ b/previews/PR3838/packages/SDDP/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -
    +
    diff --git a/previews/PR3838/packages/SDPA/index.html b/previews/PR3838/packages/SDPA/index.html index fc49c4748d3..31da6b879ad 100644 --- a/previews/PR3838/packages/SDPA/index.html +++ b/previews/PR3838/packages/SDPA/index.html @@ -12,4 +12,4 @@ set_attribute(model, "Mode", SDPA.PARAMETER_STABLE_BUT_SLOW)

    Note that the parameters are set in the order they are given, so you can set a mode and then modify parameters from this mode.

    using JuMP, SDPA
     model = Model(SDPA.Optimizer)
     set_attribute(model, "Mode", SDPA.PARAMETER_STABLE_BUT_SLOW)
    -set_attribute(model, "MaxIteration", 100)

    The choice of parameter mode has a large impact on the performance and stability of SDPA, and not necessarily in the way implied by the names of the modes; for example, PARAMETER_UNSTABLE_BUT_FAST can be more stable than the other modes for some problems. You should try each mode to see how it performs on your specific problem. See SDPA.jl#17 for more details.

    +set_attribute(model, "MaxIteration", 100)

    The choice of parameter mode has a large impact on the performance and stability of SDPA, and not necessarily in the way implied by the names of the modes; for example, PARAMETER_UNSTABLE_BUT_FAST can be more stable than the other modes for some problems. You should try each mode to see how it performs on your specific problem. See SDPA.jl#17 for more details.

    diff --git a/previews/PR3838/packages/SDPLR/index.html b/previews/PR3838/packages/SDPLR/index.html index b0528b622c4..6951e049e5a 100644 --- a/previews/PR3838/packages/SDPLR/index.html +++ b/previews/PR3838/packages/SDPLR/index.html @@ -50,4 +50,4 @@ sigma *= 2 end lambdaupdate = 0 -end +end diff --git a/previews/PR3838/packages/SDPNAL/index.html b/previews/PR3838/packages/SDPNAL/index.html index b378091658b..5edfd526362 100644 --- a/previews/PR3838/packages/SDPNAL/index.html +++ b/previews/PR3838/packages/SDPNAL/index.html @@ -18,4 +18,4 @@ '/path/to/SDPNALv1.0/solver:', ... '/path/to/SDPNALv1.0/solver_main_default:', ... '/path/to/SDPNALv1.0/util:', ... -% (...)

    If you have SDPT3 in addition to SDPNAL in the MATLAB path (that is, the toolbox/local/pathdef.m file) then you might have issues because both solvers define a validate function, and this might make SDPNAL call SDPT3's validate function instead of SDPT3's validate function.

    +% (...)

    If you have SDPT3 in addition to SDPNAL in the MATLAB path (that is, the toolbox/local/pathdef.m file) then you might have issues because both solvers define a validate function, and this might make SDPNAL call SDPT3's validate function instead of SDPT3's validate function.

    diff --git a/previews/PR3838/packages/SDPT3/index.html b/previews/PR3838/packages/SDPT3/index.html index 6a414dd31f9..1c84df807a1 100644 --- a/previews/PR3838/packages/SDPT3/index.html +++ b/previews/PR3838/packages/SDPT3/index.html @@ -29,4 +29,4 @@ julia> MATLAB.restoredefaultpath() -julia> MATLAB.mat"savepath" +julia> MATLAB.mat"savepath" diff --git a/previews/PR3838/packages/SeDuMi/index.html b/previews/PR3838/packages/SeDuMi/index.html index 5ab28b976ea..f8796ebf2ad 100644 --- a/previews/PR3838/packages/SeDuMi/index.html +++ b/previews/PR3838/packages/SeDuMi/index.html @@ -17,4 +17,4 @@ MATLAB.mat"install_sedumi" end -julia> MATLAB.mat"savepath" +julia> MATLAB.mat"savepath" diff --git a/previews/PR3838/packages/SumOfSquares/index.html b/previews/PR3838/packages/SumOfSquares/index.html index db80450a039..b982204f8ea 100644 --- a/previews/PR3838/packages/SumOfSquares/index.html +++ b/previews/PR3838/packages/SumOfSquares/index.html @@ -4,4 +4,4 @@ gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash});

    SumOfSquares.jl

    Build Status codecov

    SumOfSquares.jl is a JuMP extension that, when used in conjunction with MultivariatePolynomial and PolyJuMP, implements a sum of squares reformulation for polynomial optimization.

    License

    SumOfSquares.jl is licensed under the MIT license.

    Installation

    Install SumOfSquares using Pkg.add:

    import Pkg
    -Pkg.add("SumOfSquares")

    Documentation

    See https://jump.dev/SumOfSquares.jl/stable for the most recently tagged version of the documentation.

    See https://jump.dev/SumOfSquares.jl/dev for the in-development version of the documentation.

    Presentations

    Some presentations on, or using, SumOfSquares (see blegat/SumOfSquaresSlides for the source code of the presentations):

    Citing

    See CITATION.bib.

    +Pkg.add("SumOfSquares")

    Documentation

    See https://jump.dev/SumOfSquares.jl/stable for the most recently tagged version of the documentation.

    See https://jump.dev/SumOfSquares.jl/dev for the in-development version of the documentation.

    Presentations

    Some presentations on, or using, SumOfSquares (see blegat/SumOfSquaresSlides for the source code of the presentations):

    Citing

    See CITATION.bib.

    diff --git a/previews/PR3838/packages/Tulip/index.html b/previews/PR3838/packages/Tulip/index.html index 3ad134d39cf..3ebcb687266 100644 --- a/previews/PR3838/packages/Tulip/index.html +++ b/previews/PR3838/packages/Tulip/index.html @@ -28,4 +28,4 @@ language = {en}, url = {https://doi.org/10.1007/s12532-020-00200-8}, urldate = {2021-03-07}, -} +} diff --git a/previews/PR3838/packages/Xpress/index.html b/previews/PR3838/packages/Xpress/index.html index c1c24efb1c9..e3300b727b2 100644 --- a/previews/PR3838/packages/Xpress/index.html +++ b/previews/PR3838/packages/Xpress/index.html @@ -58,4 +58,4 @@ @test termination_status(model) == MOI.OPTIMAL @test primal_status(model) == MOI.FEASIBLE_POINT @test value(x) == 1 -@test value(y) == 2

    Environment variables

    • XPRESS_JL_SKIP_LIB_CHECK: Used to skip build lib check as previously described.
    • XPRESS_JL_NO_INFO: Disable license info log.
    • XPRESS_JL_NO_DEPS_ERROR: Disable error when do deps.jl file is found.
    • XPRESS_JL_NO_AUTO_INIT: Disable automatic run of Xpress.initialize(). Specially useful for explicitly loading the dynamic library.
    • XPRESS_JL_LIBRARY: Provide a custom path to libxprs
    • XPAUTH_PATH: Provide a custom path to the license file

    C API

    The C API can be accessed via Xpress.Lib.XPRSxx functions, where the names and arguments are identical to the C API.

    See the Xpress documentation for details.

    Documentation

    For more information, consult the FICO optimizer manual.

    +@test value(y) == 2

    Environment variables

    • XPRESS_JL_SKIP_LIB_CHECK: Used to skip build lib check as previously described.
    • XPRESS_JL_NO_INFO: Disable license info log.
    • XPRESS_JL_NO_DEPS_ERROR: Disable error when do deps.jl file is found.
    • XPRESS_JL_NO_AUTO_INIT: Disable automatic run of Xpress.initialize(). Specially useful for explicitly loading the dynamic library.
    • XPRESS_JL_LIBRARY: Provide a custom path to libxprs
    • XPAUTH_PATH: Provide a custom path to the license file

    C API

    The C API can be accessed via Xpress.Lib.XPRSxx functions, where the names and arguments are identical to the C API.

    See the Xpress documentation for details.

    Documentation

    For more information, consult the FICO optimizer manual.

    diff --git a/previews/PR3838/packages/solvers/index.html b/previews/PR3838/packages/solvers/index.html index 85ddfb19708..fc62dfdfd50 100644 --- a/previews/PR3838/packages/solvers/index.html +++ b/previews/PR3838/packages/solvers/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Introduction

    This section of the documentation contains brief documentation for some of the solvers that JuMP supports. The list of solvers is not exhaustive, but instead is intended to help you discover commonly used solvers.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers. In many cases, these packages wrap external solvers that are not developed by the JuMP developers and, while the Julia packages are all open-source, in some cases the solvers themselves are closed source commercial products.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new solvers

    Written a solver? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    +

    Introduction

    This section of the documentation contains brief documentation for some of the solvers that JuMP supports. The list of solvers is not exhaustive, but instead is intended to help you discover commonly used solvers.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers. In many cases, these packages wrap external solvers that are not developed by the JuMP developers and, while the Julia packages are all open-source, in some cases the solvers themselves are closed source commercial products.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new solvers

    Written a solver? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    diff --git a/previews/PR3838/release_notes/index.html b/previews/PR3838/release_notes/index.html index b07ed7a6ec7..b75c46d92fc 100644 --- a/previews/PR3838/release_notes/index.html +++ b/previews/PR3838/release_notes/index.html @@ -12,4 +12,4 @@ new_b = backend(model)
  • All usages of @SDconstraint are deprecated. The new syntax is @constraint(model, X >= Y, PSDCone()).
  • Creating a DenseAxisArray with a Number as an axis will now display a warning. This catches a common error in which users write @variable(model, x[length(S)]) instead of @variable(model, x[1:length(S)]).
  • The caching_mode argument to Model, for example, Model(caching_mode = MOIU.MANUAL) mode has been removed. For more control over the optimizer, use direct_model instead.
  • The previously deprecated lp_objective_perturbation_range and lp_rhs_perturbation_range functions have been removed. Use lp_sensitivity_report instead.
  • The .m fields of NonlinearExpression and NonlinearParameter have been renamed to .model.
  • Infinite variable bounds are now ignored. Thus, @variable(model, x <= Inf) will show has_upper_bound(x) == false. Previously, these bounds were passed through to the solvers which caused numerical issues for solvers expecting finite bounds.
  • The variable_type and constraint_type functions were removed. This should only affect users who previously wrote JuMP extensions. The functions can be deleted without consequence.
  • The internal functions moi_mode, moi_bridge_constraints, moi_add_constraint, and moi_add_to_function_constant are no longer exported.
  • The un-used method Containers.generate_container has been deleted.
  • The Containers API has been refactored, and _build_ref_sets is now public as Containers.build_ref_sets.
  • The parse_constraint_ methods for extending @constraint at parse time have been refactored in a breaking way. Consult the Extensions documentation for more details and examples.
  • Added

    • The TerminationStatusCode and ResultStatusCode enums are now exported by JuMP. Prefer termination_status(model) == OPTIMAL instead of == MOI.OPTIMAL, although the MOI. prefix way still works.
    • Copy a x::DenseAxisArray to an Array by calling Array(x).
    • NonlinearExpression is now a subtype of AbstractJuMPScalar
    • Constraints such as @constraint(model, x + 1 in MOI.Integer()) are now supported.
    • primal_feasibility_report now accepts a function as the first argument.
    • Scalar variables @variable(model, x[1:2] in MOI.Integer()) creates two variables, both of which are constrained to be in the set MOI.Integer.
    • Conic constraints can now be specified as inequalities under a different partial ordering. So @constraint(model, x - y in MOI.Nonnegatives()) can now be written as @constraint(model, x >= y, MOI.Nonnegatives()).
    • Names are now set for vectorized constraints.

    Fixed

    • Fixed a performance issue when show was called on a SparseAxisArray with a large number of elements.
    • Fixed a bug displaying barrier and simplex iterations in solution_summary.
    • Fixed a bug by implementing hash for DenseAxisArray and SparseAxisArray.
    • Names are now only set if the solver supports them. Previously, this prevented solvers such as Ipopt from being used with direct_model.
    • MutableArithmetics.Zero is converted into a 0.0 before being returned to the user. Previously, some calls to @expression would return the undocumented MutableArithmetics.Zero() object. One example is summing over an empty set @expression(model, sum(x[i] for i in 1:0)). You will now get 0.0 instead.
    • AffExpr and QuadExpr can now be used with == 0 instead of iszero. This fixes a number of issues relating to Julia standard libraries such as LinearAlgebra and SparseArrays.
    • Fixed a bug when registering a user-defined function with splatting.

    Other

    • The documentation is now available as a PDF.
    • The documentation now includes a full copy of the MathOptInterface documentation to make it easy to link concepts between the docs. (The MathOptInterface documentation has also been significantly improved.)
    • The documentation contains a large number of improvements and clarifications on a range of topics. Thanks to @sshin23, @DilumAluthge, and @jlwether.
    • The documentation is now built with Julia 1.6 instead of 1.0.
    • Various error messages have been improved to be more readable.

    Version 0.21.10 (September 4, 2021)

    Added

    • Added add_NL_expression
    • add_NL_xxx functions now support AffExpr and QuadExpr as terms

    Fixed

    • Fixed a bug in solution_summary
    • Fixed a bug in relax_integrality

    Other

    • Improved error message in lp_sensitivity_report

    Version 0.21.9 (August 1, 2021)

    Added

    • Containers now support arbitrary container types by passing the type to the container keyword and overloading Containers.container.
    • is_valid now supports nonlinear constraints
    • Added unsafe_backend for querying the inner-most optimizer of a JuMP model.
    • Nonlinear parameters now support the plural @NLparameters macro.
    • Containers (for example, DenseAxisArray) can now be used in vector-valued constraints.

    Other

    • Various improvements to the documentation.

    Version 0.21.8 (May 8, 2021)

    Added

    • The @constraint macro is now extendable in the same way as @variable.
    • AffExpr and QuadExpr can now be used in nonlinear macros.

    Fixed

    • Fixed a bug in lp_sensitivity_report.
    • Fixed an inference issue when creating empty SparseAxisArrays.

    Version 0.21.7 (April 12, 2021)

    Added

    • Added primal_feasibility_report, which can be used to check whether a primal point satisfies primal feasibility.
    • Added coefficient, which returns the coefficient associated with a variable in affine and quadratic expressions.
    • Added copy_conflict, which returns the IIS of an infeasible model.
    • Added solution_summary, which returns (and prints) a struct containing a summary of the solution.
    • Allow AbstractVector in vector constraints instead of just Vector.
    • Added latex_formulation(model) which returns an object representing the latex formulation of a model. Use print(latex_formulation(model)) to print the formulation as a string.
    • User-defined functions in nonlinear expressions are now automatically registered to aid quick model prototyping. However, a warning is printed to encourage the manual registration.
    • DenseAxisArray's now support broadcasting over multiple arrays.
    • Container indices can now be iterators of Base.SizeUnknown.

    Fixed

    • Fixed bug in rad2deg and deg2rad in nonlinear expressions.
    • Fixed a MethodError bug in Containers when forcing container type.
    • Allow partial slicing of a DenseAxisArray, resolving an issue from 2014.
    • Fixed a bug printing variable names in IJulia.
    • Ending an IJulia cell with model now prints a summary of the model (like in the REPL) not the latex formulation. Use print(model) to print the latex formulation.
    • Fixed a bug when copying models containing nested arrays.

    Other

    • Tutorials are now part of the documentation, and more refactoring has taken place.
    • Added JuliaFormatter added as a code formatter.
    • Added some precompilation statements to reduce initial latency.
    • Various improvements to error messages to make them more helpful.
    • Improved performance of value(::NonlinearExpression).
    • Improved performance of fix(::VariableRef).

    Version 0.21.6 (January 29, 2021)

    Added

    • Added support for skew symmetric variables via @variable(model, X[1:2, 1:2] in SkewSymmetricMatrixSpace()).
    • lp_sensitivity_report has been added which significantly improves the performance of querying the sensitivity summary of an LP. lp_objective_perturbation_range and lp_rhs_perturbation_range are deprecated.
    • Dual warm-starts are now supported with set_dual_start_value and dual_start_value.
    • (\in<tab>) can now be used in macros instead of = or in.
    • Use haskey(model::Model, key::Symbol) to check if a name key is registered in a model.
    • Added unregister(model::Model, key::Symbol) to unregister a name key from model.
    • Added callback_node_status for use in callbacks.
    • Added print_bridge_graph to visualize the bridging graph generated by MathOptInterface.
    • Improved error message for containers with duplicate indices.

    Fixed

    • Various fixes to pass tests on Julia 1.6.
    • Fixed a bug in the printing of nonlinear expressions in IJulia.
    • Fixed a bug when nonlinear expressions are passed to user-defined functions.
    • Some internal functions that were previously exported are now no longer exported.
    • Fixed a bug when relaxing a fixed binary variable.
    • Fixed a StackOverflowError that occurred when SparseAxisArrays had a large number of elements.
    • Removed an unnecessary type assertion in list_of_constraint_types.
    • Fixed a bug when copying models with registered expressions.

    Other

    • The documentation has been significantly overhauled. It now has distinct sections for the manual, API reference, and examples. The existing examples in /examples have now been moved to /docs/src/examples and rewritten using Literate.jl, and they are now included in the documentation.
    • JuliaFormatter has been applied to most of the codebase. This will continue to roll out over time, as we fix upstream issues in the formatter, and will eventually become compulsory.
    • The root cause of a large number of method invalidations has been resolved.
    • We switched continuous integration from Travis and Appveyor to GitHub Actions.

    Version 0.21.5 (September 18, 2020)

    Fixed

    • Fixed deprecation warnings
    • Throw DimensionMismatch for incompatibly sized functions and sets
    • Unify treatment of keys(x) on JuMP containers

    Version 0.21.4 (September 14, 2020)

    Added

    • Add debug info when adding unsupported constraints
    • Add relax_integrality for solving continuous relaxation
    • Allow querying constraint conflicts

    Fixed

    • Dispatch on Real for MOI.submit
    • Implement copy for CustomSet in tests
    • Don't export private macros
    • Fix invalid assertion in nonlinear
    • Error if constraint has NaN right-hand side
    • Improve speed of tests
    • Lots of work modularizing files in /test
    • Improve line numbers in macro error messages
    • Print nonlinear subexpressions
    • Various documentation updates
    • Dependency updates:
      • Datastructures 0.18
      • MathOptFormat v0.5
      • Prep for MathOptInterface 0.9.15

    Version 0.21.3 (June 18, 2020)

    • Added Special Order Sets (SOS1 and SOS2) to JuMP with default weights to ease the creation of such constraints (#2212).
    • Added functions simplex_iterations, barrier_iterations and node_count (#2201).
    • Added function reduced_cost (#2205).
    • Implemented callback_value for affine and quadratic expressions (#2231).
    • Support MutableArithmetics.Zero in objective and constraints (#2219).
    • Documentation improvements:
      • Mention tutorials in the docs (#2223).
      • Update COIN-OR links (#2242).
      • Explicit link to the documentation of MOI.FileFormats (#2253).
      • Typo fixes (#2261).
    • Containers improvements:
      • Fix Base.map for DenseAxisArray (#2235).
      • Throw BoundsError if number of indices is incorrect for DenseAxisArray and SparseAxisArray (#2240).
    • Extensibility improvements:
      • Implement a set_objective method fallback that redirects to set_objective_sense and set_objective_function (#2247).
      • Add parse_constraint method with arbitrary number of arguments (#2051).
      • Add parse_constraint_expr and parse_constraint_head (#2228).

    Version 0.21.2 (April 2, 2020)

    • Added relative_gap() to access MOI.RelativeGap() attribute (#2199).
    • Documentation fixes:
      • Added link to source for docstrings in the documentation (#2207).
      • Added docstring for @variables macro (#2216).
      • Typo fixes (#2177, #2184, #2182).
    • Implementation of methods for Base functions:
      • Implemented Base.empty! for JuMP.Model (#2198).
      • Implemented Base.conj for JuMP scalar types (#2209).

    Fixed

    • Fixed sum of expression with scalar product in macro (#2178).
    • Fixed writing of nonlinear models to MathOptFormat (#2181).
    • Fixed construction of empty SparseAxisArray (#2179).
    • Fixed constraint with zero function (#2188).

    Version 0.21.1 (Feb 18, 2020)

    • Improved the clarity of the with_optimizer deprecation warning.

    Version 0.21.0 (Feb 16, 2020)

    Breaking

    • Deprecated with_optimizer (#2090, #2084, #2141). You can replace with_optimizer by either nothing, optimizer_with_attributes or a closure:

      • replace with_optimizer(Ipopt.Optimizer) by Ipopt.Optimizer.
      • replace with_optimizer(Ipopt.Optimizer, max_cpu_time=60.0) by optimizer_with_attributes(Ipopt.Optimizer, "max_cpu_time" => 60.0).
      • replace with_optimizer(Gurobi.Optimizer, env) by () -> Gurobi.Optimizer(env).
      • replace with_optimizer(Gurobi.Optimizer, env, Presolve=0) by optimizer_with_attributes(() -> Gurobi.Optimizer(env), "Presolve" => 0).

      alternatively to optimizer_with_attributes, you can also set the attributes separately with set_optimizer_attribute.

    • Renamed set_parameter and set_parameters to set_optimizer_attribute and set_optimizer_attributes (#2150).

    • Broadcast should now be explicit inside macros. @SDconstraint(model, x >= 1) and @constraint(model, x + 1 in SecondOrderCone()) now throw an error instead of broadcasting 1 along the dimension of x (#2107).

    • @SDconstraint(model, x >= 0) is now equivalent to @constraint(model, x in PSDCone()) instead of @constraint(model, (x .- 0) in PSDCone()) (#2107).

    • The macros now create the containers with map instead of for loops, as a consequence, containers created by @expression can now have any element type and containers of constraint references now have concrete element types when possible. This fixes a long-standing issue where @expression could only be used to generate a collection of linear expressions. Now it works for quadratic expressions as well (#2070).

    • Calling deepcopy(::AbstractModel) now throws an error.

    • The constraint name is now printed in the model string (#2108).

    Added

    • Added support for solver-independent and solver-specific callbacks (#2101).
    • Added write_to_file and read_from_file, supported formats are CBF, LP, MathOptFormat, MPS and SDPA (#2114).
    • Added support for complementarity constraints (#2132).
    • Added support for indicator constraints (#2092).
    • Added support for querying multiple solutions with the result keyword (#2100).
    • Added support for constraining variables on creation (#2128).
    • Added method delete that deletes a vector of variables at once if it is supported by the underlying solver (#2135).
    • The arithmetic between JuMP expression has be refactored into the MutableArithmetics package (#2107).
    • Improved error on complex values in NLP (#1978).
    • Added an example of column generation (#2010).

    Fixed

    • Incorrect coefficients generated when using Symmetric variables (#2102)

    Version 0.20.1 (Oct 18, 2019)

    • Add sections on @variables and @constraints in the documentation (#2062).
    • Fixed product of sparse matrices for Julia v1.3 (#2063).
    • Added set_objective_coefficient to modify the coefficient of a linear term of the objective function (#2008).
    • Added set_time_limit_sec, unset_time_limit_sec and time_limit_sec to set and query the time limit for the solver in seconds (#2053).

    Version 0.20.0 (Aug 24, 2019)

    • Documentation updates.
    • Numerous bug fixes.
    • Better error messages (#1977, #1978, #1997, #2017).
    • Performance improvements (#1947, #2032).
    • Added LP sensitivity summary functions lp_objective_perturbation_range and lp_rhs_perturbation_range (#1917).
    • Added functions dual_objective_value, raw_status and set_parameter.
    • Added function set_objective_coefficient to modify the coefficient of a linear term of the objective (#2008).
    • Added functions set_normalized_rhs, normalized_rhs, and add_to_function_constant to modify and get the constant part of a constraint (#1935, #1960).
    • Added functions set_normalized_coefficient and normalized_coefficient to modify and get the coefficient of a linear term of a constraint (#1935, #1960).
    • Numerous other improvements in MOI 0.9, see the NEWS.md file of MOI for more details.

    Version 0.19.2 (June 8, 2019)

    • Fix a bug in derivatives that could arise in models with nested nonlinear subexpressions.

    Version 0.19.1 (May 12, 2019)

    • Usability and performance improvements.
    • Bug fixes.

    Version 0.19.0 (February 15, 2019)

    JuMP 0.19 contains significant breaking changes.

    Breaking

    • JuMP's abstraction layer for communicating with solvers changed from MathProgBase (MPB) to MathOptInterface (MOI). MOI addresses many longstanding design issues. (See @mlubin's slides from JuMP-dev 2018.) JuMP 0.19 is compatible only with solvers that have been updated for MOI. See the installation guide for a list of solvers that have and have not yet been updated.

    • Most solvers have been renamed to PackageName.Optimizer. For example, GurobiSolver() is now Gurobi.Optimizer.

    • Solvers are no longer added to a model via Model(solver = XXX(kwargs...)). Instead use Model(with_optimizer(XXX, kwargs...)). For example, Model(with_optimizer(Gurobi.Optimizer, OutputFlag=0)).

    • JuMP containers (for example, the objects returned by @variable) have been redesigned. Containers.SparseAxisArray replaces JuMPDict, JuMPArray was rewritten (inspired by AxisArrays) and renamed Containers.DenseAxisArray, and you can now request a container type with the container= keyword to the macros. See the corresponding documentation for more details.

    • The statuses returned by solvers have changed. See the possible status values here. The MOI statuses are much richer than the MPB statuses and can be used to distinguish between previously indistinguishable cases (for example, did the solver have a feasible solution when it stopped because of the time limit?).

    • Starting values are separate from result values. Use value to query the value of a variable in a solution. Use start_value and set_start_value to get and set an initial starting point provided to the solver. The solutions from previous solves are no longer automatically set as the starting points for the next solve.

    • The data structures for affine and quadratic expressions AffExpr and QuadExpr have changed. Internally, terms are stored in dictionaries instead of lists. Duplicate coefficients can no longer exist. Accessors and iteration methods have changed.

    • JuMPNLPEvaluator no longer includes the linear and quadratic parts of the model in the evaluation calls. These are now handled separately to allow NLP solvers that support various types of constraints.

    • JuMP solver-independent callbacks have been replaced by solver-specific callbacks. See your favorite solver for more details. (See the note below: No solver-specific callbacks are implemented yet.)

    • The norm() syntax is no longer recognized inside macros. Use the SecondOrderCone() set instead.

    • JuMP no longer performs automatic transformation between special quadratic forms and second-order cone constraints. Support for these constraint classes depends on the solver.

    • The symbols :Min and :Max are no longer used as optimization senses. Instead, JuMP uses the OptimizationSense enum from MathOptInterface. @objective(model, Max, ...), @objective(model, Min, ...), @NLobjective(model, Max, ...), and @objective(model, Min, ...) remain valid, but @objective(m, :Max, ...) is no longer accepted.

    • The sign conventions for duals has changed in some cases for consistency with conic duality (see the documentation). The shadow_price helper method returns duals with signs that match conventional LP interpretations of dual values as sensitivities of the objective value to relaxations of constraints.

    • @constraintref is no longer defined. Instead, create the appropriate container to hold constraint references manually. For example,

      constraints = Dict() # Optionally, specify types for improved performance.
       for i in 1:N
         constraints[i] = @constraint(model, ...)
      -end
    • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

    • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

    Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    +end
  • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

  • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

  • Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    diff --git a/previews/PR3838/should_i_use/index.html b/previews/PR3838/should_i_use/index.html index 958e7c98bbc..afcd9060425 100644 --- a/previews/PR3838/should_i_use/index.html +++ b/previews/PR3838/should_i_use/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Should you use JuMP?

    JuMP is an algebraic modeling language for mathematical optimization written in the Julia language.

    This page explains when you should consider using JuMP, and importantly, when you should not use JuMP.

    When should you use JuMP?

    You should use JuMP if you have a constrained optimization problem that is formulated using the language of mathematical programming, that is, the problem has:

    • a set of real- or complex-valued decision variables
    • a scalar- or vector-valued real objective function
    • a set of constraints.

    Key reasons to use JuMP include:

    • User friendliness
    • Solver independence
      • JuMP uses a generic solver-independent interface provided by the MathOptInterface package, making it easy to change between a number of open-source and commercial optimization software packages ("solvers"). The Supported solvers section contains a table of the currently supported solvers.
    • Ease of embedding
      • JuMP itself is written purely in Julia. Solvers are the only binary dependencies.
      • JuMP provides automatic installation of most solvers.
      • Because it is embedded in a general-purpose programming language, JuMP makes it easy to solve optimization problems as part of a larger workflow, for example, inside a simulation, behind a web server, or as a subproblem in a decomposition algorithm. As a trade-off, JuMP's syntax is constrained by the syntax and functionality available in Julia.
      • JuMP is MPL licensed, meaning that it can be embedded in commercial software that complies with the terms of the license.
    • Speed
      • Benchmarking has shown that JuMP can create problems at similar speeds to special-purpose modeling languages such as AMPL.
      • JuMP communicates with most solvers in memory, avoiding the need to write intermediary files.
    • Access to advanced algorithmic techniques
      • JuMP supports efficient in-memory re-solves of models.
      • JuMP provides access to solver-independent and solver-dependent Callbacks.

    When should you not use JuMP?

    JuMP supports a broad range of optimization classes. However, there are still some that it doesn't support, or that are better supported by other software packages.

    You want to optimize a complicated Julia function

    Packages in Julia compose well. It's common for people to pick two unrelated packages and use them in conjunction to create novel behavior. JuMP isn't one of those packages.

    If you want to optimize an ordinary differential equation from DifferentialEquations.jl or tune a neural network from Flux.jl, consider using other packages such as:

    Black-box, derivative free, or unconstrained optimization

    JuMP does support nonlinear programs with constraints and objectives containing user-defined operators. However, the functions must be automatically differentiable, or need to provide explicit derivatives. (See User-defined operators for more information.)

    If your function is a black-box that is non-differentiable (for example, it is the output of a simulation written in C++), JuMP is not the right tool for the job. This also applies if you want to use a derivative free method.

    Even if your problem is differentiable, if it is unconstrained there is limited benefit (and downsides in the form of more overhead) to using JuMP over tools which are only concerned with function minimization.

    Alternatives to consider are:

    Disciplined convex programming

    JuMP does not support disciplined convex programming (DCP).

    Alternatives to consider are:

    Note

    Convex.jl is also built on MathOptInterface, and shares the same set of underlying solvers. However, you input problems differently, and Convex.jl checks that the problem is DCP.

    Stochastic programming

    JuMP requires deterministic input data.

    If you have stochastic input data, consider using a JuMP extension such as:

    Polyhedral computations

    JuMP does not provide tools for working with the polyhedron formed by the set of linear constraints.

    Alternatives to consider are:

    +

    Should you use JuMP?

    JuMP is an algebraic modeling language for mathematical optimization written in the Julia language.

    This page explains when you should consider using JuMP, and importantly, when you should not use JuMP.

    When should you use JuMP?

    You should use JuMP if you have a constrained optimization problem that is formulated using the language of mathematical programming, that is, the problem has:

    • a set of real- or complex-valued decision variables
    • a scalar- or vector-valued real objective function
    • a set of constraints.

    Key reasons to use JuMP include:

    • User friendliness
    • Solver independence
      • JuMP uses a generic solver-independent interface provided by the MathOptInterface package, making it easy to change between a number of open-source and commercial optimization software packages ("solvers"). The Supported solvers section contains a table of the currently supported solvers.
    • Ease of embedding
      • JuMP itself is written purely in Julia. Solvers are the only binary dependencies.
      • JuMP provides automatic installation of most solvers.
      • Because it is embedded in a general-purpose programming language, JuMP makes it easy to solve optimization problems as part of a larger workflow, for example, inside a simulation, behind a web server, or as a subproblem in a decomposition algorithm. As a trade-off, JuMP's syntax is constrained by the syntax and functionality available in Julia.
      • JuMP is MPL licensed, meaning that it can be embedded in commercial software that complies with the terms of the license.
    • Speed
      • Benchmarking has shown that JuMP can create problems at similar speeds to special-purpose modeling languages such as AMPL.
      • JuMP communicates with most solvers in memory, avoiding the need to write intermediary files.
    • Access to advanced algorithmic techniques
      • JuMP supports efficient in-memory re-solves of models.
      • JuMP provides access to solver-independent and solver-dependent Callbacks.

    When should you not use JuMP?

    JuMP supports a broad range of optimization classes. However, there are still some that it doesn't support, or that are better supported by other software packages.

    You want to optimize a complicated Julia function

    Packages in Julia compose well. It's common for people to pick two unrelated packages and use them in conjunction to create novel behavior. JuMP isn't one of those packages.

    If you want to optimize an ordinary differential equation from DifferentialEquations.jl or tune a neural network from Flux.jl, consider using other packages such as:

    Black-box, derivative free, or unconstrained optimization

    JuMP does support nonlinear programs with constraints and objectives containing user-defined operators. However, the functions must be automatically differentiable, or need to provide explicit derivatives. (See User-defined operators for more information.)

    If your function is a black-box that is non-differentiable (for example, it is the output of a simulation written in C++), JuMP is not the right tool for the job. This also applies if you want to use a derivative free method.

    Even if your problem is differentiable, if it is unconstrained there is limited benefit (and downsides in the form of more overhead) to using JuMP over tools which are only concerned with function minimization.

    Alternatives to consider are:

    Disciplined convex programming

    JuMP does not support disciplined convex programming (DCP).

    Alternatives to consider are:

    Note

    Convex.jl is also built on MathOptInterface, and shares the same set of underlying solvers. However, you input problems differently, and Convex.jl checks that the problem is DCP.

    Stochastic programming

    JuMP requires deterministic input data.

    If you have stochastic input data, consider using a JuMP extension such as:

    Polyhedral computations

    JuMP does not provide tools for working with the polyhedron formed by the set of linear constraints.

    Alternatives to consider are:

    diff --git a/previews/PR3838/tutorials/algorithms/benders_decomposition/index.html b/previews/PR3838/tutorials/algorithms/benders_decomposition/index.html index 5e3324da468..c46243bb52c 100644 --- a/previews/PR3838/tutorials/algorithms/benders_decomposition/index.html +++ b/previews/PR3838/tutorials/algorithms/benders_decomposition/index.html @@ -65,7 +65,7 @@ Relative gap : 0.00000e+00 * Work counters - Solve time (sec) : 1.64509e-03 + Solve time (sec) : 1.79911e-03 Simplex iterations : 15 Barrier iterations : -1 Node count : 1 @@ -416,4 +416,4 @@ (3, 6) => 1.0 (4, 6) => 1.0 (5, 8) => 4.0 - (6, 8) => 2.0

    which is the same as the monolithic solution (because sum(y) >= 1 in the monolithic solution):

    feasible_inplace_solution == monolithic_solution
    true
    + (6, 8) => 2.0

    which is the same as the monolithic solution (because sum(y) >= 1 in the monolithic solution):

    feasible_inplace_solution == monolithic_solution
    true
    diff --git a/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/c05bc532.svg b/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/d6fec94f.svg similarity index 72% rename from previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/c05bc532.svg rename to previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/d6fec94f.svg index 254edb8818b..6b3ade286b5 100644 --- a/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/c05bc532.svg +++ b/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/d6fec94f.svg @@ -1,350 +1,350 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/5ee28c55.svg b/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/fed380b4.svg similarity index 69% rename from previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/5ee28c55.svg rename to previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/fed380b4.svg index 59d94bfcd3d..12ce6ae9eef 100644 --- a/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/5ee28c55.svg +++ b/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/fed380b4.svg @@ -1,516 +1,516 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/index.html b/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/index.html index eda24de63ec..a83e7beddbd 100644 --- a/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/index.html +++ b/previews/PR3838/tutorials/algorithms/cutting_stock_column_generation/index.html @@ -117,8 +117,8 @@ Relative gap : 2.87105e-01 * Work counters - Solve time (sec) : 5.06249e+00 - Simplex iterations : 20838 + Solve time (sec) : 5.28989e+00 + Simplex iterations : 21638 Barrier iterations : -1 Node count : 0

    However, there is a formulation that solves much faster, and that is to use a column generation scheme.

    Column generation theory

    The key insight for column generation is to recognize that feasible columns in the $x$ matrix of variables encode cutting patterns.

    For example, if we look only at the roll $j=1$, then a feasible solution is:

    • $x_{1,1} = 1$ (1 unit of piece #1)
    • $x_{13,1} = 1$ (1 unit of piece #13)
    • All other $x_{i,1} = 0$

    Another solution is

    • $x_{20,1} = 19$ (19 unit of piece #20)
    • All other $x_{i,1} = 0$

    Cutting patterns like $x_{1,1} = 1$ and $x_{2,1} = 1$ are infeasible because the combined length is greater than $W$.

    Since there are a finite number of ways that we could cut a roll into a valid cutting pattern, we could create a set of all possible cutting patterns $p = 1,\ldots,P$, with data $a_{i,p}$ indicating how many units of piece $i$ we cut in pattern $p$. Then, we can formulate our mixed-integer linear program as:

    \[\begin{align} @@ -188,7 +188,7 @@ return plot end -plot_patterns(data, patterns)Example block output

    The base problem

    Using the initial set of patterns, we can create and optimize our base model:

    model = Model(HiGHS.Optimizer)
    +plot_patterns(data, patterns)
    Example block output

    The base problem

    Using the initial set of patterns, we can create and optimize our base model:

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, x[1:length(patterns)] >= 0, Int)
     @objective(model, Min, sum(x))
    @@ -211,7 +211,7 @@
       Relative gap       : 0.00000e+00
     
     * Work counters
    -  Solve time (sec)   : 1.45912e-04
    +  Solve time (sec)   : 1.43766e-04
       Simplex iterations : 0
       Barrier iterations : -1
       Node count         : 0
    @@ -283,7 +283,7 @@
     [ Info: No new patterns, terminating the algorithm.

    We found lots of new patterns. Here's pattern 21:

    patterns[21]
    20-element SparseArrays.SparseVector{Int64, Int64} with 3 stored entries:
       [9 ]  =  1
       [13]  =  2
    -  [17]  =  1

    Let's have a look at the patterns now:

    plot_patterns(data, patterns)
    Example block output

    Looking at the solution

    Let's see how many of each column we need:

    solution = DataFrames.DataFrame([
    +  [17]  =  1

    Let's have a look at the patterns now:

    plot_patterns(data, patterns)
    Example block output

    Looking at the solution

    Let's see how many of each column we need:

    solution = DataFrames.DataFrame([
         (pattern = p, rolls = value(x_p)) for (p, x_p) in enumerate(x)
     ])
     filter!(row -> row.rolls > 0, solution)
    16×2 DataFrame
    Rowpatternrolls
    Int64Float64
    1138.0
    2244.0
    3330.0
    4210.5
    52210.2
    62314.65
    72423.1
    82511.25
    92621.35
    10284.3
    112919.55
    123011.25
    133117.45
    143336.0
    153411.4
    163541.0

    Since we solved a linear program, some of our columns have fractional solutions. We can create a integer feasible solution by rounding up the orders. This requires 341 rolls:

    sum(ceil.(Int, solution.rolls))
    341

    Alternatively, we can re-introduce the integrality constraints and resolve the problem:

    set_integer.(x)
    @@ -292,4 +292,4 @@
     solution = DataFrames.DataFrame([
         (pattern = p, rolls = value(x_p)) for (p, x_p) in enumerate(x)
     ])
    -filter!(row -> row.rolls > 0, solution)
    16×2 DataFrame
    Rowpatternrolls
    Int64Float64
    1138.0
    2244.0
    3330.0
    4211.0
    5229.0
    62319.0
    72419.0
    82513.0
    92617.0
    10282.0
    112919.0
    123013.0
    133118.0
    143336.0
    153415.0
    163541.0

    This now requires 334 rolls:

    sum(solution.rolls)
    333.99999999999994

    Note that this may not be the global minimum because we are not adding new columns during the solution of the mixed-integer problem model (an algorithm known as branch and price). Nevertheless, the column generation algorithm typically finds good integer feasible solutions to an otherwise intractable optimization problem.

    Next steps

    • Our objective function is to minimize the total number of rolls. What is the total length of waste? How does that compare to the total demand?
    • Writing the optimization algorithm is only part of the challenge. Can you develop a better way to communicate the solution to stakeholders?
    +filter!(row -> row.rolls > 0, solution)
    16×2 DataFrame
    Rowpatternrolls
    Int64Float64
    1138.0
    2244.0
    3330.0
    4211.0
    5229.0
    62319.0
    72419.0
    82513.0
    92617.0
    10282.0
    112919.0
    123013.0
    133118.0
    143336.0
    153415.0
    163541.0

    This now requires 334 rolls:

    sum(solution.rolls)
    333.99999999999994

    Note that this may not be the global minimum because we are not adding new columns during the solution of the mixed-integer problem model (an algorithm known as branch and price). Nevertheless, the column generation algorithm typically finds good integer feasible solutions to an otherwise intractable optimization problem.

    Next steps

    • Our objective function is to minimize the total number of rolls. What is the total length of waste? How does that compare to the total demand?
    • Writing the optimization algorithm is only part of the challenge. Can you develop a better way to communicate the solution to stakeholders?
    diff --git a/previews/PR3838/tutorials/algorithms/parallelism/index.html b/previews/PR3838/tutorials/algorithms/parallelism/index.html index a1af8fe80db..8c88bde982a 100644 --- a/previews/PR3838/tutorials/algorithms/parallelism/index.html +++ b/previews/PR3838/tutorials/algorithms/parallelism/index.html @@ -129,4 +129,4 @@ 7.0 8.0 9.0 - 10.0

    Other types of parallelism

    GPU

    JuMP does not support GPU programming, and few solvers support execution on a GPU.

    Parallelism within the solver

    Many solvers use parallelism internally. For example, commercial solvers like Gurobi and CPLEX both parallelize the search in branch-and-bound. Solvers supporting internal parallelism will typically support the MOI.NumberOfThreads attribute, which you can set using set_attribute.

    + 10.0

    Other types of parallelism

    GPU

    JuMP does not support GPU programming, and few solvers support execution on a GPU.

    Parallelism within the solver

    Many solvers use parallelism internally. For example, commercial solvers like Gurobi and CPLEX both parallelize the search in branch-and-bound. Solvers supporting internal parallelism will typically support the MOI.NumberOfThreads attribute, which you can set using set_attribute.

    diff --git a/previews/PR3838/tutorials/algorithms/rolling_horizon/b8e75c9a.svg b/previews/PR3838/tutorials/algorithms/rolling_horizon/01df96c0.svg similarity index 86% rename from previews/PR3838/tutorials/algorithms/rolling_horizon/b8e75c9a.svg rename to previews/PR3838/tutorials/algorithms/rolling_horizon/01df96c0.svg index 324b093776d..853d2d75ff5 100644 --- a/previews/PR3838/tutorials/algorithms/rolling_horizon/b8e75c9a.svg +++ b/previews/PR3838/tutorials/algorithms/rolling_horizon/01df96c0.svg @@ -1,118 +1,118 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/rolling_horizon/1ecba0be.svg b/previews/PR3838/tutorials/algorithms/rolling_horizon/8a899a70.svg similarity index 90% rename from previews/PR3838/tutorials/algorithms/rolling_horizon/1ecba0be.svg rename to previews/PR3838/tutorials/algorithms/rolling_horizon/8a899a70.svg index eb5c4227096..ccf161c258b 100644 --- a/previews/PR3838/tutorials/algorithms/rolling_horizon/1ecba0be.svg +++ b/previews/PR3838/tutorials/algorithms/rolling_horizon/8a899a70.svg @@ -1,80 +1,80 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/rolling_horizon/02449198.svg b/previews/PR3838/tutorials/algorithms/rolling_horizon/9596998d.svg similarity index 87% rename from previews/PR3838/tutorials/algorithms/rolling_horizon/02449198.svg rename to previews/PR3838/tutorials/algorithms/rolling_horizon/9596998d.svg index 80ce95e782a..da5bd1966de 100644 --- a/previews/PR3838/tutorials/algorithms/rolling_horizon/02449198.svg +++ b/previews/PR3838/tutorials/algorithms/rolling_horizon/9596998d.svg @@ -1,360 +1,360 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/rolling_horizon/index.html b/previews/PR3838/tutorials/algorithms/rolling_horizon/index.html index 847db33b359..390adf99f04 100644 --- a/previews/PR3838/tutorials/algorithms/rolling_horizon/index.html +++ b/previews/PR3838/tutorials/algorithms/rolling_horizon/index.html @@ -29,7 +29,7 @@ xticks = 0:12:total_time_length, xlabel = "Hours", ylabel = "MW", -)Example block output

    JuMP model

    We have all the information we need to create a JuMP model to solve a single window of our rolling horizon problem.

    As the optimizer, we use POI.Optimizer, which is part of ParametricOptInterface.jl. POI.Optimizer converts the Parameter decision variables into constants in the underlying optimization model, and it efficiently updates the solver in-place when we call set_parameter_value which avoids having to rebuild the problem each time we call optimize!.

    model = Model(() -> POI.Optimizer(HiGHS.Optimizer()))
    +)
    Example block output

    JuMP model

    We have all the information we need to create a JuMP model to solve a single window of our rolling horizon problem.

    As the optimizer, we use POI.Optimizer, which is part of ParametricOptInterface.jl. POI.Optimizer converts the Parameter decision variables into constants in the underlying optimization model, and it efficiently updates the solver in-place when we call set_parameter_value which avoids having to rebuild the problem each time we call optimize!.

    model = Model(() -> POI.Optimizer(HiGHS.Optimizer()))
     set_silent(model)
     @variables(model, begin
         0 <= r[1:optimization_window]
    @@ -118,4 +118,4 @@
         layout = (length(sol_windows), 1),
         size = (600, 800),
         margin = 3Plots.mm,
    -)
    Example block output

    We can re-use the function to plot the recovered solution of the full problem:

    plot_solution(sol_complete; offset = 0, xlabel = "Hour")
    Example block output

    Final remark

    ParametricOptInterface.jl offers an easy way to update the parameters of an optimization problem that will be solved several times, as in the rolling horizon implementation. It has the benefit of avoiding rebuilding the model each time we want to solve it with new information in a new window.

    +)Example block output

    We can re-use the function to plot the recovered solution of the full problem:

    plot_solution(sol_complete; offset = 0, xlabel = "Hour")
    Example block output

    Final remark

    ParametricOptInterface.jl offers an easy way to update the parameters of an optimization problem that will be solved several times, as in the rolling horizon implementation. It has the benefit of avoiding rebuilding the model each time we want to solve it with new information in a new window.

    diff --git a/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/272fb190.svg b/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/1e061ecf.svg similarity index 75% rename from previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/272fb190.svg rename to previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/1e061ecf.svg index dcf333c7d35..671291b7745 100644 --- a/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/272fb190.svg +++ b/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/1e061ecf.svg @@ -1,122 +1,122 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/62961f95.svg b/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/2c70a7be.svg similarity index 75% rename from previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/62961f95.svg rename to previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/2c70a7be.svg index 6a42fa181b9..f7d77cc5f1e 100644 --- a/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/62961f95.svg +++ b/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/2c70a7be.svg @@ -1,122 +1,122 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/index.html b/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/index.html index e8554be6be2..58f1fe6b1b8 100644 --- a/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/index.html +++ b/previews/PR3838/tutorials/algorithms/tsp_lazy_constraints/index.html @@ -61,7 +61,7 @@ global cycle = subtour(iterative_model[:x]) end -objective_value(iterative_model)
    525.7039004442727
    time_iterated
    0.028254270553588867

    As a quick sanity check, we visualize the optimal tour to verify that no subtour is present:

    function plot_tour(X, Y, x)
    +objective_value(iterative_model)
    525.7039004442727
    time_iterated
    0.027073383331298828

    As a quick sanity check, we visualize the optimal tour to verify that no subtour is present:

    function plot_tour(X, Y, x)
         plot = Plots.plot()
         for (i, j) in selected_edges(x, size(x, 1))
             Plots.plot!([X[i], X[j]], [Y[i], Y[j]]; legend = false)
    @@ -69,7 +69,7 @@
         return plot
     end
     
    -plot_tour(X, Y, value.(iterative_model[:x]))
    Example block output

    Lazy constraint method

    A more sophisticated approach makes use of lazy constraints. To be more precise, we do this through the subtour_elimination_callback() below, which is only run whenever we encounter a new integer-feasible solution.

    lazy_model = build_tsp_model(d, n)
    +plot_tour(X, Y, value.(iterative_model[:x]))
    Example block output

    Lazy constraint method

    A more sophisticated approach makes use of lazy constraints. To be more precise, we do this through the subtour_elimination_callback() below, which is only run whenever we encounter a new integer-feasible solution.

    lazy_model = build_tsp_model(d, n)
     function subtour_elimination_callback(cb_data)
         status = callback_node_status(cb_data, lazy_model)
         if status != MOI.CALLBACK_NODE_STATUS_INTEGER
    @@ -94,4 +94,4 @@
     )
     optimize!(lazy_model)
     @assert is_solved_and_feasible(lazy_model)
    -objective_value(lazy_model)
    525.7039004442727

    This finds the same optimal tour:

    plot_tour(X, Y, value.(lazy_model[:x]))
    Example block output

    Surprisingly, for this particular model with GLPK, the solution time is worse than the iterative method:

    time_lazy = solve_time(lazy_model)
    0.21987295150756836

    In most other cases and solvers, however, the lazy time should be faster than the iterative method.

    +objective_value(lazy_model)
    525.7039004442727

    This finds the same optimal tour:

    plot_tour(X, Y, value.(lazy_model[:x]))
    Example block output

    Surprisingly, for this particular model with GLPK, the solution time is worse than the iterative method:

    time_lazy = solve_time(lazy_model)
    0.20170307159423828

    In most other cases and solvers, however, the lazy time should be faster than the iterative method.

    diff --git a/previews/PR3838/tutorials/applications/optimal_power_flow/index.html b/previews/PR3838/tutorials/applications/optimal_power_flow/index.html index f28c8631a95..f63ceef35ff 100644 --- a/previews/PR3838/tutorials/applications/optimal_power_flow/index.html +++ b/previews/PR3838/tutorials/applications/optimal_power_flow/index.html @@ -129,7 +129,7 @@ Objective value : 3.08784e+03 * Work counters - Solve time (sec) : 5.40113e-03 + Solve time (sec) : 4.92096e-03 Barrier iterations : 16
    objval_solution = round(objective_value(model); digits = 2)
     println("Objective value (feasible solution) : $(objval_solution)")
    Objective value (feasible solution) : 3087.84

    The solution's power generation (in rectangular form) and complex voltage values (in polar form using degrees) are:

    DataFrames.DataFrame(;
    @@ -215,7 +215,7 @@
       9   1.5653e+03   1.5641e+03  7.67e-04  2.80e-08  3.75e-06  5.96e-03  1.74e-02  4.38e-01
     ---------------------------------------------------------------------------------------------
     Terminated with status = solved
    -solve time = 73.2ms
    Test.@test is_solved_and_feasible(model; allow_almost = true)
    +solve time = 68.9ms
    Test.@test is_solved_and_feasible(model; allow_almost = true)
     sdp_relaxation_lower_bound = round(objective_value(model); digits = 2)
     println(
         "Objective value (W & V relax. lower bound): $sdp_relaxation_lower_bound",
    @@ -232,4 +232,4 @@
         Bus = 1:N,
         Magnitude = round.(abs.(value.(V)); digits = 2),
         AngleDeg = round.(rad2deg.(angle.(value.(V))); digits = 2),
    -)
    9×3 DataFrame
    RowBusMagnitudeAngleDeg
    Int64Float64Float64
    110.95-0.0
    220.843.76
    330.832.66
    440.85-1.22
    550.86-2.12
    660.860.93
    770.86-0.18
    880.861.14
    990.85-2.47

    For further information on exploiting sparsity see (Jabr, 2012).

    This relaxation has the advantage that we can work directly with complex voltages to extend the formulation, strengthen the relaxation and gain additional approximate information about the voltage variables.

    +)
    9×3 DataFrame
    RowBusMagnitudeAngleDeg
    Int64Float64Float64
    110.95-0.0
    220.843.76
    330.832.66
    440.85-1.22
    550.86-2.12
    660.860.93
    770.86-0.18
    880.861.14
    990.85-2.47

    For further information on exploiting sparsity see (Jabr, 2012).

    This relaxation has the advantage that we can work directly with complex voltages to extend the formulation, strengthen the relaxation and gain additional approximate information about the voltage variables.

    diff --git a/previews/PR3838/tutorials/applications/power_systems/9237f030.svg b/previews/PR3838/tutorials/applications/power_systems/57e51ff9.svg similarity index 86% rename from previews/PR3838/tutorials/applications/power_systems/9237f030.svg rename to previews/PR3838/tutorials/applications/power_systems/57e51ff9.svg index dfd366eb2f6..ec0f078124c 100644 --- a/previews/PR3838/tutorials/applications/power_systems/9237f030.svg +++ b/previews/PR3838/tutorials/applications/power_systems/57e51ff9.svg @@ -1,78 +1,78 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/power_systems/6ea876e2.svg b/previews/PR3838/tutorials/applications/power_systems/5aeeb529.svg similarity index 85% rename from previews/PR3838/tutorials/applications/power_systems/6ea876e2.svg rename to previews/PR3838/tutorials/applications/power_systems/5aeeb529.svg index 8003042c89c..648185eeb90 100644 --- a/previews/PR3838/tutorials/applications/power_systems/6ea876e2.svg +++ b/previews/PR3838/tutorials/applications/power_systems/5aeeb529.svg @@ -1,43 +1,43 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/power_systems/31209046.svg b/previews/PR3838/tutorials/applications/power_systems/7d13bdd7.svg similarity index 86% rename from previews/PR3838/tutorials/applications/power_systems/31209046.svg rename to previews/PR3838/tutorials/applications/power_systems/7d13bdd7.svg index c0612ae70c5..be84d314322 100644 --- a/previews/PR3838/tutorials/applications/power_systems/31209046.svg +++ b/previews/PR3838/tutorials/applications/power_systems/7d13bdd7.svg @@ -1,80 +1,80 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/power_systems/index.html b/previews/PR3838/tutorials/applications/power_systems/index.html index c96427fbeda..3c88af5eec3 100644 --- a/previews/PR3838/tutorials/applications/power_systems/index.html +++ b/previews/PR3838/tutorials/applications/power_systems/index.html @@ -98,7 +98,7 @@ (c_g1_scale, sol.g[1], sol.g[2], sol.w, sol.wind_spill, sol.total_cost), ) end -print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.16277289390563965 seconds
    c_g_scale_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.0300.01000.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Modifying the JuMP model in-place

    Note that in the previous exercise we entirely rebuilt the optimization model at every iteration of the internal loop, which incurs an additional computational burden. This burden can be alleviated if instead of re-building the entire model, we modify the constraints or objective function, as it shown in the example below.

    Compare the computing time in case of the above and below models.

    function solve_economic_dispatch_inplace(
    +print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.16048288345336914 seconds
    c_g_scale_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.0300.01000.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Modifying the JuMP model in-place

    Note that in the previous exercise we entirely rebuilt the optimization model at every iteration of the internal loop, which incurs an additional computational burden. This burden can be alleviated if instead of re-building the entire model, we modify the constraints or objective function, as it shown in the example below.

    Compare the computing time in case of the above and below models.

    function solve_economic_dispatch_inplace(
         generators::Vector,
         wind,
         scenario,
    @@ -155,7 +155,7 @@
         scenario,
         0.5:0.1:3.0,
     )
    -print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.1481800079345703 seconds

    For small models, adjusting specific constraints or the objective function is sometimes faster and sometimes slower than re-building the entire model. However, as the problem size increases, updating the model in-place is usually faster.

    inplace_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.01000.0300.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Inefficient usage of wind generators

    The economic dispatch problem does not perform commitment decisions and, thus, assumes that all generators must be dispatched at least at their minimum power output limit. This approach is not cost efficient and may lead to absurd decisions. For example, if $d = \sum_{i \in I} g^{\min}_{i}$, the wind power injection must be zero, that is, all available wind generation is spilled, to meet the minimum power output constraints on generators.

    In the following example, we adjust the total demand and observed how it affects wind spillage.

    demand_scale_df = DataFrames.DataFrame(;
    +print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.13906407356262207 seconds

    For small models, adjusting specific constraints or the objective function is sometimes faster and sometimes slower than re-building the entire model. However, as the problem size increases, updating the model in-place is usually faster.

    inplace_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.01000.0300.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Inefficient usage of wind generators

    The economic dispatch problem does not perform commitment decisions and, thus, assumes that all generators must be dispatched at least at their minimum power output limit. This approach is not cost efficient and may lead to absurd decisions. For example, if $d = \sum_{i \in I} g^{\min}_{i}$, the wind power injection must be zero, that is, all available wind generation is spilled, to meet the minimum power output constraints on generators.

    In the following example, we adjust the total demand and observed how it affects wind spillage.

    demand_scale_df = DataFrames.DataFrame(;
         demand = Float64[],
         dispatch_G1 = Float64[],
         dispatch_G2 = Float64[],
    @@ -212,7 +212,7 @@
         ),
     )
     
    -Plots.plot(dispatch_plot, wind_plot)
    Example block output

    This particular drawback can be overcome by introducing binary decisions on the "on/off" status of generators. This model is called unit commitment and considered later in these notes.

    For further reading on the interplay between wind generation and the minimum power output constraints of generators, we refer interested readers to R. Baldick, "Wind and energy markets: a case study of Texas," IEEE Systems Journal, vol. 6, pp. 27-34, 2012.

    Unit commitment

    The Unit Commitment (UC) model can be obtained from ED model by introducing binary variable associated with each generator. This binary variable can attain two values: if it is "1," the generator is synchronized and, thus, can be dispatched, otherwise, that is, if the binary variable is "0," that generator is not synchronized and its power output is set to 0.

    To obtain the mathematical formulation of the UC model, we will modify the constraints of the ED model as follows:

    \[g^{\min}_{i} \cdot u_{t,i} \leq g_{i} \leq g^{\max}_{i} \cdot u_{t,i},\]

    where $u_{i} \in \{0,1\}.$ In this constraint, if $u_{i} = 0$, then $g_{i} = 0$. On the other hand, if $u_{i} = 1$, then $g^{min}_{i} \leq g_{i} \leq g^{max}_{i}$.

    For further reading on the UC problem we refer interested readers to G. Morales-Espana, J. M. Latorre, and A. Ramos, "Tight and Compact MILP Formulation for the Thermal Unit Commitment Problem," IEEE Transactions on Power Systems, vol. 28, pp. 4897-4908, 2013.

    In the following example we convert the ED model explained above to the UC model.

    function solve_unit_commitment(generators::Vector, wind, scenario)
    +Plots.plot(dispatch_plot, wind_plot)
    Example block output

    This particular drawback can be overcome by introducing binary decisions on the "on/off" status of generators. This model is called unit commitment and considered later in these notes.

    For further reading on the interplay between wind generation and the minimum power output constraints of generators, we refer interested readers to R. Baldick, "Wind and energy markets: a case study of Texas," IEEE Systems Journal, vol. 6, pp. 27-34, 2012.

    Unit commitment

    The Unit Commitment (UC) model can be obtained from ED model by introducing binary variable associated with each generator. This binary variable can attain two values: if it is "1," the generator is synchronized and, thus, can be dispatched, otherwise, that is, if the binary variable is "0," that generator is not synchronized and its power output is set to 0.

    To obtain the mathematical formulation of the UC model, we will modify the constraints of the ED model as follows:

    \[g^{\min}_{i} \cdot u_{t,i} \leq g_{i} \leq g^{\max}_{i} \cdot u_{t,i},\]

    where $u_{i} \in \{0,1\}.$ In this constraint, if $u_{i} = 0$, then $g_{i} = 0$. On the other hand, if $u_{i} = 1$, then $g^{min}_{i} \leq g_{i} \leq g^{max}_{i}$.

    For further reading on the UC problem we refer interested readers to G. Morales-Espana, J. M. Latorre, and A. Ramos, "Tight and Compact MILP Formulation for the Thermal Unit Commitment Problem," IEEE Transactions on Power Systems, vol. 28, pp. 4897-4908, 2013.

    In the following example we convert the ED model explained above to the UC model.

    function solve_unit_commitment(generators::Vector, wind, scenario)
         model = Model(HiGHS.Optimizer)
         set_silent(model)
         N = length(generators)
    @@ -325,7 +325,7 @@
         ),
     )
     
    -Plots.plot(commitment_plot, dispatch_plot)
    Example block output

    Nonlinear economic dispatch

    As a final example, we modify our economic dispatch problem in two ways:

    • The thermal cost function is user-defined
    • The output of the wind is only the square-root of the dispatch
    import Ipopt
    +Plots.plot(commitment_plot, dispatch_plot)
    Example block output

    Nonlinear economic dispatch

    As a final example, we modify our economic dispatch problem in two ways:

    • The thermal cost function is user-defined
    • The output of the wind is only the square-root of the dispatch
    import Ipopt
     
     """
         thermal_cost_function(g)
    @@ -395,4 +395,4 @@
         xlabel = "Cost",
         ylabel = "Dispatch [MW]",
         label = false,
    -)
    Example block output +)Example block output diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/0e110230.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/0e110230.svg new file mode 100644 index 00000000000..ab25f7886db --- /dev/null +++ b/previews/PR3838/tutorials/applications/two_stage_stochastic/0e110230.svg @@ -0,0 +1,99 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/1d9f60b6.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/1d9f60b6.svg deleted file mode 100644 index 12872654be5..00000000000 --- a/previews/PR3838/tutorials/applications/two_stage_stochastic/1d9f60b6.svg +++ /dev/null @@ -1,81 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/4f30c49c.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/4f30c49c.svg deleted file mode 100644 index ee8742e2585..00000000000 --- a/previews/PR3838/tutorials/applications/two_stage_stochastic/4f30c49c.svg +++ /dev/null @@ -1,96 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/72c39399.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/72c39399.svg new file mode 100644 index 00000000000..83d106ee405 --- /dev/null +++ b/previews/PR3838/tutorials/applications/two_stage_stochastic/72c39399.svg @@ -0,0 +1,76 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/76eaf3ec.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/76eaf3ec.svg deleted file mode 100644 index ae5d7932275..00000000000 --- a/previews/PR3838/tutorials/applications/two_stage_stochastic/76eaf3ec.svg +++ /dev/null @@ -1,85 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/808b7e5d.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/808b7e5d.svg new file mode 100644 index 00000000000..4142a1a08ed --- /dev/null +++ b/previews/PR3838/tutorials/applications/two_stage_stochastic/808b7e5d.svg @@ -0,0 +1,80 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/8e906d6f.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/8e906d6f.svg deleted file mode 100644 index bf541e878e0..00000000000 --- a/previews/PR3838/tutorials/applications/two_stage_stochastic/8e906d6f.svg +++ /dev/null @@ -1,116 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/b0e8dd41.svg b/previews/PR3838/tutorials/applications/two_stage_stochastic/b0e8dd41.svg new file mode 100644 index 00000000000..ca29b899b7b --- /dev/null +++ b/previews/PR3838/tutorials/applications/two_stage_stochastic/b0e8dd41.svg @@ -0,0 +1,108 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/applications/two_stage_stochastic/index.html b/previews/PR3838/tutorials/applications/two_stage_stochastic/index.html index 05fb1387274..e0a955fdb4b 100644 --- a/previews/PR3838/tutorials/applications/two_stage_stochastic/index.html +++ b/previews/PR3838/tutorials/applications/two_stage_stochastic/index.html @@ -18,7 +18,7 @@ d = sort!(rand(D, N)); Ω = 1:N P = fill(1 / N, N); -StatsPlots.histogram(d; bins = 20, label = "", xlabel = "Demand")Example block output

    JuMP model

    The implementation of our two-stage stochastic program in JuMP is:

    model = Model(HiGHS.Optimizer)
    +StatsPlots.histogram(d; bins = 20, label = "", xlabel = "Demand")
    Example block output

    JuMP model

    The implementation of our two-stage stochastic program in JuMP is:

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, x >= 0)
     @variable(model, 0 <= y[ω in Ω] <= d[ω])
    @@ -38,37 +38,37 @@
     * Candidate solution (result #1)
       Primal status      : FEASIBLE_POINT
       Dual status        : FEASIBLE_POINT
    -  Objective value    : 5.43360e+02
    -  Objective bound    : 5.43360e+02
    +  Objective value    : 5.52791e+02
    +  Objective bound    : 5.52791e+02
       Relative gap       : Inf
    -  Dual objective value : 5.43360e+02
    +  Dual objective value : 5.52791e+02
     
     * Work counters
    -  Solve time (sec)   : 3.85523e-04
    +  Solve time (sec)   : 3.59774e-04
       Simplex iterations : 42
       Barrier iterations : 0
       Node count         : -1
    -

    The optimal number of pies to make is:

    value(x)
    200.1410144043135

    The distribution of total profit is:

    total_profit = [-2 * value(x) + value(z[ω]) for ω in Ω]
    100-element Vector{Float64}:
    - 373.1479165903481
    - 379.4717644872805
    - 380.67708179225457
    - 395.38589801710094
    - 402.3087061030856
    - 407.63177430232537
    - 412.9429522672114
    - 416.6563976872223
    - 419.2123656657246
    - 420.7639425452771
    +

    The optimal number of pies to make is:

    value(x)
    200.57675843199794

    The distribution of total profit is:

    total_profit = [-2 * value(x) + value(z[ω]) for ω in Ω]
    100-element Vector{Float64}:
    + 386.8975647850469
    + 390.79140079100733
    + 407.75180996002933
    + 412.46737290686
    + 413.7535003580228
    + 430.6073496681266
    + 437.9896289395744
    + 442.2213226154984
    + 448.1470076851768
    + 452.8753994510361
        ⋮
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405
    - 600.4230432129405

    Let's plot it:

    """
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938
    + 601.7302752959938

    Let's plot it:

    """
         bin_distribution(x::Vector{Float64}, N::Int)
     
     A helper function that discretizes `x` into bins of width `N`.
    @@ -89,7 +89,7 @@
         label = "Expected profit (\$$(round(Int, μ)))",
         linewidth = 3,
     )
    -plot
    Example block output

    Risk measures

    A risk measure is a function which maps a random variable to a real number. Common risk measures include the mean (expectation), median, mode, and maximum. We need a risk measure to convert the distribution of second stage costs into a single number that can be optimized.

    Our model currently uses the expectation risk measure, but others are possible too. One popular risk measure is the conditional value at risk (CVaR).

    CVaR has a parameter $\gamma$, and it computes the expectation of the worst $\gamma$ fraction of outcomes.

    If we are maximizing, so that small outcomes are bad, the definition of CVaR is:

    \[CVaR_{\gamma}[Z] = \max\limits_{\xi} \;\; \xi - \frac{1}{\gamma}\mathbb{E}_\omega\left[(\xi - Z)_+\right]\]

    which can be formulated as the linear program:

    \[\begin{aligned} +plotExample block output

    Risk measures

    A risk measure is a function which maps a random variable to a real number. Common risk measures include the mean (expectation), median, mode, and maximum. We need a risk measure to convert the distribution of second stage costs into a single number that can be optimized.

    Our model currently uses the expectation risk measure, but others are possible too. One popular risk measure is the conditional value at risk (CVaR).

    CVaR has a parameter $\gamma$, and it computes the expectation of the worst $\gamma$ fraction of outcomes.

    If we are maximizing, so that small outcomes are bad, the definition of CVaR is:

    \[CVaR_{\gamma}[Z] = \max\limits_{\xi} \;\; \xi - \frac{1}{\gamma}\mathbb{E}_\omega\left[(\xi - Z)_+\right]\]

    which can be formulated as the linear program:

    \[\begin{aligned} CVaR_{\gamma}[Z] = \max\limits_{\xi, z_\omega} \;\; & \xi - \frac{1}{\gamma}\sum P_\omega z_\omega\\ & z_\omega \ge \xi - Z_\omega & \quad \forall \omega \\ & z_\omega \ge 0 & \quad \forall \omega. @@ -105,7 +105,7 @@ optimize!(model) @assert is_solved_and_feasible(model) return objective_value(model) -end

    CVaR (generic function with 1 method)

    When γ is 1.0, we compute the mean of the profit:

    cvar_10 = CVaR(total_profit, P; γ = 1.0)
    543.3598730215334
    Statistics.mean(total_profit)
    543.3598730215333

    As γ approaches 0.0, we compute the worst-case (minimum) profit:

    cvar_00 = CVaR(total_profit, P; γ = 0.0001)
    373.1479165903481
    minimum(total_profit)
    373.1479165903481

    By varying γ between 0 and 1 we can compute some trade-off of these two extremes:

    cvar_05 = CVaR(total_profit, P; γ = 0.5)
    488.026514531157

    Let's plot these outcomes on our distribution:

    plot = StatsPlots.histogram(
    +end
    CVaR (generic function with 1 method)

    When γ is 1.0, we compute the mean of the profit:

    cvar_10 = CVaR(total_profit, P; γ = 1.0)
    552.7914766214402
    Statistics.mean(total_profit)
    552.7914766214406

    As γ approaches 0.0, we compute the worst-case (minimum) profit:

    cvar_00 = CVaR(total_profit, P; γ = 0.0001)
    386.8975647850469
    minimum(total_profit)
    386.8975647850469

    By varying γ between 0 and 1 we can compute some trade-off of these two extremes:

    cvar_05 = CVaR(total_profit, P; γ = 0.5)
    505.5507275523217

    Let's plot these outcomes on our distribution:

    plot = StatsPlots.histogram(
         total_profit;
         bins = bin_distribution(total_profit, 25),
         label = "",
    @@ -118,7 +118,7 @@
         label = ["γ = 1.0" "γ = 0.5" "γ = 0.0"],
         linewidth = 3,
     )
    -plot
    Example block output

    Risk averse sample average approximation

    Because CVaR can be formulated as a linear program, we can form a risk averse sample average approximation model by combining the two formulations:

    γ = 0.4
    +plot
    Example block output

    Risk averse sample average approximation

    Because CVaR can be formulated as a linear program, we can form a risk averse sample average approximation model by combining the two formulations:

    γ = 0.4
     model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, x >= 0)
    @@ -130,7 +130,7 @@
     @constraint(model, [ω in Ω], z[ω] >= ξ - Z[ω])
     @objective(model, Max, -2x + ξ - 1 / γ * sum(P[ω] * z[ω] for ω in Ω))
     optimize!(model)
    -@assert is_solved_and_feasible(model)

    When $\gamma = 0.4$, the optimal number of pies to bake is:

    value(x)
    180.0814448207134

    The distribution of total profit is:

    risk_averse_total_profit = [value(-2x + Z[ω]) for ω in Ω]
    +@assert is_solved_and_feasible(model)

    When $\gamma = 0.4$, the optimal number of pies to bake is:

    value(x)
    182.042526073742

    The distribution of total profit is:

    risk_averse_total_profit = [value(-2x + Z[ω]) for ω in Ω]
     bins = bin_distribution([total_profit; risk_averse_total_profit], 25)
     plot = StatsPlots.histogram(total_profit; label = "Expectation", bins = bins)
     StatsPlots.histogram!(
    @@ -140,4 +140,4 @@
         bins = bins,
         alpha = 0.5,
     )
    -plot
    Example block output

    Next steps

    • Try solving this problem for different numbers of samples and different distributions.
    • Refactor the example to avoid hard-coding the costs. What happens to the solution if the cost of disposing unsold pies increases?
    • Plot the optimal number of pies to make for different values of the risk aversion parameter $\gamma$. What is the relationship?
    +plotExample block output

    Next steps

    • Try solving this problem for different numbers of samples and different distributions.
    • Refactor the example to avoid hard-coding the costs. What happens to the solution if the cost of disposing unsold pies increases?
    • Plot the optimal number of pies to make for different values of the risk aversion parameter $\gamma$. What is the relationship?
    diff --git a/previews/PR3838/tutorials/applications/web_app/index.html b/previews/PR3838/tutorials/applications/web_app/index.html index 14853ed8532..63bb31a4731 100644 --- a/previews/PR3838/tutorials/applications/web_app/index.html +++ b/previews/PR3838/tutorials/applications/web_app/index.html @@ -88,4 +88,4 @@ "status" => "failure" "reason" => "missing lower_bound param"

    If we don't send a lower_bound that is a number, we get:

    send_request(Dict("lower_bound" => "1.2"))
    Dict{String, Any} with 2 entries:
       "status" => "failure"
    -  "reason" => "lower_bound is not a number"

    Finally, we can shutdown our HTTP server:

    close(server)
    [ Info: Server on 127.0.0.1:8080 closing

    Next steps

    For more complicated examples relating to HTTP servers, consult the HTTP.jl documentation.

    To see how you can integrate this with a larger JuMP model, read Design patterns for larger models.

    + "reason" => "lower_bound is not a number"

    Finally, we can shutdown our HTTP server:

    close(server)
    [ Info: Server on 127.0.0.1:8080 closing

    Next steps

    For more complicated examples relating to HTTP servers, consult the HTTP.jl documentation.

    To see how you can integrate this with a larger JuMP model, read Design patterns for larger models.

    diff --git a/previews/PR3838/tutorials/conic/arbitrary_precision/index.html b/previews/PR3838/tutorials/conic/arbitrary_precision/index.html index 0809fc572b8..2f07ca0659b 100644 --- a/previews/PR3838/tutorials/conic/arbitrary_precision/index.html +++ b/previews/PR3838/tutorials/conic/arbitrary_precision/index.html @@ -37,7 +37,7 @@ Dual objective value : -6.42857e-01 * Work counters - Solve time (sec) : 1.82988e-03 + Solve time (sec) : 1.82098e-03 Barrier iterations : 5

    The value of each decision variable is a BigFloat:

    value.(x)
    2-element Vector{BigFloat}:
      0.4285714246558161076147072906813123533593766450416896337912086518811186790735189
    @@ -82,4 +82,4 @@
     * Work counters
     

    The optimal values are given in exact rational arithmetic:

    value.(x)
    2-element Vector{Rational{BigInt}}:
      1//6
    - 2//3
    objective_value(model)
    5//6
    value(c2)
    13//6
    + 2//3
    objective_value(model)
    5//6
    value(c2)
    13//6
    diff --git a/previews/PR3838/tutorials/conic/dualization/index.html b/previews/PR3838/tutorials/conic/dualization/index.html index 01204c8148a..bd435a67a8c 100644 --- a/previews/PR3838/tutorials/conic/dualization/index.html +++ b/previews/PR3838/tutorials/conic/dualization/index.html @@ -53,12 +53,12 @@ ------------------------------------------------------------------ iter | pri res | dua res | gap | obj | scale | time (s) ------------------------------------------------------------------ - 0| 1.65e+01 1.60e-01 5.09e+01 -2.91e+01 1.00e-01 1.34e-04 - 50| 1.74e-08 2.70e-10 4.88e-08 -4.00e+00 1.00e-01 2.09e-04 + 0| 1.65e+01 1.60e-01 5.09e+01 -2.91e+01 1.00e-01 1.27e-04 + 50| 1.74e-08 2.70e-10 4.88e-08 -4.00e+00 1.00e-01 2.02e-04 ------------------------------------------------------------------ status: solved -timings: total: 2.10e-04s = setup: 4.47e-05s + solve: 1.65e-04s - lin-sys: 1.04e-05s, cones: 5.66e-05s, accel: 2.79e-06s +timings: total: 2.03e-04s = setup: 4.24e-05s + solve: 1.61e-04s + lin-sys: 1.03e-05s, cones: 5.65e-05s, accel: 2.71e-06s ------------------------------------------------------------------ objective = -4.000000 ------------------------------------------------------------------

    (There are five rows in the constraint matrix because SCS expects problems in geometric conic form, and so JuMP has reformulated the X, PSD variable constraint into the affine constraint X .+ 0 in PSDCone().)

    The solution we obtain is:

    value.(X)
    2×2 Matrix{Float64}:
    @@ -83,12 +83,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  1.22e-04
    -    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  2.01e-04
    +     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  1.20e-04
    +    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  1.99e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 2.02e-04s = setup: 4.46e-05s + solve: 1.57e-04s
    -	 lin-sys: 9.09e-06s, cones: 5.78e-05s, accel: 2.67e-06s
    +timings: total: 2.00e-04s = setup: 4.10e-05s + solve: 1.59e-04s
    +	 lin-sys: 8.95e-06s, cones: 5.63e-05s, accel: 2.73e-06s
     ------------------------------------------------------------------
     objective = 4.000000
     ------------------------------------------------------------------

    and the solution we obtain is:

    dual.(dual_c)
    2×2 Matrix{Float64}:
    @@ -113,12 +113,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  1.32e-04
    -    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  2.15e-04
    +     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  9.56e-05
    +    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  1.75e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 2.16e-04s = setup: 4.49e-05s + solve: 1.71e-04s
    -	 lin-sys: 8.99e-06s, cones: 5.90e-05s, accel: 2.74e-06s
    +timings: total: 1.76e-04s = setup: 4.00e-05s + solve: 1.36e-04s
    +	 lin-sys: 8.86e-06s, cones: 5.80e-05s, accel: 2.84e-06s
     ------------------------------------------------------------------
     objective = 4.000000
     ------------------------------------------------------------------

    The performance is the same as if we solved model_dual, and the correct solution is returned to X:

    value.(X)
    2×2 Matrix{Float64}:
    @@ -144,12 +144,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.65e+01  1.60e-01  5.09e+01 -2.91e+01  1.00e-01  1.34e-04
    -    50| 1.74e-08  2.70e-10  4.88e-08 -4.00e+00  1.00e-01  2.13e-04
    +     0| 1.65e+01  1.60e-01  5.09e+01 -2.91e+01  1.00e-01  1.11e-04
    +    50| 1.74e-08  2.70e-10  4.88e-08 -4.00e+00  1.00e-01  1.86e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 2.14e-04s = setup: 4.60e-05s + solve: 1.68e-04s
    -	 lin-sys: 1.08e-05s, cones: 5.90e-05s, accel: 2.67e-06s
    +timings: total: 1.87e-04s = setup: 3.96e-05s + solve: 1.47e-04s
    +	 lin-sys: 1.03e-05s, cones: 5.47e-05s, accel: 2.71e-06s
     ------------------------------------------------------------------
     objective = -4.000000
     ------------------------------------------------------------------
    dual.(dual_c)
    2×2 Matrix{Float64}:
    @@ -185,12 +185,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 4.73e+00  1.00e+00  2.92e+00  1.23e+00  1.00e-01  1.71e-04
    -   150| 1.01e-04  3.07e-05  6.08e-05  1.33e+00  1.00e-01  7.29e-04
    +     0| 4.73e+00  1.00e+00  2.92e+00  1.23e+00  1.00e-01  1.51e-04
    +   150| 1.01e-04  3.07e-05  6.08e-05  1.33e+00  1.00e-01  7.28e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 7.31e-04s = setup: 7.37e-05s + solve: 6.57e-04s
    -	 lin-sys: 9.57e-05s, cones: 3.80e-04s, accel: 3.79e-05s
    +timings: total: 7.29e-04s = setup: 6.32e-05s + solve: 6.66e-04s
    +	 lin-sys: 9.42e-05s, cones: 3.99e-04s, accel: 3.69e-05s
     ------------------------------------------------------------------
     objective = 1.333363
     ------------------------------------------------------------------
    set_optimizer(model, Dualization.dual_optimizer(SCS.Optimizer))
    @@ -212,12 +212,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 3.71e+01  1.48e+00  2.23e+02 -1.13e+02  1.00e-01  1.05e-04
    -   150| 1.57e-04  2.28e-05  2.08e-04 -1.33e+00  1.00e-01  6.86e-04
    +     0| 3.71e+01  1.48e+00  2.23e+02 -1.13e+02  1.00e-01  9.17e-05
    +   150| 1.57e-04  2.28e-05  2.08e-04 -1.33e+00  1.00e-01  6.70e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 6.87e-04s = setup: 7.77e-05s + solve: 6.10e-04s
    -	 lin-sys: 9.76e-05s, cones: 4.08e-04s, accel: 2.27e-05s
    +timings: total: 6.71e-04s = setup: 6.79e-05s + solve: 6.03e-04s
    +	 lin-sys: 9.87e-05s, cones: 4.02e-04s, accel: 2.17e-05s
     ------------------------------------------------------------------
     objective = -1.333460
    -------------------------------------------------------------------

    For this problem, SCS reports that the primal has variables n: 11, constraints m: 24 and that the dual has variables n: 14, constraints m: 24. Therefore, we should probably use the primal formulation because it has fewer variables and the same number of constraints.

    When to use dual_optimizer

    Because it can make the problem larger or smaller, depending on the problem and the choice of solver, there is no definitive rule on when you should use dual_optimizer. However, you should try dual_optimizer if your conic optimization problem takes a long time to solve, or if you need to repeatedly solve similarly structured problems with different data. In some cases solving the dual instead of the primal can make a large difference.

    +------------------------------------------------------------------

    For this problem, SCS reports that the primal has variables n: 11, constraints m: 24 and that the dual has variables n: 14, constraints m: 24. Therefore, we should probably use the primal formulation because it has fewer variables and the same number of constraints.

    When to use dual_optimizer

    Because it can make the problem larger or smaller, depending on the problem and the choice of solver, there is no definitive rule on when you should use dual_optimizer. However, you should try dual_optimizer if your conic optimization problem takes a long time to solve, or if you need to repeatedly solve similarly structured problems with different data. In some cases solving the dual instead of the primal can make a large difference.

    diff --git a/previews/PR3838/tutorials/conic/ellipse_approx/695e189e.svg b/previews/PR3838/tutorials/conic/ellipse_approx/48ec82be.svg similarity index 57% rename from previews/PR3838/tutorials/conic/ellipse_approx/695e189e.svg rename to previews/PR3838/tutorials/conic/ellipse_approx/48ec82be.svg index 3028b0d888b..1ea382f08ce 100644 --- a/previews/PR3838/tutorials/conic/ellipse_approx/695e189e.svg +++ b/previews/PR3838/tutorials/conic/ellipse_approx/48ec82be.svg @@ -1,2450 +1,2450 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/conic/ellipse_approx/ed5982a2.svg b/previews/PR3838/tutorials/conic/ellipse_approx/b4c90619.svg similarity index 58% rename from previews/PR3838/tutorials/conic/ellipse_approx/ed5982a2.svg rename to previews/PR3838/tutorials/conic/ellipse_approx/b4c90619.svg index 9a8f0a7bf09..bf8d794bf99 100644 --- a/previews/PR3838/tutorials/conic/ellipse_approx/ed5982a2.svg +++ b/previews/PR3838/tutorials/conic/ellipse_approx/b4c90619.svg @@ -1,2451 +1,2451 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/conic/ellipse_approx/index.html b/previews/PR3838/tutorials/conic/ellipse_approx/index.html index 69f820c2a46..3b57609d813 100644 --- a/previews/PR3838/tutorials/conic/ellipse_approx/index.html +++ b/previews/PR3838/tutorials/conic/ellipse_approx/index.html @@ -36,7 +36,7 @@ c = :green, shape = :x, size = (600, 600), -)Example block output

    JuMP formulation

    Now let's build and the JuMP model. We'll compute $D$ and $c$ after the solve.

    model = Model(SCS.Optimizer)
    +)
    Example block output

    JuMP formulation

    Now let's build and the JuMP model. We'll compute $D$ and $c$ after the solve.

    model = Model(SCS.Optimizer)
     # We need to use a tighter tolerance for this example, otherwise the bounding
     # ellipse won't actually be bounding...
     set_attribute(model, "eps_rel", 1e-6)
    @@ -71,7 +71,7 @@
       Dual objective value : 4.47966e-03
     
     * Work counters
    -  Solve time (sec)   : 7.29894e-01
    +  Solve time (sec)   : 7.62289e-01
     

    Results

    After solving the model to optimality we can recover the solution in terms of $D$ and $c$:

    D = value.(Z)
    2×2 Matrix{Float64}:
       0.00707822  -0.0102173
      -0.0102173    0.0175624
    c = D \ value.(z)
    2-element Vector{Float64}:
    @@ -79,7 +79,7 @@
      -1.8428256866067543

    Finally, overlaying the solution in the plot we see the minimal volume approximating ellipsoid:

    P = sqrt(D)
     q = -P * c
     data = [tuple(P \ [cos(θ) - q[1], sin(θ) - q[2]]...) for θ in 0:0.05:(2pi+0.05)]
    -Plots.plot!(plot, data; c = :crimson, label = nothing)
    Example block output

    Alternative formulations

    The formulation of model uses MOI.RootDetConeSquare. However, because SCS does not natively support this cone, JuMP automatically reformulates the problem into an equivalent problem that SCS does support. You can see the reformulation that JuMP chose using print_active_bridges:

    print_active_bridges(model)
     * Unsupported objective: MOI.VariableIndex
    +Plots.plot!(plot, data; c = :crimson, label = nothing)
    Example block output

    Alternative formulations

    The formulation of model uses MOI.RootDetConeSquare. However, because SCS does not natively support this cone, JuMP automatically reformulates the problem into an equivalent problem that SCS does support. You can see the reformulation that JuMP chose using print_active_bridges:

    print_active_bridges(model)
     * Unsupported objective: MOI.VariableIndex
      |  bridged by:
      |   MOIB.Objective.FunctionConversionBridge{Float64, MOI.ScalarAffineFunction{Float64}, MOI.VariableIndex}
      |  may introduce:
    @@ -259,7 +259,7 @@
     @objective(model, Max, 1 * t + 0)
     optimize!(model)
     Test.@test is_solved_and_feasible(model)
    -solve_time_1 = solve_time(model)
    0.785296383

    This formulation gives the much smaller graph:

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
    +solve_time_1 = solve_time(model)
    0.7753247590000001

    This formulation gives the much smaller graph:

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
      * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      * Unsupported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.PositiveSemidefiniteConeTriangle
      |  bridged by:
    @@ -298,7 +298,7 @@
      |   |   |   |   * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      |   * Supported variable: MOI.Reals

    The last bullet shows how JuMP reformulated the MOI.RootDetConeTriangle constraint by adding a mix of MOI.PositiveSemidefiniteConeTriangle and MOI.GeometricMeanCone constraints.

    Because SCS doesn't natively support the MOI.GeometricMeanCone, these constraints were further bridged using a MOI.Bridges.Constraint.GeoMeanToPowerBridge to a series of MOI.PowerCone constraints.

    However, there are many other ways that a MOI.GeometricMeanCone can be reformulated into something that SCS supports. Let's see what happens if we use remove_bridge to remove the MOI.Bridges.Constraint.GeoMeanToPowerBridge:

    remove_bridge(model, MOI.Bridges.Constraint.GeoMeanToPowerBridge)
     optimize!(model)
    -Test.@test is_solved_and_feasible(model)
    Test Passed

    This time, the solve took:

    solve_time_2 = solve_time(model)
    0.44538185199999997

    where previously it took

    solve_time_1
    0.785296383

    Why was the solve time different?

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
    +Test.@test is_solved_and_feasible(model)
    Test Passed

    This time, the solve took:

    solve_time_2 = solve_time(model)
    0.43312649100000006

    where previously it took

    solve_time_1
    0.7753247590000001

    Why was the solve time different?

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
      * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      * Unsupported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.PositiveSemidefiniteConeTriangle
      |  bridged by:
    @@ -342,4 +342,4 @@
      |   |   |   * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.SecondOrderCone
      |   |   * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      |   |   * Supported variable: MOI.Reals
    - |   * Supported variable: MOI.Reals

    This time, JuMP used a MOI.Bridges.Constraint.GeoMeanBridge to reformulate the constraint into a set of MOI.RotatedSecondOrderCone constraints, which were further reformulated into a set of supported MOI.SecondOrderCone constraints.

    Since the two models are equivalent, we can conclude that for this particular model, the MOI.SecondOrderCone formulation is more efficient.

    In general though, the performance of a particular reformulation is problem- and solver-specific. Therefore, JuMP chooses to minimize the number of bridges in the default reformulation, leaving you to explore alternative formulations using the tools and techniques shown in this tutorial.

    + | * Supported variable: MOI.Reals

    This time, JuMP used a MOI.Bridges.Constraint.GeoMeanBridge to reformulate the constraint into a set of MOI.RotatedSecondOrderCone constraints, which were further reformulated into a set of supported MOI.SecondOrderCone constraints.

    Since the two models are equivalent, we can conclude that for this particular model, the MOI.SecondOrderCone formulation is more efficient.

    In general though, the performance of a particular reformulation is problem- and solver-specific. Therefore, JuMP chooses to minimize the number of bridges in the default reformulation, leaving you to explore alternative formulations using the tools and techniques shown in this tutorial.

    diff --git a/previews/PR3838/tutorials/conic/experiment_design/index.html b/previews/PR3838/tutorials/conic/experiment_design/index.html index 74595799938..5dc3388d2e2 100644 --- a/previews/PR3838/tutorials/conic/experiment_design/index.html +++ b/previews/PR3838/tutorials/conic/experiment_design/index.html @@ -99,4 +99,4 @@ 2.9157806299837166 2.67337566459234 2.735395012219622 - 0.3378388086258122 + 0.3378388086258122 diff --git a/previews/PR3838/tutorials/conic/introduction/index.html b/previews/PR3838/tutorials/conic/introduction/index.html index 955d33fa53a..5e4c603be3f 100644 --- a/previews/PR3838/tutorials/conic/introduction/index.html +++ b/previews/PR3838/tutorials/conic/introduction/index.html @@ -6,4 +6,4 @@

    Introduction

    Conic programs are a class of convex nonlinear optimization problems which use cones to represent the nonlinearities. They have the form:

    \[\begin{align} & \min_{x \in \mathbb{R}^n} & f_0(x) \\ & \;\;\text{s.t.} & f_j(x) \in \mathcal{S}_j & \;\; j = 1 \ldots m -\end{align}\]

    Mixed-integer conic programs (MICPs) are extensions of conic programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of conic solvers, although support differs on what types of cones each solver supports. In the list of Supported solvers, "SOCP" denotes solvers supporting second-order cones and "SDP" denotes solvers supporting semidefinite cones. In addition, solvers such as SCS and Mosek have support for the exponential cone. Moreover, due to the bridging system in MathOptInterface, many of these solvers support a much wider range of exotic cones than they natively support. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    Tip

    Duality plays a large role in solving conic optimization models. Depending on the solver, it can be more efficient to solve the dual instead of the primal. If performance is an issue, see the Dualization tutorial for more details.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Modeling with cones tutorial contains a number of helpful reformulations and tricks you can use when modeling conic programs. Look here if you are stuck trying to formulate a problem as a conic program.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    +\end{align}\]

    Mixed-integer conic programs (MICPs) are extensions of conic programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of conic solvers, although support differs on what types of cones each solver supports. In the list of Supported solvers, "SOCP" denotes solvers supporting second-order cones and "SDP" denotes solvers supporting semidefinite cones. In addition, solvers such as SCS and Mosek have support for the exponential cone. Moreover, due to the bridging system in MathOptInterface, many of these solvers support a much wider range of exotic cones than they natively support. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    Tip

    Duality plays a large role in solving conic optimization models. Depending on the solver, it can be more efficient to solve the dual instead of the primal. If performance is an issue, see the Dualization tutorial for more details.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Modeling with cones tutorial contains a number of helpful reformulations and tricks you can use when modeling conic programs. Look here if you are stuck trying to formulate a problem as a conic program.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    diff --git a/previews/PR3838/tutorials/conic/logistic_regression/index.html b/previews/PR3838/tutorials/conic/logistic_regression/index.html index e1c7b80d7af..2a3e5828ab1 100644 --- a/previews/PR3838/tutorials/conic/logistic_regression/index.html +++ b/previews/PR3838/tutorials/conic/logistic_regression/index.html @@ -109,4 +109,4 @@ )
    Number of non-zero components: 8 (out of 10 features)

    Extensions

    A direct extension would be to consider the sparse logistic regression with hard thresholding, which, on contrary to the soft version using a $\ell_1$ regularization, adds an explicit cardinality constraint in its formulation:

    \[\begin{aligned} \min_{\theta} & \; \sum_{i=1}^n \log(1 + \exp(-y_i \theta^\top x_i)) + \lambda \| \theta \|_2^2 \\ \text{subject to } & \quad \| \theta \|_0 <= k -\end{aligned}\]

    where $k$ is the maximum number of non-zero components in the vector $\theta$, and $\|.\|_0$ is the $\ell_0$ pseudo-norm:

    \[\| x\|_0 = \#\{i : \; x_i \neq 0\}\]

    The cardinality constraint $\|\theta\|_0 \leq k$ could be reformulated with binary variables. Thus the hard sparse regression problem could be solved by any solver supporting mixed integer conic problems.

    +\end{aligned}\]

    where $k$ is the maximum number of non-zero components in the vector $\theta$, and $\|.\|_0$ is the $\ell_0$ pseudo-norm:

    \[\| x\|_0 = \#\{i : \; x_i \neq 0\}\]

    The cardinality constraint $\|\theta\|_0 \leq k$ could be reformulated with binary variables. Thus the hard sparse regression problem could be solved by any solver supporting mixed integer conic problems.

    diff --git a/previews/PR3838/tutorials/conic/min_ellipse/f898c24e.svg b/previews/PR3838/tutorials/conic/min_ellipse/91bf8e7a.svg similarity index 88% rename from previews/PR3838/tutorials/conic/min_ellipse/f898c24e.svg rename to previews/PR3838/tutorials/conic/min_ellipse/91bf8e7a.svg index 182cbf71c2d..495482a7d8c 100644 --- a/previews/PR3838/tutorials/conic/min_ellipse/f898c24e.svg +++ b/previews/PR3838/tutorials/conic/min_ellipse/91bf8e7a.svg @@ -1,50 +1,50 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/conic/min_ellipse/d91a8a6d.svg b/previews/PR3838/tutorials/conic/min_ellipse/9e49e91f.svg similarity index 88% rename from previews/PR3838/tutorials/conic/min_ellipse/d91a8a6d.svg rename to previews/PR3838/tutorials/conic/min_ellipse/9e49e91f.svg index fd67fe0a13d..e5bef08cb81 100644 --- a/previews/PR3838/tutorials/conic/min_ellipse/d91a8a6d.svg +++ b/previews/PR3838/tutorials/conic/min_ellipse/9e49e91f.svg @@ -1,53 +1,53 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/conic/min_ellipse/index.html b/previews/PR3838/tutorials/conic/min_ellipse/index.html index d67343d7e41..734ca6a38fc 100644 --- a/previews/PR3838/tutorials/conic/min_ellipse/index.html +++ b/previews/PR3838/tutorials/conic/min_ellipse/index.html @@ -46,7 +46,7 @@ for ellipse in ellipses plot_ellipse(plot, ellipse) end -plotExample block output

    Build the model

    Now let's build the model, using the change-of-variables = $P^2$ and P_q = $P q$. We'll recover the true value of P and q after the solve.

    model = Model(SCS.Optimizer)
    +plot
    Example block output

    Build the model

    Now let's build the model, using the change-of-variables = $P^2$ and P_q = $P q$. We'll recover the true value of P and q after the solve.

    model = Model(SCS.Optimizer)
     # We need to use a tighter tolerance for this example, otherwise the bounding
     # ellipse won't actually be bounding...
     set_attribute(model, "eps_rel", 1e-6)
    @@ -85,7 +85,7 @@
       Dual objective value : -4.04364e+00
     
     * Work counters
    -  Solve time (sec)   : 2.15602e-01
    +  Solve time (sec)   : 2.12042e-01
     

    Results

    After solving the model to optimality we can recover the solution in terms of $P$ and $q$:

    P = sqrt(value.(P²))
     q = P \ value.(P_q)
    2-element Vector{Float64}:
      -0.3964217693227084
    @@ -94,4 +94,4 @@
         [tuple(P \ [cos(θ) - q[1], sin(θ) - q[2]]...) for θ in 0:0.05:(2pi+0.05)];
         c = :crimson,
         label = nothing,
    -)
    Example block output +)Example block output diff --git a/previews/PR3838/tutorials/conic/quantum_discrimination/index.html b/previews/PR3838/tutorials/conic/quantum_discrimination/index.html index 0bea2b9115b..198e211c85e 100644 --- a/previews/PR3838/tutorials/conic/quantum_discrimination/index.html +++ b/previews/PR3838/tutorials/conic/quantum_discrimination/index.html @@ -44,7 +44,7 @@ Dual objective value : 8.64062e-01 * Work counters - Solve time (sec) : 4.46315e-04 + Solve time (sec) : 4.10023e-04

    The probability of guessing correctly is:

    objective_value(model)
    0.8640614507314219

    When N = 2, there is a known analytical solution of:

    0.5 + 0.25 * sum(LinearAlgebra.svdvals(ρ[1] - ρ[2]))
    0.8640627582954737

    proving that we found the optimal solution.

    Finally, the optimal POVM is:

    solution = [value.(e) for e in E]
    2-element Vector{Matrix{ComplexF64}}:
      [0.9495721399750024 + 0.0im 0.03442451603977098 + 0.21609731371190505im; 0.03442451603977098 - 0.21609731371190505im 0.05042785512985496 + 0.0im]
      [0.05042785517602001 + 0.0im -0.03442451605312517 - 0.21609731370614843im; -0.03442451605312517 + 0.21609731370614843im 0.9495721400119357 + 0.0im]
    Tip

    Duality plays a large role in solving conic optimization models. Depending on the solver, it can be more efficient to solve the dual of this problem instead of the primal. If performance is an issue, see the Dualization tutorial for more details.

    Alternative formulation

    The formulation above includes N Hermitian matrices and a set of linear equality constraints. We can simplify the problem by replacing $E_N$ with $E_N = I - \sum\limits_{i=1}^{N-1} E_i$. This results in:

    model = Model(SCS.Optimizer)
    @@ -71,5 +71,5 @@
       Dual objective value : 8.64062e-01
     
     * Work counters
    -  Solve time (sec)   : 4.25775e-04
    -
    objective_value(model)
    0.8640596603179975
    + Solve time (sec) : 3.83034e-04 +
    objective_value(model)
    0.8640596603179975
    diff --git a/previews/PR3838/tutorials/conic/simple_examples/0242bc27.svg b/previews/PR3838/tutorials/conic/simple_examples/c8c5f047.svg similarity index 79% rename from previews/PR3838/tutorials/conic/simple_examples/0242bc27.svg rename to previews/PR3838/tutorials/conic/simple_examples/c8c5f047.svg index 369e4ded760..334ff9d3bad 100644 --- a/previews/PR3838/tutorials/conic/simple_examples/0242bc27.svg +++ b/previews/PR3838/tutorials/conic/simple_examples/c8c5f047.svg @@ -1,49 +1,49 @@ - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/conic/simple_examples/index.html b/previews/PR3838/tutorials/conic/simple_examples/index.html index 8d5d031307a..5893f8dacb3 100644 --- a/previews/PR3838/tutorials/conic/simple_examples/index.html +++ b/previews/PR3838/tutorials/conic/simple_examples/index.html @@ -179,7 +179,7 @@ ) end -example_minimum_distortion()Example block output

    Lovász numbers

    The Lovász number of a graph, also known as Lovász's theta-function, is a number that lies between two important and related numbers that are computationally hard to determine, namely the chromatic and clique numbers of the graph. It is possible however to efficient compute the Lovász number as the optimal value of a semidefinite program.

    Consider the pentagon graph:

         [5]
    +example_minimum_distortion()
    Example block output

    Lovász numbers

    The Lovász number of a graph, also known as Lovász's theta-function, is a number that lies between two important and related numbers that are computationally hard to determine, namely the chromatic and clique numbers of the graph. It is possible however to efficient compute the Lovász number as the optimal value of a semidefinite program.

    Consider the pentagon graph:

         [5]
         /   \
        /     \
      [1]     [4]
    @@ -242,4 +242,4 @@
         return
     end
     
    -example_robust_uncertainty_sets()
    +example_robust_uncertainty_sets() diff --git a/previews/PR3838/tutorials/conic/start_values/index.html b/previews/PR3838/tutorials/conic/start_values/index.html index d753bc4d5bd..b812cab034e 100644 --- a/previews/PR3838/tutorials/conic/start_values/index.html +++ b/previews/PR3838/tutorials/conic/start_values/index.html @@ -52,12 +52,12 @@ ------------------------------------------------------------------ iter | pri res | dua res | gap | obj | scale | time (s) ------------------------------------------------------------------ - 0| 4.42e+01 1.00e+00 1.28e+02 -6.64e+01 1.00e-01 1.06e-04 - 75| 5.30e-07 2.63e-06 3.15e-07 -3.00e+00 1.00e-01 1.53e-04 + 0| 4.42e+01 1.00e+00 1.28e+02 -6.64e+01 1.00e-01 9.39e-05 + 75| 5.30e-07 2.63e-06 3.15e-07 -3.00e+00 1.00e-01 1.38e-04 ------------------------------------------------------------------ status: solved -timings: total: 1.54e-04s = setup: 3.76e-05s + solve: 1.16e-04s - lin-sys: 1.33e-05s, cones: 6.76e-06s, accel: 3.80e-06s +timings: total: 1.39e-04s = setup: 3.28e-05s + solve: 1.06e-04s + lin-sys: 1.23e-05s, cones: 6.25e-06s, accel: 3.38e-06s ------------------------------------------------------------------ objective = -2.999998 ------------------------------------------------------------------

    By looking at the log, we can see that SCS took 75 iterations to find the optimal solution. Now we set the optimal solution as our starting point:

    set_optimal_start_values(model)

    and we re-optimize:

    optimize!(model)
    ------------------------------------------------------------------
    @@ -76,11 +76,11 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.90e-05  1.56e-06  9.14e-05 -3.00e+00  1.00e-01  1.04e-04
    +     0| 1.90e-05  1.56e-06  9.14e-05 -3.00e+00  1.00e-01  1.03e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 1.05e-04s = setup: 3.72e-05s + solve: 6.78e-05s
    -	 lin-sys: 8.42e-07s, cones: 1.43e-06s, accel: 2.00e-08s
    +timings: total: 1.04e-04s = setup: 3.63e-05s + solve: 6.76e-05s
    +	 lin-sys: 7.72e-07s, cones: 1.26e-06s, accel: 3.00e-08s
     ------------------------------------------------------------------
     objective = -3.000044
    -------------------------------------------------------------------

    Now the optimization terminates after 0 iterations because our starting point is already optimal.

    Caveats

    Some solvers do not support setting some parts of the starting solution, for example, they may support only set_start_value for variables.

    If you encounter an UnsupportedSupported attribute error for MOI.VariablePrimalStart, MOI.ConstraintPrimalStart, or MOI.ConstraintDualStart, comment out the corresponding part of the set_optimal_start_values function.

    +------------------------------------------------------------------

    Now the optimization terminates after 0 iterations because our starting point is already optimal.

    Caveats

    Some solvers do not support setting some parts of the starting solution, for example, they may support only set_start_value for variables.

    If you encounter an UnsupportedSupported attribute error for MOI.VariablePrimalStart, MOI.ConstraintPrimalStart, or MOI.ConstraintDualStart, comment out the corresponding part of the set_optimal_start_values function.

    diff --git a/previews/PR3838/tutorials/conic/tips_and_tricks/index.html b/previews/PR3838/tutorials/conic/tips_and_tricks/index.html index d6616d08643..037ad7b9ccd 100644 --- a/previews/PR3838/tutorials/conic/tips_and_tricks/index.html +++ b/previews/PR3838/tutorials/conic/tips_and_tricks/index.html @@ -172,4 +172,4 @@ @constraint(model, u == 0.5) optimize!(model) @assert is_solved_and_feasible(model) -value(t), 0.5 * log(LinearAlgebra.det(value.(X) ./ 0.5))
    (1.4979204481049098, 1.4978661010981238)

    Other Cones and Functions

    For other cones supported by JuMP, check out the MathOptInterface Manual.

    +value(t), 0.5 * log(LinearAlgebra.det(value.(X) ./ 0.5))
    (1.4979204481049098, 1.4978661010981238)

    Other Cones and Functions

    For other cones supported by JuMP, check out the MathOptInterface Manual.

    diff --git a/previews/PR3838/tutorials/getting_started/debugging/index.html b/previews/PR3838/tutorials/getting_started/debugging/index.html index ec13c10034d..eb02713377a 100644 --- a/previews/PR3838/tutorials/getting_started/debugging/index.html +++ b/previews/PR3838/tutorials/getting_started/debugging/index.html @@ -20,4 +20,4 @@ if abs(value(var)) > 1e3 println("Variable `$(name(var))` may be unbounded") end - endVariable `x` may be unbounded + endVariable `x` may be unbounded diff --git a/previews/PR3838/tutorials/getting_started/design_patterns_for_larger_models/index.html b/previews/PR3838/tutorials/getting_started/design_patterns_for_larger_models/index.html index 8ba6b8e47d3..43920fcfda0 100644 --- a/previews/PR3838/tutorials/getting_started/design_patterns_for_larger_models/index.html +++ b/previews/PR3838/tutorials/getting_started/design_patterns_for_larger_models/index.html @@ -520,4 +520,4 @@ ) @test x === nothing end -end
    Test.DefaultTestSet("KnapsackModel", Any[Test.DefaultTestSet("feasible_binary_knapsack", Any[], 5, false, false, true, 1.728265883585683e9, 1.72826588359347e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("feasible_integer_knapsack", Any[], 5, false, false, true, 1.728265883593511e9, 1.728265883710088e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("infeasible_binary_knapsack", Any[], 1, false, false, true, 1.728265883710132e9, 1.728265883712871e9, false, "design_patterns_for_larger_models.md")], 0, false, false, true, 1.728265883585644e9, 1.728265883712878e9, false, "design_patterns_for_larger_models.md")
    Tip

    Place these tests in a separate file test_knapsack_model.jl so that you can run the tests by adding include("test_knapsack_model.jl") to any file where needed.

    Next steps

    We've only briefly scratched the surface of ways to create and structure large JuMP models, so consider this tutorial a starting point, rather than a comprehensive list of all the possible ways to structure JuMP models. If you are embarking on a large project that uses JuMP, a good next step is to look at ways people have written large JuMP projects "in the wild."

    Here are some good examples (all co-incidentally related to energy):

    +end
    Test.DefaultTestSet("KnapsackModel", Any[Test.DefaultTestSet("feasible_binary_knapsack", Any[], 5, false, false, true, 1.728267139874698e9, 1.728267139880502e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("feasible_integer_knapsack", Any[], 5, false, false, true, 1.728267139880542e9, 1.728267139995168e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("infeasible_binary_knapsack", Any[], 1, false, false, true, 1.728267139995213e9, 1.728267139997359e9, false, "design_patterns_for_larger_models.md")], 0, false, false, true, 1.728267139874664e9, 1.728267139997365e9, false, "design_patterns_for_larger_models.md")
    Tip

    Place these tests in a separate file test_knapsack_model.jl so that you can run the tests by adding include("test_knapsack_model.jl") to any file where needed.

    Next steps

    We've only briefly scratched the surface of ways to create and structure large JuMP models, so consider this tutorial a starting point, rather than a comprehensive list of all the possible ways to structure JuMP models. If you are embarking on a large project that uses JuMP, a good next step is to look at ways people have written large JuMP projects "in the wild."

    Here are some good examples (all co-incidentally related to energy):

    diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_JuMP/index.html b/previews/PR3838/tutorials/getting_started/getting_started_with_JuMP/index.html index 1ef9d1054ce..afa289f9652 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_JuMP/index.html +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_JuMP/index.html @@ -242,4 +242,4 @@ Model status : Optimal Simplex iterations: 4 Objective value : 4.9230769231e+00 -HiGHS run time : 0.00
    julia> @assert is_solved_and_feasible(vector_model)
    julia> objective_value(vector_model)4.923076923076922 +HiGHS run time : 0.00
    julia> @assert is_solved_and_feasible(vector_model)
    julia> objective_value(vector_model)4.923076923076922 diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/3139a25e.svg b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/45ac2d7b.svg similarity index 84% rename from previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/3139a25e.svg rename to previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/45ac2d7b.svg index 6007666a1fd..1ee8bc7c019 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/3139a25e.svg +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/45ac2d7b.svg @@ -1,62 +1,62 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/d94e393a.svg b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/ad03704c.svg similarity index 82% rename from previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/d94e393a.svg rename to previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/ad03704c.svg index 7a42bc495f0..11afc4e99b9 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/d94e393a.svg +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/ad03704c.svg @@ -1,73 +1,73 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/789d8e53.svg b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/fda83b00.svg similarity index 85% rename from previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/789d8e53.svg rename to previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/fda83b00.svg index 2cf96715312..9ed90d08c51 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/789d8e53.svg +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/fda83b00.svg @@ -1,59 +1,59 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/index.html b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/index.html index 7a30b1dbb97..9bd455dbbfd 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/index.html +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_data_and_plotting/index.html @@ -14,7 +14,7 @@ csv_df.Height; xlabel = "Weight", ylabel = "Height", -)Example block output

    That doesn't look right. What happened? If you look at the dataframe above, it read Weight in as a String column because there are "NA" fields. Let's correct that, by telling CSV to consider "NA" as missing.

    csv_df = CSV.read(
    +)
    Example block output

    That doesn't look right. What happened? If you look at the dataframe above, it read Weight in as a String column because there are "NA" fields. Let's correct that, by telling CSV to consider "NA" as missing.

    csv_df = CSV.read(
         joinpath(DATA_DIR, "StarWars.csv"),
         DataFrames.DataFrame;
         missingstring = "NA",
    @@ -26,7 +26,7 @@
         ylabel = "Height",
         label = false,
         ylims = (0, 3),
    -)
    Example block output

    That looks better.

    Tip

    Read the CSV documentation for other parsing options.

    DataFrames.jl supports manipulation using functions similar to pandas. For example, split the dataframe into groups based on eye-color:

    by_eyecolor = DataFrames.groupby(csv_df, :Eyecolor)

    GroupedDataFrame with 7 groups based on key: Eyecolor

    First Group (5 rows): Eyecolor = "blue"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Anakin Skywalkermale1.8884.0blueblondfairTatooine41.9BBY4ABYjedihumanlightsaber
    2Luke Skywalkermale1.7277.0blueblondfairTatooine19BBYunk_diedjedihumanlightsaber
    3Qui-Gon Jinnmale1.9388.5bluebrownlightunk_planet92BBY32BBYjedihumanlightsaber
    4Sheev Palpatinemale1.7375.0blueredpaleNaboo82BBY10ABYno_jedihumanforce-lightning
    5Chewbaccamale2.28112.0bluebrownmissingKashyyyk200BBY25ABYno_jediwookieebowcaster

    Last Group (1 row): Eyecolor = "black"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Chief Chirpamale1.050.0blackgraybrownEndorunk_born4ABYno_jediewokspear

    Then recombine into a single dataframe based on a function operating over the split dataframes:

    eyecolor_count = DataFrames.combine(by_eyecolor) do df
    +)
    Example block output

    That looks better.

    Tip

    Read the CSV documentation for other parsing options.

    DataFrames.jl supports manipulation using functions similar to pandas. For example, split the dataframe into groups based on eye-color:

    by_eyecolor = DataFrames.groupby(csv_df, :Eyecolor)

    GroupedDataFrame with 7 groups based on key: Eyecolor

    First Group (5 rows): Eyecolor = "blue"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Anakin Skywalkermale1.8884.0blueblondfairTatooine41.9BBY4ABYjedihumanlightsaber
    2Luke Skywalkermale1.7277.0blueblondfairTatooine19BBYunk_diedjedihumanlightsaber
    3Qui-Gon Jinnmale1.9388.5bluebrownlightunk_planet92BBY32BBYjedihumanlightsaber
    4Sheev Palpatinemale1.7375.0blueredpaleNaboo82BBY10ABYno_jedihumanforce-lightning
    5Chewbaccamale2.28112.0bluebrownmissingKashyyyk200BBY25ABYno_jediwookieebowcaster

    Last Group (1 row): Eyecolor = "black"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Chief Chirpamale1.050.0blackgraybrownEndorunk_born4ABYno_jediewokspear

    Then recombine into a single dataframe based on a function operating over the split dataframes:

    eyecolor_count = DataFrames.combine(by_eyecolor) do df
         return DataFrames.nrow(df)
     end
    7×2 DataFrame
    RowEyecolorx1
    String15?Int64
    1blue5
    2brown8
    3bluegray1
    4missing2
    5yellow2
    6gold1
    7black1

    We can rename columns:

    DataFrames.rename!(eyecolor_count, :x1 => :count)
    7×2 DataFrame
    RowEyecolorcount
    String15?Int64
    1blue5
    2brown8
    3bluegray1
    4missing2
    5yellow2
    6gold1
    7black1

    Drop some missing rows:

    DataFrames.dropmissing!(eyecolor_count, :Eyecolor)
    6×2 DataFrame
    RowEyecolorcount
    String15Int64
    1blue5
    2brown8
    3bluegray1
    4yellow2
    5gold1
    6black1

    Then we can visualize the data:

    sort!(eyecolor_count, :count; rev = true)
     Plots.bar(
    @@ -35,7 +35,7 @@
         xlabel = "Eye color",
         ylabel = "Number of characters",
         label = false,
    -)
    Example block output

    Other Delimited Files

    We can also use the CSV.jl package to read any other delimited text file format.

    By default, CSV.File will try to detect a file's delimiter from the first 10 lines of the file.

    Candidate delimiters include ',', '\t', ' ', '|', ';', and ':'. If it can't auto-detect the delimiter, it will assume ','.

    Let's take the example of space separated data.

    ss_df = CSV.read(joinpath(DATA_DIR, "Cereal.txt"), DataFrames.DataFrame)
    23×10 DataFrame
    RowNameCupsCaloriesCarbsFatFiberPotassiumProteinSodiumSugars
    String31Float64Int64Float64Int64Float64Int64Int64Int64Int64
    1CapnCrunch0.7512012.020.035122012
    2CocoaPuffs1.011012.010.055118013
    3Trix1.011013.010.025114012
    4AppleJacks1.011011.001.030212514
    5CornChex1.011022.000.02522803
    6CornFlakes1.010021.001.03522902
    7Nut&Honey0.6712015.010.04021909
    8Smacks0.751109.011.04027015
    9MultiGrain1.010015.012.09022206
    10CracklinOat0.511010.034.016031407
    11GrapeNuts0.2511017.003.09031793
    12HoneyNutCheerios0.7511011.511.590325010
    13NutriGrain0.6714021.023.013032207
    14Product191.010020.001.04533203
    15TotalRaisinBran1.014015.014.0230319014
    16WheatChex0.6710017.013.011532303
    17Oatmeal0.513013.521.5120317010
    18Life0.6710012.022.09541506
    19Maypo1.010016.010.095403
    20QuakerOats0.510014.012.011041356
    21Muesli1.015016.033.0170415011
    22Cheerios1.2511017.022.010562901
    23SpecialK1.011016.001.05562303

    We can also specify the delimiter as follows:

    delim_df = CSV.read(
    +)
    Example block output

    Other Delimited Files

    We can also use the CSV.jl package to read any other delimited text file format.

    By default, CSV.File will try to detect a file's delimiter from the first 10 lines of the file.

    Candidate delimiters include ',', '\t', ' ', '|', ';', and ':'. If it can't auto-detect the delimiter, it will assume ','.

    Let's take the example of space separated data.

    ss_df = CSV.read(joinpath(DATA_DIR, "Cereal.txt"), DataFrames.DataFrame)
    23×10 DataFrame
    RowNameCupsCaloriesCarbsFatFiberPotassiumProteinSodiumSugars
    String31Float64Int64Float64Int64Float64Int64Int64Int64Int64
    1CapnCrunch0.7512012.020.035122012
    2CocoaPuffs1.011012.010.055118013
    3Trix1.011013.010.025114012
    4AppleJacks1.011011.001.030212514
    5CornChex1.011022.000.02522803
    6CornFlakes1.010021.001.03522902
    7Nut&Honey0.6712015.010.04021909
    8Smacks0.751109.011.04027015
    9MultiGrain1.010015.012.09022206
    10CracklinOat0.511010.034.016031407
    11GrapeNuts0.2511017.003.09031793
    12HoneyNutCheerios0.7511011.511.590325010
    13NutriGrain0.6714021.023.013032207
    14Product191.010020.001.04533203
    15TotalRaisinBran1.014015.014.0230319014
    16WheatChex0.6710017.013.011532303
    17Oatmeal0.513013.521.5120317010
    18Life0.6710012.022.09541506
    19Maypo1.010016.010.095403
    20QuakerOats0.510014.012.011041356
    21Muesli1.015016.033.0170415011
    22Cheerios1.2511017.022.010562901
    23SpecialK1.011016.001.05562303

    We can also specify the delimiter as follows:

    delim_df = CSV.read(
         joinpath(DATA_DIR, "Soccer.txt"),
         DataFrames.DataFrame;
         delim = "::",
    @@ -203,7 +203,7 @@
       Relative gap       : 0.00000e+00
     
     * Work counters
    -  Solve time (sec)   : 6.22034e-03
    +  Solve time (sec)   : 6.14572e-03
       Simplex iterations : 26
       Barrier iterations : -1
       Node count         : 1
    @@ -235,4 +235,4 @@
      * Uganda
      * United Arab Emirates
      * United States
    - * Zimbabwe

    We need some passports, like New Zealand and the United States, which have widespread access to a large number of countries. However, we also need passports like North Korea which only have visa-free access to a very limited number of countries.

    Note

    We use value(x[c]) > 0.5 rather than value(x[c]) == 1 to avoid excluding solutions like x[c] = 0.99999 that are "1" to some tolerance.

    + * Zimbabwe

    We need some passports, like New Zealand and the United States, which have widespread access to a large number of countries. However, we also need passports like North Korea which only have visa-free access to a very limited number of countries.

    Note

    We use value(x[c]) > 0.5 rather than value(x[c]) == 1 to avoid excluding solutions like x[c] = 0.99999 that are "1" to some tolerance.

    diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_julia/index.html b/previews/PR3838/tutorials/getting_started/getting_started_with_julia/index.html index 3e88387557e..bf0f3da4ae8 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_julia/index.html +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_julia/index.html @@ -41,10 +41,10 @@ Closest candidates are: *(::Any, ::Any, ::Any, ::Any...) @ Base operators.jl:587 - *(::MutableArithmetics.Zero, ::Any) - @ MutableArithmetics ~/.julia/packages/MutableArithmetics/beEHn/src/rewrite.jl:61 - *(::Any, ::ChainRulesCore.ZeroTangent) - @ ChainRulesCore ~/.julia/packages/ChainRulesCore/6Pucz/src/tangent_arithmetic.jl:105 + *(::ChainRulesCore.NotImplemented, ::Any) + @ ChainRulesCore ~/.julia/packages/ChainRulesCore/6Pucz/src/tangent_arithmetic.jl:37 + *(::Any, ::ChainRulesCore.NoTangent) + @ ChainRulesCore ~/.julia/packages/ChainRulesCore/6Pucz/src/tangent_arithmetic.jl:65 ...

    But multiplying transposes works:

    julia> b' * b61
    julia> b * b'2×2 Matrix{Int64}: 25 30 30 36

    Other common types

    Comments

    Although not technically a type, code comments begin with the # character:

    julia> 1 + 1  # This is a comment2

    Multiline comments begin with #= and end with =#:

    #=
    @@ -180,4 +180,4 @@
      0.5103924401614957
      0.9296414851080324

    The Package Manager is used to install packages that are not part of Julia's standard library.

    For example the following can be used to install JuMP,

    using Pkg
     Pkg.add("JuMP")

    For a complete list of registered Julia packages see the package listing at JuliaHub.

    From time to you may wish to use a Julia package that is not registered. In this case a git repository URL can be used to install the package.

    using Pkg
    -Pkg.add("https://github.com/user-name/MyPackage.jl.git")

    Package environments

    By default, Pkg.add will add packages to Julia's global environment. However, Julia also has built-in support for virtual environments.

    Activate a virtual environment with:

    import Pkg; Pkg.activate("/path/to/environment")

    You can see what packages are installed in the current environment with Pkg.status().

    Tip

    We strongly recommend you create a Pkg environment for each project that you create in Julia, and add only the packages that you need, instead of adding lots of packages to the global environment. The Pkg manager documentation has more information on this topic.

    +Pkg.add("https://github.com/user-name/MyPackage.jl.git")

    Package environments

    By default, Pkg.add will add packages to Julia's global environment. However, Julia also has built-in support for virtual environments.

    Activate a virtual environment with:

    import Pkg; Pkg.activate("/path/to/environment")

    You can see what packages are installed in the current environment with Pkg.status().

    Tip

    We strongly recommend you create a Pkg environment for each project that you create in Julia, and add only the packages that you need, instead of adding lots of packages to the global environment. The Pkg manager documentation has more information on this topic.

    diff --git a/previews/PR3838/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html b/previews/PR3838/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html index 025cd3109fb..4ac4e66a217 100644 --- a/previews/PR3838/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html +++ b/previews/PR3838/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html @@ -219,4 +219,4 @@ ("Dunedin", "Auckland") => 1426 ("Auckland", "Christchurch") => 1071

    Then, we can create our model like so:

    model = Model()
     @variable(model, x[keys(routes)])
    -@objective(model, Min, sum(v * x[k] for (k, v) in routes))

    \[ 643 x_{("Auckland", "Wellington")} + 436 x_{("Wellington", "Christchurch")} + 790 x_{("Wellington", "Dunedin")} + 360 x_{("Christchurch", "Dunedin")} + 1426 x_{("Auckland", "Dunedin")} + 1426 x_{("Dunedin", "Auckland")} + 1071 x_{("Auckland", "Christchurch")} \]

    This has a number of benefits over the other approaches, including a compacter algebraic model and variables that are named in a more meaningful way.

    Tip

    If you're struggling to formulate a problem using the available syntax in JuMP, it's probably a sign that you should convert your data into a different form.

    Next steps

    The purpose of this tutorial was to show how JuMP does not have specialized syntax for set creation and manipulation. Instead, you should use the tools provided by Julia itself.

    This is both an opportunity and a challenge, because you are free to pick the syntax and data structures that best suit your problem, but for new users it can be daunting to decide which structure to use.

    Read through some of the other JuMP tutorials to get inspiration and ideas for how you can use Julia's syntax and data structures to your advantage.

    +@objective(model, Min, sum(v * x[k] for (k, v) in routes))

    \[ 643 x_{("Auckland", "Wellington")} + 436 x_{("Wellington", "Christchurch")} + 790 x_{("Wellington", "Dunedin")} + 360 x_{("Christchurch", "Dunedin")} + 1426 x_{("Auckland", "Dunedin")} + 1426 x_{("Dunedin", "Auckland")} + 1071 x_{("Auckland", "Christchurch")} \]

    This has a number of benefits over the other approaches, including a compacter algebraic model and variables that are named in a more meaningful way.

    Tip

    If you're struggling to formulate a problem using the available syntax in JuMP, it's probably a sign that you should convert your data into a different form.

    Next steps

    The purpose of this tutorial was to show how JuMP does not have specialized syntax for set creation and manipulation. Instead, you should use the tools provided by Julia itself.

    This is both an opportunity and a challenge, because you are free to pick the syntax and data structures that best suit your problem, but for new users it can be daunting to decide which structure to use.

    Read through some of the other JuMP tutorials to get inspiration and ideas for how you can use Julia's syntax and data structures to your advantage.

    diff --git a/previews/PR3838/tutorials/getting_started/introduction/index.html b/previews/PR3838/tutorials/getting_started/introduction/index.html index d076236aff0..7b4ba0f864e 100644 --- a/previews/PR3838/tutorials/getting_started/introduction/index.html +++ b/previews/PR3838/tutorials/getting_started/introduction/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Introduction

    The purpose of these "Getting started" tutorials is to teach new users the basics of Julia and JuMP.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The "Getting started with" tutorials are basic introductions to different aspects of JuMP and Julia. If you are new to JuMP and Julia, start by reading them in the following order:
    • Julia has a reputation for being "fast." Unfortunately, it is also easy to write slow Julia code. Performance tips contains a number of important tips on how to improve the performance of models you write in JuMP.
    • Design patterns for larger models is a more advanced tutorial that is aimed at users writing large JuMP models. It's in the "Getting started" section to give you an early preview of how JuMP makes it easy to structure larger models. If you are new to JuMP you may want to skip or briefly skim this tutorial, and come back to it once you have written a few JuMP models.
    +

    Introduction

    The purpose of these "Getting started" tutorials is to teach new users the basics of Julia and JuMP.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The "Getting started with" tutorials are basic introductions to different aspects of JuMP and Julia. If you are new to JuMP and Julia, start by reading them in the following order:
    • Julia has a reputation for being "fast." Unfortunately, it is also easy to write slow Julia code. Performance tips contains a number of important tips on how to improve the performance of models you write in JuMP.
    • Design patterns for larger models is a more advanced tutorial that is aimed at users writing large JuMP models. It's in the "Getting started" section to give you an early preview of how JuMP makes it easy to structure larger models. If you are new to JuMP you may want to skip or briefly skim this tutorial, and come back to it once you have written a few JuMP models.
    diff --git a/previews/PR3838/tutorials/getting_started/performance_tips/index.html b/previews/PR3838/tutorials/getting_started/performance_tips/index.html index f6ad43c184e..828c0d64d00 100644 --- a/previews/PR3838/tutorials/getting_started/performance_tips/index.html +++ b/previews/PR3838/tutorials/getting_started/performance_tips/index.html @@ -37,4 +37,4 @@ └ Names registered in the model: none
    julia> @variable(model, x[1:3])3-element Vector{VariableRef}: x[1] x[2] - x[3]

    Here's what happens if we construct the expression outside the macro:

    julia> @allocated x[1] + x[2] + x[3]1424
    Info

    The @allocated measures how many bytes were allocated during the evaluation of an expression. Fewer is better.

    If we use the @expression macro, we get many fewer allocations:

    julia> @allocated @expression(model, x[1] + x[2] + x[3])800

    Disable string names

    By default, JuMP creates String names for variables and constraints and passes these to the solver. The benefit of passing names is that it improves the readability of log messages from the solver (for example, "variable x has invalid bounds" instead of "variable v1203 has invalid bounds"), but for larger models the overhead of passing names can be non-trivial.

    Disable the creation of String names by setting set_string_name = false in the @variable and @constraint macros, or by calling set_string_names_on_creation to disable all names for a particular model:

    julia> model = Model();
    julia> set_string_names_on_creation(model, false)
    julia> @variable(model, x)_[1]
    julia> @constraint(model, c, 2x <= 1)2 _[1] ≤ 1

    Note that this doesn't change how symbolic names and bindings are stored:

    julia> x_[1]
    julia> model[:x]_[1]
    julia> x === model[:x]true

    But you can no longer look up the variable by the string name:

    julia> variable_by_name(model, "x") === nothingtrue
    Info

    For more information on the difference between string names, symbolic names, and bindings, see String names, symbolic names, and bindings.

    + x[3]

    Here's what happens if we construct the expression outside the macro:

    julia> @allocated x[1] + x[2] + x[3]1424
    Info

    The @allocated measures how many bytes were allocated during the evaluation of an expression. Fewer is better.

    If we use the @expression macro, we get many fewer allocations:

    julia> @allocated @expression(model, x[1] + x[2] + x[3])800

    Disable string names

    By default, JuMP creates String names for variables and constraints and passes these to the solver. The benefit of passing names is that it improves the readability of log messages from the solver (for example, "variable x has invalid bounds" instead of "variable v1203 has invalid bounds"), but for larger models the overhead of passing names can be non-trivial.

    Disable the creation of String names by setting set_string_name = false in the @variable and @constraint macros, or by calling set_string_names_on_creation to disable all names for a particular model:

    julia> model = Model();
    julia> set_string_names_on_creation(model, false)
    julia> @variable(model, x)_[1]
    julia> @constraint(model, c, 2x <= 1)2 _[1] ≤ 1

    Note that this doesn't change how symbolic names and bindings are stored:

    julia> x_[1]
    julia> model[:x]_[1]
    julia> x === model[:x]true

    But you can no longer look up the variable by the string name:

    julia> variable_by_name(model, "x") === nothingtrue
    Info

    For more information on the difference between string names, symbolic names, and bindings, see String names, symbolic names, and bindings.

    diff --git a/previews/PR3838/tutorials/getting_started/sum_if/23d9d0bd.svg b/previews/PR3838/tutorials/getting_started/sum_if/8220bdfd.svg similarity index 60% rename from previews/PR3838/tutorials/getting_started/sum_if/23d9d0bd.svg rename to previews/PR3838/tutorials/getting_started/sum_if/8220bdfd.svg index 8016548a878..1eed119c436 100644 --- a/previews/PR3838/tutorials/getting_started/sum_if/23d9d0bd.svg +++ b/previews/PR3838/tutorials/getting_started/sum_if/8220bdfd.svg @@ -1,68 +1,68 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/getting_started/sum_if/de89758d.svg b/previews/PR3838/tutorials/getting_started/sum_if/ab3233b9.svg similarity index 54% rename from previews/PR3838/tutorials/getting_started/sum_if/de89758d.svg rename to previews/PR3838/tutorials/getting_started/sum_if/ab3233b9.svg index 10b32b54b06..b7bcdc406e6 100644 --- a/previews/PR3838/tutorials/getting_started/sum_if/de89758d.svg +++ b/previews/PR3838/tutorials/getting_started/sum_if/ab3233b9.svg @@ -1,55 +1,55 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/getting_started/sum_if/index.html b/previews/PR3838/tutorials/getting_started/sum_if/index.html index 00104b8692d..2f0793c7ff5 100644 --- a/previews/PR3838/tutorials/getting_started/sum_if/index.html +++ b/previews/PR3838/tutorials/getting_started/sum_if/index.html @@ -64,7 +64,7 @@ end nodes, edges, demand = build_random_graph(1_000, 2_000) -@elapsed build_naive_model(nodes, edges, demand)
    0.121298817

    A good way to benchmark is to measure the runtime across a wide range of input sizes. From our big-O analysis, we should expect that doubling the number of nodes and edges results in a 4x increase in the runtime.

    run_times = Float64[]
    +@elapsed build_naive_model(nodes, edges, demand)
    0.121925519

    A good way to benchmark is to measure the runtime across a wide range of input sizes. From our big-O analysis, we should expect that doubling the number of nodes and edges results in a 4x increase in the runtime.

    run_times = Float64[]
     factors = 1:10
     for factor in factors
         graph = build_random_graph(1_000 * factor, 5_000 * factor)
    @@ -73,7 +73,7 @@
     Plots.plot(; xlabel = "Factor", ylabel = "Runtime [s]")
     Plots.scatter!(factors, run_times; label = "Actual")
     a, b = hcat(ones(10), factors .^ 2) \ run_times
    -Plots.plot!(factors, a .+ b * factors .^ 2; label = "Quadratic fit")
    Example block output

    As expected, the runtimes demonstrate quadratic scaling: if we double the number of nodes and edges, the runtime increases by a factor of four.

    Caching

    We can improve our formulation by caching the list of incoming and outgoing nodes for each node n:

    out_nodes = Dict(n => Int[] for n in nodes)
    +Plots.plot!(factors, a .+ b * factors .^ 2; label = "Quadratic fit")
    Example block output

    As expected, the runtimes demonstrate quadratic scaling: if we double the number of nodes and edges, the runtime increases by a factor of four.

    Caching

    We can improve our formulation by caching the list of incoming and outgoing nodes for each node n:

    out_nodes = Dict(n => Int[] for n in nodes)
     in_nodes = Dict(n => Int[] for n in nodes)
     for (i, j) in edges
         push!(out_nodes[i], j)
    @@ -104,7 +104,7 @@
     end
     
     nodes, edges, demand = build_random_graph(1_000, 2_000)
    -@elapsed build_cached_model(nodes, edges, demand)
    0.168183485

    Analysis

    Now we can analyse the difference in runtime of the two formulations:

    run_times_naive = Float64[]
    +@elapsed build_cached_model(nodes, edges, demand)
    0.154821868

    Analysis

    Now we can analyse the difference in runtime of the two formulations:

    run_times_naive = Float64[]
     run_times_cached = Float64[]
     factors = 1:10
     for factor in factors
    @@ -118,4 +118,4 @@
     Plots.plot!(factors, a .+ b * factors .^ 2; label = "Quadratic fit")
     Plots.scatter!(factors, run_times_cached; label = "Cached")
     a, b = hcat(ones(10), factors) \ run_times_cached
    -Plots.plot!(factors, a .+ b * factors; label = "Linear fit")
    Example block output

    Even though the cached model needs to build in_nodes and out_nodes, it is asymptotically faster than the naïve model, scaling linearly with factor rather than quadratically.

    Lesson

    If you write code with sum-if type conditions, for example, @constraint(model, [a in set], sum(x[b] for b in list if condition(a, b)), you can improve the performance by caching the elements for which condition(a, b) is true.

    Finally, you should understand that this behavior is not specific to JuMP, and that it applies more generally to all computer programs you might write. (Python programs that use Pyomo or gurobipy would similarly benefit from this caching approach.)

    Understanding big-O notation and algorithmic complexity is a useful debugging skill to have, regardless of the type of program that you are writing.

    +Plots.plot!(factors, a .+ b * factors; label = "Linear fit")Example block output

    Even though the cached model needs to build in_nodes and out_nodes, it is asymptotically faster than the naïve model, scaling linearly with factor rather than quadratically.

    Lesson

    If you write code with sum-if type conditions, for example, @constraint(model, [a in set], sum(x[b] for b in list if condition(a, b)), you can improve the performance by caching the elements for which condition(a, b) is true.

    Finally, you should understand that this behavior is not specific to JuMP, and that it applies more generally to all computer programs you might write. (Python programs that use Pyomo or gurobipy would similarly benefit from this caching approach.)

    Understanding big-O notation and algorithmic complexity is a useful debugging skill to have, regardless of the type of program that you are writing.

    diff --git a/previews/PR3838/tutorials/getting_started/tolerances/index.html b/previews/PR3838/tutorials/getting_started/tolerances/index.html index 755aa43f1f0..16b0cfcaea2 100644 --- a/previews/PR3838/tutorials/getting_started/tolerances/index.html +++ b/previews/PR3838/tutorials/getting_started/tolerances/index.html @@ -37,34 +37,34 @@ ------------------------------------------------------------------ iter | pri res | dua res | gap | obj | scale | time (s) ------------------------------------------------------------------ - 0| 2.00e+01 1.00e+00 2.00e+01 -9.98e+00 1.00e-01 3.44e-02 - 100| 6.92e-05 7.92e-05 7.33e-06 2.41e-05 1.00e-01 9.28e-02 + 0| 2.00e+01 1.00e+00 2.00e+01 -9.98e+00 1.00e-01 3.49e-02 + 100| 6.92e-05 7.92e-05 7.33e-06 2.41e-05 1.00e-01 9.13e-02 ------------------------------------------------------------------ status: solved -timings: total: 9.29e-02s = setup: 3.32e-02s + solve: 5.97e-02s - lin-sys: 5.02e-02s, cones: 2.19e-03s, accel: 8.03e-04s +timings: total: 9.13e-02s = setup: 3.38e-02s + solve: 5.75e-02s + lin-sys: 4.74e-02s, cones: 2.01e-03s, accel: 2.08e-03s ------------------------------------------------------------------ objective = 0.000024 ------------------------------------------------------------------

    SCS reports that it solved the problem to optimality:

    is_solved_and_feasible(model)
    true

    and that the solution for x[1] is nearly zero:

    value(x[1])
    2.04406873858532e-5

    However, the analytic solution for x[1] is:

    1 - n * ε / 2
    0.8479

    The answer is very wrong, and there is no indication from the solver that anything untoward happened. What's going on?

    One useful debugging tool is primal_feasibility_report:

    report = primal_feasibility_report(model)
    Dict{Any, Float64} with 8192 entries:
    -  x[3654] ≥ 0 => 1.71395e-5
    -  x[7752] ≥ 0 => 2.01984e-5
    -  x[1128] ≥ 0 => 1.71395e-5
    -  x[1328] ≥ 0 => 1.8669e-5
    -  x[3660] ≥ 0 => 1.8669e-5
    -  x[3091] ≥ 0 => 1.40807e-5
    -  x[1891] ≥ 0 => 1.71395e-5
    -  x[25] ≥ 0   => 1.10219e-5
    -  x[4602] ≥ 0 => 2.01984e-5
    -  x[214] ≥ 0  => 1.56101e-5
    -  x[1623] ≥ 0 => 1.71395e-5
    -  x[7544] ≥ 0 => 2.32572e-5
    -  x[5227] ≥ 0 => 1.71395e-5
    -  x[2579] ≥ 0 => 1.40807e-5
    -  x[2448] ≥ 0 => 1.8669e-5
    -  x[7951] ≥ 0 => 2.01984e-5
    -  x[8012] ≥ 0 => 2.17278e-5
    -  x[4456] ≥ 0 => 1.8669e-5
    -  x[3924] ≥ 0 => 2.01984e-5
    +  x[5060] ≥ 0 => 1.8669e-5
    +  x[5783] ≥ 0 => 1.8669e-5
    +  x[7924] ≥ 0 => 2.32572e-5
    +  x[3867] ≥ 0 => 1.8669e-5
    +  x[181] ≥ 0  => 1.40807e-5
    +  x[2378] ≥ 0 => 1.56101e-5
    +  x[1119] ≥ 0 => 1.71395e-5
    +  x[4893] ≥ 0 => 1.71395e-5
    +  x[7753] ≥ 0 => 1.71395e-5
    +  x[586] ≥ 0  => 1.40807e-5
    +  x[1382] ≥ 0 => 1.71395e-5
    +  x[5776] ≥ 0 => 2.01984e-5
    +  x[1108] ≥ 0 => 1.56101e-5
    +  x[5404] ≥ 0 => 1.8669e-5
    +  x[3248] ≥ 0 => 2.01984e-5
    +  x[5649] ≥ 0 => 1.40807e-5
    +  x[6928] ≥ 0 => 2.01984e-5
    +  x[1227] ≥ 0 => 1.56101e-5
    +  x[3008] ≥ 0 => 2.32572e-5
       ⋮           => ⋮

    report is a dictionary which maps constraints to the violation. The largest violation is approximately 1e-5:

    maximum(values(report))
    6.92133754155444e-5

    This makes sense, because the default primal feasibility tolerance for SCS is 1e-4.

    Most of the entries are lower bound constraints on the variables. Here are all the variables which violate their lower bound:

    violated_variables = filter(xi -> value(xi) < 0, x)
    8178-element Vector{VariableRef}:
      x[4]
      x[6]
    @@ -104,14 +104,14 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 2.00e+01  1.00e+00  2.00e+01 -9.98e+00  1.00e-01  3.40e-02
    -   250| 2.01e-02  2.85e-04  2.00e-02  3.01e-02  3.86e-01  1.85e-01
    -   500| 3.69e-04  5.93e-04  8.84e-05  8.48e-01  6.13e-01  3.39e-01
    -   550| 2.66e-06  6.58e-10  1.27e-05  8.48e-01  6.13e-01  3.70e-01
    +     0| 2.00e+01  1.00e+00  2.00e+01 -9.98e+00  1.00e-01  3.21e-02
    +   250| 2.01e-02  2.85e-04  2.00e-02  3.01e-02  3.86e-01  1.73e-01
    +   500| 3.69e-04  5.93e-04  8.84e-05  8.48e-01  6.13e-01  3.17e-01
    +   550| 2.66e-06  6.58e-10  1.27e-05  8.48e-01  6.13e-01  3.45e-01
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 3.70e-01s = setup: 3.28e-02s + solve: 3.37e-01s
    -	 lin-sys: 2.74e-01s, cones: 1.21e-02s, accel: 6.84e-03s
    +timings: total: 3.45e-01s = setup: 3.11e-02s + solve: 3.14e-01s
    +	 lin-sys: 2.57e-01s, cones: 1.10e-02s, accel: 5.17e-03s
     ------------------------------------------------------------------
     objective = 0.847906
     ------------------------------------------------------------------
    @assert is_solved_and_feasible(model)
    @@ -151,4 +151,4 @@
     is_solved_and_feasible(model)
    false

    HiGHS reports the problem is infeasible, but there is a feasible (to tolerance) solution of:

    primal_feasibility_report(model, Dict(x => 1.0, y => 1e-6))
    Dict{Any, Float64} with 1 entry:
       y binary => 1.0e-6

    This happens because the presolve routine deduces that the y <= 0.5 constraint forces the binary variable y to take the value 0. Substituting the value for y into the last constraint, presolve may also deduce that x <= 0, which violates the bound of x >= 1 and so the problem is infeasible.

    We can work around this by providing HiGHS with the feasible starting solution:

    set_start_value(x, 1)
     set_start_value(y, 1e-6)

    Now HiGHS will report that the problem is feasible:

    optimize!(model)
    -is_solved_and_feasible(model)
    true

    Contradictory results are not a bug in the solver

    These contradictory examples are not bugs in the HiGHS solver. They are an expected result of the interaction between the tolerances and the solution algorithm. There will always be models in the gray boundary at the edge of feasibility, for which the question of feasibility is not a clear true or false.

    +is_solved_and_feasible(model)
    true

    Contradictory results are not a bug in the solver

    These contradictory examples are not bugs in the HiGHS solver. They are an expected result of the interaction between the tolerances and the solution algorithm. There will always be models in the gray boundary at the edge of feasibility, for which the question of feasibility is not a clear true or false.

    diff --git a/previews/PR3838/tutorials/linear/basis/index.html b/previews/PR3838/tutorials/linear/basis/index.html index ebb8d0188f0..6e57c038c66 100644 --- a/previews/PR3838/tutorials/linear/basis/index.html +++ b/previews/PR3838/tutorials/linear/basis/index.html @@ -96,4 +96,4 @@ @constraint(model, A * x == b) optimize!(model) degenerate_variables = filter(is_degenerate, all_variables(model))
    1-element Vector{VariableRef}:
    - x[1]

    The solution is degenerate because:

    value(x[1])
    -0.0

    and

    get_attribute(x[1], MOI.VariableBasisStatus())
    BASIC::BasisStatusCode = 0
    + x[1]

    The solution is degenerate because:

    value(x[1])
    -0.0

    and

    get_attribute(x[1], MOI.VariableBasisStatus())
    BASIC::BasisStatusCode = 0
    diff --git a/previews/PR3838/tutorials/linear/callbacks/index.html b/previews/PR3838/tutorials/linear/callbacks/index.html index 98dee6346f1..25ed9dca835 100644 --- a/previews/PR3838/tutorials/linear/callbacks/index.html +++ b/previews/PR3838/tutorials/linear/callbacks/index.html @@ -166,4 +166,4 @@ Adding ScalarConstraint{AffExpr, MathOptInterface.LessThan{Float64}}(y - x, MathOptInterface.LessThan{Float64}(1.0)) Called from reason = 7 Called from reason = 1 -Called from reason = 2 +Called from reason = 2 diff --git a/previews/PR3838/tutorials/linear/cannery/index.html b/previews/PR3838/tutorials/linear/cannery/index.html index 18131a2caa4..5a4a81dbe3d 100644 --- a/previews/PR3838/tutorials/linear/cannery/index.html +++ b/previews/PR3838/tutorials/linear/cannery/index.html @@ -76,7 +76,7 @@ Dual objective value : 1.68000e+03 * Work counters - Solve time (sec) : 2.13623e-04 + Solve time (sec) : 1.76668e-04 Simplex iterations : 3 Barrier iterations : 0 Node count : -1 @@ -88,4 +88,4 @@ Seattle => New-York: 0.0 San-Diego => Chicago: 0.0 San-Diego => Topeka: 300.0 -San-Diego => New-York: 300.0 +San-Diego => New-York: 300.0 diff --git a/previews/PR3838/tutorials/linear/constraint_programming/index.html b/previews/PR3838/tutorials/linear/constraint_programming/index.html index f5f69c977c9..1b2a75cbf28 100644 --- a/previews/PR3838/tutorials/linear/constraint_programming/index.html +++ b/previews/PR3838/tutorials/linear/constraint_programming/index.html @@ -97,4 +97,4 @@ value.(x)
    3-element Vector{Float64}:
      1.0
      1.0
    - 0.0
    + 0.0 diff --git a/previews/PR3838/tutorials/linear/diet/index.html b/previews/PR3838/tutorials/linear/diet/index.html index 2bbc324a55f..4309f332b63 100644 --- a/previews/PR3838/tutorials/linear/diet/index.html +++ b/previews/PR3838/tutorials/linear/diet/index.html @@ -11,7 +11,7 @@ \min & \sum\limits_{f \in F} c_f x_f \\ \text{s.t.}\ \ & l_m \le \sum\limits_{f \in F} a_{m,f} x_f \le u_m, && \forall m \in M \\ & x_f \ge 0, && \forall f \in F. -\end{aligned}\]

    In the rest of this tutorial, we will create and solve this problem in JuMP, and learn what we should cook for dinner.

    Data

    First, we need some data for the problem. For this tutorial, we'll write CSV files to a temporary directory from Julia. If you have existing files, you could change the filenames to point to them instead.

    dir = mktempdir()
    "/tmp/jl_p3JpOc"

    The first file is a list of foods with their macro-nutrient profile:

    food_csv_filename = joinpath(dir, "diet_foods.csv")
    +\end{aligned}\]

    In the rest of this tutorial, we will create and solve this problem in JuMP, and learn what we should cook for dinner.

    Data

    First, we need some data for the problem. For this tutorial, we'll write CSV files to a temporary directory from Julia. If you have existing files, you could change the filenames to point to them instead.

    dir = mktempdir()
    "/tmp/jl_xQnVNS"

    The first file is a list of foods with their macro-nutrient profile:

    food_csv_filename = joinpath(dir, "diet_foods.csv")
     open(food_csv_filename, "w") do io
         write(
             io,
    @@ -103,7 +103,7 @@
       Dual objective value : 1.18289e+01
     
     * Work counters
    -  Solve time (sec)   : 2.20060e-04
    +  Solve time (sec)   : 1.94311e-04
       Simplex iterations : 6
       Barrier iterations : 0
       Node count         : -1
    @@ -142,8 +142,8 @@
       Dual objective value : 3.56146e+00
     
     * Work counters
    -  Solve time (sec)   : 1.38998e-04
    +  Solve time (sec)   : 1.35422e-04
       Simplex iterations : 0
       Barrier iterations : 0
       Node count         : -1
    -

    There exists no feasible solution to our problem. Looks like we're stuck eating ice cream for dinner.

    Next steps

    • You can delete a constraint using delete(model, dairy_constraint). Can you add a different constraint to provide a diet with less dairy?
    • Some food items (like hamburgers) are discrete. You can use set_integer to force a variable to take integer values. What happens to the solution if you do?
    +

    There exists no feasible solution to our problem. Looks like we're stuck eating ice cream for dinner.

    Next steps

    • You can delete a constraint using delete(model, dairy_constraint). Can you add a different constraint to provide a diet with less dairy?
    • Some food items (like hamburgers) are discrete. You can use set_integer to force a variable to take integer values. What happens to the solution if you do?
    diff --git a/previews/PR3838/tutorials/linear/facility_location/0ab70411.svg b/previews/PR3838/tutorials/linear/facility_location/491dad85.svg similarity index 79% rename from previews/PR3838/tutorials/linear/facility_location/0ab70411.svg rename to previews/PR3838/tutorials/linear/facility_location/491dad85.svg index b0921e703b5..b4eb1cb1274 100644 --- a/previews/PR3838/tutorials/linear/facility_location/0ab70411.svg +++ b/previews/PR3838/tutorials/linear/facility_location/491dad85.svg @@ -1,69 +1,69 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/facility_location/7b9ef6a0.svg b/previews/PR3838/tutorials/linear/facility_location/626cc0b9.svg similarity index 81% rename from previews/PR3838/tutorials/linear/facility_location/7b9ef6a0.svg rename to previews/PR3838/tutorials/linear/facility_location/626cc0b9.svg index 51a391e7a27..56e5945324f 100644 --- a/previews/PR3838/tutorials/linear/facility_location/7b9ef6a0.svg +++ b/previews/PR3838/tutorials/linear/facility_location/626cc0b9.svg @@ -1,61 +1,61 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/facility_location/e19ddf83.svg b/previews/PR3838/tutorials/linear/facility_location/d22ea3ae.svg similarity index 80% rename from previews/PR3838/tutorials/linear/facility_location/e19ddf83.svg rename to previews/PR3838/tutorials/linear/facility_location/d22ea3ae.svg index b8036f1d10b..195a6781f61 100644 --- a/previews/PR3838/tutorials/linear/facility_location/e19ddf83.svg +++ b/previews/PR3838/tutorials/linear/facility_location/d22ea3ae.svg @@ -1,57 +1,57 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/facility_location/3ab94e28.svg b/previews/PR3838/tutorials/linear/facility_location/f8a9e3bf.svg similarity index 79% rename from previews/PR3838/tutorials/linear/facility_location/3ab94e28.svg rename to previews/PR3838/tutorials/linear/facility_location/f8a9e3bf.svg index 1bec3e99f6c..9d9f5550bad 100644 --- a/previews/PR3838/tutorials/linear/facility_location/3ab94e28.svg +++ b/previews/PR3838/tutorials/linear/facility_location/f8a9e3bf.svg @@ -1,69 +1,69 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/facility_location/index.html b/previews/PR3838/tutorials/linear/facility_location/index.html index 44507719946..e1b2751c383 100644 --- a/previews/PR3838/tutorials/linear/facility_location/index.html +++ b/previews/PR3838/tutorials/linear/facility_location/index.html @@ -51,7 +51,7 @@ markersize = 6, markerstrokecolor = :red, markerstrokewidth = 2, -)Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
    +)
    Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, y[1:n], Bin);
     @variable(model, x[1:m, 1:n], Bin);
    @@ -94,7 +94,7 @@
         end
     end
     
    -p
    Example block output

    Capacitated facility location

    Problem formulation

    The capacitated variant introduces a capacity constraint on each facility, that is, clients have a certain level of demand to be served, while each facility only has finite capacity which cannot be exceeded.

    Specifically,

    • The demand of client $i$ is denoted by $a_{i} \geq 0$
    • The capacity of facility $j$ is denoted by $q_{j} \geq 0$

    The capacity constraints then write

    \[\begin{aligned} +pExample block output

    Capacitated facility location

    Problem formulation

    The capacitated variant introduces a capacity constraint on each facility, that is, clients have a certain level of demand to be served, while each facility only has finite capacity which cannot be exceeded.

    Specifically,

    • The demand of client $i$ is denoted by $a_{i} \geq 0$
    • The capacity of facility $j$ is denoted by $q_{j} \geq 0$

    The capacity constraints then write

    \[\begin{aligned} \sum_{i} a_{i} x_{i, j} &\leq q_{j} y_{j} && \forall j \in N \end{aligned}\]

    Note that, if $y_{j}$ is set to $0$, the capacity constraint above automatically forces $x_{i, j}$ to $0$.

    Thus, the capacitated facility location can be formulated as follows

    \[\begin{aligned} \min_{x, y} \ \ \ & @@ -126,7 +126,7 @@ markersize = q, markerstrokecolor = :red, markerstrokewidth = 2, -)Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
    +)
    Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, y[1:n], Bin);
     @variable(model, x[1:m, 1:n], Bin);
    @@ -169,4 +169,4 @@
         end
     end
     
    -p
    Example block output +pExample block output diff --git a/previews/PR3838/tutorials/linear/factory_schedule/685cf118.svg b/previews/PR3838/tutorials/linear/factory_schedule/16aad172.svg similarity index 78% rename from previews/PR3838/tutorials/linear/factory_schedule/685cf118.svg rename to previews/PR3838/tutorials/linear/factory_schedule/16aad172.svg index 1d8a72a7cac..aefe3bf37ee 100644 --- a/previews/PR3838/tutorials/linear/factory_schedule/685cf118.svg +++ b/previews/PR3838/tutorials/linear/factory_schedule/16aad172.svg @@ -1,160 +1,160 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/factory_schedule/770dce83.svg b/previews/PR3838/tutorials/linear/factory_schedule/2d072995.svg similarity index 78% rename from previews/PR3838/tutorials/linear/factory_schedule/770dce83.svg rename to previews/PR3838/tutorials/linear/factory_schedule/2d072995.svg index b53dad19fba..51c16a56da3 100644 --- a/previews/PR3838/tutorials/linear/factory_schedule/770dce83.svg +++ b/previews/PR3838/tutorials/linear/factory_schedule/2d072995.svg @@ -1,162 +1,162 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/factory_schedule/223d6540.svg b/previews/PR3838/tutorials/linear/factory_schedule/fa5f7d58.svg similarity index 86% rename from previews/PR3838/tutorials/linear/factory_schedule/223d6540.svg rename to previews/PR3838/tutorials/linear/factory_schedule/fa5f7d58.svg index d27e62d1151..a76282032f5 100644 --- a/previews/PR3838/tutorials/linear/factory_schedule/223d6540.svg +++ b/previews/PR3838/tutorials/linear/factory_schedule/fa5f7d58.svg @@ -1,81 +1,81 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/factory_schedule/index.html b/previews/PR3838/tutorials/linear/factory_schedule/index.html index c78187e8d59..b4a59d7f9e4 100644 --- a/previews/PR3838/tutorials/linear/factory_schedule/index.html +++ b/previews/PR3838/tutorials/linear/factory_schedule/index.html @@ -126,7 +126,7 @@ ylabel = "Production", legend = :topleft, color = ["#20326c" "#4063d8" "#a0b1ec"], -)Example block output

    Note that we don't have any unmet demand.

    What happens if demand increases?

    Let's run an experiment by increasing the demand by 50% in all time periods:

    demand_df.demand .*= 1.5
    12-element Vector{Float64}:
    +)
    Example block output

    Note that we don't have any unmet demand.

    What happens if demand increases?

    Let's run an experiment by increasing the demand by 50% in all time periods:

    demand_df.demand .*= 1.5
    12-element Vector{Float64}:
      180000.0
      150000.0
      195000.0
    @@ -146,7 +146,7 @@
         ylabel = "Production",
         legend = :topleft,
         color = ["#20326c" "#4063d8" "#a0b1ec"],
    -)
    Example block output

    Uh oh, we can't satisfy all of the demand.

    How sensitive is the solution to changes in variable cost?

    Let's run another experiment, this time seeing how the optimal objective value changes as we vary the variable costs of each factory.

    First though, let's reset the demand to it's original level:

    demand_df.demand ./= 1.5;

    For our experiment, we're going to scale the variable costs of both factories by a set of values from 0.0 to 1.5:

    scale_factors = 0:0.1:1.5
    0.0:0.1:1.5

    At a high level, we're going to loop over the scale factors for A, then the scale factors for B, rescale the input data, call our solve_factory_scheduling example, and then store the optimal objective value in the following cost matrix:

    cost = zeros(length(scale_factors), length(scale_factors));

    Because we're modifying factory_df in-place, we need to store the original variable costs in a new column:

    factory_df[!, :old_variable_cost] = copy(factory_df.variable_cost);

    Then, we need a function to scale the :variable_cost column for a particular factory by a value scale:

    function scale_variable_cost(df, factory, scale)
    +)
    Example block output

    Uh oh, we can't satisfy all of the demand.

    How sensitive is the solution to changes in variable cost?

    Let's run another experiment, this time seeing how the optimal objective value changes as we vary the variable costs of each factory.

    First though, let's reset the demand to it's original level:

    demand_df.demand ./= 1.5;

    For our experiment, we're going to scale the variable costs of both factories by a set of values from 0.0 to 1.5:

    scale_factors = 0:0.1:1.5
    0.0:0.1:1.5

    At a high level, we're going to loop over the scale factors for A, then the scale factors for B, rescale the input data, call our solve_factory_scheduling example, and then store the optimal objective value in the following cost matrix:

    cost = zeros(length(scale_factors), length(scale_factors));

    Because we're modifying factory_df in-place, we need to store the original variable costs in a new column:

    factory_df[!, :old_variable_cost] = copy(factory_df.variable_cost);

    Then, we need a function to scale the :variable_cost column for a particular factory by a value scale:

    function scale_variable_cost(df, factory, scale)
         rows = df.factory .== factory
         df[rows, :variable_cost] .=
             round.(Int, df[rows, :old_variable_cost] .* scale)
    @@ -163,4 +163,4 @@
         cost;
         xlabel = "Scale of factory A",
         ylabel = "Scale of factory B",
    -)
    Example block output

    What can you infer from the solution?

    Info

    The Power Systems tutorial explains a number of other ways you can structure a problem to perform a parametric analysis of the solution. In particular, you can use in-place modification to reduce the time it takes to build and solve the resulting models.

    +)Example block output

    What can you infer from the solution?

    Info

    The Power Systems tutorial explains a number of other ways you can structure a problem to perform a parametric analysis of the solution. In particular, you can use in-place modification to reduce the time it takes to build and solve the resulting models.

    diff --git a/previews/PR3838/tutorials/linear/finance/index.html b/previews/PR3838/tutorials/linear/finance/index.html index c171944ea8e..d37664453e9 100644 --- a/previews/PR3838/tutorials/linear/finance/index.html +++ b/previews/PR3838/tutorials/linear/finance/index.html @@ -50,4 +50,4 @@ 1.0 -0.0 -0.0 - 0.0 + 0.0 diff --git a/previews/PR3838/tutorials/linear/geographic_clustering/index.html b/previews/PR3838/tutorials/linear/geographic_clustering/index.html index 9edb7239152..c3acf2860a7 100644 --- a/previews/PR3838/tutorials/linear/geographic_clustering/index.html +++ b/previews/PR3838/tutorials/linear/geographic_clustering/index.html @@ -135,4 +135,4 @@ 5 │ San Francisco, CA 0.837 37.7749 -122.419 3.0 6 │ El Paso, TX 0.674 31.7775 -106.442 3.0 -sum(group.population) = 9.261000000000001 +sum(group.population) = 9.261000000000001 diff --git a/previews/PR3838/tutorials/linear/introduction/index.html b/previews/PR3838/tutorials/linear/introduction/index.html index d33b4338813..4a2466dcf15 100644 --- a/previews/PR3838/tutorials/linear/introduction/index.html +++ b/previews/PR3838/tutorials/linear/introduction/index.html @@ -7,4 +7,4 @@ \min_{x \in \mathbb{R}^n} & \sum\limits_{i=1}^n c_i x_i \\ \;\;\text{s.t.} & l_j \le \sum\limits_{i=1}^n a_{ij} x_i \le u_j & j = 1 \ldots m \\ & l_i \le x_i \le u_i & i = 1 \ldots n. -\end{align}\]

    The most important thing to note is that all terms are of the form coefficient * variable, and that there are no nonlinear terms or multiplications between variables.

    Mixed-integer linear programs (MILPs) are extensions of linear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    Almost all solvers support linear programs; look for "LP" in the list of Supported solvers. However, fewer solvers support mixed-integer linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Tips and tricks tutorial contains a number of helpful reformulations and tricks you can use when modeling linear programs. Look here if you are stuck trying to formulate a problem as a linear program.
    • The Sensitivity analysis of a linear program tutorial explains how to create sensitivity reports like those produced by the Excel Solver.
    • The Callbacks tutorial explains how to write a variety of solver-independent callbacks. Look here if you want to write a callback.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    +\end{align}\]

    The most important thing to note is that all terms are of the form coefficient * variable, and that there are no nonlinear terms or multiplications between variables.

    Mixed-integer linear programs (MILPs) are extensions of linear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    Almost all solvers support linear programs; look for "LP" in the list of Supported solvers. However, fewer solvers support mixed-integer linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Tips and tricks tutorial contains a number of helpful reformulations and tricks you can use when modeling linear programs. Look here if you are stuck trying to formulate a problem as a linear program.
    • The Sensitivity analysis of a linear program tutorial explains how to create sensitivity reports like those produced by the Excel Solver.
    • The Callbacks tutorial explains how to write a variety of solver-independent callbacks. Look here if you want to write a callback.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    diff --git a/previews/PR3838/tutorials/linear/knapsack/index.html b/previews/PR3838/tutorials/linear/knapsack/index.html index f4449ff04f1..cd7e88e2665 100644 --- a/previews/PR3838/tutorials/linear/knapsack/index.html +++ b/previews/PR3838/tutorials/linear/knapsack/index.html @@ -48,7 +48,7 @@ Relative gap : 0.00000e+00 * Work counters - Solve time (sec) : 5.39541e-04 + Solve time (sec) : 4.92573e-04 Simplex iterations : 1 Barrier iterations : -1 Node count : 1 @@ -83,4 +83,4 @@ solve_knapsack_problem(; profit = profit, weight = weight, capacity = capacity)
    3-element Vector{Int64}:
      1
      4
    - 5

    We observe that the chosen items (1, 4, and 5) have the best profit to weight ratio in this particular example.

    Next steps

    Here are some things to try next:

    • Call the function with different data. What happens as the capacity increases?
    • What happens if the profit and weight vectors are different lengths?
    • Instead of creating a binary variable with Bin, we could have written @variable(model, 0 <= x[1:n] <= 1, Int). Verify that this formulation finds the same solution. What happens if we are allowed to take more than one of each item?
    + 5

    We observe that the chosen items (1, 4, and 5) have the best profit to weight ratio in this particular example.

    Next steps

    Here are some things to try next:

    • Call the function with different data. What happens as the capacity increases?
    • What happens if the profit and weight vectors are different lengths?
    • Instead of creating a binary variable with Bin, we could have written @variable(model, 0 <= x[1:n] <= 1, Int). Verify that this formulation finds the same solution. What happens if we are allowed to take more than one of each item?
    diff --git a/previews/PR3838/tutorials/linear/lp_sensitivity/index.html b/previews/PR3838/tutorials/linear/lp_sensitivity/index.html index de17a51006a..0842e8d08a8 100644 --- a/previews/PR3838/tutorials/linear/lp_sensitivity/index.html +++ b/previews/PR3838/tutorials/linear/lp_sensitivity/index.html @@ -40,11 +40,11 @@ c3 : 0.00000e+00 * Work counters - Solve time (sec) : 2.41280e-04 + Solve time (sec) : 2.04086e-04 Simplex iterations : 2 Barrier iterations : 0 Node count : -1 -

    Can you identify:

    • The objective coefficient of each variable?
    • The right-hand side of each constraint?
    • The optimal primal and dual solutions?

    Sensitivity reports

    Now let's call lp_sensitivity_report:

    report = lp_sensitivity_report(model)
    SensitivityReport{Float64}(Dict{ConstraintRef, Tuple{Float64, Float64}}(c1 : 6 x + 8 y ≥ 100 => (-4.0, 2.857142857142857), z ≤ 1 => (-Inf, Inf), x ≥ 0 => (-Inf, 15.0), y ≥ 0 => (-Inf, 1.25), y ≤ 3 => (-1.75, Inf), c3 : x + y ≤ 20 => (-3.75, Inf), c2 : 7 x + 12 y ≥ 120 => (-3.3333333333333335, 4.666666666666667)), Dict{VariableRef, Tuple{Float64, Float64}}(y => (-4.0, 0.5714285714285714), x => (-0.3333333333333333, 3.0), z => (-Inf, 1.0)))

    It returns a SensitivityReport object, which maps:

    • Every variable reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
    • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

    Both tuples are relative, rather than absolute. So, given an objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

    For example:

    report[x]
    (-0.3333333333333333, 3.0)

    indicates that the objective coefficient on x, that is, 12, can decrease by -0.333 or increase by 3.0 and the primal solution (15, 1.25) will remain optimal. In addition:

    report[c1]
    (-4.0, 2.857142857142857)

    means that the right-hand side of the c1 constraint (100), can decrease by 4 units, or increase by 2.85 units, and the primal solution (15, 1.25) will remain optimal.

    Variable sensitivity

    By themselves, the tuples aren't informative. Let's put them in context by collating a range of other information about a variable:

    function variable_report(xi)
    +

    Can you identify:

    • The objective coefficient of each variable?
    • The right-hand side of each constraint?
    • The optimal primal and dual solutions?

    Sensitivity reports

    Now let's call lp_sensitivity_report:

    report = lp_sensitivity_report(model)
    SensitivityReport{Float64}(Dict{ConstraintRef, Tuple{Float64, Float64}}(y ≤ 3 => (-1.75, Inf), c2 : 7 x + 12 y ≥ 120 => (-3.3333333333333335, 4.666666666666667), y ≥ 0 => (-Inf, 1.25), x ≥ 0 => (-Inf, 15.0), z ≤ 1 => (-Inf, Inf), c1 : 6 x + 8 y ≥ 100 => (-4.0, 2.857142857142857), c3 : x + y ≤ 20 => (-3.75, Inf)), Dict{VariableRef, Tuple{Float64, Float64}}(y => (-4.0, 0.5714285714285714), x => (-0.3333333333333333, 3.0), z => (-Inf, 1.0)))

    It returns a SensitivityReport object, which maps:

    • Every variable reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
    • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

    Both tuples are relative, rather than absolute. So, given an objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

    For example:

    report[x]
    (-0.3333333333333333, 3.0)

    indicates that the objective coefficient on x, that is, 12, can decrease by -0.333 or increase by 3.0 and the primal solution (15, 1.25) will remain optimal. In addition:

    report[c1]
    (-4.0, 2.857142857142857)

    means that the right-hand side of the c1 constraint (100), can decrease by 4 units, or increase by 2.85 units, and the primal solution (15, 1.25) will remain optimal.

    Variable sensitivity

    By themselves, the tuples aren't informative. Let's put them in context by collating a range of other information about a variable:

    function variable_report(xi)
         return (
             name = name(xi),
             lower_bound = has_lower_bound(xi) ? lower_bound(xi) : -Inf,
    @@ -71,4 +71,4 @@
     c1_report = constraint_report(c1)
    (name = "c1", value = 100.0, rhs = 100.0, slack = 0.0, shadow_price = -0.25, allowed_decrease = -4.0, allowed_increase = 2.857142857142857)

    That's a bit hard to read, so let's call this on every variable in the model and put things into a DataFrame:

    constraint_df = DataFrames.DataFrame(
         constraint_report(ci) for (F, S) in list_of_constraint_types(model) for
         ci in all_constraints(model, F, S) if F == AffExpr
    -)
    3×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    3c316.2520.03.750.0-3.75Inf

    Analysis questions

    Now we can use these dataframes to ask questions of the solution.

    For example, we can find basic variables by looking for variables with a reduced cost of 0:

    basic = filter(row -> iszero(row.reduced_cost), variable_df)
    2×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1x0.015.0Inf0.012.0-0.3333333.0
    2y0.01.253.00.020.0-4.00.571429

    and non-basic variables by looking for non-zero reduced costs:

    non_basic = filter(row -> !iszero(row.reduced_cost), variable_df)
    1×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1z-Inf1.01.0-1.0-1.0-Inf1.0

    we can also find constraints that are binding by looking for zero slacks:

    binding = filter(row -> iszero(row.slack), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667

    or non-zero shadow prices:

    binding2 = filter(row -> !iszero(row.shadow_price), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    +)
    3×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    3c316.2520.03.750.0-3.75Inf

    Analysis questions

    Now we can use these dataframes to ask questions of the solution.

    For example, we can find basic variables by looking for variables with a reduced cost of 0:

    basic = filter(row -> iszero(row.reduced_cost), variable_df)
    2×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1x0.015.0Inf0.012.0-0.3333333.0
    2y0.01.253.00.020.0-4.00.571429

    and non-basic variables by looking for non-zero reduced costs:

    non_basic = filter(row -> !iszero(row.reduced_cost), variable_df)
    1×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1z-Inf1.01.0-1.0-1.0-Inf1.0

    we can also find constraints that are binding by looking for zero slacks:

    binding = filter(row -> iszero(row.slack), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667

    or non-zero shadow prices:

    binding2 = filter(row -> !iszero(row.shadow_price), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    diff --git a/previews/PR3838/tutorials/linear/mip_duality/index.html b/previews/PR3838/tutorials/linear/mip_duality/index.html index 2852bd463e4..391f10cb090 100644 --- a/previews/PR3838/tutorials/linear/mip_duality/index.html +++ b/previews/PR3838/tutorials/linear/mip_duality/index.html @@ -113,4 +113,4 @@ g[2] ≤ 1000 w ≤ 200 dispatch[1] binary - dispatch[2] binary + dispatch[2] binary diff --git a/previews/PR3838/tutorials/linear/multi/index.html b/previews/PR3838/tutorials/linear/multi/index.html index 273ed04d3ec..3898b4af835 100644 --- a/previews/PR3838/tutorials/linear/multi/index.html +++ b/previews/PR3838/tutorials/linear/multi/index.html @@ -118,7 +118,7 @@ INNER JOIN locations b ON a.type = 'origin' AND b.type = 'destination' """, -)
    SQLite.Query{false}(SQLite.Stmt(SQLite.DB("/home/runner/work/JuMP.jl/JuMP.jl/docs/build/tutorials/linear/multi.sqlite"), Base.RefValue{Ptr{SQLite.C.sqlite3_stmt}}(Ptr{SQLite.C.sqlite3_stmt} @0x000000003d05a1d8), Dict{Int64, Any}()), Base.RefValue{Int32}(100), [:origin, :destination], Type[Union{Missing, String}, Union{Missing, String}], Dict(:origin => 1, :destination => 2), Base.RefValue{Int64}(0))

    With a constraint that we cannot send more than 625 units between each pair:

    for r in Tables.rows(od_pairs)
    +)
    SQLite.Query{false}(SQLite.Stmt(SQLite.DB("/home/runner/work/JuMP.jl/JuMP.jl/docs/build/tutorials/linear/multi.sqlite"), Base.RefValue{Ptr{SQLite.C.sqlite3_stmt}}(Ptr{SQLite.C.sqlite3_stmt} @0x000000003b286918), Dict{Int64, Any}()), Base.RefValue{Int32}(100), [:origin, :destination], Type[Union{Missing, String}, Union{Missing, String}], Dict(:origin => 1, :destination => 2), Base.RefValue{Int64}(0))

    With a constraint that we cannot send more than 625 units between each pair:

    for r in Tables.rows(od_pairs)
         @constraint(model, sum(x[r.origin, r.destination, :]) <= 625)
     end

    Solution

    Finally, we can optimize the model:

    optimize!(model)
     Test.@test is_solved_and_feasible(model)
    @@ -139,7 +139,7 @@
       Dual objective value : 2.25700e+05
     
     * Work counters
    -  Solve time (sec)   : 6.41584e-04
    +  Solve time (sec)   : 6.31571e-04
       Simplex iterations : 54
       Barrier iterations : 0
       Node count         : -1
    @@ -170,4 +170,4 @@
     PITT WIN    75   250    .
     PITT STL   400    25   200
     PITT FRE    .    450   100
    -PITT LAF   250   125    .
    +PITT LAF 250 125 . diff --git a/previews/PR3838/tutorials/linear/multi_commodity_network/index.html b/previews/PR3838/tutorials/linear/multi_commodity_network/index.html index 3cb44b11c07..c0a955a074e 100644 --- a/previews/PR3838/tutorials/linear/multi_commodity_network/index.html +++ b/previews/PR3838/tutorials/linear/multi_commodity_network/index.html @@ -87,7 +87,7 @@ Dual objective value : 1.43228e+02 * Work counters - Solve time (sec) : 3.16381e-04 + Solve time (sec) : 2.88248e-04 Simplex iterations : 8 Barrier iterations : 0 Node count : -1 @@ -95,4 +95,4 @@ df_supply.x_supply = value.(df_supply.x_supply);

    and display the optimal solution for flows:

    DataFrames.select(
         filter!(row -> row.x_flow > 0.0, df_shipping),
         [:origin, :destination, :product, :x_flow],
    -)
    9×4 DataFrame
    Roworigindestinationproductx_flow
    StringStringStringFloat64
    1waikatoaucklandmilk10.0
    2waikatowellingtonmilk2.0
    3taurangaaucklandmilk2.0
    4taurangawaikatomilk2.0
    5christchurchaucklandmilk4.0
    6aucklandchristchurchkiwifruit4.0
    7waikatoaucklandkiwifruit20.0
    8waikatowellingtonkiwifruit2.0
    9taurangawaikatokiwifruit22.0
    +)
    9×4 DataFrame
    Roworigindestinationproductx_flow
    StringStringStringFloat64
    1waikatoaucklandmilk10.0
    2waikatowellingtonmilk2.0
    3taurangaaucklandmilk2.0
    4taurangawaikatomilk2.0
    5christchurchaucklandmilk4.0
    6aucklandchristchurchkiwifruit4.0
    7waikatoaucklandkiwifruit20.0
    8waikatowellingtonkiwifruit2.0
    9taurangawaikatokiwifruit22.0
    diff --git a/previews/PR3838/tutorials/linear/multi_objective_examples/index.html b/previews/PR3838/tutorials/linear/multi_objective_examples/index.html index 3ea4be8b0df..9a69a1d1e2e 100644 --- a/previews/PR3838/tutorials/linear/multi_objective_examples/index.html +++ b/previews/PR3838/tutorials/linear/multi_objective_examples/index.html @@ -31,7 +31,7 @@ Dual objective value : -1.50000e+01 * Work counters - Solve time (sec) : 1.15013e-03 + Solve time (sec) : 1.02997e-03 Simplex iterations : 0 Barrier iterations : 0 Node count : 0 @@ -68,7 +68,7 @@ Relative gap : 0.00000e+00 * Work counters - Solve time (sec) : 7.34806e-03 + Solve time (sec) : 8.97503e-03 Simplex iterations : 0 Barrier iterations : 0 Node count : 0 @@ -125,7 +125,7 @@ Relative gap : 0.00000e+00 * Work counters - Solve time (sec) : 5.24497e-03 + Solve time (sec) : 4.77982e-03 Simplex iterations : 0 Barrier iterations : 0 Node count : 0 @@ -142,4 +142,4 @@ end
    1: z = [8, 9] | Path: 1->2 2->4 4->6
     2: z = [10, 7] | Path: 1->2 2->5 5->6
     3: z = [11, 5] | Path: 1->2 2->6
    -4: z = [13, 4] | Path: 1->3 3->4 4->6
    +4: z = [13, 4] | Path: 1->3 3->4 4->6 diff --git a/previews/PR3838/tutorials/linear/multi_objective_knapsack/ad761c30.svg b/previews/PR3838/tutorials/linear/multi_objective_knapsack/26da78ba.svg similarity index 87% rename from previews/PR3838/tutorials/linear/multi_objective_knapsack/ad761c30.svg rename to previews/PR3838/tutorials/linear/multi_objective_knapsack/26da78ba.svg index 0ee9f36f01d..a6571a631f9 100644 --- a/previews/PR3838/tutorials/linear/multi_objective_knapsack/ad761c30.svg +++ b/previews/PR3838/tutorials/linear/multi_objective_knapsack/26da78ba.svg @@ -1,53 +1,53 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/multi_objective_knapsack/57151a29.svg b/previews/PR3838/tutorials/linear/multi_objective_knapsack/dda43991.svg similarity index 83% rename from previews/PR3838/tutorials/linear/multi_objective_knapsack/57151a29.svg rename to previews/PR3838/tutorials/linear/multi_objective_knapsack/dda43991.svg index fca2604eeeb..dd9df2a784f 100644 --- a/previews/PR3838/tutorials/linear/multi_objective_knapsack/57151a29.svg +++ b/previews/PR3838/tutorials/linear/multi_objective_knapsack/dda43991.svg @@ -1,55 +1,55 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/multi_objective_knapsack/index.html b/previews/PR3838/tutorials/linear/multi_objective_knapsack/index.html index 881cb06c9e1..32be882b7fe 100644 --- a/previews/PR3838/tutorials/linear/multi_objective_knapsack/index.html +++ b/previews/PR3838/tutorials/linear/multi_objective_knapsack/index.html @@ -25,7 +25,7 @@ xlabel = "Profit", ylabel = "Desire", legend = false, -)Example block output

    The goal of the bi-objective knapsack problem is to choose a subset which maximizes both objectives.

    JuMP formulation

    Our JuMP formulation is a direct translation of the mathematical formulation:

    model = Model()
    +)
    Example block output

    The goal of the bi-objective knapsack problem is to choose a subset which maximizes both objectives.

    JuMP formulation

    Our JuMP formulation is a direct translation of the mathematical formulation:

    model = Model()
     @variable(model, x[1:N], Bin)
     @constraint(model, sum(weight[i] * x[i] for i in 1:N) <= capacity)
     @expression(model, profit_expr, sum(profit[i] * x[i] for i in 1:N))
    @@ -51,7 +51,7 @@
       Relative gap       : 0.00000e+00
     
     * Work counters
    -  Solve time (sec)   : 9.68809e-02
    +  Solve time (sec)   : 1.01494e-01
       Simplex iterations : 0
       Barrier iterations : 0
       Node count         : 0
    @@ -81,7 +81,7 @@
         Plots.annotate!(y[1] - 1, y[2], (i, 10))
     end
     ideal_point = objective_bound(model)
    -Plots.scatter!([ideal_point[1]], [ideal_point[2]]; label = "Ideal point")
    Example block output

    Visualizing the objective space lets the decision maker choose a solution that suits their personal preferences. For example, result #7 is close to the maximum value of profit, but offers significantly higher desirability compared with solutions #8 and #9.

    The set of items that are chosen in solution #7 are:

    items_chosen = [i for i in 1:N if value(x[i]; result = 7) > 0.9]
    11-element Vector{Int64}:
    +Plots.scatter!([ideal_point[1]], [ideal_point[2]]; label = "Ideal point")
    Example block output

    Visualizing the objective space lets the decision maker choose a solution that suits their personal preferences. For example, result #7 is close to the maximum value of profit, but offers significantly higher desirability compared with solutions #8 and #9.

    The set of items that are chosen in solution #7 are:

    items_chosen = [i for i in 1:N if value(x[i]; result = 7) > 0.9]
    11-element Vector{Int64}:
       1
       2
       3
    @@ -92,4 +92,4 @@
      11
      15
      16
    - 17

    Next steps

    MultiObjectiveAlgorithms.jl implements a number of different algorithms. Try solving the same problem using MOA.Dichotomy(). Does it find the same solution?

    + 17

    Next steps

    MultiObjectiveAlgorithms.jl implements a number of different algorithms. Try solving the same problem using MOA.Dichotomy(). Does it find the same solution?

    diff --git a/previews/PR3838/tutorials/linear/n-queens/index.html b/previews/PR3838/tutorials/linear/n-queens/index.html index 0f2bbe6eadc..ec225c95d54 100644 --- a/previews/PR3838/tutorials/linear/n-queens/index.html +++ b/previews/PR3838/tutorials/linear/n-queens/index.html @@ -23,4 +23,4 @@ 0 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 - 0 1 0 0 0 0 0 0 + 0 1 0 0 0 0 0 0 diff --git a/previews/PR3838/tutorials/linear/network_flows/index.html b/previews/PR3838/tutorials/linear/network_flows/index.html index b36e2bab8de..7c7372a6c75 100644 --- a/previews/PR3838/tutorials/linear/network_flows/index.html +++ b/previews/PR3838/tutorials/linear/network_flows/index.html @@ -91,4 +91,4 @@ 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 - 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 + 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/f7522d63.svg b/previews/PR3838/tutorials/linear/piecewise_linear/044a3b21.svg similarity index 84% rename from previews/PR3838/tutorials/linear/piecewise_linear/f7522d63.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/044a3b21.svg index 7d890edb5a1..977f6a75200 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/f7522d63.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/044a3b21.svg @@ -1,65 +1,65 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/b507a7ef.svg b/previews/PR3838/tutorials/linear/piecewise_linear/16c489f6.svg similarity index 92% rename from previews/PR3838/tutorials/linear/piecewise_linear/b507a7ef.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/16c489f6.svg index c797ed0560b..a333368a332 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/b507a7ef.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/16c489f6.svg @@ -1,63 +1,63 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/a7de0b0a.svg b/previews/PR3838/tutorials/linear/piecewise_linear/365cf2f3.svg similarity index 85% rename from previews/PR3838/tutorials/linear/piecewise_linear/a7de0b0a.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/365cf2f3.svg index 30a19c899cd..39283795bdc 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/a7de0b0a.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/365cf2f3.svg @@ -1,44 +1,44 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/45fcbf6c.svg b/previews/PR3838/tutorials/linear/piecewise_linear/68c98407.svg similarity index 80% rename from previews/PR3838/tutorials/linear/piecewise_linear/45fcbf6c.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/68c98407.svg index c3f66a55530..fc742aea45c 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/45fcbf6c.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/68c98407.svg @@ -1,63 +1,63 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/f0ca95a3.svg b/previews/PR3838/tutorials/linear/piecewise_linear/73500721.svg similarity index 86% rename from previews/PR3838/tutorials/linear/piecewise_linear/f0ca95a3.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/73500721.svg index fe31206e653..f3f55ae5468 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/f0ca95a3.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/73500721.svg @@ -1,43 +1,43 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/9bd7e877.svg b/previews/PR3838/tutorials/linear/piecewise_linear/81ee56a7.svg similarity index 87% rename from previews/PR3838/tutorials/linear/piecewise_linear/9bd7e877.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/81ee56a7.svg index 379d2c07c81..d094dae941e 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/9bd7e877.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/81ee56a7.svg @@ -1,50 +1,50 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/fd1897f7.svg b/previews/PR3838/tutorials/linear/piecewise_linear/897bf5b8.svg similarity index 78% rename from previews/PR3838/tutorials/linear/piecewise_linear/fd1897f7.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/897bf5b8.svg index 12e3061af9e..2ac237f12d9 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/fd1897f7.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/897bf5b8.svg @@ -1,60 +1,60 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/bcf7d56d.svg b/previews/PR3838/tutorials/linear/piecewise_linear/8ec5e5ed.svg similarity index 81% rename from previews/PR3838/tutorials/linear/piecewise_linear/bcf7d56d.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/8ec5e5ed.svg index db99a4c9dbd..c7e2f1b673c 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/bcf7d56d.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/8ec5e5ed.svg @@ -1,45 +1,45 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/a907712b.svg b/previews/PR3838/tutorials/linear/piecewise_linear/ac0dee02.svg similarity index 82% rename from previews/PR3838/tutorials/linear/piecewise_linear/a907712b.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/ac0dee02.svg index 84a537d1ed1..08f1955fdd1 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/a907712b.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/ac0dee02.svg @@ -1,61 +1,61 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/d32c72dd.svg b/previews/PR3838/tutorials/linear/piecewise_linear/adebb149.svg similarity index 94% rename from previews/PR3838/tutorials/linear/piecewise_linear/d32c72dd.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/adebb149.svg index f99e81c028d..50077efef3f 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/d32c72dd.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/adebb149.svg @@ -1,48 +1,48 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/f2b7bb48.svg b/previews/PR3838/tutorials/linear/piecewise_linear/fb69c516.svg similarity index 85% rename from previews/PR3838/tutorials/linear/piecewise_linear/f2b7bb48.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/fb69c516.svg index 47ac6b104e9..0e6883253a5 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/f2b7bb48.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/fb69c516.svg @@ -1,46 +1,46 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/b9bf8efd.svg b/previews/PR3838/tutorials/linear/piecewise_linear/fca7433c.svg similarity index 82% rename from previews/PR3838/tutorials/linear/piecewise_linear/b9bf8efd.svg rename to previews/PR3838/tutorials/linear/piecewise_linear/fca7433c.svg index ee95f1a36e2..802cea9d18f 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/b9bf8efd.svg +++ b/previews/PR3838/tutorials/linear/piecewise_linear/fca7433c.svg @@ -1,48 +1,48 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/linear/piecewise_linear/index.html b/previews/PR3838/tutorials/linear/piecewise_linear/index.html index 118a1966038..38f3c4f6e4f 100644 --- a/previews/PR3838/tutorials/linear/piecewise_linear/index.html +++ b/previews/PR3838/tutorials/linear/piecewise_linear/index.html @@ -7,11 +7,11 @@ import HiGHS import Plots

    Minimizing a convex function (outer approximation)

    If the function you are approximating is convex, and you want to minimize "down" onto it, then you can use an outer approximation.

    For example, $f(x) = x^2$ is a convex function:

    f(x) = x^2
     ∇f(x) = 2 * x
    -plot = Plots.plot(f, -2:0.01:2; ylims = (-0.5, 4), label = false, width = 3)
    Example block output

    Because $f$ is convex, we know that for any $x_k$, we have: $f(x) \ge f(x_k) + \nabla f(x_k) \cdot (x - x_k)$

    for x_k in -2:1:2  ## Tip: try changing the number of points x_k
    +plot = Plots.plot(f, -2:0.01:2; ylims = (-0.5, 4), label = false, width = 3)
    Example block output

    Because $f$ is convex, we know that for any $x_k$, we have: $f(x) \ge f(x_k) + \nabla f(x_k) \cdot (x - x_k)$

    for x_k in -2:1:2  ## Tip: try changing the number of points x_k
         g = x -> f(x_k) + ∇f(x_k) * (x - x_k)
         Plots.plot!(plot, g, -2:0.01:2; color = :red, label = false, width = 3)
     end
    -plot
    Example block output

    We can use these tangent planes as constraints in our model to create an outer approximation of the function. As we add more planes, the error between the true function and the piecewise linear outer approximation decreases.

    Here is the model in JuMP:

    function outer_approximate_x_squared(x̄)
    +plot
    Example block output

    We can use these tangent planes as constraints in our model to create an outer approximation of the function. As we add more planes, the error between the true function and the piecewise linear outer approximation decreases.

    Here is the model in JuMP:

    function outer_approximate_x_squared(x̄)
         f(x) = x^2
         ∇f(x) = 2x
         model = Model(HiGHS.Optimizer)
    @@ -29,7 +29,7 @@
         ȳ = outer_approximate_x_squared(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output
    Note

    This formulation does not work if we want to maximize y.

    Maximizing a concave function (outer approximation)

    The outer approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
    +plot
    Example block output
    Note

    This formulation does not work if we want to maximize y.

    Maximizing a concave function (outer approximation)

    The outer approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
     ∇f(x) = 1 / x
     X = 0.1:0.1:1.6
     plot = Plots.plot(
    @@ -44,7 +44,7 @@
         g = x -> f(x_k) + ∇f(x_k) * (x - x_k)
         Plots.plot!(plot, g, X; color = :red, label = false, width = 3)
     end
    -plot
    Example block output

    Here is the model in JuMP:

    function outer_approximate_log(x̄)
    +plot
    Example block output

    Here is the model in JuMP:

    function outer_approximate_log(x̄)
         f(x) = log(x)
         ∇f(x) = 1 / x
         model = Model(HiGHS.Optimizer)
    @@ -62,18 +62,18 @@
         ȳ = outer_approximate_log(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output
    Note

    This formulation does not work if we want to minimize y.

    Minimizing a convex function (inner approximation)

    Instead of creating an outer approximation, we can also create an inner approximation. For example, given $f(x) = x^2$, we may want to approximate the true function by the red piecewise linear function:

    f(x) = x^2
    +plot
    Example block output
    Note

    This formulation does not work if we want to minimize y.

    Minimizing a convex function (inner approximation)

    Instead of creating an outer approximation, we can also create an inner approximation. For example, given $f(x) = x^2$, we may want to approximate the true function by the red piecewise linear function:

    f(x) = x^2
     x̂ = -2:0.8:2  ## Tip: try changing the number of points in x̂
     plot = Plots.plot(f, -2:0.01:2; ylims = (-0.5, 4), label = false, linewidth = 3)
     Plots.plot!(plot, f, x̂; label = false, color = :red, linewidth = 3)
    -plot
    Example block output

    To do so, we represent the decision variables $(x, y)$ by the convex combination of a set of discrete points $\{x_k, y_k\}_{k=1}^K$:

    \[\begin{aligned} +plotExample block output

    To do so, we represent the decision variables $(x, y)$ by the convex combination of a set of discrete points $\{x_k, y_k\}_{k=1}^K$:

    \[\begin{aligned} x = \sum\limits_{k=1}^K \lambda_k x_k \\ y = \sum\limits_{k=1}^K \lambda_k y_k \\ \sum\limits_{k=1}^K \lambda_k = 1 \\ \lambda_k \ge 0, k=1,\ldots,k \\ \end{aligned}\]

    The feasible region of the convex combination actually allows any $(x, y)$ point inside this shaded region:

    I = [1, 2, 3, 4, 5, 6, 1]
     Plots.plot!(x̂[I], f.(x̂[I]); fill = (0, 0, "#f004"), width = 0, label = false)
    -plot
    Example block output

    Thus, this formulation does not work if we want to maximize $y$.

    Here is the model in JuMP:

    function inner_approximate_x_squared(x̄)
    +plot
    Example block output

    Thus, this formulation does not work if we want to maximize $y$.

    Here is the model in JuMP:

    function inner_approximate_x_squared(x̄)
         f(x) = x^2
         ∇f(x) = 2x
         x̂ = -2:0.8:2  ## Tip: try changing the number of points in x̂
    @@ -96,13 +96,13 @@
         ȳ = inner_approximate_x_squared(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output

    Maximizing a convex function (inner approximation)

    The inner approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
    +plot
    Example block output

    Maximizing a convex function (inner approximation)

    The inner approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
     x̂ = 0.1:0.5:1.6  ## Tip: try changing the number of points in x̂
     plot = Plots.plot(f, 0.1:0.01:1.6; label = false, linewidth = 3)
     Plots.plot!(x̂, f.(x̂); linewidth = 3, color = :red, label = false)
     I = [1, 2, 3, 4, 1]
     Plots.plot!(x̂[I], f.(x̂[I]); fill = (0, 0, "#f004"), width = 0, label = false)
    -plot
    Example block output

    Here is the model in JuMP:

    function inner_approximate_log(x̄)
    +plot
    Example block output

    Here is the model in JuMP:

    function inner_approximate_log(x̄)
         f(x) = log(x)
         x̂ = 0.1:0.5:1.6  ## Tip: try changing the number of points in x̂
         ŷ = f.(x̂)
    @@ -124,13 +124,13 @@
         ȳ = inner_approximate_log(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output

    Piecewise linear approximation

    If the model is non-convex (or non-concave), then we cannot use an outer approximation, and the inner approximation allows a solution far from the true function. For example, for $f(x) = sin(x)$, we have:

    f(x) = sin(x)
    +plot
    Example block output

    Piecewise linear approximation

    If the model is non-convex (or non-concave), then we cannot use an outer approximation, and the inner approximation allows a solution far from the true function. For example, for $f(x) = sin(x)$, we have:

    f(x) = sin(x)
     plot = Plots.plot(f, 0:0.01:2π; label = false)
     x̂ = range(; start = 0, stop = 2π, length = 7)
     Plots.plot!(x̂, f.(x̂); linewidth = 3, color = :red, label = false)
     I = [1, 5, 6, 7, 3, 2, 1]
     Plots.plot!(x̂[I], f.(x̂[I]); fill = (0, 0, "#f004"), width = 0, label = false)
    -plot
    Example block output

    We can force the inner approximation to stay on the red line by adding the constraint λ in SOS2(). The SOS2 set is a Special Ordered Set of Type 2, and it ensures that at most two elements of λ can be non-zero, and if they are, that they must be adjacent. This prevents the model from taking a convex combination of points 1 and 5 to end up on the lower boundary of the shaded red area.

    Here is the model in JuMP:

    function piecewise_linear_sin(x̄)
    +plot
    Example block output

    We can force the inner approximation to stay on the red line by adding the constraint λ in SOS2(). The SOS2 set is a Special Ordered Set of Type 2, and it ensures that at most two elements of λ can be non-zero, and if they are, that they must be adjacent. This prevents the model from taking a convex combination of points 1 and 5 to end up on the lower boundary of the shaded red area.

    Here is the model in JuMP:

    function piecewise_linear_sin(x̄)
         f(x) = sin(x)
         # Tip: try changing the number of points in x̂
         x̂ = range(; start = 0, stop = 2π, length = 7)
    @@ -155,4 +155,4 @@
         ȳ = piecewise_linear_sin(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output +plotExample block output diff --git a/previews/PR3838/tutorials/linear/sudoku/index.html b/previews/PR3838/tutorials/linear/sudoku/index.html index 09ba65407a7..02adc047f43 100644 --- a/previews/PR3838/tutorials/linear/sudoku/index.html +++ b/previews/PR3838/tutorials/linear/sudoku/index.html @@ -93,4 +93,4 @@ 7 1 3 9 2 4 8 5 6 9 6 1 5 3 7 2 8 4 2 8 7 4 1 9 6 3 5 - 3 4 5 2 8 6 1 7 9

    Which is the same as we found before:

    sol == csp_sol
    true
    + 3 4 5 2 8 6 1 7 9

    Which is the same as we found before:

    sol == csp_sol
    true
    diff --git a/previews/PR3838/tutorials/linear/tips_and_tricks/index.html b/previews/PR3838/tutorials/linear/tips_and_tricks/index.html index 1df908b7871..f1460da7e00 100644 --- a/previews/PR3838/tutorials/linear/tips_and_tricks/index.html +++ b/previews/PR3838/tutorials/linear/tips_and_tricks/index.html @@ -70,4 +70,4 @@ y == sum(ŷ[i] * λ[i] for i in 1:N) sum(λ) == 1 λ in SOS2() - end)(x + λ[1] + 0.5 λ[2] - 0.5 λ[4] - λ[5] - 1.5 λ[6] - 2 λ[7] = 0, y - λ[1] - 0.25 λ[2] - 0.25 λ[4] - λ[5] - 2.25 λ[6] - 4 λ[7] = 0, λ[1] + λ[2] + λ[3] + λ[4] + λ[5] + λ[6] + λ[7] = 1, [λ[1], λ[2], λ[3], λ[4], λ[5], λ[6], λ[7]] ∈ MathOptInterface.SOS2{Float64}([1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0])) + end)(x + λ[1] + 0.5 λ[2] - 0.5 λ[4] - λ[5] - 1.5 λ[6] - 2 λ[7] = 0, y - λ[1] - 0.25 λ[2] - 0.25 λ[4] - λ[5] - 2.25 λ[6] - 4 λ[7] = 0, λ[1] + λ[2] + λ[3] + λ[4] + λ[5] + λ[6] + λ[7] = 1, [λ[1], λ[2], λ[3], λ[4], λ[5], λ[6], λ[7]] ∈ MathOptInterface.SOS2{Float64}([1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0])) diff --git a/previews/PR3838/tutorials/linear/transp/index.html b/previews/PR3838/tutorials/linear/transp/index.html index c57d3952190..bfe9bae1a59 100644 --- a/previews/PR3838/tutorials/linear/transp/index.html +++ b/previews/PR3838/tutorials/linear/transp/index.html @@ -74,4 +74,4 @@ end
    solve_transportation_problem (generic function with 1 method)

    Solution

    Let's solve and view the solution:

    solve_transportation_problem(data)
            FRA    DET    LAN    WIN    STL    FRE    LAF
     GARY      .      .      .      .  300.0 1100.0      .
     CLEV      .      .  600.0      . 1000.0      . 1000.0
    -PITT  900.0 1200.0      .  400.0  400.0      .      .
    +PITT 900.0 1200.0 . 400.0 400.0 . . diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/32566bbe.svg b/previews/PR3838/tutorials/nonlinear/classifiers/117cc728.svg similarity index 62% rename from previews/PR3838/tutorials/nonlinear/classifiers/32566bbe.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/117cc728.svg index 5f9308963ef..ae7a337aac9 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/32566bbe.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/117cc728.svg @@ -1,543 +1,543 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/8ae95394.svg b/previews/PR3838/tutorials/nonlinear/classifiers/15748a25.svg similarity index 73% rename from previews/PR3838/tutorials/nonlinear/classifiers/8ae95394.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/15748a25.svg index b3ee4f42cf5..69dbe0361b8 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/8ae95394.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/15748a25.svg @@ -1,143 +1,143 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/5f35c36c.svg b/previews/PR3838/tutorials/nonlinear/classifiers/197f6567.svg similarity index 72% rename from previews/PR3838/tutorials/nonlinear/classifiers/5f35c36c.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/197f6567.svg index 13eddb2645a..5f58e38d305 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/5f35c36c.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/197f6567.svg @@ -1,142 +1,142 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/b8b484f4.svg b/previews/PR3838/tutorials/nonlinear/classifiers/25ef36b9.svg similarity index 63% rename from previews/PR3838/tutorials/nonlinear/classifiers/b8b484f4.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/25ef36b9.svg index cf6df865fe9..ba877532369 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/b8b484f4.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/25ef36b9.svg @@ -1,551 +1,551 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/0e75b6aa.svg b/previews/PR3838/tutorials/nonlinear/classifiers/26a34877.svg similarity index 69% rename from previews/PR3838/tutorials/nonlinear/classifiers/0e75b6aa.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/26a34877.svg index 0c3b84c75b2..9210815b6ff 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/0e75b6aa.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/26a34877.svg @@ -1,20913 +1,20913 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/f300096c.svg b/previews/PR3838/tutorials/nonlinear/classifiers/5bbfc3eb.svg similarity index 62% rename from previews/PR3838/tutorials/nonlinear/classifiers/f300096c.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/5bbfc3eb.svg index 1650a895f00..8248aaa48c2 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/f300096c.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/5bbfc3eb.svg @@ -1,550 +1,550 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/8bc63f07.svg b/previews/PR3838/tutorials/nonlinear/classifiers/a9d36cb7.svg similarity index 61% rename from previews/PR3838/tutorials/nonlinear/classifiers/8bc63f07.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/a9d36cb7.svg index abd450997c2..0ec20601790 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/8bc63f07.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/a9d36cb7.svg @@ -1,1042 +1,1042 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/3499be38.svg b/previews/PR3838/tutorials/nonlinear/classifiers/cdcacde4.svg similarity index 62% rename from previews/PR3838/tutorials/nonlinear/classifiers/3499be38.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/cdcacde4.svg index b05e85bb575..f3aa49bb97b 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/3499be38.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/cdcacde4.svg @@ -1,543 +1,543 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/3d0bc893.svg b/previews/PR3838/tutorials/nonlinear/classifiers/db428a09.svg similarity index 62% rename from previews/PR3838/tutorials/nonlinear/classifiers/3d0bc893.svg rename to previews/PR3838/tutorials/nonlinear/classifiers/db428a09.svg index 2db6f07a1aa..12bef5c6af7 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/3d0bc893.svg +++ b/previews/PR3838/tutorials/nonlinear/classifiers/db428a09.svg @@ -1,544 +1,544 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/classifiers/index.html b/previews/PR3838/tutorials/nonlinear/classifiers/index.html index 3428fcb2b32..23255be9dd2 100644 --- a/previews/PR3838/tutorials/nonlinear/classifiers/index.html +++ b/previews/PR3838/tutorials/nonlinear/classifiers/index.html @@ -20,9 +20,9 @@ color = :white, size = (600, 600), legend = false, -)Example block output

    We want to split the points into two distinct sets on either side of a dividing line. We'll then label each point depending on which side of the line it happens to fall. Based on the labels of the point, we'll show how to create a classifier using a JuMP model. We can then test how well our classifier reproduces the original labels and the boundary between them.

    Let's make a line to divide the points into two sets by defining a gradient and a constant:

    w_0, g_0 = [5, 3], 8
    +)
    Example block output

    We want to split the points into two distinct sets on either side of a dividing line. We'll then label each point depending on which side of the line it happens to fall. Based on the labels of the point, we'll show how to create a classifier using a JuMP model. We can then test how well our classifier reproduces the original labels and the boundary between them.

    Let's make a line to divide the points into two sets by defining a gradient and a constant:

    w_0, g_0 = [5, 3], 8
     line(v::AbstractArray; w = w_0, g = g_0) = w' * v - g
    -line(x::Real; w = w_0, g = g_0) = -(w[1] * x - g) / w[2];

    Julia's multiple dispatch feature allows us to define the vector and single-variable form of the line function under the same name.

    Let's add this to the plot:

    Plots.plot!(plot, line; linewidth = 5)
    Example block output

    Now we label the points relative to which side of the line they are. It is numerically useful to have the labels +1 and -1 for the upcoming JuMP formulation.

    labels = ifelse.(line.(eachrow(P)) .>= 0, 1, -1)
    +line(x::Real; w = w_0, g = g_0) = -(w[1] * x - g) / w[2];

    Julia's multiple dispatch feature allows us to define the vector and single-variable form of the line function under the same name.

    Let's add this to the plot:

    Plots.plot!(plot, line; linewidth = 5)
    Example block output

    Now we label the points relative to which side of the line they are. It is numerically useful to have the labels +1 and -1 for the upcoming JuMP formulation.

    labels = ifelse.(line.(eachrow(P)) .>= 0, 1, -1)
     Plots.scatter!(
         plot,
         P[:, 1],
    @@ -30,7 +30,7 @@
         shape = ifelse.(labels .== 1, :cross, :xcross),
         markercolor = ifelse.(labels .== 1, :blue, :crimson),
         markersize = 8,
    -)
    Example block output

    Our goal is to show we can reconstruct the line from just the points and the labels.

    Formulation: linear support vector machine

    A classifier known as the linear support vector machine (SVM) looks for the affine function $L(p) = w^\top p - g$ that satisfies $L(p) < 0$ for all points $p$ with a label -1 and $L(p) \ge 0$ for all points $p$ with a label +1.

    The linearly constrained quadratic program that implements this is:

    \[\begin{aligned} +)Example block output

    Our goal is to show we can reconstruct the line from just the points and the labels.

    Formulation: linear support vector machine

    A classifier known as the linear support vector machine (SVM) looks for the affine function $L(p) = w^\top p - g$ that satisfies $L(p) < 0$ for all points $p$ with a label -1 and $L(p) \ge 0$ for all points $p$ with a label +1.

    The linearly constrained quadratic program that implements this is:

    \[\begin{aligned} \min_{w \in \mathbb{R}^n, \; g \in \mathbb{R}, \; y \in \mathbb{R}^m} \quad & \frac{1}{2} w^\top w + C \; \sum_{i=1}^m y_i \\ \text{subject to } \quad & D \cdot (P w - g) + y \geq \mathbf{1} \\ & y \ge 0. @@ -59,7 +59,7 @@ │ ├ AffExpr in MOI.GreaterThan{Float64}: 100 │ └ VariableRef in MOI.GreaterThan{Float64}: 100 └ Names registered in the model - └ :g, :w, :y, Main.classifier)

    With the solution, we can ask: was the value of the penalty constant "sufficiently large" for this data set? This can be judged in part by the range of the slack variables. If the slack is too large, then we need to increase the penalty constant.

    Let's plot the solution and check how we did:

    Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    We find that we have recovered the dividing line from just the information of the points and their labels.

    Nonseparable classes of points

    Now, what if the point sets are not cleanly separable by a line (or a hyperplane in higher dimensions)? Does this still work? Let's repeat the process, but this time we will simulate nonseparable classes of points by intermingling a few nearby points across the previously used line.

    nearby_indices = abs.(line.(eachrow(P))) .< 1.1
    +  └ :g, :w, :y, Main.classifier)

    With the solution, we can ask: was the value of the penalty constant "sufficiently large" for this data set? This can be judged in part by the range of the slack variables. If the slack is too large, then we need to increase the penalty constant.

    Let's plot the solution and check how we did:

    Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    We find that we have recovered the dividing line from just the information of the points and their labels.

    Nonseparable classes of points

    Now, what if the point sets are not cleanly separable by a line (or a hyperplane in higher dimensions)? Does this still work? Let's repeat the process, but this time we will simulate nonseparable classes of points by intermingling a few nearby points across the previously used line.

    nearby_indices = abs.(line.(eachrow(P))) .< 1.1
     labels_new = ifelse.(nearby_indices, -labels, labels)
     model, classifier = solve_SVM_classifier(P, labels_new)
     plot = Plots.scatter(
    @@ -79,7 +79,7 @@
         markercolor = ifelse.(labels_new .== 1, :blue, :crimson),
         markersize = 8,
     )
    -Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    So our JuMP formulation still produces a classifier, but it mis-classifies some of the nonseparable points.

    We can find out which points are contributing to the shape of the line by looking at the dual values of the affine constraints and comparing them to the penalty constant $C$:

    affine_cons = all_constraints(model, AffExpr, MOI.GreaterThan{Float64})
    +Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    So our JuMP formulation still produces a classifier, but it mis-classifies some of the nonseparable points.

    We can find out which points are contributing to the shape of the line by looking at the dual values of the affine constraints and comparing them to the penalty constant $C$:

    affine_cons = all_constraints(model, AffExpr, MOI.GreaterThan{Float64})
     active_cons = findall(isapprox.(dual.(affine_cons), C_0; atol = 0.001))
     findall(nearby_indices) ⊆ active_cons
    true

    The last statement tells us that our nonseparable points are actively contributing to how the classifier is defined. The remaining points are of interest and are highlighted:

    P_active = P[setdiff(active_cons, findall(nearby_indices)), :]
     Plots.scatter!(
    @@ -89,7 +89,7 @@
         shape = :hexagon,
         markersize = 8,
         markeropacity = 0.5,
    -)
    Example block output

    Advanced: duality and the kernel method

    We now consider an alternative formulation for a linear SVM by solving the dual problem.

    The dual program

    The dual of the linear SVM program is also a linearly constrained quadratic program:

    \[\begin{aligned} +)Example block output

    Advanced: duality and the kernel method

    We now consider an alternative formulation for a linear SVM by solving the dual problem.

    The dual program

    The dual of the linear SVM program is also a linearly constrained quadratic program:

    \[\begin{aligned} \min_{u \in \mathbb{R}^m} \quad & \frac{1}{2} u^\top D P P^\top D u - \; \mathbf{1}^\top u \\ \text{subject to } \quad & \mathbf{1}^\top D u = 0 \\ & 0 \leq u \leq C\mathbf{1}. @@ -108,7 +108,7 @@ classifier(x) = line(x; w = w, g = g) return classifier end

    solve_dual_SVM_classifier (generic function with 1 method)

    We recover the line gradient vector $w$ through setting $w = P^\top D u$, and the line constant $g$ as the dual value of the single affine constraint.

    The dual problem has fewer variables and fewer constraints, so in many cases it may be simpler to solve the dual form.

    We can check that the dual form has recovered a classifier:

    classifier = solve_dual_SVM_classifier(P, labels)
    -Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dash)
    Example block output

    The kernel method

    Linear SVM techniques are not limited to finding separating hyperplanes in the original space of the dataset. One could first transform the training data under a nonlinear mapping, apply our method, then map the hyperplane back into original space.

    The actual data describing the point set is held in a matrix $P$, but looking at the dual program we see that what actually matters is the Gram matrix $P P^\top$, expressing a pairwise comparison (an inner-product) between each point vector. It follows that any mapping of the point set only needs to be defined at the level of pairwise maps between points. Such maps are known as kernel functions:

    \[k \; : \; \mathbb{R}^n \times \mathbb{R}^n \; \rightarrow \mathbb{R}, \qquad +Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dash)Example block output

    The kernel method

    Linear SVM techniques are not limited to finding separating hyperplanes in the original space of the dataset. One could first transform the training data under a nonlinear mapping, apply our method, then map the hyperplane back into original space.

    The actual data describing the point set is held in a matrix $P$, but looking at the dual program we see that what actually matters is the Gram matrix $P P^\top$, expressing a pairwise comparison (an inner-product) between each point vector. It follows that any mapping of the point set only needs to be defined at the level of pairwise maps between points. Such maps are known as kernel functions:

    \[k \; : \; \mathbb{R}^n \times \mathbb{R}^n \; \rightarrow \mathbb{R}, \qquad (s, t) \mapsto \left< \Phi(s), \Phi(t) \right>\]

    where the right-hand side applies some transformation $\Phi : \mathbb{R}^n \rightarrow \mathbb{R}^{n'}$ followed by an inner-product in that image space.

    In practice, we can avoid having $\Phi$ explicitly given but instead define a kernel function directly between pairs of vectors. This change to using a kernel function without knowing the map is called the kernel method (or sometimes, the kernel trick).

    Classifier using a Gaussian kernel

    We will demonstrate the application of a Gaussian or radial basis function kernel:

    \[k(s, t) = \exp\left( -\mu \lVert s - t \rVert^2_2 \right)\]

    for some positive parameter $\mu$.

    k_gauss(s::Vector, t::Vector; μ = 0.5) = exp(-μ * LinearAlgebra.norm(s - t)^2)
    k_gauss (generic function with 1 method)

    Given a matrix of points expressed row-wise and a kernel, the next function returns the transformed matrix $K$ that replaces $P P^\top$:

    function pairwise_transform(kernel::Function, P::Matrix{T}) where {T}
         m, n = size(P)
         K = zeros(T, m, m)
    @@ -151,7 +151,7 @@
         markersize = ifelse.(labels .== 1, 4, 2),
         size = (600, 600),
         legend = false,
    -)
    Example block output

    Is the technique capable of generating a distinctly nonlinear surface? Let's solve the Gaussian kernel based quadratic problem with these parameters:

    classifier = solve_kernel_SVM_classifier(k_gauss, B, labels; C = 1e5, μ = 10.0)
    +)
    Example block output

    Is the technique capable of generating a distinctly nonlinear surface? Let's solve the Gaussian kernel based quadratic problem with these parameters:

    classifier = solve_kernel_SVM_classifier(k_gauss, B, labels; C = 1e5, μ = 10.0)
     grid = [[x, y] for x in 0:0.01:2, y in 0:0.01:2]
     grid_pos = [Tuple(g) for g in grid if classifier(g) >= 0]
    -Plots.scatter!(plot, grid_pos; markersize = 0.2)
    Example block output

    We find that the kernel method can perform well as a nonlinear classifier.

    The result has a fairly strong dependence on the choice of parameters, with larger values of $\mu$ allowing for a more complex boundary while smaller values lead to a smoother boundary for the classifier. Determining a better performing kernel function and choice of parameters is covered by the process of cross-validation with respect to the dataset, where different testing, training and tuning sets are used to validate the best choice of parameters against a statistical measure of error.

    +Plots.scatter!(plot, grid_pos; markersize = 0.2)Example block output

    We find that the kernel method can perform well as a nonlinear classifier.

    The result has a fairly strong dependence on the choice of parameters, with larger values of $\mu$ allowing for a more complex boundary while smaller values lead to a smoother boundary for the classifier. Determining a better performing kernel function and choice of parameters is covered by the process of cross-validation with respect to the dataset, where different testing, training and tuning sets are used to validate the best choice of parameters against a statistical measure of error.

    diff --git a/previews/PR3838/tutorials/nonlinear/complementarity/index.html b/previews/PR3838/tutorials/nonlinear/complementarity/index.html index b943e124b77..3a00a522645 100644 --- a/previews/PR3838/tutorials/nonlinear/complementarity/index.html +++ b/previews/PR3838/tutorials/nonlinear/complementarity/index.html @@ -131,7 +131,7 @@ Objective value : 0.00000e+00 * Work counters - Solve time (sec) : 1.43000e-04 + Solve time (sec) : 1.34000e-04

    An equilibrium solution is to build 389 MW:

    value(x)
    389.31506849315065

    The production in each scenario is:

    value.(Q)
    5-element Vector{Float64}:
      240.0000000000001
      289.9999999999999
    @@ -142,4 +142,4 @@
       60.0
       59.99999999999994
       60.68493150684928
    - 110.68493150684935
    + 110.68493150684935 diff --git a/previews/PR3838/tutorials/nonlinear/introduction/index.html b/previews/PR3838/tutorials/nonlinear/introduction/index.html index 7cdbd8578d9..bf601b30b1b 100644 --- a/previews/PR3838/tutorials/nonlinear/introduction/index.html +++ b/previews/PR3838/tutorials/nonlinear/introduction/index.html @@ -7,4 +7,4 @@ \min_{x \in \mathbb{R}^n} & f_0(x) \\ \;\;\text{s.t.} & l_j \le f_j(x) \le u_j & j = 1 \ldots m \\ & l_i \le x_i \le u_i & i = 1 \ldots n. -\end{align}\]

    Mixed-integer nonlinear linear programs (MINLPs) are extensions of nonlinear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of nonlinear solvers; look for "NLP" in the list of Supported solvers. However, very few solvers support mixed-integer nonlinear linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    If the only nonlinearities in your model are quadratic terms (that is, multiplication between two decision variables), you can also use second-order cone solvers, which are indicated by "SOCP." In most cases, these solvers are restricted to convex quadratic problems and will error if you pass a nonconvex quadratic function; however, Gurobi has the ability to solve nonconvex quadratic terms.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    +\end{align}\]

    Mixed-integer nonlinear linear programs (MINLPs) are extensions of nonlinear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of nonlinear solvers; look for "NLP" in the list of Supported solvers. However, very few solvers support mixed-integer nonlinear linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    If the only nonlinearities in your model are quadratic terms (that is, multiplication between two decision variables), you can also use second-order cone solvers, which are indicated by "SOCP." In most cases, these solvers are restricted to convex quadratic problems and will error if you pass a nonconvex quadratic function; however, Gurobi has the ability to solve nonconvex quadratic terms.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    diff --git a/previews/PR3838/tutorials/nonlinear/nested_problems/index.html b/previews/PR3838/tutorials/nonlinear/nested_problems/index.html index cb70ef3836c..5ce09b7bd65 100644 --- a/previews/PR3838/tutorials/nonlinear/nested_problems/index.html +++ b/previews/PR3838/tutorials/nonlinear/nested_problems/index.html @@ -64,7 +64,7 @@ Dual objective value : 0.00000e+00 * Work counters - Solve time (sec) : 5.44837e-01 + Solve time (sec) : 5.11887e-01 Barrier iterations : 32

    The optimal objective value is:

    objective_value(model)
    -418983.48680640775

    and the optimal upper-level decision variables $x$ are:

    value.(x)
    2-element Vector{Float64}:
      154.97862337234338
    @@ -127,8 +127,8 @@
       Dual objective value : 0.00000e+00
     
     * Work counters
    -  Solve time (sec)   : 1.96720e-01
    +  Solve time (sec)   : 1.80008e-01
       Barrier iterations : 32
     

    an we can check we get the same objective value:

    objective_value(model)
    -418983.48680640775

    and upper-level decision variable $x$:

    value.(x)
    2-element Vector{Float64}:
      154.97862337234338
    - 180.0096143098799
    + 180.0096143098799 diff --git a/previews/PR3838/tutorials/nonlinear/operator_ad/index.html b/previews/PR3838/tutorials/nonlinear/operator_ad/index.html index dc2bd3b035b..ca1df756e01 100644 --- a/previews/PR3838/tutorials/nonlinear/operator_ad/index.html +++ b/previews/PR3838/tutorials/nonlinear/operator_ad/index.html @@ -150,4 +150,4 @@ enzyme_rosenbrock()
    2-element Vector{Float64}:
      0.9999999999999899
    - 0.9999999999999792
    + 0.9999999999999792 diff --git a/previews/PR3838/tutorials/nonlinear/portfolio/50a8ef93.svg b/previews/PR3838/tutorials/nonlinear/portfolio/e8754326.svg similarity index 79% rename from previews/PR3838/tutorials/nonlinear/portfolio/50a8ef93.svg rename to previews/PR3838/tutorials/nonlinear/portfolio/e8754326.svg index 8348bb68962..be2d603f0b9 100644 --- a/previews/PR3838/tutorials/nonlinear/portfolio/50a8ef93.svg +++ b/previews/PR3838/tutorials/nonlinear/portfolio/e8754326.svg @@ -1,581 +1,581 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/portfolio/index.html b/previews/PR3838/tutorials/nonlinear/portfolio/index.html index 9a52c429520..5f7aaa3f880 100644 --- a/previews/PR3838/tutorials/nonlinear/portfolio/index.html +++ b/previews/PR3838/tutorials/nonlinear/portfolio/index.html @@ -72,7 +72,7 @@ Dual objective value : 4.52688e+04 * Work counters - Solve time (sec) : 2.98405e-03 + Solve time (sec) : 2.82407e-03 Barrier iterations : 11

    The optimal allocation of our assets is:

    value.(x)
    3-element Vector{Float64}:
      497.045529849864
    @@ -103,7 +103,7 @@
       Objective bound    : [5.78303e-09,-7.37159e+01]
     
     * Work counters
    -  Solve time (sec)   : 2.07764e-01
    +  Solve time (sec)   : 1.91580e-01
       Barrier iterations : 0
     

    The algorithm found 50 different solutions. Let's plot them to see how they differ:

    objective_space = Plots.hline(
         [scalar_return];
    @@ -136,4 +136,4 @@
         ylabel = "Investment (\$)",
         title = "Decision space",
     )
    -Plots.plot(objective_space, decision_space; layout = (2, 1), size = (600, 600))
    Example block output

    Perhaps our trade-off wasn't so bad after all. Our original solution corresponded to picking a solution #17. If we buy more SEHI, we can increase the return, but the variance also increases. If we buy less SEHI, such as a solution like #5 or #6, then we can achieve the corresponding return without deploying all of our capital. We should also note that at no point should we buy WMT.

    +Plots.plot(objective_space, decision_space; layout = (2, 1), size = (600, 600))Example block output

    Perhaps our trade-off wasn't so bad after all. Our original solution corresponded to picking a solution #17. If we buy more SEHI, we can increase the return, but the variance also increases. If we buy less SEHI, such as a solution like #5 or #6, then we can achieve the corresponding return without deploying all of our capital. We should also note that at no point should we buy WMT.

    diff --git a/previews/PR3838/tutorials/nonlinear/querying_hessians/index.html b/previews/PR3838/tutorials/nonlinear/querying_hessians/index.html index 1fbdcc3921d..231ba8cb9ba 100644 --- a/previews/PR3838/tutorials/nonlinear/querying_hessians/index.html +++ b/previews/PR3838/tutorials/nonlinear/querying_hessians/index.html @@ -168,4 +168,4 @@ 2.82843 2.82843

    Compare that to the analytic solution:

    y = value.(x)
     [2y[1] 0; 2y[1]+2y[2] 2y[1]+2y[2]]
    2×2 Matrix{Float64}:
      1.58072  0.0
    - 2.82843  2.82843
    + 2.82843 2.82843 diff --git a/previews/PR3838/tutorials/nonlinear/rocket_control/1befcd64.svg b/previews/PR3838/tutorials/nonlinear/rocket_control/89264e00.svg similarity index 89% rename from previews/PR3838/tutorials/nonlinear/rocket_control/1befcd64.svg rename to previews/PR3838/tutorials/nonlinear/rocket_control/89264e00.svg index 59a13aa9fc3..bf5470b347c 100644 --- a/previews/PR3838/tutorials/nonlinear/rocket_control/1befcd64.svg +++ b/previews/PR3838/tutorials/nonlinear/rocket_control/89264e00.svg @@ -1,130 +1,130 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/rocket_control/index.html b/previews/PR3838/tutorials/nonlinear/rocket_control/index.html index 1d7c19739ad..28eb224ef0c 100644 --- a/previews/PR3838/tutorials/nonlinear/rocket_control/index.html +++ b/previews/PR3838/tutorials/nonlinear/rocket_control/index.html @@ -48,7 +48,7 @@ Dual objective value : 4.66547e+00 * Work counters - Solve time (sec) : 1.56850e-01 + Solve time (sec) : 1.50742e-01 Barrier iterations : 24

    Finally, we plot the solution:

    function plot_trajectory(y; kwargs...)
         return Plots.plot(
    @@ -66,4 +66,4 @@
         plot_trajectory(x_v; ylabel = "Velocity"),
         plot_trajectory(u_t; ylabel = "Thrust");
         layout = (2, 2),
    -)
    Example block output

    Next steps

    • Experiment with different values for the constants. How does the solution change? In particular, what happens if you change T_max?
    • The dynamical equations use rectangular integration for the right-hand side terms. Modify the equations to use the Trapezoidal rule instead. (As an example, x_v[t-1] would become 0.5 * (x_v[t-1] + x_v[t]).) Is there a difference?
    +)Example block output

    Next steps

    • Experiment with different values for the constants. How does the solution change? In particular, what happens if you change T_max?
    • The dynamical equations use rectangular integration for the right-hand side terms. Modify the equations to use the Trapezoidal rule instead. (As an example, x_v[t-1] would become 0.5 * (x_v[t-1] + x_v[t]).) Is there a difference?
    diff --git a/previews/PR3838/tutorials/nonlinear/simple_examples/index.html b/previews/PR3838/tutorials/nonlinear/simple_examples/index.html index bab286b52fd..1ac59892cb3 100644 --- a/previews/PR3838/tutorials/nonlinear/simple_examples/index.html +++ b/previews/PR3838/tutorials/nonlinear/simple_examples/index.html @@ -100,7 +100,7 @@ Number of equality constraint Jacobian evaluations = 5 Number of inequality constraint Jacobian evaluations = 0 Number of Lagrangian Hessian evaluations = 4 -Total seconds in IPOPT = 0.030 +Total seconds in IPOPT = 0.029 EXIT: Optimal Solution Found. termination_status = LOCALLY_SOLVED @@ -181,4 +181,4 @@ z ≥ 0 Objective value: 0.32699283491387243 x = 0.32699283491387243 -y = 0.2570658388068964 +y = 0.2570658388068964 diff --git a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/573098a9.svg b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/6ee659b0.svg similarity index 88% rename from previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/573098a9.svg rename to previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/6ee659b0.svg index fc2e770b263..641e13fa28c 100644 --- a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/573098a9.svg +++ b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/6ee659b0.svg @@ -1,97 +1,97 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/e1cffcfa.svg b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/730ad8e6.svg similarity index 88% rename from previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/e1cffcfa.svg rename to previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/730ad8e6.svg index 205a3a3bbd5..709c8ccf58c 100644 --- a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/e1cffcfa.svg +++ b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/730ad8e6.svg @@ -1,48 +1,48 @@ - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/44112ba4.svg b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/d66358df.svg similarity index 88% rename from previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/44112ba4.svg rename to previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/d66358df.svg index cc1f3743599..1ea2cc75032 100644 --- a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/44112ba4.svg +++ b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/d66358df.svg @@ -1,182 +1,182 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html index fd06bfc9cf0..3255623e0b6 100644 --- a/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html +++ b/previews/PR3838/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html @@ -221,7 +221,7 @@ layout = grid(3, 2), linewidth = 2, size = (700, 700), -)Example block output
    function q(h, v, a)
    +)
    Example block output
    function q(h, v, a)
         ρ(h) = ρ₀ * exp(-h / hᵣ)
         qᵣ(h, v) = 17700 * √ρ(h) * (0.0001 * v)^3.07
         qₐ(a) = c₀ + c₁ * rad2deg(a) + c₂ * rad2deg(a)^2 + c₃ * rad2deg(a)^3
    @@ -255,7 +255,7 @@
         layout = grid(3, 1),
         linewidth = 2,
         size = (700, 700),
    -)
    Example block output
    plot(
    +)
    Example block output
    plot(
         rad2deg.(value.(ϕ)),
         rad2deg.(value.(θ)),
         value.(scaled_h);
    @@ -265,4 +265,4 @@
         xlabel = "Longitude (deg)",
         ylabel = "Latitude (deg)",
         zlabel = "Altitude (100,000 ft)",
    -)
    Example block output +)Example block output diff --git a/previews/PR3838/tutorials/nonlinear/tips_and_tricks/index.html b/previews/PR3838/tutorials/nonlinear/tips_and_tricks/index.html index 4cbd08ffc99..e68a8ecf625 100644 --- a/previews/PR3838/tutorials/nonlinear/tips_and_tricks/index.html +++ b/previews/PR3838/tutorials/nonlinear/tips_and_tricks/index.html @@ -69,4 +69,4 @@ @assert is_solved_and_feasible(model) Test.@test objective_value(model) ≈ √3 atol = 1e-4 Test.@test value.(x) ≈ [1.0, 1.0] atol = 1e-4 -println("Memoized approach: function_calls = $(function_calls)")
    Memoized approach: function_calls = 22

    Compared to the naive approach, the memoized approach requires half as many function evaluations.

    +println("Memoized approach: function_calls = $(function_calls)")
    Memoized approach: function_calls = 22

    Compared to the naive approach, the memoized approach requires half as many function evaluations.

    diff --git a/previews/PR3838/tutorials/nonlinear/user_defined_hessians/index.html b/previews/PR3838/tutorials/nonlinear/user_defined_hessians/index.html index a7a66a0fe7a..983bea2357e 100644 --- a/previews/PR3838/tutorials/nonlinear/user_defined_hessians/index.html +++ b/previews/PR3838/tutorials/nonlinear/user_defined_hessians/index.html @@ -39,6 +39,6 @@ Dual solution : * Work counters - Solve time (sec) : 3.25010e-02 + Solve time (sec) : 3.02830e-02 Barrier iterations : 14 - + diff --git a/previews/PR3838/tutorials/transitioning/transitioning_from_matlab/index.html b/previews/PR3838/tutorials/transitioning/transitioning_from_matlab/index.html index 1977759708e..0407566c680 100644 --- a/previews/PR3838/tutorials/transitioning/transitioning_from_matlab/index.html +++ b/previews/PR3838/tutorials/transitioning/transitioning_from_matlab/index.html @@ -58,7 +58,7 @@ 6 1.1746e-09 -1.2507e-09 2.43e-09 1.59e-16 6.59e-17 2.83e-10 3.87e-10 9.90e-01 --------------------------------------------------------------------------------------------- Terminated with status = solved -solve time = 956μs

    The exclamation mark here is a Julia-ism that means the function is modifying its argument, model.

    Querying solution status

    After the optimization is done, you should check for the solution status to see what solution (if any) the solver found.

    Like YALMIP and CVX, JuMP provides a solver-independent way to check it, via the command:

    is_solved_and_feasible(model)
    true

    If the return value is false, you should investigate with termination_status, primal_status, and raw_status, See Solutions for more details on how to query and interpret solution statuses.

    Extracting variables

    Like YALMIP, but unlike CVX, with JuMP you need to explicitly ask for the value of your variables after optimization is done, with the function call value(x) to obtain the value of variable x.

    value.(m[1][1, 1])
    0.0

    A subtlety is that, unlike YALMIP, the function value is only defined for scalars. For vectors and matrices you need to use Julia broadcasting: value.(v).

    value.(m[1])
    3×3 Matrix{Float64}:
    +solve time =  943μs

    The exclamation mark here is a Julia-ism that means the function is modifying its argument, model.

    Querying solution status

    After the optimization is done, you should check for the solution status to see what solution (if any) the solver found.

    Like YALMIP and CVX, JuMP provides a solver-independent way to check it, via the command:

    is_solved_and_feasible(model)
    true

    If the return value is false, you should investigate with termination_status, primal_status, and raw_status, See Solutions for more details on how to query and interpret solution statuses.

    Extracting variables

    Like YALMIP, but unlike CVX, with JuMP you need to explicitly ask for the value of your variables after optimization is done, with the function call value(x) to obtain the value of variable x.

    value.(m[1][1, 1])
    0.0

    A subtlety is that, unlike YALMIP, the function value is only defined for scalars. For vectors and matrices you need to use Julia broadcasting: value.(v).

    value.(m[1])
    3×3 Matrix{Float64}:
      0.0  0.0  0.0
      0.0  0.0  0.0
      0.0  0.0  0.0

    There is also a specialized function for extracting the value of the objective, objective_value(model), which is useful if your objective doesn't have a convenient expression.

    objective_value(model)
    -5.999999998825352

    Dual variables

    Like YALMIP and CVX, JuMP allows you to recover the dual variables. In order to do that, the simplest method is to name the constraint you're interested in, for example, @constraint(model, bob, sum(v) == 1) and then, after the optimzation is done, call dual(bob). See Duality for more details.

    Reformulating problems

    Perhaps the biggest difference between JuMP and YALMIP and CVX is how far the package is willing to go in reformulating the problems you give to it.

    CVX is happy to reformulate anything it can, even using approximations if your solver cannot handle the problem.

    YALMIP will only do exact reformulations, but is still fairly adventurous, for example, being willing to reformulate a nonlinear objective in terms of conic constraints.

    JuMP does no such thing: it only reformulates objectives into objectives, and constraints into constraints, and is fairly conservative at that. As a result, you might need to do some reformulations manually, for which a good guide is the Modeling with cones tutorial.

    Vectorization

    In MATLAB, it is absolutely essential to "vectorize" your code to obtain acceptable performance. This is because MATLAB is a slow interpreted language, which sends your commands to fast libraries. When you "vectorize" your code you are minimizing the MATLAB part of the work and sending it to the fast libraries instead.

    There's no such duality with Julia.

    Everything you write and most libraries you use will compile down to LLVM, so "vectorization" has no effect.

    For example, if you are writing a linear program in MATLAB and instead of the usual constraints = [v >= 0] you write:

    for i = 1:n
    @@ -157,4 +157,4 @@
         x = randn(d, 1) + 1i * randn(d, 1);
         y = x * x';
         rho = y / trace(y);
    -end
    +end