[ZK Stack] - ecosystem init compilation error

[nktaushanov]

Team or Project

No response

Module Affected

• System contracts (era-system-contracts)
• Smart contracts (era-contracts)
• zkEVM (era-zk_evm)
• Server (zksync-era)
• Prover (era-boojum)
• Fee withdrawer (era-fee-withdrawer)
• Block Explorer (clock-explorer)
• Portal - Wallet + Bridge (dapp-portal)
• Other (please specify below)

Rust Version

1.82.0

Operating System

• Ubuntu
• MacOS
• Windows
• Other (Please specify below)

Issue Description

I've been following the guide on how to setup a new ecosystem locally from here https://docs.zksync.io/zk-stack/running/quickstart. Initial reth, postgres and observability containers spin up. I get to running the zkstack ecosystem init --dev but when it gets to the Starting the genesis of the server. Building the entire server may take a lot of time..., the compilation fails and it not able to run the server.

Expected Behavior

To start an era server locally.

Current Behavior

Fails with the following error:

■  Unable to perform genesis on the database
│
▲    0: Failed to start server
│    1: Command failed to run: cargo run --release --bin zksync_server -- --genesis-path ./chains/era/configs/genesis.yaml --wallets-path ./chains/era/configs/wallets.yaml --config-path ./chains/era/configs/general.yaml --secrets-path ./chains/era/configs/secrets.yaml --contracts-config-path ./chains/era/configs/contracts.yaml --genesis
│     Compiling zksync_basic_types v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/basic_types)
│     Compiling zksync_dal v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/dal)
│     Compiling zksync_protobuf_config v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/protobuf_config)
│     Compiling zksync_shared_metrics v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/shared_metrics)
│     Compiling zksync_crypto_primitives v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/crypto_primitives)
│     Compiling zksync_system_constants v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/constants)
│     Compiling zksync_contracts v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/contracts)
│     Compiling zksync_db_connection v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/db_connection)
│     Compiling zksync_mini_merkle_tree v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/mini_merkle_tree)
│     Compiling zksync_config v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/config)
│     Compiling zksync_eth_signer v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/eth_signer)
│     Compiling zksync_types v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/types)
│     Compiling zksync_env_config v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/env_config)
│     Compiling zksync_object_store v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/object_store)
│     Compiling zksync_vm_interface v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/vm_interface)
│     Compiling zksync_web3_decl v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/web3_decl)
│     Compiling zksync_external_price_api v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/external_price_api)
│     Compiling zksync_mempool v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/mempool)
│     Compiling zksync_prover_interface v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/prover_interface)
│     Compiling zksync_multivm v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/multivm)
│     Compiling zksync_da_clients v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/da_clients)
│     Compiling zksync_core_leftovers v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/zksync_core_leftovers)
│     Compiling zksync_l1_contract_interface v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/l1_contract_interface)
│     Compiling zksync_merkle_tree v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/merkle_tree)
│     Compiling zksync_eth_client v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/eth_client)
│     Compiling zksync_vm_executor v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/vm_executor)
│     Compiling zksync_node_fee_model v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/fee_model)
│     Compiling zksync_node_test_utils v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/test_utils)
│     Compiling zksync_node_genesis v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/genesis)
│     Compiling zksync_snapshots_applier v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/snapshots_applier)
│     Compiling zksync_logs_bloom_backfill v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/logs_bloom_backfill)
│     Compiling zksync_node_db_pruner v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/db_pruner)
│     Compiling zksync_da_dispatcher v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/da_dispatcher)
│     Compiling zksync_external_proof_integration_api v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/external_proof_integration_api)
│     Compiling zksync_commitment_generator v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/commitment_generator)
│     Compiling zksync_state v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/state)
│     Compiling zksync_base_token_adjuster v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/base_token_adjuster)
│     Compiling zksync_metadata_calculator v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/metadata_calculator)
│     Compiling zksync_reorg_detector v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/reorg_detector)
│     Compiling zksync_state_keeper v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/state_keeper)
│     Compiling zksync_block_reverter v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/block_reverter)
│     Compiling zksync_vm_runner v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/vm_runner)
│     Compiling zksync_proof_data_handler v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/proof_data_handler)
│     Compiling zksync_eth_sender v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/eth_sender)
│     Compiling zksync_eth_watch v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/eth_watch)
│     Compiling zksync_node_sync v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/node_sync)
│     Compiling zksync_house_keeper v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/house_keeper)
│     Compiling zksync_node_storage_init v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/node_storage_init)
│     Compiling zksync_node_consensus v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/consensus)
│     Compiling zksync_node_api_server v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/api_server)
│     Compiling zksync_consistency_checker v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/consistency_checker)
│     Compiling zksync_circuit_breaker v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/lib/circuit_breaker)
│     Compiling zksync_contract_verification_server v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/contract_verification_server)
│     Compiling zksync_node_framework v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/node/node_framework)
│     Compiling zksync_server v0.1.0 (/Users/nikola/Development/Alchemy/temp/zk/zksync-era/core/bin/zksync_server)
│      Finished `release` profile [optimized] target(s) in 1m 56s
│       Running `target/release/zksync_server --genesis-path ./chains/era/configs/genesis.yaml --wallets-path ./chains/era/configs/wallets.yaml --config-path ./chains/era/configs/general.yaml --secrets-path ./chains/era/configs/secrets.yaml --contracts-config-path ./chains/era/configs/contracts.yaml --genesis`
│  thread 'tokio-runtime-worker' panicked at core/lib/contracts/src/lib.rs:344:13:
│  Can't find bytecode for 'proved_batch' yul contract at "/Users/nikola/Development/Alchemy/temp/zk/zksync-era/contracts/system-contracts/bootloader/build/artifacts"
│  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
│  Error: One or more tasks failed: ["Task oneshot_runner failed: Oneshot task node_storage_initializer panicked: Can't find bytecode for 'proved_batch' yul contract at \"/Users/nikola/Development/Alchemy/temp/zk/zksync-era/contracts/system-contracts/bootloader/build/artifacts\""]
│
│    2: Command failed to run: cargo run --release --bin zksync_server -- --genesis-path ./chains/era/configs/genesis.yaml --wallets-path ./chains/era/configs/wallets.yaml --config-path ./chains/era/configs/general.yaml --secrets-path ./chains/era/configs/secrets.yaml --contracts-config-path ./chains/era/configs/contracts.yaml --genesis
│
└  Failed to run command

Debugging further I found out that in /Users/nikola/Development/Alchemy/temp/zk/zksync-era/contracts/system-contracts/bootloader/build the artifacts folder is missing so I guess some compilation step of the bootloader didn't work but I see no logs related to that.

Repository Link (if applicable)

No response

Additional Details

No response

Prior Research

• Yes, I searched for similar issues and did not find any matching ones.

[popzxc]

Hello! foundry-zksync had a breaking change recently, and the latest version is not supported yet.

To make sure that everything work, you should do the following:

• git pull to make sure that you're running the most recent version of the codebase.
• zkstackup --local to reinstall zkstack CLI
• foundryup-zksync -C 27360d4c8 (not newer!) to install compatible version of foundry-zksync.
• rm -rf contracts and git submodule update --init --recursive to make sure that there are no old contracts artifacts.

After that, deploying should work.
This is only required temporarily; hopefully the latest foundry-zksync version would be supported in the core codebase soon.

[nktaushanov]

Thank you @popzxc, this resolved the issue indeed! Might be worth adding to your docs temporarily (or the README of the Era repo as others might hit the same problem)

[nktaushanov]

@popzxc short followup related to the running a rollup locally using the zkstack: I've continued with the docs and ended up on this step - https://docs.zksync.io/zk-stack/running/production but I don't have the zk cli tool installed, is this page outdated and is there another way to generate the docker setup?

[popzxc]

This page is indeed outdated. I guess the most recent guide on building docker images can be found in the core docs