A batch management system for calcium imaging analysis using the CaImAn library.
It contains pandas.DataFrame and pandas.Series extensions that interface with CaImAn for running the various algorithms and organizing input & output data.
This replaces the Mesmerize legacy desktop application.
mesmerize-core is MUCH faster, more efficient, and offers many more features! For example there are simple extensions which you can just call to get the motion correction shifts, CNMF reconstructed movie, CNMF residuals, contours etc.
We recommend starting out with the demo notebook notebooks/mcorr_cnmf.ipynb
Documentation is available at: https://mesmerize-core.readthedocs.io/
User guide: https://mesmerize-core.readthedocs.io/en/latest/user_guide.html
Please use the GitHub issue tracker for any issues. For smaller questions or discussion use gitter.
gitter: https://gitter.im/mesmerize_discussion/mesmerize-viz
Video tutorial/virtual workshop from September 2022: https://www.youtube.com/watch?v=0AGiAaslJdk
We recommend either fastplotlib or mesmerize-viz for visualization. Mesmerize-viz gives you ready-to-use viuslizations for motion correction and CNMF - including component exploration, interactive component evaluation using metrics, and manual addition or removal of components.
Note that mesmerize-viz is very new and we are always happy to help (same for mesmerize-core and fastplotlib!). Installation instructions for mesmerize-viz are at the repo, it has very few dependencies so installation should be straight-forward: https://github.com/kushalkolar/mesmerize-viz
You can still find the demo notebooks with pure fastplotlib visualizations here: https://github.com/nel-lab/mesmerize-core/tree/master/with-fastplotlib/notebooks
mesviz-mcorr.mp4
mesviz-variants.mp4
mesviz-eval-interactive.mp4
If you use fastplotlib directly you can create highly complex and interactive plots to combine outputs from the CaImAn algorithms with other experimentally relevant analysis, such as behavioral data.
See the notebooks directory for detailed examples.
Note that fastplotlib is required for the visualizations.
The instructions below will install mesmerize-core.
For visualization install fastplotlib into the same environment as mesmerize-core:
pip install "fastplotlib[notebook]"You may need to install Vulkan drivers depending on your system, see the fastplotlib repo for more information: https://github.com/kushalkolar/fastplotlib#graphics-drivers
mesmerize-core is availabe as a conda package which also gives you CaImAn! These instructions will give you a working mesmerize-core along with caiman in the same environment.
Important note: Sometimes conda or mamba will get stuck at a step, such as creating an environment or installing a package. I found that pressing Enter on your keyboard can sometimes help it continue when it pauses.
- Install
mambainto your base environment. Skip this step if you havemamba. This step may take 10 minutes and display several messages like "Solving environment: failed with..." but it should eventually installmamba.
conda install -c conda-forge mamba
# if conda is behaving slow, this command can sometimes help
conda clean -a- To create a new environment and install
mesmerize-coreinto it do this:
mamba create -n mescore -c conda-forge mesmerize-corecaiman is a dependency of mesmerize-core so it will automatically grab caiman too
If you already have an environment with caiman:
mamba install -n name-of-env-with-caiman mesmerize-core- Activate environment. You can only use
mesmerize-corein the environment that it's installed into.
mamba activate mescore- Install
caimanmanager
If you are using an older version of caiman < 1.9.16, then please see Step 4 in the old README.
caimanmanager installIf you have issues with this step, please post an issue on the caiman github or gitter: https://github.com/flatironinstitute/CaImAn/issues
- Run
ipythonand verify thatmesmerize_coreis installed:
# run in ipython
import mesmerize_core
mesmerize_core.__version__- Install
fastplotlibfor visualization into the same environment (run this in the anaconda prompt, not ipython). You may also need to install Vulkan drivers depending on your system, see thefastplotlibrepo for more information: https://github.com/kushalkolar/fastplotlib#graphics-drivers
pip install "fastplotlib[notebook]"Optional: install simplejpeg for much faster notebook visualization, you will need C compilers and libjpeg-turbo for this to work:
pip install simplejpeg# create a new env in some directory
# tested on python3.9 and 3.10
python3.10 -m venv python-venvs/mesmerize-core
source python-venvs/mesmerize-core/bin/activate
# get latest pip setuptools and wheel
pip install --upgrade setuptools wheel pip
# cd into or make a dir that has your repos
mkdir repos
cd repos
# install caiman
git clone https://github.com/flatironinstitute/CaImAn.git
cd CaImAn
pip install -r requirements.txt
pip install .
caimanmanager install
# install mesmerize-core
pip install mesmerize-core
# install fastplotlib
pip install "fastplotlib[notebook]"
# you should now be able to import mesmerize_core
# start ipython
ipython
# run in ipython
import mesmerize_core
mesmerize_core.__version__# install mamba in your base environment
conda install -c conda-forge mamba
conda clean -a
conda create --name mesmerize-core
# activate environment
conda activate mesmerize-core
conda clean -a
# clone this repo
git clone https://github.com/nel-lab/mesmerize-core.git
cd mesmerize-core
# update env with environment file
# this installs caiman as well
mamba env update -n mesmerize-core --file environment.yml
# install caimanmanager
caimanmanager install
# install mesmerize-core
pip install .
# install pytest and run tests to make sure everything works properly
mamba install pytest
MESMERIZE_KEEP_TEST_DATA=1 DOWNLOAD_GROUND_TRUTHS=1 pytest -s .# create a new env in some directory
# tested on python3.9 and 3.10
python3.10 -m venv python-venvs/mesmerize-core
source python-venvs/mesmerize-core/bin/activate
# get latest pip setuptools and wheel
pip install --upgrade setuptools wheel pip
# cd into or make a dir that has your repos
mkdir repos
cd repos
# install caiman
git clone https://github.com/flatironinstitute/CaImAn.git
cd CaImAn
pip install -r requirements.txt
pip install .
caimanmanager install
# clone this repo and install mesmerize-core
cd ..
git clone https://github.com/nel-lab/mesmerize-core.git
cd mesmerize-core
pip install -e .
# run tests to make sure everything works
MESMERIZE_KEEP_TEST_DATA=1 DOWNLOAD_GROUND_TRUTHS=1 pytest -s .