-
Notifications
You must be signed in to change notification settings - Fork 1
Home
Welcome to the top-level wiki for Orcasound!
Hot links: 2023 priority projects | community discussions
Add a photo and/or graphics to this home page?
What is Orcasound?
Orcasound is a hydrophone network in the critical habitat of the endangered Southern Resident killer whales.
Orcasound is an open source community building free hardware and software solutions for bioacoustics and marine conservation.
Orcasound is powered by volunteerism. Some folks are divers, captains, or general volunteers who help their favorite NGO deploy and maintain a new hydrophone. Some are software designers and developers who contribute via hackathons, summer internships, or asynchronous teams. Others are retirees or working professionals who bring expertise in project management, data science, artificial intelligence, or bioacoustics to the table and build innovative new solutions for science and saving soniferous species.
Orcasound is a do-ocracy. If you can build it with open source tools and/or cheap hardware -- and your innovative solution works for science and sustainability -- how you do it (or hack it together) doesn't matter so much to us.
Learn more about our community (code of conduct, organization, governance, resources, funding, acknowledgments, recruiting, Hall of Fame)
Add intro here that is beyond what is listed in README.md?
Ideally we want to quickly route incoming volunteers through info here that everyone should have read to be part of a fruitful community, and then custom info to efficiently get them contributing.
How do you want to contribute?
- 2.a I want to join the UX Research and Design Team
- 2.b I want to join the Dev & DevOps Team
- 2.c I want to join Project Management Team
- 2.c I want to help pioneer open hydrophones and marine bioacoustic hardware
- 2.b I want to help maintain and expand the hydrophone network (deployments and maintenance)
- UX Research and Design Team Resources
Practical technical guidance for monitoring & maintaining currently-deployed Orcasound software, deployments, and analytics.
If you're an Orcasound administrator, or would like to be one, the following sections will lead you to critical how-to information across the Orcasound ecosystem.
The core Orcasound software is a suite of tools that make it easy to listen to live audio streams within any web browser. Because the audio data can be mapped to a date-time, the player in the web app knows the real time of the audio a listener is hearing, so community scientists can use the web app to help to annotate the live audio data.
The Orcanode software generates the live audio stream from a low-cost single-board computer. We are agnostic to the hardware selected, but have mostly tested and deployed on Raspberry Pis (model 3b or 4). The Dockerized code is written in shell script or Python.
The Orcanode wiki covers:
- How to add a node to the network
- How to put a node in streaming vs research mode?
- How to remove a node?
The Orcasite software is currently deployed via Heroku and pulls audio and other data from Amazon S3 buckets.
The Orcasite wiki covers:
- How to add a node to the web app
- How to test a node in dev or beta subdomains of orcasound.net
- How to add or remove a node from the production subdomain -- live.orcasound.net
A long-term goal of the Orcasound web app is to facilitate signal detection in live audio data by an optimal combination of human listeners and Artificial Intelligence agents. To that end we have built a machine learning pipeline that iteratively harvests live audio data that humans find interesting (indicated with a button in v2) and/or that initial models think contain orca sounds. To speed the iterative process, we have also developed annotation tools to more efficiently label our highest-value archived data (see Annotation projects below).
With increasing amounts of labeled data in hand, we have developed and are refining a real time inference system that utilizes a binary classifier to predict if a detected signal is a call of the endangered Southern Resident killer whales (SRKWs), or not. Dubbed "OrcaHello" by the Microsoft hacakthon volunteers who built it, the system is deployed via Azure services working from the raw audio data S3 buckets.
The OrcaHello software is maintained in the aifororcas-livesystem repo.
The aifororcas-livesystem wiki has a (OrcaHello Administration )[https://github.com/orcasound/aifororcas-livesystem/wiki/Administration] page that covers:
- How to add a node to the real time inference stream
- How to add or remove OrcaHello moderators (who validate raw detection candidates)
- How to add or remove OrcaHello subscribers (who receive notifications of confirmed true positives)
- Orca Active Learning GSoC project -- OrcaAL
- Need to add direct link to administrative documentation...
-
Pod.Cast
- Need to add direct link to administrative documentation...
- Orcasound's Google Analytics account
-
UX dashboard
- Need to write administration documentation, esp after GA4 upgrades...
Maybe this is more of a catch-all troubleshooting guide or FAQ aimed at concerned community scientists persona? Or a general FAQ broken down by persona?
Concerned community scientist FAQ:
- Player (Confirm/deny a loop?)
Professional conservation scientist FAQ:
- Moderation guide (for human or machine detections)
- Automated detection moderation (OrcaHello)
- Human detection moderation (document once live.orcasound.net admin UI is made public?)
A guide for replicating Orcasound for another region or species
- Network organization & site selection
- Hydrophone hardware (acquisition and deployment)
- How science, management, or education goals can constrain hardware & software options and limit startup costs
- Orcanode wiki
- Hydrophone system deployment strategies
- Open source software
- Orcanode - audio data streaming code
- Orcasite - live-listening app for crowdsourced event detection and conservation action
- OrcaHello - real time inference system for killer whale detection
- Audio data annotation tools
- Pod.Cast
- OrcaAL
- HALLO annotation tool
- WhaleDr/Megaptera
- Bioacoustic analysis & data visualization software
- Bioacoustic inspiration (an open Trello board)