Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add gen2-mono-raw-controls #132

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Conversation

alex-luxonis
Copy link
Contributor

@alex-luxonis alex-luxonis commented May 21, 2021

Displays both the raw output of a mono camera (left) and the ISP processed out.
(raw output added in luxonis/depthai-python#265)

Key controls:

'IOKL' for manual exposure/iso:
  Control:      key[dec/inc]  min..max
  exposure time:     I   O     20..33000 [us]
  sensitivity iso:   K   L    100..1600
To go back to auto controls:
  'E' - autoexposure
Other camera controls:
'1' - AWB lock (true / false)
'2' - AE lock (true / false)
'3' - Select control: AWB mode
'4' - Select control: AE compensation
'5' - Select control: anti-banding/flicker mode
'6' - Select control: effect mode
'7' - Select control: brightness
'8' - Select control: contrast
'9' - Select control: saturation
'0' - Select control: sharpness
'[' - Select control: luma denoise
For the 'Select control: ...' options, use these keys to modify the value:
  '-' or '_' to decrease
  '+' or '=' to increase
'C' - capture a set of frames (PNG and unprocessed)
'Q' - quit

@alex-luxonis
Copy link
Contributor Author

alex-luxonis commented May 21, 2021

image

@chris-piekarski
Copy link
Contributor

Another quick question for you @alex-luxonis. When running both ISP and RAW I am getting about 10fps for preview streams. If I disable RAW I can get 22-24 fps on ISP. But if I use cam.setFPS(60) it doesn't improve. Wondering if I am hitting USB bandwidth limit on the RPI3 or if the MonoCamera has other internal limits? If I drop to T_720_P from 800 I get another 2fps. Given the specs I was thinking I could get more than 24 fps out of it. Thoughts?

@Luxonis-Brandon
Copy link
Contributor

Yes, this is very likely a USB2 limitation/Pi CPU limitation. I recall in Gen1 we had the capability to increase the size of data chunks that are transferred, which helps reduce CPU load and thereby increase throughput. I'm not sure if it's in Gen2 yet though.

To tell if it's a USB bandwidth issue, you could run this example, which does encoding, and will reduce the throughput requirements by about an order of magnitude:
https://docs.luxonis.com/projects/api/en/latest/samples/rgb_mono_encoding/#rgb-mono-encoding

Could be missing something though, so definitely feel free to wait for Alex on this. :-)

@chris-piekarski
Copy link
Contributor

Thanks @Luxonis-Brandon. I will run that example and then switch to RPI4 to see if FPS goes up.

@chris-piekarski
Copy link
Contributor

chris-piekarski commented May 27, 2021

So must be bandwidth. I can get 60fps using single stream mono on Jetson/USB3 (both mono streams results is 34 fps each). Pushing fps above 60 kicks out a system warning that fps is capped for 720p resolution.

@Luxonis-Brandon
Copy link
Contributor

Thanks. And if you do lower resolution (640x400) you can do up to 118FPS on the grayscale.

@SzabolcsGergely
Copy link
Contributor

Should we merge this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants