ML testing

Menu
====

* Simple navigation: press arrow keys to move around. Press and hold arrow keys to move faster.
* Scrollwheel navigation: should work in the same way as in Canon menus.
* Edit mode:
   - Simple fields: change value with SET.
   - Fields with many values: press SET followed by LEFT/RIGHT/MainDial
   - Fields with submenus: press the indicated key (usually Q) to open the submenu; inside submenu, adjust things with LEFT/RIGHT
* Modes:
   - Photo mode: menu should work normally
   - LiveView: menu should work normally
   - Recording: scrollwheels will not work, submenu (Q) button may not work. If Q does not work, INFO button should take its place.
* Key help text (light blue): it will tell the function for two keys. Check whether is correct what the help text says.
* Function help text: should tell what the function does. You can suggest better help texts.
* Icons: dark gray = OFF, light green = ON, yellow triangle = ACTION, dice icon = multiple choices, red X = actively disable something, volume-like icon = some numeric quantity...
* Error messages in menu: if something doesn't work (usually because you need to enable some other setting), a red icon and a red help text should tell you what to do.
  For example, if you enable trap focus in AF mode, ML should tell you that you have to switch to MF.


Audio
=====

This module should be pretty stable, there were very few changes to it since long ago.

* Analog Gain: obvious, audio meters should react to it
* L/R Digital Gain: same
* Input Source: should select the correct mic, or should autodetect an external mic if configured so
* Mic power: I don't know when to use this (in theory, with low impedance mics)
* AGC: normally off. Enabling it should disable L/R digital gains.
* Output volume: should alter volume in headphones.
* Headphone Monitoring:
   - If enabled: plug the headphones, screen should not go blank, you should hear audio, ML should display "headphones connected"
   - Should work if you first plug headphones, then start the camera
   - Should work with a HDMI monitor too
* Audio meters: should display the meters in movie mode, or in ML menu. Should be yellow at -12 dB and red at -3 dB.


Expo
====

White Balance:
* Range in movie mode: 1500 - 15000
* WBShift: obvious
* RGB multipliers: should let you alter the Custom WB setting
* Black Level (movie mode): should adjust green-magenta balance in shadows.
* Auto adjust (PushWB): should set WB based on a reference gray indicated by a small square. On SD monitors it should fail gracefully.

ISO:
* Equivalent ISO: should reflect reality. Reference: ISOs from Canon firmware.
* Analog ISO: 100-3200, in full stop increments.
* Canon digital ISO: normally from -0.3 EV to +0.3 EV, can be 1EV or 2EV at expanded ISO.
* ML digital ISO: should only appear in movie mode.
* Display gain: should only appear in photo mode. 
* HTP: this affects ISO, so it's placed here.
* ISO selection: 
  - C 100/160x: when changing ISO from ML, it should use only Canon ISOs (ML digital ISO should become zero)
  - ML ISOs: when changing ISO from ML, Canon digital ISO should become zero.
* Min/Max Movie Auto ISO: obvious
* A-ISO smoothness: low values = slower changes to ISO in auto iso mode.

Shutter:
* With exposure override on, you should be able to get 1/25 in 25p,  1/8000 in any modes, and many intermediate values (1/8-stop increments).
* With exposure override off, you should get the same values as with Canon firmware (or more, if you are lucky).

Aperture:
* With exposure override on, you should be able to adjust aperture in 1/8-stop increments.
* With exposure override off, you should get the same values as with Canon firmware.

Picture Style
* ML settings should match Canon settings (especially on 600D - auto picstyle).
* Same for contrast, saturation, sharpness etc.
* You should be able to adjust them while seeing LiveView image. Not all cameras let you do this with factory firmware.
* User picture styles: ML should display correct names, in menu and in top info bar.

REC pic style
* SET enables/disables the feature; the new picture style can be chosen from submenu.
* ML should switch to the "REC pic style" when recording starts, and back when recording stops.

Flash AEcomp
* Should do flash expo compensation, without Canon limits.
* Should work with external flashes too, I think (not sure).

Expo override:
* ON: should let you select more values for shutter and aperture, should enable manual video controls on cameras without it, should fix underexposure LiveView bug with manual lenses.
* OFF: exposure should behave like in Canon firmware.
* Auto: ML should only select it when needed (see user guide).


LV display
* Values: Photo ExpSim, Photo without ExpSim, Movie.
* Cameras with dedicated movie mode: you should be able to change this only in photo mode.
* Cameras without movie mode: you should be able to change it in LiveView, at all times (except while recording).
* When expsim is disabled, ML should not display exposure tools (like zebras, histograms). ML help text should explain why they are not displayed.

LiveV
=====

GlobalDraw:
* ON: should display ML graphics 
* OFF: should not draw ML graphics. On external displays, check if things look alright with globaldraw off (ML might forget to refresh display parameters).
* If Canon graphics are on the screen, ML should not display any graphics. Instead, it should tell you to press INFO/DISP to turn Canon graphics off.

Zebras:
* Luma: red/blue zebras
* RGB: zebras have the opposite color of clipped channel. Examples: clipped white => black zebras; clipped red => cyan zebras (G+B); clipped red+green => blue zebras.
* Should not interfere with other graphics elements.
* Optional: zebras can be disabled when recording
* Speed: when only zebras are enabled, they should be very fast. If focus peaking is active too, zebras will become slow.

Focus peaking:
* Speed: should be always fluent, no matter what settings you have
* Grayscale option: LiveView should be grayscale, but recorded image should be color
* Accuracy: can you compare it with other focus peaking algorithms? (from other camera or from an external monitor)

Magic Zoom:
* Check all trigger modes, according to user guide
* Size: try all sizes. Large size may introduce flicker (should not).
* Position: this may also influence flicker (try them all).
* Magnification: no special things here.
* Focus confirmation: check if it works. If it doesn't, this item should be disabled (not all cameras can confirm focus).

Cropmarks:
* Check all cropmarks included with ML
* Check your own cropmarks too (edit an existing cropmark in Paint, Gimp, Photoshop etc).
* Submenu: check the "show in play mode" option
* Should play nice with all other graphics elements:
  - zebras / peaking / etc should be only in the transparent cropmark area
  - cropmarks shouldn't be "eaten" by peaking
* Redrawing: cropmarks shouldn't become corrupted by other actions (like playing with menus, moving focus box etc)


Ghost image:
* Create: 
  - from playback (press LV)
  - from QuickReview, right after taking a pic (press LV)
* Check alignment: take a picture, create a ghost image, 
  use it to take a second picture aligned with the first one, check alignment in playback mode.
* Redraw: ML considers ghost images as cropmarks, so they should behave in the same way
* Move around: 
  - in LiveView, use arrows and SET
  - if some Canon dialogs are active (like ISO, or picturestyle, arrow keys should work in those dialogs)

Spotmeter:
* Check all units
* Use arrows to move spotmeter around
* Refresh rate: should be fast enough to keep up with exposure changes, but slow enough so you can read it
* Should not interfere with zebras and other graphics

False color:
* Should work in a similar way to zebras
* Check the different palettes
* Check the "green screen" palette (that one is a dynamic palette, not a fixed one)

Histogram:
* Refresh rate: if nothing else is enabled, it should be very fast. If not, it can lag 1-2 seconds.
* Linear histogram: check if it's the same as Canon's.
* Clip warning: check whether it's accurate.

Waveform:
* Accuracy: compare with the waveform from some other software or external monitor
* Size: full screen waveform might cause redraw issues (shouldn't)
* Position: should not overlap the histogram or other things

Vectorscope:
* No config options
* Compare with the vectorscope from some other software, on the same image (recorded video)

Level indicator (60D):
* Should not interfere with normal usage (unlike Canon's)
* Should be displayed when recording too


Movie
=====

Bit rate
* At 1x, bitrate should be just like in Canon firmware
* At 0.5x, bitrate should be half, compared to Canon firmware
* Values higher than 1.x should be an upper limit for the bitrate (you should not get bitrates higher than the menu setting)
* Buffer warning: ML should pause the graphics if video buffer is almost full
* Recording stopping: either with globaldraw on and off, the probability of recording stopping due to high bitrate should be the same

Time indicator
* Value should be roughly correct, in all modes. It will never be exact. 
* Check the value when recording is about to stop (4GB limit or card size limit) - it should stop at zero.
* When bitrate control is enabled, time indicator should be still accurate.
* Note: Canon time indicator uses strong assumptions about bitrate, ML does not (instead it measures bitrate on the fly).

Movie logging
* A LOG file should created for each movie, named in a similar way
* Movie logging should not increase the probability of recording being stopped
* LOG file should be readable and contain useful info

Movie restart
* If movie recording happens to stop, ML should restart it
* If you stop recording from the button, ML should not restart it
* Tip: check this with very high bitrates, so you don't have to wait for several minutes

Movie mode remap
* Check if it works as advertised :)
* Also check the shortcut key: ISO+LV.

REC/STBY notification
* Check if it works as advertised :)
* If beeps are selected: sound recording should not be affected

Movie REC key: HalfShutter
* Recording should start/stop when pressing shutter halfway
* If you take pictures, this shouldn't break the ability to start recording
* With a wired remote, you should be able to start/stop recording

Movie REC key: SET
* Nothing special

Force LiveView
* For cameras with a dedicated movie mode: this should work in movie mode only. For 5D2, it should work always.
* When you start the camera with any lens (especially manual lenses), it should start in LiveView.
* If you remove a Canon lens and mount it back, ML should enable LiveView.
* With Always setting: ML should enable LiveView right after you remove a Canon lens (always LiveView).

Shutter Lock:
* If you change shutter from top scrollwheel, ML should change it back.
* If you change shutter from ML menu, it should work.
* Should have no effect in photo mode.

FPS override: 
* Check a few values covering the entire range (very low, medium, very high)
* Check all optimization modes
* All settings should result in correct image
* Audio sync: try to sync the footage with audio from an external recorder, using the value indicated by ML
* With simple menu mode, should have no effect in photo mode. Advanced mode: should take effect in photo mode too (useful for night shots).

HDR video:
* Standby: it should alternate the ISO every 2 seconds
* Recording: display should alternate ISO every 2 seconds, recorded footage should alternate ISO every frame
* 60D/600D: ML should only alter the analog part of the ISO
* Should have no effect in photo mode.
* Check for proper sync while recording.

Image effects:
* Should work as advertised.
* Should have no effect in photo mode.

Shoot
=====

HDR bracketing:
* Test the Automatic setting (e.g. Ax1 EV). Try with a bright scene that requires shutter speeds faster than 1/8000 => should not repeat shots at fastest shutter speed.
* Night shots: if the bracketed shot needs exposures longer than 30 seconds, these should be done in bulb mode.
* Post scripts (enfuse): check if these work. For RAW shots, develop the RAW files first with your favorite program.
* Silent HDR pics: check if they work. Auto silent HDR may cause problems.
* ISO shifting: ML should take the same exposures as without it, but should adjust both ISO and shutter (not just shutter).
* Bracketing in auto modes: ML should do exposure compensation bracketing.

Intervalometer:
* Check if interval is accurate (with a clock)
* Should play nice with HDR brackets, bulb timer, silent pics, movies
* Start after X time units: check if it works as expected.
* Stop after X shots: check if it works as expected.
* Stop REC after X seconds: in movie mode, ML should record short movie clips of specified duration

Bulb/Focus Ramp:
* Auto ramping: check if it works as advertised. Submit BRAMPxx.LOG to developers.
* Manual exposure ramping: should work both as standalone and combined with auto ramping.
* Manual focus raping: should work as advertised (and should go to LiveView). Should warn if MF is selected.

Bulb timer:
* Should only work in BULB mode
* Should start by a long half-shutter press
* Should confirm visually when it was triggered (even with main display off)
* LED should be off during long exposures. Should blink once every 10 seconds and twice every minute.
* Main display should be OFF during long exposures (even if with Canon firmware it may be on). Common sense :)
* You should be able to stop the exposure by pressing shutter halfway. You should be able to start a new long exposure right away.
* Should not interfere with full-shutter presses (manual bulb exposures).

Audio remote shot:
* Should trigger when peak audio level is X dB above the average level
* Should not crash when triggered by noise made by pressing RECORD button (that would start movie and photo at the same time)
* Should only trigger in idle mode (not when playing with menus)

LCD remote shot:
* Should appear only on cameras with a LCD sensor.
* Photo mode: should take pictures.
* Should play nice with HDR bracketing, bulb timer, silent pics.
* Movie mode: 
  - if triggered from standby: should start recording:
  - if recording: wave mode should stop recording, away and near should start rack focus.
* Should warn if 'LCD Auto Off' is disabled from Canon menu.
* Should warn if an external display is connected.

Motion detect:
* Should warn if not in LiveView.
* Both trigger modes should work.
* Should play nice with HDR bracketing.
* It should always take photos (even in movie modes).
* Should not be triggered by going in/out LiveView, by playing with menus, or by pressing zoom.
* Should play nice with "Turn off LCD and LV" - powersave option.

Flash/NoFlash:
* For cameras with a built-in flash only
* Odd pictures (by file numbering) should be taken with flash, even files without flash.
* After turning this off, flash should work again (all pics with flash).

Silent pic:
* All combinations from menu should work.
* Try in photo mode, in movie mode (all resolutions) and in 5x zoom mode.
* You should be able to convert all pics to JPEG.

Mirror lockup:
* Self-timer setting: ML should enable MLU when you select self timer, and disable it otherwise
* ON/OFF setting: MLU should work like if you would select this from Canon menu.
* If self-timer is enabled, and you change MLU from Canon menu, ML should disable the self-timer mode (and revert to simple ON or OFF).

Focus
=====

Trap focus:
* Should warn if AF is active
* Should warn if lens doesn't have chip and you are not in LiveView
* Should work in photo mode (nonLV) and maybe in LV. If it doesn't work in LV, it should say so.
* Continuous mode: should work as expected (when something comes in focus, ML should take a picture, without requiring you to press buttons).

Focus patterns:
* Should work as advertised.
* Should warn if lens doesn't have chip.

Follow focus:
* Should warn if MF mode is active, or you are not in LiveView
* FF++ should be faster than FF+
* Direction reversal should work
* Follow focus with LCD sensor should work (if your camera has it)
* When recording: MENU should save current focus point, PLAY should return to it.

Focus stepsize and Focus StepDelay
* Setting should be applied to follow focus, rack focus, stack focus, focus ramping for timelapse.

Rack Delay:
* Rack focus should start after X seconds.

Focus End Point:
* Press SET to zero it out (set end point here)
* Press arrows to move the focus to start point. End point will remain fixed.

Rack Focus:
* SET: will start rack focus after the programmed delay
* PLAY: will start recording, wait, rack focus, wait again, stop recording.

Stack focus:
* Should take a sequence of pictures over the programmed rack focus range
* Should compute how many pictures it will take
* Should work with HDR brackets and silent pics, if any of these is enabled

Lens info
* Should display correct info about your lens (be it Canon lens, third party chipped lens, or manual lens).


Display
=======

Clear Overlays:
* HalfShutter: should clear zebras and peaking right after pressing shutter halfway, and the entire screen after 1-2 seconds.
* WhenIdle: should clear the entire screen after a few seconds after last key press.
* Always: should clear the entire screen as soon as LiveView display is idle (no other dialogs). Menus should work normally.

Contrast, saturation:
* Should work in LiveView only
* Should not affect recorded image
* Should not affect image in playback
* Should not conflict with focus peaking with grayscale option

Color scheme:
* Should work as advertised
* Should be applied on Canon menus too
* Should not cause stability issues (this feature changes a large number of digic registers, so things might go wrong).

Image position:
* Should work as advertised (on built-in LCD)
* Should display a warning on external monitors.

Upside Down mode:
* User interface elements should be readable if the camera is upside down
* Zebras should be fluent

Orientation:
* Should work as advertised

Auto Mirroring:
* If you flip out the LCD at 180 degrees, in LiveView, ML text should be still readable.

Focus box (autohide):
* Should disappear after 1 second (if enabled), or should stay there (if disabled)

Screen Layout:
* ML elements should reposition themselves properly.
* For external display: ML menu should be visible (not cropped) if the correct layout is selected.

Force HDMI-VGA:
* The HDMI monitor should drop to SD resolution
* Display should not go blank when you press record.

Tweaks
======

LV zoom settings:
* If zoom x5 is disabled, a single zoom press should go to 10x zoom.
* If zoom x10 is disabled, first zoom press will go to x5, second will go back to x1.
* Face detection mode: ML should zoom on autodetected face.
* Auto exposure on zoom: you should be able to freely change the aperture of your manual lens without altering exposure. If it doesn't work, it should print that.
* Increase Sharp+Contrast: in zoom mode, ML should bump sharpness and contrast. Settings should be back to normal when you go back to 1x, when you take a picture, when you start recording, or when you shutdown the camera while in zoom mode.
* Zoom on HalfShutter: should work as advertised.
* Zoom with Focus Ring: with a lens that reports focus distance, you should be able to trigger zoom by rotating the ring.
* Zoom should not be triggered while recording.

Arrow key shortcuts:
* Press the key indicated by help text to open shortcuts "menu".
* Press shutter halfway to close shortcuts menu.
* Press arrows or SET to perform the action specified on screen.
* Hold arrows pressed to change the setting faster (with acceleration).
* Try in standby, recording and 5x zoom.
* If shortcuts are off, the shortcut key should have its normal behavior (if any).

Sticky DOF preview:
* In photo mode, LiveView: press DOF once. Aperture should close and stay there. Press DOF again to release it.
* It may block certain keys (can't fix).

Swap MENU<->ERASE (60D):
* Open ML menu with MENU
* Open Canon menu with ERASE
* Delete files with MENU

Crop factor display:
* Displayed focal length should be the real one x 1.6 (with "eq" symbol). 
* Should not be displayed on full-frame camera

Play
====

SET + MainDial: 
* Should do the selected action
* Should stop doint the action if you quit play mode in the middle

Image Review Mode:
* QuickReview: should work like with Canon firmware
* Rvw:Hold->Play: if you select "Image Review: Hold" from Canon menu, this means ML should use play mode instead. With this, you can zoom in like Ken Rockwell, right after taking a picture.

LiveV tools in QR:
* After taking a pic, you should see zebras, histograms and whatever you may have selected from LiveView.

Zoom in PLAY mode:
* Normal: no change to Canon firmware
* Fast: should zoom faster
* Fast+100%: first zoom press should zoom all the way up, centered on current AF point. Subsequent presses should change zoom quickly.

LV button: Protect Image
* Should just work

Quick Erase:
* SET+ERASE should delete the picture, without confirmation
* SET should not become sticky (!!!) - that would be very dangerous

Powersave
=========

Enable powersaving: on Standby, on Recording, on both: obvious.

Dim display: obvious. Should wake up as soon as you press some key (and do the action for that key).

Turn off LCD and LV:
* in standby: LCD should turn off, LiveView should be paused.
* when recording: only LCD should turn off.
* with motion detect active: only LCD should turn off.
* wakeup: any key press should enable the display, but the normal action for that key should be skipped.
* shutdown: you should be able to turn off the camera cleanly from powersave mode.

Turn off GlobalDraw: obvious.

Battery level: estimation should be correct.

Debug
=====

Flashlight:
* SET: should make the screen white, at max brightness. Half-shutter press should restore it back.
* PLAY: should enable the front LED.

Screenshot:
* Should save a BMP file and a 422 file, after 10 seconds.

Stability tests:
* Quick test: should run a lot of backend tests.
* Random test: should select random things from menu (infinite). Run it for as long as the battery allows it.
* Menu backend test: opens/closes menu very quickly. While this is running, change camera modes (go to movie mode, record, take pics, go to Canon menus). Run it for as long as the battery allows it.
* Redraw test: same as for menu backend. Run it for as long as the battery allows it.
* Report any problems or log files.

Show tasks:
* ML should display a list of tasks.

Save CPU usage log:
* After 20 seconds of measuring CPU usage, you should get a log file. 
* Powersaving task should have the highest CPU usage.
* In photo mode, idle, the CPU usage of ML tasks should be comparable with CPU usage of Canon tasks (not much higher).

Indicators (free memory, shutter count, CMOS temperature)
* Should be green.

Config
======
* Config AutoSave: ML should save config at shutdown and after closing menu (but only if you changed some setting).
* Delete config: at next reboot, ML should start with default settings.

Help
====

* Displayed help text should match reality.
* For each feature, check if the bottom help text and the description from the manual are accurate.

Shutdown
========

There are 4 methods for turning off the camera:

* Normal power down (from power switch)
* Open card door
* Open battery door 
* Auto power off (timeout)

The following things may interfere with shutdown:

* Turn off LCD and LV (pausing LiveView)
* Aggressive stress tests (that may overload GUI message queue)
* Aggressive menu navigation (was a problem in old versions)
* Follow focus?

ML should never cause incomplete shutdowns (that would cause battery draining overnight, 
or would require you to take the battery out in order to start the camera again).

Misc
====

SET pressed at startup: should bypass loading ML.

Formatting the card and restoring ML: 
* Should work with FAT16, FAT32, EXFAT
* Should not allow you to cancel the process (buttons should be blocked)