Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simplify lock state tracking #14358

Closed
wants to merge 3 commits into from
Closed

Conversation

seanbudd
Copy link
Member

@seanbudd seanbudd commented Nov 10, 2022

Link to issue number:

None

Summary of the issue:

If NVDA freezes, session tracking notifications may be dropped.
If this happens when locking, NVDA will be insecure while on the Windows lock screen.
If this happens when unlocking, NVDA will not behave correctly and be inaccessible while Windows is unlocked.

Description of user facing changes

Should avoid the described issue, otherwise no changes.

Description of development approach

The previous approach is querying an initial state, and tracking state changes via session tracking notification.
Instead, query and cache the lock state on each core cycle with AutoPropertyObject.

Testing strategy:

As it is difficult to time and simulate a freeze, general smoke testing on the new session tracking method should be performed instead.

With a try-build, use speech, enable error sounds, and monitor the logs for errors/warnings.

  • Smoke test the sign-in flow from lock, switch users, sleep, restart, log in and log out, checking the lock screen, sign-in screen, and general NVDA usage after sign in.
  • Smoke test the UAC dialog
  • Test the STR for issues fixed in 2022.3.1 and 2022.3.2

Known issues with pull request:

Change log entries:

Bug fixes

- Fixed bug where if NVDA freezes when locking, NVDA will allow access to the users desktop while on the Windows lock screen.
- Fixed bug where if NVDA freezes when locking, NVDA will not behave correctly, as if the device was still locked.

Deprecation warnings: TODO

Code Review Checklist:

  • Pull Request description:
    • description is up to date
    • change log entries
  • Testing:
    • Unit tests
    • System (end to end) tests
    • Manual testing
  • API is compatible with existing add-ons.
  • Documentation:
    • User Documentation
    • Developer / Technical Documentation
    • Context sensitive help for GUI changes
  • UX of all users considered:
    • Speech
    • Braille
    • Low Vision
    • Different web browsers
    • Localization in other languages / culture than English
  • Security precautions taken.

If NVDA freezes, session tracking notifications may be dropped. Instead, query and cache the lock state on each core cycle with AutoPropertyObject
@seanbudd seanbudd marked this pull request as ready for review November 10, 2022 04:17
@seanbudd seanbudd requested a review from a team as a code owner November 10, 2022 04:17
@seanbudd seanbudd requested review from feerrenrut and removed request for a team November 10, 2022 04:17
@seanbudd seanbudd added this to the 2022.3.3 milestone Nov 10, 2022
@seanbudd seanbudd self-assigned this Nov 10, 2022
Copy link
Member

@michaelDCurran michaelDCurran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The approach looks okay to me. But also requesting review from @feerrenrut as there is a massive amount of code removal which I find hard to review efficiently.

@michaelDCurran
Copy link
Member

Not that I have any evidence to suggest there is a performance issue, but if we do now or at some point become concerned there is, we could rather than use an AutoPropertyObject caching for a core cycle (which is rather short) we could instead cache it for ever as an instance variable on api.getForegroundObject() as then it will only be re-fetched each time the foreground changes.

Copy link
Contributor

@feerrenrut feerrenrut left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this approach will work. Just a few details that might cause issues.

# https://docs.microsoft.com/en-us/windows/win32/api/wtsapi32/nf-wtsapi32-wtsregistersessionnotification#remarks
"Global\\TermSrvReadyEvent" # LPCWSTR lpName - The name of the event object.
def register(handle: int) -> bool:
# TODO: improve deprecation practice on beta/master merges
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure what this means. Happy for the plan to be documented on the PR description.

source/baseObject.py Show resolved Hide resolved
source/winAPI/sessionTracking.py Show resolved Hide resolved
source/winAPI/sessionTracking.py Show resolved Hide resolved
source/winAPI/sessionTracking.py Show resolved Hide resolved
source/winAPI/sessionTracking.py Show resolved Hide resolved
"""
global _currentSessionState
log.debug("initializing session tracking")
_currentSessionState = _CurrentSessionState()


def isWindowsLocked() -> bool:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's deprecate this and fix the name on master:

Suggested change
def isWindowsLocked() -> bool:
def isWindowsLocked() -> bool:
return isWindowsLockScreenActive()
def isWindowsLockScreenActive() -> bool:
...

source/winAPI/sessionTracking.py Show resolved Hide resolved
@seanbudd seanbudd closed this Nov 17, 2022
seanbudd added a commit that referenced this pull request Dec 16, 2022
Link to issue number:
Supercedes #14358
Fixes: #14379
Fixes: #14368

Summary of the issue:
Issue 1: Session tracking notification failures (#14358)
If NVDA freezes, session tracking notifications may be dropped.
If this happens when locking, NVDA will be insecure while on the Windows lock screen.
If this happens when unlocking, NVDA will not behave correctly and be inaccessible while Windows is unlocked.

This is fixed by querying the session directly, and caching this every core cycle.
If a query fails, NVDA should fall back accessible behaviour, rather than secure.

Issue 2: Forgot my PIN workflow is inaccessible (#14368)
NVDA cannot read content on the forgot my PIN workflow screen.
This is a similar situation to the lock screen, except an Edge Spartan window is used for the workflow.
This runs on a temporary user profile.

This is fixed by detecting the z-order of windows, and making an window above the lock screen window accessible.

Issue 2a: Object navigation does not work on the PIN workflow screen (#14416)
This is because TextInfo.obj can be a TreeInterceptor, where it was previously documented as just NVDAObject.
This assumption caused the _isSecureObjectWhileLockScreenActivated function to fail, making object navigation fail.
In those cases, the TreeInterceptor.rootNVDAObject should be checked instead.

Issue 3: NVDA fails to install in some environments (#14379)
Sometimes an NVDA session query returns an unexpected value.
In this case, default to the "session unknown" behaviour.
If a session query fails, NVDA should roll back to accessible behaviour rather than failing to run.

Description of user facing changes
PIN workflow screen should become accessible.
NVDA has better session tracking management (i.e. is aware of the lock state more accuractely).
NVDA should handle session query failures without preventing installation, blocking usage, etc.

Description of development approach
There are 4 security modes of NVDA:

normal, authenticated user
secure mode: secure desktop mode (when serviceDebug param not set), or --secure param provided.
Refer to existing docs on this.
secure desktop mode: enabled secure mode (when serviceDebug param not set).
Also prevents access to some controls, that should not be accessible from the sign-in/UAC dialog.
lock screen mode: prevents access to user data. Used on the lock screen, which runs on a user desktop.
Also include the reset PIN workflow and out of box experience. (Only Win 10+)
Lock state session tracking is handled by NVDA now, by querying the session state every core pump cycle.

When on lock screen mode, we need to check the z-order of windows to confirm if an NVDA object should be accessible.
The window associated with the NVDAObject should be above the lowest lock screen window.
Lock screen windows can be identified by known class names.
This is risky as class names may change, but the lockapp appModule isn't detectable on the forgot PIN workflow.

We can confirm the windows order by starting at the lowest lock screen, then navigating our way up.
If we can confirm that the NVDA Object is not below the lock screen window, we can make the object accessible.
This method is risky, as z-ordering is dynamic.
There are unit tests to cover this, code aims to make NVDAObjects accessible where the order is unknown.
@seanbudd seanbudd deleted the simplify-lock-state-tracking branch February 13, 2024 05:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants