[ManojTestsigma]

please review this addon and publish as PUBLIC

Addon name : windows_advanced_actions
Addon accont: https://jarvis.testsigma.com/ui/tenants/2817/addons
Jira: https://testsigma.atlassian.net/browse/CUS-14093

fix

1. Updated the add-on for tracking purpose.
2. added press keys nlp to windows advanced which was already present in windows lite.

Summary by CodeRabbit

• New Features

  • Added Windows actions for clipboard and file operations, coordinate-based clicking, right-clicking, keyboard input, key combinations, and repeated key presses.
  • Added image- and text-based clicking, relative positioning, waiting, verification, and runtime-variable storage using OCR, visual matching, or AI.
  • Added support for multi-action keyboard sequences with waits and special keys.

• Improvements

  • Improved screenshot handling, image matching, OCR text detection, keyboard typing, and network fallback behavior.
  • Updated action names and input labels for clearer presentation.

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: d415a2d7-3607-4971-bd46-2d57e472181d

📥 Commits

Reviewing files that changed from the base of the PR and between f88f4d0 and d70244e.

📒 Files selected for processing (70)

• windows_advanced_actions/pom.xml
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/AiTextUtils.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/ApproachConfig.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/Constants.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/FindImageUtils.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/HttpClientProvider.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/KeyboardUtils.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/OCRResponse.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/OCRTextPoint.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/OCRUtils.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/ResponseObjectForFindImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/ScreenshotUtils.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/util/StringCompareUtil.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/AddDataToClipboard.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/AddDataToFile.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnFixedCoordinates.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnImageWithFindImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnImageWithTimeout.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnPositionRelativeToImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnPositionRelativeToText.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnRelativeCoordinates.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnTextWithSpacesAndWait.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnTextWithWait.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/CopyAndPasteTestDataOnScreen.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/EnterDataUsingKeyboard.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/EnterDataUsingKeyboardAndPressEnter.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/EraseDataInFile.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ExtractDataFromScreen.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PerformMultipleActions.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressControlOrFunctionKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressControlOrFunctionKeyMultipleTimes.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressControlOrFunctionKeyWithCombination.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressControlOrFunctionKeyWithOtherControlKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressControlOrFunctionKeyWithOtherControlKeyAndAlphaNumeric.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressFunctionKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressModifierKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressModifierKeyWithBasicKeyCombination.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressModifierKeyWithGivenKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressSpecialKeyMultipleTimes.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressTwoModifierKeys.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/PressTwoModifierKeysWithBasicKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/StorePresenceOfTextInRuntimeVariable.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/StringCompareWindowsAdvanced.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/VerifyTextInApplication.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/VerifyTextInApplicationWithAI.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/VerifyUntilEitherTextIsPresentWhileLoop.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/VerifyUntilTextIsPresentWhileLoop.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/WaitUntilImagePresent.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/WaitUntilImagePresentWithFindImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/WaitUntilTextPresentInScreen.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/util/KeyUtil.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/ClickOnImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/ClickOnPositionRelativeToImage.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/ClickOnPositionRelativeToText.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/ClickOnTextWithWait.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/CopyAndPasteTestDataOnScreen.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/EnterDataUsingKeyboard.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/EnterDataUsingKeyboardAndPressEnter.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/PressFunctionKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/PressModifierKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/PressModifierKeyWithBasicKeyCombination.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/PressModifierKeyWithGivenKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/PressTwoModifierKeys.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/PressTwoModifierKeysWithBasicKey.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/RightClick.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/StorePresenceOfTextInRuntimeVariable.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/VerifyTextInApplication.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/WaitUntilImagePresent.java
• windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/WaitUntilTextPresentInScreen.java

---

📝 Walkthrough

Walkthrough

Changes

The PR adds shared AI/OCR detection, HTTP fallback, screenshot, keyboard, and comparison utilities; introduces Windows Advanced and Windows Lite actions for screen interaction, file and clipboard operations, keyboard input, visual matching, OCR verification, AI extraction, and coordinate-based clicking; and updates the Maven version to 1.0.38.

Windows Advanced actions

Layer / File(s)	Summary
Shared detection and transport utilities windows_advanced_actions/src/main/java/com/testsigma/addons/util/*	Adds AI text detection with fallback models, OCR parsing and matching, visual-server request helpers, proxy/retry handling, screenshot changes, keyboard character typing, and comparison utilities.
Visual and text automation windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/ClickOnImage*.java, ClickOnPositionRelativeTo*.java, ClickOnText*.java, Verify*.java, WaitUntil*.java	Adds or refactors image and OCR-based clicking, waiting, verification, relative positioning, and runtime-variable presence actions.
Data, clipboard, file, and multi-action automation windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/AddData*.java, CopyAndPaste*.java, EraseDataInFile.java, ExtractDataFromScreen.java, PerformMultipleActions.java, ClickOnFixedCoordinates.java, ClickOnRelativeCoordinates.java	Adds clipboard, file, coordinate, AI extraction, and tokenized multi-action execution flows.
Keyboard automation windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/Press*.java, EnterDataUsingKeyboard*.java, windows_advanced_actions/src/main/java/com/testsigma/addons/windowsAdvanced/util/KeyUtil.java	Adds key mapping, combinations, repeated key presses, character typing, and updated keyboard action metadata and utility imports.

Windows Lite actions

Layer / File(s)	Summary
Visual and text automation windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/ClickOn*.java, WaitUntil*.java, VerifyTextInApplication.java	Adds OCR- and image-based clicking, relative positioning, waiting, and AI text verification flows.
Keyboard, clipboard, and coordinate automation windows_advanced_actions/src/main/java/com/testsigma/addons/windowsLite/CopyAndPaste*.java, EnterDataUsingKeyboard*.java, Press*.java, RightClick.java, StorePresenceOfTextInRuntimeVariable.java	Adds clipboard paste, keyboard entry, function/modifier key actions, right-clicking, and AI-backed runtime-variable storage.

Estimated code review effort: 5 (Critical) | ~120 minutes

Possibly related PRs

• testsigmahq/testsigma-addons#211: Updates overlapping Windows Advanced keyboard actions and shared utility wiring.

Suggested reviewers: vigneshtestsigma, ganesh-testsigma

✨ Finishing Touches

📝 Generate docstrings

• Create stacked PR
• Commit on current branch

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch CUS-14093

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}