Clearing input fields and sending modifier keys such as Ctrl key

[kensoh]

Raising on behalf of user's email so that other users can benefit -

---

Have started using TagUi and fascinated with it.

I have a input field which has default test already in it, which needs to be deleted before entering any text.

Manually this can be achieved using [ctrl+A] and [delete] keyboard combination. How can this be achieved in TagUI file?.

In short, how do i send modifier keystrokes to the input field?.

Thanks in advance,

[kensoh]

Hi @dinesh3434, short answer is use the [clear] keyword, for example -
type email_text_box as [clear]test@gmail.com

Long answer, need to check as I have not tested modifier keys on Chrome. Sikuli integration using vision step should be able to send modifier keys as well but will need to test before sharing with you.

[kensoh]

I tried Chrome DevTools Protocol's Input.dispatchKeyEvent but result was not able to simulate the key entry with modifier keys. If you want to do more than the [clear] keyword above, you can try using the visual automation with Sikuli, which you can send custom keypresses using TagUI vision step. Will need to visually click the field first before doing the custom steps. More modifier keys definitions here.

macOS

vision type('a',Key.CMD)
vision type(Key.DELETE)

Windows

vision type('a',Key.CTRL)
vision type(Key.DELETE)

[kensoh]

response from user

   Thanks for your input, but i am using headless chrome for my automation in windows 10 environment. According to the documentation sikuli will not help me in this situation (correct me if i am wrong). Please let me know how we can use modifier keys in this situation.

Also, let me know how we can use sikuli if it is possible to do so (I cannot use Xvfb or tigerVNC)

---

my response

I'm afraid Sikuli won't work without a screen or running in headless mode. It seems that Chrome technically can work with modifiers but haven't figure out a way for TagUI to do that. Can you tell me more about your use scenarios for modifier keys?

[kensoh]

user response

The scenario is to manipulate online excel like sheets. Shift + arrow keys are used to select the data and manipulate the same. Hence, Modifier keys are required for the same.

[kensoh]

Reopening issue to explore further on modifier keys -

Ic.. Thanks @dinesh3434 for sharing.. I'm reopening the issue to explore further. For your online excel sheet application, is it open for public, or it is similar to Google sheets that I can try testing on?

---

Thanks :). It is similar to google sheets and you can try testing on the same.

[kensoh]

@dinesh3434 to prioritize on the other features, closing the issue as not supported for the use case of sending custom keystrokes in invisible mode (eg running without display adapter screen, no Xvbf on VM etc). during visible mode, users can use vision step to send custom commands to sikuli, for eg

click terminal_icon.png
vision type("ls -lrt" + Key.ENTER)

List of key modifiers, special keys, and examples - http://doc.sikuli.org/keys.html

update
In currrent cutting edge release, for entering simple text (characters, enter key),
type page.png as text can now be used. more details here - #113 (comment)

[kensoh]

fyi @Aussiroth @lohvht