1/2/2024 0 Comments Mouseless androidIf you're already using Vimium, I suggest trying qutebrowser, which takes keyboard accessibility to a whole new level, by making it a first-class feature for the entire browser. Shortcat is macOS only for now as I haven't been able to investigate how viable doing this on Windows or Linux would be, especially on Linux considering all the different toolkits that exist. One of the goals is to help improve accessibility implementations by exposing more people to its implementations and pushing for developers to fix broken or incorrectly implemented accessibility tagging. Shortcat relies on using the Accessibility API to index UI elements however, and is dependent on how well an app or website has implemented it. I'm currently working on a modal option which enables staying within Shortcat to navigate an interface, as well as chords for simulating scrolling and arrow keys. The goal is to minimise cognitive overhead to achieve a particular intent, so being able to type a word to hit a button, or active a deep menu item when you don't know the shortcut is quick and easy. Works almost everywhere on macOS, including browsers, Electron apps, and even iOS apps! Type a word, abbreviations, or hints and hit Enter to click or action the element. Rather than try to simulate the moving the mouse itself, Shortcat indexes the user interface (buttons, text fields, links, menus, etc) and enables fast fuzzy search of the interface. Then again there are times when I've simply wave my hand with fingers not clearly stretched out, and the controller recognizes the assigned gesture.I've built an app that has the same goals (not operate a mouse) but approach it completely different. The effectiveness also depends on how you move your hand.Īs an example, I notice if I do a slight pause over the control before waving five fingers to the right, the activation works better. Leap Motion needs to be able to determine the number of fingers you're holding up, and sometimes it gets confused. Waving five fingers up or down is certainly a lot faster to adjust the sound level on my Mac than it is to locate and press the volume keys on my keyboard.Įveryone's custom gestures will be different, and you will need to practice with the hand motions and various assigned gestures to see which ones work best for you. I can perform any of these actions using BTT on my trackpad, but in many cases it's easier and faster to just wave my hand over the controller to execute an action, just as it's easier to type "jk" (an assigned Keyboard Maestro string trigger) to delete the last word I type, instead of reaching for the delete key. Almost any finger gesture to awaken my monitor (unfortunately when your computer is sleep, you can't use Leap Motion to wake it up).A simulated clap motion (without actually making a clapping sound) to sleep my computer.This can be done while Rdio (or any assigned application) is hidden in the background and without bringing it to the front. Two-finger swipe right to skip to the next song in the Rdio player.Two-finger swipe left to launch or bring the Rdio player app to the front.Five-finger up to raise the audio volume and five finger down to lower the volume.Five-finger swipe left to send the front most application window to the next monitor.Five-finger swipe right to hide an application.After some time setting everything up, my BTT-Leap Motion features include the following actions: When it takes too many attempts for a hand motion to execute an assigned action, I usually change it and try a different one. The finger tap gestures seem to require more precision in order for Leap Motion to recognize them. Based on my experience so far, I find the five finger gestures work really well, while Leap Motion often confuses the difference between single or two-finger gestures. You can create BTT Leap Motion finger gestures in the same way you create mouse or trackpad gestures.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |