Is Ui automation possible/effective with Matlab?

I am a novice in matlab programming, but have some interest in Ui automation. I have some basic experience in UiPath (Robotic Process Automation). Now my question is: is it possible to do UiPath-like Ui automation through Matlab (and potentially third-part-applications), such as

• Open external applications (including web browser and non-Microsoft)
• Send hotkeys to external applications
• Extract information from external application
• Screen scraping from external application

[Jan]

What exactly is "non-Microsoft"? "Extract information from external application" can mean nearly everything, so this is hard to answer.

[Johnny Birch]

Hi Jan, I don’t have any specific example but by non-Microsoft I mean application which are not standard in Windows. It could be an Adobe application. And by “Extract information” it could be a text section or author name from a .pdf file. It could also be something different from Adobe like a playlist from Spotify.

Answer 1

[Jan]

This is a very general job. Of course you can do this with Matlab, e.g. using FEX: keyinject and FEX: textinject, but there are other tools available, which handle such an automation more reliable and easier, e.g. AutoIt. See a list here: https://en.wikipedia.org/wiki/Comparison_of_GUI_testing_tools

I recommend not to reinvent the wheel but stay at one of the already working and freely available solutions instead of creating a new implementation in Matlab.