thanks very much for this code. Working perfectly for me on a uiimage object which I use to display a tiled map (like OpenStreetMap).
Since I needed more possible interactions than just the default MATLAB “ImageClicked” callback, this came as the perfect solution!

Thanks again, great work.

I don’t know if this is “general knowledge” but you can turn on debugging by running:

matlab.internal.webwindow('http://example.com', 'DebugPort', 4040)

before any other App, or kill all MatlabWindow applications (from task manager) before the command. Then go with Chrome to http://localhost:4040/

Hi Khris,



Thanks for sharing your attempt (and thoughts) regarding the key press listeners! I’m sure it would be a helpful starting point for those who would like to explore this direction further. If you have a suggestion regarding how to add this functionality to mlapptools in a way that would be convenient for the user – please don’t hesitate to open an issue in the repo and/or drop us a line in chat. We’d be happy to hear feedback regarding any existing (or missing) functionality, and ideas about alternative implementations.


All the best,
Iliya.

I was playing with something similar to this, though my approach was not as nice. I found that we can add listeners to the DOM for key presses and then use javascript (document.querySelector([id="uniqName_##_#"]').click()) to initiate a button press on an invisible button, which then fires the matlab callback for the .ButtonPushedFcn. Essentially doing what you’ve done here for mouse clicks but for keyboard presses. I haven’t extensively tested it, but the following function works to spit out keypresses into the command window (only tested on 2018a).

I’m sure there are better ways to capture the keypress information (dojo/keys perhaps) and I would assume it’s possible to capture keypresses in defined contexts, like when a text area is active or when the mouse is hovering over an element, but I haven’t really tested this extensively.

Cheers,
Khris

function [f,b,w] = testkey()
  f = uifigure;
  b = uibutton(f,'Visible',  'off');
  [w,bid] = mlapptools.getWebElements(b);
  
  function clickCallback(s,e)
    %callback for button press gets keypress text and displays in console.
    tx = w.executeJS('tK');
    disp(tx)
  end

  b.ButtonPushedFcn = @(s,e)clickCallback(s,e);
  bqry = sprintf('document.querySelector(''[%s="%s"]'')', ...
    bid.ID_attr, ...
    bid.ID_val ...
    );
  
  jstext = [ ...
    'var tK = "", ', ...
    'but = %s;', ...
    'document.addEventListener(''keypress'', function(e){', ...
    '  tK = "";',...
    '  if (e.altKey) tK += ''ALT+'';',...
    '  if (e.ctrlKey) tK += ''CTRL+'';',...
    '  if (e.metaKey) tK += ''META+'';',...
    '  if (e.shiftKey) tK += ''SHIFT+'';',...
    '  tK += e.key;',...
    '  but.click(); ' ...
    '});' ...
  ];

  w.executeJS(sprintf(jstext,bqry));
end