JetBrains PyCharm apparently uses the JavaHelp help viewer in its PyCharm product (and possibly in other JetBrains IDEs too).
I created a couple of issues in their bug tracker:
I'm guessing this is pretty easy to implement (at least the first one). Pointers to where (in the source code)/how to implement this would be helpful.