BrowserWindow.addDevToolsExtension Multiple Renderers

We have an app that uses multiple renderer processes. When trying to add the devtools extensions, either directory or with electron-devtools-installer, it seems like it only installs to the first BrowserWindow, which happens to be the wrong one. Is there a way to get it to install to a specific BrowserWindow, or all of them?