This is how I feel as well, but unless unexpected new data arrives, removing the ToC does seem to be the right course of action for most users. For me, it will be an enormous hassle, since I rely so heavily on it. That said, it should be relatively easy to create a browser extension that collects headings and insets a ToC somewhere useful in the page or even in the browser UI (like the sidebar, or in a drop-down menu, or something). That would let those of us that rely on the ToC have at it again.
I personally don’t feel it’s the best solution (having to resort to an extension to get a feature as fundamental to the reading experience as a table of contents), but I can’t argue that the numbers don’t suggest that getting it out of the way makes sense. That said, I would rather have a drop-down menu ToC either instead of or in addition to the jump bar. But we are outnumbered.