Morse code is transmitted as a binary code, but that doesn’t make Morse code binary. If that were the case the Latin alphabet would also count as binary because computers transmit it in binary. The rules you describe is the encoding between Morse code’s native trinary alphanumeric encoding into a binary format for transmission.


It’s a lot harder to make that argument in the context of the rest of the lyrics
It’s not anti-science, it’s frustration at the world for being the complicated, messy place it is, and a longing to go back to the simple innocence of childhood where even basic physical processes are magical. It’s not a rant that nobody should do science, it’s his own disillusionment, and a plea for people to allow a little bit more wonder into their world.
It’s a powerful lyric because even in a song about how magical the world is, it still slips in and ruins it, the pebble in your shoe that doesn’t allow you to ever truly experience that pure feeling again, always gnawing at you in the background no matter what you do.