People used to say human eyes can't perceive >60fps.
It's also just CDs, not digital formats in general. Grab an audiophile and ask their opinions about digital PDM/PCM formats, high bitrate AACs even, against true vinyls. They wouldn't have as much opinions as they do against CDs.
Also: 44.1kHz sampling rate != arbitrary waveform up to 22050Hz, unless music you're listening to consists of pure sine waves(and not even classic Yamaha FM sound chip signals).
But in the case of analog recording, nobody can distinguish a pure analog recording from the same thing but with a good ADC/DAC pair in the signal path in a blind test. It's theoretically possible to hear undithered 16 bit quantization noise if you turn the volume up extremely loud, but correctly mastered CDs should be dithered from higher bit depth.
And 44.1kHz sampling rate can theoretically represent arbitrary waveforms up to 22050Hz. The only complication is that this requires a brickwall filter, which is impossible to implement. That's why the sampling rate is set higher than needed to exceed the 20kHz limit of human hearing (in practice the limit for adult hearing is almost always lower). The higher sample rate allows for a practical filter with a shallower transition band to be used.
No, because a reconstruction filter is used to remove the stairsteps. This does not lose any information. I recommend watching the xiph.org videos explaining it:
EDIT: Also, consider that true square/triangle/sawtooth waves are mathematical abstractions that can't exist in reality. If you try to move a real loudspeaker cone in a square wave, you have to reverse direction in exactly zero time. This requires infinite acceleration and therefore infinite force. If you take the Fourier transform of these waveforms you get an infinite series of harmonics.
A real-world "square" wave only contains the lower harmonics within some frequency band. When you limit it to audio frequencies, all square waves above 6.67kHz are identical to sine waves because the only harmonic within that frequency band is the fundamental.
It's also just CDs, not digital formats in general. Grab an audiophile and ask their opinions about digital PDM/PCM formats, high bitrate AACs even, against true vinyls. They wouldn't have as much opinions as they do against CDs.
Also: 44.1kHz sampling rate != arbitrary waveform up to 22050Hz, unless music you're listening to consists of pure sine waves(and not even classic Yamaha FM sound chip signals).