No it really wasn’t. DirectX, OpenGL and Glide were really the start of Windows games and they didn’t become the norm until around 98 (bare in mind I’m talking about release date, not purchase date). In fact even as late as then some games were still written in DOS using special Glide or GL drivers for DOS. The 95 era of Windows was very much DOS orientated when it came to gaming.
Citation: I was a gamer and games developer in that era.