Laura Coombs' second of the afternoon saw City overturn a two-goal deficit against Aston Villa to lead as the hour mark approached.
But the hosts rallied, and went on to claim all three points through a Kenza Dali leveller and Rachel Daly's eventual winning goal.
And Taylor was disappointed that his side couldn't hold on to the points at Villa Park, consigning us to our first opening day defeat since 2014.
He said: "It's not the start we wanted. We didn't find out rhythm in the first half and struggled against their counter attacks.
"We turned the game around inside ten minutes of the second half so to not have taken anything form the game at that point, not necessarily winning but certainly to not take anything is disappointing.
"If you concede four away from home, you're always going to struggle."
Hear the boss' post-match thoughts in full via the video above...