Do I need to apply for a yearly extension of my Non Immigrant O visa in the province where my wife’s blue book is registered?

You must apply for your yearly extension at the immigration office that serves the address where you are actually residing, not necessarily where your wife's blue book is registered. This is important as there may also be home visits or interviews conducted by immigration offices depending on the location.