The whale watching season in Sri Lanka runs from November to April Southen coast, and whales migrate from the southern hemisphere to the northern hemisphere(accessible from Galle and Mirissa). 
The rest of the year from March to August East Coast (accessible from Trincomalee) During the season, the ocean is calm and off-season: the ocean is rough because of the Monsoon. And it is not worth going.