First of all upgrade both add-ons to their latest versions or make sure they are at their most current versions. Of course it would be nice if Exp Eng were at its most current version also. :-)
I don't recall the details of this issue, best to ask the developers, but one solution is to try the settings in Wygwam for "Defer loading". In the settings for Wygwam you can set a preference that displays the Wygwam editor or defers it until you click on the field. In one instance I set this to NOT defer loading. The Edit page loads more slowly, especially if you have multiple Wygwam fields, but this may solve your issue.
Also, are you using any custom CKEditor settings or a custom CSS file for the Wygwam field settings?