There is an API call you can make to get a JSON result including the URL to the actual image. I implemented this a while back for the MB artist boxes shown in this forum, see the code at https://github.com/phw/discourse-musicbrainz-onebox/blob/master/engine/wikimedia.rb
And it is also documented somewhere on the Wikipedia pages of course.