ismember() never does wildcarding. It only does exact matches.
regexp() does matching but the handling of wildcards is different than what you would expect.
~cellfun(@isempty, regexp({struct.name},'.*\.mat$', 'once'))
but for your purposes it might be enough to use
endsWith({S.name},'.mat')
