Word comparison using frequency domain.

Question

0 个投票

Good day, I've managed to get the following from a sound wave using the FFT function:

The red circles are the peak values found using the findpeaks() function (I make use of both descending and MinProminance). This means I have their x and y -coordinates in decending order. I then only take the first 6 x and y elements and save them to a .mat file to compare the other words (Other words' .mat files to). I horizontally concatenate them and save them as a .mat file. I do this for 5 different words and then compare their .mat files via the mean square error function (immse). The word with the lowest error then corrisponds to a value k, i.e Word 1 word 2 etc. The problem is however, that it doesn't produce the right result. So I say "Five" and the algorithm says I said "Two" as it more closely resembles the .mat file of the word "Two" (So the peaks are closer).

Does anyone have any hints on where I could be going wrong or what other step I might need to take to go from the graph above to detecting which word has been said. My code is quite a mess and I don't want to discourage help by posting it... It follows the excact method I described to you for figuring out which word has been said. But if You'd like to help and request I post it I will. Thanks in advance!

13 个评论
显示 11更早的评论隐藏 11更早的评论

Leon Ellis 2021-11-13

在 MATLAB Online 中打开

The code I used to produce these mat files is the following: I just changed the file names when saving the different words. I want to compare the "Word3.mat" to itself, then word4.mat and word5.mat and find which word it's most likely to be using the immse() function.

Fs=8000;             
rs = audiorecorder(Fs,24,1);      %Initialize variable for Sound (20) to be saved in.
                 recordblocking(rs,2);         %Give the Sound within the given 2 seconds
                Sound = getaudiodata(rs,"double");
                audiowrite("C:\Users\leone\OneDrive\Desktop\Year 2\Semester 2\EERI 222\Practical1\Sounds\CWord.wav",Sound,Fs);
          
            [CompareWord, Fs] = audioread("C:\Users\leone\OneDrive\Desktop\Year 2\Semester 2\EERI 222\Practical1\Sounds\CWord.wav");
            Ts=1/Fs;
            dt=(0:length(CompareWord)-1)*Ts;
            
            nfft=length(CompareWord);
            nfft2=2.^nextpow2(nfft);
            
            ff=fft(CompareWord,nfft2);
            ff=ff(1:nfft2/2);
            ffm=movmax(ff,50); 
             xfft=Fs*(0:nfft2/2-1)/nfft2;
            
            cut_off=1.2e3/Fs/2;
            order=32;
            
            h=fir1(order,cut_off);
            
            fh=fft(h,nfft2);
            fh=fh(1:nfft2/2);
    
           
            mul=conv(fh,ff);
            con=conv(CompareWord,h);
            hold off;
            
             plot(dt,CompareWord);
            plot(xfft,abs(ff/max(ff))); %#ok<ADPROPLC> 
            hold on;
            %pks=findpeaks(abs(ffm));
            %%Gets center x-coordinates of local maximum values.
            TF2=islocalmax(abs(ffm),'FlatSelection',"center");
            x=1:length(xfft);
            hold on;
            plot(x,abs(ff)/max(abs(ff)),x(TF2),abs(ff(TF2)/max(ff)),'r*');
           hold off;
           
            
           stem(h);
           plot(abs(fh/max(fh))); %#ok<ADPROPLC> 
           sound(con);
           plot(con);
          CompareWord=con;
          
            save("CompareWord.mat","CompareWord","-mat");
           
           plot(abs(mul));
           TF3=islocalmax(abs(ffm),'FlatSelection',"center");
            x=1:length(mul);
            hold on;
            

This is what I got plotting the Time amplitude domain using the

[con,f,t]=pspectrum(con,'spectrogram');

plot(app.UIAxes,t,con);

But I'm not sure how to use it or if findpeaks() will even work here.

Thanks again for your time!

Leon Ellis 2021-11-13

编辑：Leon Ellis 2021-11-13

Please try help with the main code! This was me trying to solve it differently so you can just ignore this.

I've also tried using mscohere on the imported soundwaves and then trying to find the line closest to a straigh line with y=1; (y=1 means there's no difference in the soundwave). Although the code works, it still gives the wrong output many times. I'm feeling quite hopeless atm. My code was: but please keep to the main question with the .mat files if possible. This was just me trying to classify the words in a different way.

clc;

clear;

clf;

Fs=8000;

M=100000;

flag='0';

int=1;

M2=0;

for k=1:10

k2=num2str(k);

[x,Fs]=audioread("C:\Users\leone\OneDrive\Desktop\Year 2\Semester 2\EERI 222\Practical1\Sounds\WordL1_"+k2+".wav");

psdx=psd(spectrum.periodogram,x,'Fs',8000,'NFFT',length(x));

[z,Fs]=audioread("C:\Users\leone\OneDrive\Desktop\Year 2\Semester 2\EERI 222\Practical1\Sounds\WordR1_"+k2+".wav");

psdx=psd(spectrum.periodogram,z,'Fs',8000,'NFFT',length(z));

[y,Fs]=audioread("C:\Users\leone\OneDrive\Desktop\Year 2\Semester 2\EERI 222\Practical1\Sounds\CWord.wav");

psdy=psd(spectrum.periodogram,y,'Fs',8000,'NFFT',length(y));

L=100000;

%%Make sure signals are same length%%

if (length(y)<length(x))

L=length(y);

end

if(length(x)<L)

L=length(x);

end

if(length(z)<L)

L=length(z);

end

x=x(1:L);

y=y(1:L);

z=z(1:L);

%%Get the amplitudes and their corresponding frequency points

[amp,fs]=mscohere(x,y,hanning(1e3),800,1024,8000);

[amp2,fs]=mscohere(z,y,hanning(1e3),800,1024,8000);

%%Get the area under the plotted amplitude and frequency points and compare

%%it to the area under a y=1 line over the same interval

amp=trapz(amp,fs);

amp2=trapz(amp2,fs);

%%Area under y=1 line.

L1 = trapz(ones(length(amp),1),fs);

L2 = trapz(ones(length(amp2),1),fs);

if(immse(amp,L1)<M)

M=immse(amp,L1)

flag=k2;

end

if(immse(amp2,L2)<M)

M=immse(amp2,L2)

flag=k2;

end

%%Check to see which word has been said based on the value of flag

if(flag=='1')

Title ='One';

end

if(flag=='2')

Title ='Two';

end

if(flag=='3')

Title ='Three';

end

if(flag=='4')

Title ='Four';

end

if(flag=='5')

Title ='Five';

end

if(flag=='6')

Title ='Six';

end

if(flag=='7')

Title ='Seven';

end

if(flag=='8')

Title ='Eight';

end

if(flag=='9')

Title ='Nine';

end

if(flag=='10')

Title ='Ten';

end

Salman Ahmed 2021-11-17

Hi Leon,

From my understanding, you wish to develop an algorithm for word classification. If you have a dataset of different spoken instances of each word, you could extract time-frequency features and train a neural network. Also, have a look at a similar example here. You could customize this code by replacing the words you wish to detect. Hope it helps.

Leon Ellis 2021-11-17

Thank you very much. Unfortunetely it's a bit too late and I wasn't able to get it to work. I also don't think we're suppost to create an algorithm to train for word identification (We're just suppost to work with the audio file characteristics for identification.) But thanks a lot for replying!

请先登录，再进行评论。

请先登录，再回答此问题。

Follow Question

Word comparison using frequency domain.

13 个评论
显示 11更早的评论隐藏 11更早的评论

回答（0 个）

类别

产品

版本

标签

Community Treasure Hunt

Word comparison using frequency domain.

13 个评论 显示 11更早的评论 隐藏 11更早的评论

回答（0 个）

类别

产品

版本

标签

另请参阅

Community Treasure Hunt

13 个评论
显示 11更早的评论隐藏 11更早的评论