split dataset with probability weights

2019 10 15
1 个回答
回答已采纳
更新时间：2019 10 15
3 次查看（30 天）

0 个投票

Hello everyone
i have a dataset like 20 x 6. i want to split dataset (npop1) into two dataset which depend on probabbility 'weights'. the probability comes from random number r1. i can't figure out how to store the rest data into another variable dataset (rw2). I don't use randperm because randperm has no probability function. I will appreciate any help. Thank you.
Sorry for my bad English..
pc = 0.4; %percentage to split data
nfitA = length(fitA);
PC = pc*npop;% make positive interger
r1 = rand (nfitA,1); %random number for weight probability
rw1 = datasample(npop1,PC,'Weights',r1);

请先登录，再回答此问题。

 采纳的回答

Fabio Freschi
Fabio Freschi 2019-10-15

0 个投票

datasample has a two outputs, where the second is the index to the selected data in your npop1. So:
[rw1,idSelected] = datasample(npop1,PC,'Weights',r1);
idUnselected = setdiff(1:nfitA,idSelected);
rw2 = npop1(idUnselected,:);

7 个评论
显示 5更早的评论 隐藏 5更早的评论

Genz
Genz 2019-10-15
thank you for fast reply sir.
this is almost what i looking for but is there a bug in setdiff? because the answer its different every time i execute. i tried in data npop1(10x6). for rw1 the answer always 4x6. but rw2 sometimes 6x6, 7x6 and 8x6. how to fix this?
thank you.
Sorry for my bad English.
Fabio Freschi
Fabio Freschi 2019-10-15
Can you provide a MWE (minimal working example) of your code to figure out what's going wrong?
Jos (10584)
Jos (10584) 2019-10-15
datasample samples with replacement, so idSelected may not have 4 distinct values, leaving 6 upto 9 values not selected
Genz
Genz 2019-10-15
编辑：Genz 2019-10-15
my entire code only 8 rows. so i don't know if this can be called MWE. but this is my entire code.
npop = 10;
pc = 0.4; %percentage to split data
nfitA = length(fitA);
PC = pc*npop;% make positive interger
r1 = rand (nfitA,1); %random number for weight probability
[rw1,idSelected] = datasample(npop1,PC,'Weights',r1);
idUnselected = setdiff(1:nfitA,idSelected);
rw2 = npop1(idUnselected,:);
i also attach m file and mat files.
run more than 3 times, then maybe you will see the different for rw2.
Genz
Genz 2019-10-15
sorry sir, i am not quite understand. but fitA only contain 10x1. fitA is data from another file.
split data only on npop1 data (10x6).
Fabio Freschi
Fabio Freschi 2019-10-15
Got the point! As Jos highlighted, datasample samples with replacement. This means that each sample can be selected more than once. see for example this link.
If you don't want the replacement, you must instruct datasample in this way:
[rw1,idSelected] = datasample(npop1,PC,'Weights',r1,'Replace',false);
You can leave the rest of the code unchanged. Let me know if this fits your initial request.
Genz
Genz 2019-10-15
its work well. i don't realize there was a "replacement".
many thanks sir. GBU.

请先登录，再进行评论。

更多回答（0 个）

类别

在 帮助中心 和 File Exchange 中查找有关 Multinomial Distribution 的更多信息

产品

版本

R2016b

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by