Hi Preetham,
Combining different feature matrices with varying dimensions into a single classifier for each feature descriptor method can be challenging due to the differing sizes of the visual vocabulary. However, there are a few strategies you could consider to handle this situation:
- Feature Aggregation or Pooling: You could aggregate features across different dictionary sizes to create a fixed-size representation for each descriptor method. For example, you could use average pooling, max pooling, or a more sophisticated method like VLAD (Vector of Locally Aggregated Descriptors) or Fisher Vectors to aggregate features from all dictionary sizes into a single descriptor per image.
- Dimensionality Reduction: Apply dimensionality reduction techniques such as PCA (Principal Component Analysis) to reduce all feature matrices to the same size. This approach would allow you to create a single classifier for each descriptor method, with each classifier trained on the reduced feature set.
- Canonical Correlation Analysis (CCA): CCA can be used to find a common space where feature vectors from different sizes can be compared. This would allow you to project all feature vectors to a shared space and train a single classifier for each descriptor method.
- Neural Network with Multiple Inputs: Design a neural network architecture that can handle multiple inputs, where each input corresponds to a different dictionary size. The network can learn to combine these inputs in a meaningful way to make a prediction.
- Feature Selection: Perform feature selection on each feature matrix to keep only the most informative features. This could lead to feature matrices of the same size, which you can then use to train a single classifier for each descriptor method.
