Which one is the feature in SIFT .Is key Point or descriptor .I am trying to cluster .which one should I consider for clustering and why?. This cluster data is used for classification.
The descriptor is what you mean by "feature". Keep in mind that a SIFT descriptor is made of 128 int elements, which will make your classifying task really hard (from a computational point of view) unless using some kind of dimensional reduction