Automated inspection systems have been used extensively for high-speed defect detection, gaging and quality control. In the semiconductor manufacturing industry, assembly and testing processes are getting more complex resulting in a greater tendency of defects to impact the production process. Currently available defect detection and classification systems are customized and hard-wired to the detection of particular classes of defects and cannot deal with new unknown classes. Shortage of defective units, similarities within different classes of defects, wide variations within the same defect class, and data imbalance are the basic challenges for this problem. This paper presents a novel stacking-based multi-feature, sparse-based defect detection and classification method that is robust to data imbalance and low number of training samples. Experimental results on real-world data from Intel show that the proposed approach results in a high classification accuracy as compared to existing methods.