Pre-warning of whether a corporate will fall into a decline stage in the near future is an emerging issue in financial management. Improper decision-making by firms incurs a higher possibility to cause financial crisis (distress) and deteriorates the soundness of financial markets. The aim of this study is to establish a novel prediction mechanism based on combining the sampling technique (synthetic minority over-sampling technique; SMOTE), feature selection ensemble (original, intersection, and union), extreme learning machine (ELM) ensemble and decision tree (DT). The proposed model - namely, the multiple extreme learning machines (MELMs) - shows promising performance under numerous assessing criteria, but one critical defect of the ensemble classifier is that it lacks comprehensibility. Thus, we perform a DT as the knowledge generator to extract the inherent information from the ensemble mechanism. This knowledge visualized process can assist decision makers in efficiently allocating limited financial resources and to help firms survive in an extremely competitive environment. (C) 2012 Elsevier B.V. All rights reserved.