A Neural Ensemble for Speech Recognition