A new fast high-order neural network learning algorithm for pattern recognition is proposed. The new learning algorithm uses some properties of trigonometry for reducing and controlling the number of weights of a third-order network used for invariant pattern recognition. Experimental results on typed upper case English letters indicate that the new approach maintains the higher classification accuracy and reduces the complexity of neural networks significantly. The proposed method can also be adapted for applications in some other pattern recognition problems.