In this paper, a new observation equation of non-Gaussian frequency selective fading Bell Labs layered space time (BLAST) architecture system is proposed, which is used for frequency selective fading channels and non-Gaussian noise in an application environment of BLAST system. With othogonal matrix triangularization (QR decomposition) of the channel matrix, the static observation equation of frequency selective fading BLAST system is transformed into a dynamic state space model, and then the particle filter is used for space-time layered detection. Making the full use of the finite alphabet of the digital modulation communication signal, the optimal proposal distribution can be chosen to produce particle and update the weight. Incorporated with current method of reducing error propagation, a new space-time layered detection algorithm is proposed. Simulation result shows the validity of the proposed algorithm.