已为您找到该学者9条结果 成果回收站
【期刊论文】A sensitivity-based approach for pruning architecture of Madalines
曾晓勤, Xiaoqin Zeng, Jing Shao, Yingfeng Wang, Shuiming Zhong
Neural Comput & Applic (2009) 18: 957-965,-0001,():
-1年11月30日
Architecture design is a very important issue in neural network research. One popular way to find proper size of a network is to prune an oversize trained network to a smaller one while keeping established performance. This paper presents a sensitivity-based approach to prune hidden Adalines from a Madaline with causing as little as possible performance loss and thus easy compensating for the loss. The approach is novel in setting up a relevance measure, by means of an Adalines'sensitivity measure, to locate the least relevant Adaline in a Madaline. The sensitivity measure is the probability of an Adaline's output inversions due to input variation with respect to overall input patterns, and the relevance measure is defined as the multiplication of the Adaline's sensitivity value by the summation of the absolute value of the Adaline's outgoing weights. Based on the relevance measure, a pruning algorithm can be simply programmed, which iteratively prunes an Adaline with the least relevance value from hidden layer of a given Madaline and then conducts some compensations until no more Adalines can be removed under a given performance requirement. The effectiveness of the pruning approach is verified by some experimental results.
Adaline, Madaline, Architecture pruning, Sensitivity measure, Relevance measure
-
46浏览
-
0点赞
-
0收藏
-
0分享
-
102下载
-
0
-
引用
曾晓勤, 曾晓勤+, 韩秀清, 邹阳
软件学报,2008,19(8):1893~1901,-0001,():
-1年11月30日
围绕解决图文法中的主要问题——嵌入问题,提出了一种基于边的上下文相关图文法形式化框架,并对由此定义的文法的一些性质及相应的归约算法进行了讨论。对所提出的图文法与已有的文法进行了比较。同时,展望了今后值得进一步研究的一些问题和方向。
可视化语言, 形式化, 图文法, 嵌入问题, 产生式
-
73浏览
-
0点赞
-
0收藏
-
0分享
-
89下载
-
0
-
引用
-
34浏览
-
0点赞
-
0收藏
-
0分享
-
121下载
-
0
-
引用
曾晓勤, Xiaoqin
IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 17, NO. 2, MARCH 2006,-0001,():
-1年11月30日
In
Adaline,
-
40浏览
-
0点赞
-
0收藏
-
0分享
-
143下载
-
0
-
引用
曾晓勤, Xiaoqin
X. Zeng, D. S. Yeung. Neurocomputing 69 (2006) 825-837,-0001,():
-1年11月30日
In
Neural
-
38浏览
-
0点赞
-
0收藏
-
0分享
-
221下载
-
0
-
引用