【发布时间】:2013-12-27 23:37:55
【问题描述】:
UPDATE2:更好的标题(现在我理解了问题)将是: scipy optimize.fmin 中输入的正确语法是什么?
更新:请求了可运行代码,因此函数定义已替换为可运行代码。示例输入数据已被硬编码为 numpy 数组“数据”。
我正在尝试使用 scipy 优化功能,但我真的卡住了,必须寻求帮助。一个零长度数组被传递给优化器中的一个方法,我不明白为什么,也不明白如何克服这个问题。
此代码试图做什么的简要概述:
- 给定的数据集“数据”由单个观测值“r”组成
- 估计最有可能产生“数据”的参数“m”的值
- 对于给定的 m,计算观察“data”中每个“r”的概率 p(r|m)
- 对于给定的 m,计算“m”生成数据的概率 P(m|data)。
- 定义一个辅助函数以与 optimize.fmin 一起使用。
- 使用 SciPy optimize.fmin 确定 helper(m|data) 最大化的 m。
我在运行此代码时遇到的错误是: ValueError: 零大小数组到归约操作最大值,没有身份
这是一个可运行的 sn-p 代码,它会在我的机器上生成错误。
#!/usr/bin/env python2.7
import numpy as np
from scipy import optimize
def p_of_r(m, r): ## this calculates p(r|m) for each datum r
r_range = np.arange(0, r+1, 1, dtype='int')
p_r = []
p_r = np.array([0.0 for a in r_range])
for x in r_range:
if x == 0:
p_r[x] = np.exp(-1 * m)
else:
total = 0.0
for y in np.arange(0, x, 1, dtype='int'):
current = ( p_r[y] ) / (x - y + 1)
total = current + total
p_r[x] = ( m / x ) * total
return p_r
def likelihood_function(m, *data): # calculates P(m|data) using entire data set
p_r = p_of_r(m, np.ma.max(data))
p_r_m = np.array([p_r[y] for y in data])
bigP = np.prod(p_r_m)
return bigP
def main():
data = np.array( [10, 10, 7, 19, 9, 23, 26, 7, 164, 16 ] )
median_r = np.median(data)
def Drake(m):
return median_r / m - np.log(m)
m_initial = optimize.broyden1(Drake, 1)
def helper(x, *args):
helper_value = -1 * likelihood_function(x, *args)
return helper_value
# here is the actual optimize.fmin
fmin_result = optimize.fmin(helper, x0=[m_initial], args=data)
print fmin_result
# for i in np.arange(0.0, 25.0, 0.1):
# print i, helper(i, data)
if __name__ == "__main__" : main()
错误本身: ValueError: 零大小数组到归约操作最大值,没有身份
下面提供了回溯。
ValueError Traceback (most recent call last)
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/IPython/utils/py3compat.pyc in execfile(fname, *where)
176 else:
177 filename = fname
--> 178 __builtin__.execfile(filename, *where)
/Users/deyler/bin/MSS-likelihood-minimal.py in <module>()
43 print fmin_result
44
---> 45 if __name__ == "__main__" : main()
/Users/deyler/bin/MSS-likelihood-minimal.py in main()
40
41
---> 42 fmin_result = optimize.fmin(helper, x0=[m_initial], args=data)
43 print fmin_result
44
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scipy/optimize/optimize.pyc in fmin(func, x0, args, xtol, ftol, maxiter, maxfun, full_output, disp, retall, callback)
371 'return_all': retall}
372
--> 373 res = _minimize_neldermead(func, x0, args, callback=callback, **opts)
374 if full_output:
375 retlist = res['x'], res['fun'], res['nit'], res['nfev'], res['status']
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scipy/optimize/optimize.pyc in _minimize_neldermead(func, x0, args, callback, xtol, ftol, maxiter, maxfev, disp, return_all, **unknown_options)
436 if retall:
437 allvecs = [sim[0]]
--> 438 fsim[0] = func(x0)
439 nonzdelt = 0.05
440 zdelt = 0.00025
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scipy/optimize/optimize.pyc in function_wrapper(*wrapper_args)
279 def function_wrapper(*wrapper_args):
280 ncalls[0] += 1
--> 281 return function(*(wrapper_args + args))
282
283 return ncalls, function_wrapper
/Users/deyler/bin/MSS-likelihood-minimal.py in helper(x, *args)
33 m_initial = optimize.broyden1(Drake, 1)
34 def helper(x, *args):
---> 35 helper_value = -1 * likelihood_function(x, *args)
36 return helper_value
37
/Users/deyler/bin/MSS-likelihood-minimal.py in likelihood_function(m, *data)
21
22 def likelihood_function(m, *data):
---> 23 p_r = p_of_r(m, np.ma.max(data))
24 p_r_m = np.array([p_r[y] for y in data])
25 bigP = np.prod(p_r_m)
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/numpy/ma/core.pyc in max(obj, axis, out, fill_value)
5899 # If obj doesn't have a max method,
5900 # ...or if the method doesn't accept a fill_value argument
-> 5901 return asanyarray(obj).max(axis=axis, fill_value=fill_value, out=out)
5902 max.__doc__ = MaskedArray.max.__doc__
5903
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/numpy/ma/core.pyc in max(self, axis, out, fill_value)
5159 # No explicit output
5160 if out is None:
-> 5161 result = self.filled(fill_value).max(axis=axis, out=out).view(type(self))
5162 if result.ndim:
5163 # Set the mask
/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/numpy/core/_methods.pyc in _amax(a, axis, out, keepdims)
8 def _amax(a, axis=None, out=None, keepdims=False):
9 return um.maximum.reduce(a, axis=axis,
---> 10 out=out, keepdims=keepdims)
11
12 def _amin(a, axis=None, out=None, keepdims=False):
ValueError: zero-size array to reduction operation maximum which has no identity
【问题讨论】:
-
请提供您在收到错误时正在处理的示例数据
-
您的
data似乎是空的。不幸的是,我们不知道data来自哪里。此外,您的错误消息与您的代码不匹配。在剥离或简化代码时,请尽力构建一个最小的、可运行的示例,以在您运行它时演示您发布的错误。如果做不到,请至少与错误信息保持一致。 -
@alko, @user2357112:发布了可运行的错误生成代码。
data是明确定义的。如果data看起来是空的,那么我对优化器的输入做错了。