huadongw

损失函数画图

  • Hinge loss function:

\[H(z) = max(0,1-z)\]

  • $\psi$-learning loss function: 

\[{\phi _s}(z) = \left\{ {\begin{array}{*{20}{c}}
s&{z < 0}\\
0&{z \ge 0}
\end{array}} \right.\]

  • Normalized Sigmoid loss:

\[{P_t}(z) = 1 - \tanh (tz)\]

  • Ramp loss function:

\[{R_s}(z) = \left\{ {\begin{array}{*{20}{c}}
0&{z > 0}\\
{1 - z}&{0 \le z \le 1}\\
{1 - s}&{z > 1}
\end{array}} \right.\]

 

%plot loss function

%define the loss function
H = @(z)max(0,1-z) ; %Hinge loss function
P = @(z)(2*(z<0)+0*(z>=0)); %\psi-learning loss function
S = @(z)(1-tanh(2*z)); %Normalized Sigmoid loss function
R = @(z)(1*(z<0)+(1-z).*(z>=0&z<1)+0*(z>=1)); % ramp loss

z=-2:0.01:2;
subplot(1,4,1) % plot the 1st figure of 1-4
plot(z,H(z),\'-\',\'linewidth\',2);
xlabel(\'z\');
title(\'Hinge loss\',\'fontweight\',\'normal\',\'fontsize\',10);
axis([-2,2 0 3])

subplot(1,4,2)
plot(z,P(z),\'g-\',\'linewidth\',2);
xlabel(\'z\');
title(\'\psi-learnig loss\',\'fontweight\',\'normal\',\'fontsize\',10);
axis([-2,2 0 3])

subplot(1,4,3)
plot(z,S(z),\'r-\',\'linewidth\',2);
xlabel(\'z\');
title(\'Normalized Sigmoid loss\',\'fontweight\',\'normal\',\'fontsize\',10);
axis([-2,2 0 3])

subplot(1,4,4)
plot(z,R(z),\'b-\',\'linewidth\',2);
xlabel(\'z\');
title(\'Ramp loss\',\'fontweight\',\'normal\',\'fontsize\',10);
axis([-2,2 0 3])

  

分类:

技术点:

相关文章: