【问题标题】:Confusion matrix graphic not displaying data混淆矩阵图形不显示数据
【发布时间】:2018-09-10 07:01:08
【问题描述】:

我正在使用完整数据集的一些分类器进行逻辑回归。它工作正常,我得到了一个很好的混淆矩阵,但我无法让情节工作。我在 Jupyter Notebook 中使用 Python 3.6,我已验证导入的所有包都是最新的。

这里是我获取和处理数据集的地方:

import itertools
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline
import os
os.chdir('C:/Users/theca/Desktop/Rstuff')
data = pd.read_csv('telco_customer_churn.csv')

categorical = data[["gender", "SeniorCitizen"]]
df = data[["tenure", "MonthlyCharges","Churn"]]
dummies = pd.get_dummies(categorical)
df_new = dummies.join(df)
df_new.head()

X = df_new.iloc[:,[0,1,2,3,4]]
y = df_new.iloc[:,[5]]
#Splitting the data set
from sklearn.model_selection import train_test_split
X_train,X_test, y_train,y_test = train_test_split(X,y, test_size = 0.25,random_state = 0)

#Fitting logistic regression
from sklearn.linear_model import LogisticRegression
classifier = LogisticRegression(random_state = 0)
classifier.fit(X_train,np.ravel(y_train))

#predicting the test results
y_pred = classifier.predict(X_test)
#making the confusion matrix
from sklearn.metrics import confusion_matrix
cm = confusion_matrix(y_test,y_pred)

混淆矩阵:

[[1164 134]

[250 213]]

现在我正在尝试使用我在 sklearn 中找到的方法 http://scikit-learn.org/stable/auto_examples/model_selection/plot_confusion_matrix.html

我是这样改编的:

def plot_confusion_matrix(cm, classes,
                          normalize=False,
                          title='Confusion matrix',
                          cmap=plt.cm.Blues):
    """
    This function prints and plots the confusion matrix.
    Normalization can be applied by setting `normalize=True`.
    """
    if normalize:
        cm = cm.astype('float') / cm.sum(axis=1)[:, np.newaxis]
        print("Normalized confusion matrix")
    else:
        print('Confusion matrix, without normalization')

    print(cm)
    plt.imshow(cm, interpolation='nearest', cmap=cmap)
    plt.title(title)
    plt.colorbar()
    tick_marks = np.arange(len(classes))
    plt.xticks(tick_marks, classes, rotation=45)
    plt.yticks(tick_marks, classes)

    fmt = '.2f' if normalize else 'd'
    thresh = cm.max() / 2.
    for i, j in itertools.product(range(cm.shape[0]), range(cm.shape[1])):
        plt.text(j, i, format(cm[i, j], fmt),
                 horizontalalignment="center",
                 color="white" if cm[i, j] > thresh else "black")

    plt.tight_layout()
    plt.ylabel('True label')
    plt.xlabel('Predicted label')

然后我尝试生成图形:

plt.figure()
plot_confusion_matrix(cm, classes=df_new[["Churn"]],
                      title='Confusion matrix, without normalization')

我的图形看起来像这样,上面没有数据:

我意识到这种方法不是使用 pandas 数据框,而是使用 numpy 数组?如何让它正确显示?

谢谢!

【问题讨论】:

    标签: python-3.x dataframe data-mining logistic-regression


    【解决方案1】:

    您可以使用 seaborn 绘制混淆矩阵图形。我将真实和预测的标签传递给函数。代码如下:

    def plot_confusion_matrix(true, pred):
        from sklearn.metrics import confusion_matrix
        confusion_matrix = confusion_matrix(true, pred, labels=[1, 0])
    
        import seaborn as sns; sns.set()
        import matplotlib.pyplot as plt
    
        cm_df = pd.DataFrame(confusion_matrix,
                     index = ['1', '0'], 
                     columns = ['1', '0'])
        ax = sns.heatmap(cm_df, fmt = 'd' , cmap="YlGnBu", cbar = False,  annot=True)
    
        plt.ylabel('True label')
        plt.xlabel('Predicted label')
        plt.title('Confusion Matrix')
        plt.show()
    

    【讨论】:

    • 这对我不起作用,我已经有一个 sklearn 混淆矩阵。我只是想以某种方式形象化它。我没有“true”和“pred”值传递给函数。
    • 您需要将 y_test,y_pred 传递给函数。 plot_confusion_matrix(y_test,y_pred)
    【解决方案2】:

    此代码也很有帮助。

    import numpy as np
    import matplotlib.pyplot as plt
    import itertools
    from pycm import ConfusionMatrix
    
    def plot_confusion_matrix(cm,
                              normalize=False,
                              title='Confusion matrix',
                              cmap=plt.cm.Blues):
    """
    This function modified to plots the ConfusionMatrix object.
    Normalization can be applied by setting `normalize=True`.
    
    Code Reference : 
    http://scikit-learn.org/stable/auto_examples/model_selection/plot_confusion_matrix.html
    
    """
    
    plt_cm = []
    for i in cm.classes :
        row=[]
        for j in cm.classes:
            row.append(cm.table[i][j])
        plt_cm.append(row)
    plt_cm = np.array(plt_cm)
    if normalize:
        plt_cm = plt_cm.astype('float') / plt_cm.sum(axis=1)[:, np.newaxis]     
    plt.imshow(plt_cm, interpolation='nearest', cmap=cmap)
    plt.title(title)
    plt.colorbar()
    tick_marks = np.arange(len(cm.classes))
    plt.xticks(tick_marks, cm.classes, rotation=45)
    plt.yticks(tick_marks, cm.classes)
    
    fmt = '.2f' if normalize else 'd'
    thresh = plt_cm.max() / 2.
    for i, j in itertools.product(range(plt_cm.shape[0]), range(plt_cm.shape[1])):
        plt.text(j, i, format(plt_cm[i, j], fmt),
                 horizontalalignment="center",
                 color="white" if plt_cm[i, j] > thresh else "black")
    
    plt.tight_layout()
    plt.ylabel('Actual')
    plt.xlabel('Predict')
    

    然后这个函数可以如下使用:

    cm = ConfusionMatrix(matrix={0:{0:13,1:0,2:0},1:{0:0,1:10,2:6},2:{0:0,1:0,2:9}})
    
    plt.figure()
    plot_confusion_matrix(cm,title='cm')
    plt.figure()
    plot_confusion_matrix(cm,title='cm(Normalized)',normalize=True)
    plt.show()
    

    关于使用 seabornpandas 的情节,请参阅 here

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 2020-03-09
      • 2020-12-08
      • 2020-02-23
      • 2020-07-25
      • 1970-01-01
      • 1970-01-01
      • 2019-11-23
      • 1970-01-01
      相关资源
      最近更新 更多