【问题标题】:Precision, recall, F1 score equal with sklearn精度、召回率、F1 分数等于 sklearn
【发布时间】:2017-05-28 06:01:26
【问题描述】:

我正在尝试比较 k 近邻算法中不同的距离计算方法和不同的投票系统。目前我的问题是,无论我做什么 precision_recall_fscore_support 来自 scikit-learn 的方法在精度、召回率和 fscore 方面产生完全相同的结果。这是为什么?我已经在不同的数据集(虹膜、玻璃和葡萄酒)上进行了尝试。我究竟做错了什么?到目前为止的代码:

#!/usr/bin/env python3
from collections import Counter
from data_loader import DataLoader
from sklearn.metrics import precision_recall_fscore_support as pr
import random
import math
import ipdb

def euclidean_distance(x, y):
    return math.sqrt(sum([math.pow((a - b), 2) for a, b in zip(x, y)]))

def manhattan_distance(x, y):
    return sum(abs([(a - b) for a, b in zip(x, y)]))

def get_neighbours(training_set, test_instance, k):
    names = [instance[4] for instance in training_set]
    training_set = [instance[0:4] for instance in training_set]
    distances = [euclidean_distance(test_instance, training_set_instance) for training_set_instance in training_set]
    distances = list(zip(distances, names))
    print(list(filter(lambda x: x[0] == 0.0, distances)))
    sorted(distances, key=lambda x: x[0])
    return distances[:k]

def plurality_voting(nearest_neighbours):
    classes = [nearest_neighbour[1] for nearest_neighbour in nearest_neighbours]
    count = Counter(classes)
    return count.most_common()[0][0]

def weighted_distance_voting(nearest_neighbours):
    distances = [(1/nearest_neighbour[0], nearest_neighbour[1]) for nearest_neighbour in nearest_neighbours]
    index = distances.index(min(distances))
    return nearest_neighbours[index][1]

def weighted_distance_squared_voting(nearest_neighbours):
    distances = list(map(lambda x: 1 / x[0]*x[0], nearest_neighbours))
    index = distances.index(min(distances))
    return nearest_neighbours[index][1]

def main():
    data = DataLoader.load_arff("datasets/iris.arff")
    dataset = data["data"]
    # random.seed(42)
    random.shuffle(dataset)
    train = dataset[:100]
    test = dataset[100:150]
    classes = [instance[4] for instance in test]
    predictions = []
    for test_instance in test:
        prediction = weighted_distance_voting(get_neighbours(train, test_instance[0:4], 15))
        predictions.append(prediction)
    print(pr(classes, predictions, average="micro"))

if __name__ == "__main__":
    main()

【问题讨论】:

    标签: python machine-learning scikit-learn knn


    【解决方案1】:

    问题在于您使用的是“微观”平均值。

    here所述:

    正如文档中所写:“请注意,对于“微”平均 在多类设置中将产生相同的精度、召回率和 [图片:F],而“加权”平均可能会产生一个 F 分数,即 不在精确率和召回率之间。” http://scikit-learn.org/stable/modules/model_evaluation.html

    但是,如果您使用标签参数删除多数标签,那么 微平均不同于准确度,而精确度不同于 回忆一下。

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2021-09-01
      • 2012-01-07
      • 2021-03-02
      • 1970-01-01
      • 2021-05-05
      • 2017-06-21
      相关资源
      最近更新 更多