【问题标题】:How to update fit method in a sklearn class?如何更新 sklearn 类中的 fit 方法?
【发布时间】:2019-12-22 04:54:19
【问题描述】:

我最近开始使用 GridSearchCV,但对面向对象的编程不是很熟悉。

问题:我在其中一个预测变量中有一些缺失的数据,并且我有一个我想与适当的参数网格一起使用的算法列表。我想知道是否有一种方法可以创建一个自定义类,该类可以在拟合之前以不同的方式在我的数据中估算缺失值,并为我同时使用的任何算法尝试不同的属性组合。有没有可能?

非常感谢您的帮助!

这是我创建的一个类,用于在我的房价数据集的 SQFT 列中估算缺失值:

class Impute_sqft():

    train_X = houses_dummies_copy.dropna(subset=['sqft']).drop(columns=['sqft', 'final_price'])
    train_Y = houses_dummies_copy.dropna(subset=['sqft'])['sqft']
    test_X = houses_dummies_copy[pd.isna(houses_dummies_copy.sqft)].drop(columns=['sqft', 'final_price'])


    def __init__(self, how='random forest'):
        self.how = how

    def impute(self):

        # replace missing values with the ones predicted by random forest
        if self.how == 'random forest':
            houses_dummies_copy = houses_dummies.copy()
            rf = RandomForestRegressor()
            rf.fit(train_X, train_Y)
            pred_Y = rf.predict(test_X)
            houses_dummies_copy.loc[test_X.index,'sqft'] = pred_Y
            return houses_dummies_copy[predictors]

        # replace missing values with the ones predicted by knn        
        if self.how == 'knn':
            houses_dummies_copy = houses_dummies.copy()
            import sys
            from impyute.imputation.cs import fast_knn
            sys.setrecursionlimit(100000) 
            knn_n = 30
            result = fast_knn(houses_dummies_copy[predictors], k=knn_n)
            result.columns = houses_dummies_copy[predictors].columns
            return result

        # replace missing values with the mean for every type of property     
        if self.how == 'mean':
            houses_dummies_copy = houses_dummies.copy()
            sqft_statistics = []
            for house_type in houses_types:
                statistic = houses_dummies_copy[houses_dummies_copy['type_' + house_type] == 1].sqft.mean(skipna=True)
                indexes = houses_dummies_copy[(houses_dummies_copy['type_' + house_type] == 1) & pd.isna(houses_dummies_copy.sqft)].index
                houses_dummies_copy.loc[indexes, 'sqft'] = statistic
            return houses_dummies_copy[predictors]



GridSearchCV 有什么网格:

param_grid = [{
    'bootstrap': [True, False],
        'n_estimators': [3, 10],
        'max_features': [2, 3, 4]
    }]

GridSearchCV 我想要什么网格:

param_grid = [{
        'bootstrap': [True, False],
        'n_estimators': [3, 10],
        'max_features': [2, 3, 4],
        'sqft_imputer': ['random forest', 'knn', 'mean']

    }]

【问题讨论】:

    标签: python python-3.x object machine-learning scikit-learn


    【解决方案1】:

    您想要创建一个自定义Transformer,并在Pipeline 中的估算器之前使用它。

    自定义转换器:

    看看模板:TemplateTransformer。

    几个cmets:

    • 你需要从BaseEstimator继承。
    • self.how 的选择必须在类的 __init__ 方法中定义。
    • 为了正确,您需要估计fit 期间的统计数据,并在transform 期间应用它们。 (另见Why does sklearn Imputer need to fit?)

    管道

    要链接您的自定义估算器和估算器,您可以使用 scikit-learn Pipeline:

    • 例如查看example,它将PCA 和LogisticRegression 链接到Pipeline,然后在GridSearchCV 中使用它。
    • 您需要使用管道中使用的名称更改参数网格,例如
    param_grid = [{
            'estimator__bootstrap': [True, False],
            'estimator__n_estimators': [3, 10],
            'estimator__max_features': [2, 3, 4],
            'imputer__how': ['random forest', 'knn', 'mean']
    
        }]
    

    【讨论】:

      【解决方案2】:

      按照上面的答案。现在一切正常。

      from sklearn.base import BaseEstimator, TransformerMixin
      
      class Impute_sqft(BaseEstimator, TransformerMixin):
          def __init__(self, how='random forest'):        
              self.how = how
      
          def fit(self, X, y=None):
              return self
      
          def transform(self, X):
              import sys
              sys.setrecursionlimit(100000) #Increase the recursion limit of the OS
              from impyute.imputation.cs import fast_knn, mice
              result = X.copy()
      
              if self.how == 'random forest':
                  train_X = houses_dummies.dropna(subset=['sqft']).drop(columns=['sqft', 'final_price'])
                  train_Y = houses_dummies.dropna(subset=['sqft'])['sqft']
                  test_X = result[pd.isna(result.sqft)].drop(columns=['sqft'])
      
                  rf = RandomForestRegressor()
                  rf.fit(train_X, train_Y)
                  pred_Y = rf.predict(test_X)
                  result.loc[test_X.index,'sqft'] = pred_Y
      
              if self.how == 'knn':
                  knn_n = 30
                  result = fast_knn(houses_dummies[predictors], k=knn_n)
                  result.columns = houses_dummies[predictors].columns
                  result.index = houses_dummies[predictors].index
                  result = result.loc[X.index,:]
      
              if self.how == 'mice':
                  result = mice(houses_dummies[predictors])
                  result.columns = houses_dummies[predictors].columns
                  result.index = houses_dummies[predictors].index
                  result = result.loc[X.index,:]
      
              if self.how == 'mean':
                  result['sqft'] = houses_edited.groupby('type')['sqft'].transform(lambda x: x.fillna(x.mean(skipna=True)))
      
              if self.how == 'median':
                  result['sqft'] = houses_edited.groupby('type')['sqft'].transform(lambda x: x.fillna(x.median(skipna=True)))
      
              if self.how == 'mode':
                  result['sqft'] = houses_edited.groupby('type')['sqft'].transform(lambda x: x.fillna(x.mode()[0]))
      
              return result[predictors]
      
      methods = ['random forest', 'knn', 'mice', 'mean', 'median', 'mode']
      
      imputer = Impute_sqft()
      rf = RandomForestRegressor()
      pipe = Pipeline(steps=[
          ('imputer', imputer),
          ('rf', rf)
      ])
      
      param_grid = [{
          'imputer__how':methods,
          'rf__max_depth':[1,2,None],
          'rf__bootstrap':[True, False]    
      }]
      
      houses_dummies_copy = houses_dummies.copy()
      
      search = GridSearchCV(pipe, param_grid, iid=False, cv=5, scoring='neg_mean_absolute_error')
      search.fit(houses_dummies_copy[predictors], houses_dummies_copy.final_price)
      

      【讨论】:

        猜你喜欢
        • 1970-01-01
        • 2021-06-21
        • 2019-11-12
        • 2019-06-15
        • 2021-10-14
        • 2017-04-02
        • 2018-02-08
        • 2020-10-03
        • 1970-01-01
        相关资源
        最近更新 更多