Printing Feature Contributions in a Random Forest algorithm from the Treeinterpreter library leading to...












0












$begingroup$


I am working on a dataset where I predict the risks of developing pancreatic cancer with respect to a number of variables. I have created a random forest, and want to find the feature contributions. I have already used the "Treeinterpreter" library, resulting in a contributions array that is three-dimensional. I want to display the contributions in the array beside the name of the factor/variable. I have used the code below to do so, however, the code responsible for displaying the contributions does not work. I have tried multiple methods, including converting the dataframe to a numpy array, and other methods such as .all() and .any(). However, none are producing the desired result.



What can be the right way to display the feature contributions with respect to each of the feature it represents?



     # -*- coding: utf-8 -*-
"""
Created on Mon Apr 15 13:39:19 2019

@author: GoodManMcGee
"""

import pandas as pd
from sklearn.metrics import accuracy_score
from sklearn import tree
from sklearn.model_selection import train_test_split
from sklearn import preprocessing
from sklearn.metrics import confusion_matrix
from sklearn.ensemble import RandomForestClassifier
from IPython.display import Image
from sklearn.tree import export_graphviz
from treeinterpreter import treeinterpreter as ti
import matplotlib.pyplot as plt
import numpy as np
import itertools

data = pd.read_csv("pancreatic_cancer_smokers.csv")
target = data['case (1: case, 0: control)']
data.drop('case (1: case, 0: control)', axis=1, inplace=True)
x_train, x_test, y_train, y_test = train_test_split(data, target, test_size = 0.2)
clf = RandomForestClassifier(n_estimators=100)
clf.fit(x_train, y_train)
y_pred = clf.predict(x_test)
clf_accuracy = accuracy_score(y_test, y_pred)
clf_pred, clf_bias, contributions = ti.predict(clf, x_test)


#The code below was taken from DataDive's treeinterpreter tutorial.
#The aforementioned messages applies to all code between the underscores
#///////////////////////////////////////////

for i in range(len(x_test)):
print ("Instance", i)
print ("Bias (trainset mean)", clf_bias[i])
print ("Feature contributions:")
for c, feature in sorted(zip(contributions[i], data.feature_names),
key=lambda x: -abs(x[0])):
#An error occurs in the "data.feature_names" method in the code above:AttributeError: 'DataFrame' object has no attribute 'feature_names'. I have tried referenceing columns from datasets also, but that also leads to errors: ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()
print (feature, round(c, 2))
print ("-"*20)
#///////////////////////////////////////////








share







New contributor




Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$

















    0












    $begingroup$


    I am working on a dataset where I predict the risks of developing pancreatic cancer with respect to a number of variables. I have created a random forest, and want to find the feature contributions. I have already used the "Treeinterpreter" library, resulting in a contributions array that is three-dimensional. I want to display the contributions in the array beside the name of the factor/variable. I have used the code below to do so, however, the code responsible for displaying the contributions does not work. I have tried multiple methods, including converting the dataframe to a numpy array, and other methods such as .all() and .any(). However, none are producing the desired result.



    What can be the right way to display the feature contributions with respect to each of the feature it represents?



         # -*- coding: utf-8 -*-
    """
    Created on Mon Apr 15 13:39:19 2019

    @author: GoodManMcGee
    """

    import pandas as pd
    from sklearn.metrics import accuracy_score
    from sklearn import tree
    from sklearn.model_selection import train_test_split
    from sklearn import preprocessing
    from sklearn.metrics import confusion_matrix
    from sklearn.ensemble import RandomForestClassifier
    from IPython.display import Image
    from sklearn.tree import export_graphviz
    from treeinterpreter import treeinterpreter as ti
    import matplotlib.pyplot as plt
    import numpy as np
    import itertools

    data = pd.read_csv("pancreatic_cancer_smokers.csv")
    target = data['case (1: case, 0: control)']
    data.drop('case (1: case, 0: control)', axis=1, inplace=True)
    x_train, x_test, y_train, y_test = train_test_split(data, target, test_size = 0.2)
    clf = RandomForestClassifier(n_estimators=100)
    clf.fit(x_train, y_train)
    y_pred = clf.predict(x_test)
    clf_accuracy = accuracy_score(y_test, y_pred)
    clf_pred, clf_bias, contributions = ti.predict(clf, x_test)


    #The code below was taken from DataDive's treeinterpreter tutorial.
    #The aforementioned messages applies to all code between the underscores
    #///////////////////////////////////////////

    for i in range(len(x_test)):
    print ("Instance", i)
    print ("Bias (trainset mean)", clf_bias[i])
    print ("Feature contributions:")
    for c, feature in sorted(zip(contributions[i], data.feature_names),
    key=lambda x: -abs(x[0])):
    #An error occurs in the "data.feature_names" method in the code above:AttributeError: 'DataFrame' object has no attribute 'feature_names'. I have tried referenceing columns from datasets also, but that also leads to errors: ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()
    print (feature, round(c, 2))
    print ("-"*20)
    #///////////////////////////////////////////








    share







    New contributor




    Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$















      0












      0








      0





      $begingroup$


      I am working on a dataset where I predict the risks of developing pancreatic cancer with respect to a number of variables. I have created a random forest, and want to find the feature contributions. I have already used the "Treeinterpreter" library, resulting in a contributions array that is three-dimensional. I want to display the contributions in the array beside the name of the factor/variable. I have used the code below to do so, however, the code responsible for displaying the contributions does not work. I have tried multiple methods, including converting the dataframe to a numpy array, and other methods such as .all() and .any(). However, none are producing the desired result.



      What can be the right way to display the feature contributions with respect to each of the feature it represents?



           # -*- coding: utf-8 -*-
      """
      Created on Mon Apr 15 13:39:19 2019

      @author: GoodManMcGee
      """

      import pandas as pd
      from sklearn.metrics import accuracy_score
      from sklearn import tree
      from sklearn.model_selection import train_test_split
      from sklearn import preprocessing
      from sklearn.metrics import confusion_matrix
      from sklearn.ensemble import RandomForestClassifier
      from IPython.display import Image
      from sklearn.tree import export_graphviz
      from treeinterpreter import treeinterpreter as ti
      import matplotlib.pyplot as plt
      import numpy as np
      import itertools

      data = pd.read_csv("pancreatic_cancer_smokers.csv")
      target = data['case (1: case, 0: control)']
      data.drop('case (1: case, 0: control)', axis=1, inplace=True)
      x_train, x_test, y_train, y_test = train_test_split(data, target, test_size = 0.2)
      clf = RandomForestClassifier(n_estimators=100)
      clf.fit(x_train, y_train)
      y_pred = clf.predict(x_test)
      clf_accuracy = accuracy_score(y_test, y_pred)
      clf_pred, clf_bias, contributions = ti.predict(clf, x_test)


      #The code below was taken from DataDive's treeinterpreter tutorial.
      #The aforementioned messages applies to all code between the underscores
      #///////////////////////////////////////////

      for i in range(len(x_test)):
      print ("Instance", i)
      print ("Bias (trainset mean)", clf_bias[i])
      print ("Feature contributions:")
      for c, feature in sorted(zip(contributions[i], data.feature_names),
      key=lambda x: -abs(x[0])):
      #An error occurs in the "data.feature_names" method in the code above:AttributeError: 'DataFrame' object has no attribute 'feature_names'. I have tried referenceing columns from datasets also, but that also leads to errors: ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()
      print (feature, round(c, 2))
      print ("-"*20)
      #///////////////////////////////////////////








      share







      New contributor




      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I am working on a dataset where I predict the risks of developing pancreatic cancer with respect to a number of variables. I have created a random forest, and want to find the feature contributions. I have already used the "Treeinterpreter" library, resulting in a contributions array that is three-dimensional. I want to display the contributions in the array beside the name of the factor/variable. I have used the code below to do so, however, the code responsible for displaying the contributions does not work. I have tried multiple methods, including converting the dataframe to a numpy array, and other methods such as .all() and .any(). However, none are producing the desired result.



      What can be the right way to display the feature contributions with respect to each of the feature it represents?



           # -*- coding: utf-8 -*-
      """
      Created on Mon Apr 15 13:39:19 2019

      @author: GoodManMcGee
      """

      import pandas as pd
      from sklearn.metrics import accuracy_score
      from sklearn import tree
      from sklearn.model_selection import train_test_split
      from sklearn import preprocessing
      from sklearn.metrics import confusion_matrix
      from sklearn.ensemble import RandomForestClassifier
      from IPython.display import Image
      from sklearn.tree import export_graphviz
      from treeinterpreter import treeinterpreter as ti
      import matplotlib.pyplot as plt
      import numpy as np
      import itertools

      data = pd.read_csv("pancreatic_cancer_smokers.csv")
      target = data['case (1: case, 0: control)']
      data.drop('case (1: case, 0: control)', axis=1, inplace=True)
      x_train, x_test, y_train, y_test = train_test_split(data, target, test_size = 0.2)
      clf = RandomForestClassifier(n_estimators=100)
      clf.fit(x_train, y_train)
      y_pred = clf.predict(x_test)
      clf_accuracy = accuracy_score(y_test, y_pred)
      clf_pred, clf_bias, contributions = ti.predict(clf, x_test)


      #The code below was taken from DataDive's treeinterpreter tutorial.
      #The aforementioned messages applies to all code between the underscores
      #///////////////////////////////////////////

      for i in range(len(x_test)):
      print ("Instance", i)
      print ("Bias (trainset mean)", clf_bias[i])
      print ("Feature contributions:")
      for c, feature in sorted(zip(contributions[i], data.feature_names),
      key=lambda x: -abs(x[0])):
      #An error occurs in the "data.feature_names" method in the code above:AttributeError: 'DataFrame' object has no attribute 'feature_names'. I have tried referenceing columns from datasets also, but that also leads to errors: ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()
      print (feature, round(c, 2))
      print ("-"*20)
      #///////////////////////////////////////////






      python random-forest feature-extraction





      share







      New contributor




      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.










      share







      New contributor




      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.








      share



      share






      New contributor




      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 2 mins ago









      Dhruv UpadhyayDhruv Upadhyay

      11




      11




      New contributor




      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Dhruv Upadhyay is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "557"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });






          Dhruv Upadhyay is a new contributor. Be nice, and check out our Code of Conduct.










          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49697%2fprinting-feature-contributions-in-a-random-forest-algorithm-from-the-treeinterpr%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          Dhruv Upadhyay is a new contributor. Be nice, and check out our Code of Conduct.










          draft saved

          draft discarded


















          Dhruv Upadhyay is a new contributor. Be nice, and check out our Code of Conduct.













          Dhruv Upadhyay is a new contributor. Be nice, and check out our Code of Conduct.












          Dhruv Upadhyay is a new contributor. Be nice, and check out our Code of Conduct.
















          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49697%2fprinting-feature-contributions-in-a-random-forest-algorithm-from-the-treeinterpr%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Callistus I

          Tabula Rosettana

          How to label and detect the document text images