Understanding Performance metrics for classification(SAC - SAP Analytics Cloud)

 


lets take an example of a Matrix.



It shows the percentage of accuracy of predicted results.



TN- predicted negative and result also negative
FP-  Predicted positive but actual negative
FN- Predicted Negative but actual positive
TP- predicted positive and actual also positive




Predictive Power represents how close to the perfect model is the predictive model. 
Prediction Confidence expresses the ability to reproduce the same detection with a new dataset.






Influencers




the main influencers which directly affected the predicted result.




The X axis represents the overall population and the Y axis represents the positive cases.

The red line is a random picking. This means that there is no predictive model. To take an image, it’s like playing heads or tails. On the opposite, the green curve represents a perfect predictive model.

The orange and blue curves correspond to the percentage of positive cases when ordering by decreasing score/probability.


Profit Simulation

If you would like to know the impacts and costs of your decisions.


The profit simulation role is to choose a threshold. One way to choose that threshold is to optimize the profit.

Click on maximize profit button to see the best scenario.









Comments