Are the following steps to calculate the accuracy correct or not?. Also, regarding to the sensitivity and specificity, should I do the same?
1 view (last 30 days)
Show older comments
I have a video clip that contains1500 frames. I trained my algorithm using a training video and detected the abnormalities in these frames. Thus, I have the detected frames which are logical frames and the ground truth dataset, which also is also logical frames. Now, I want to calculate the accuracy and ROC curve. I used the confusion function in this link (https://www.mathworks.com/matlabcentral/fileexchange/46035-confusionmatstats-group-grouphat-?focused=5540014&tab=function), which gives me the accuracy, sensitivity, and specificity. I applied the function to each row in the frame, then to each frame in the video to calculate the average accuracy.
6 Comments
Rik
on 6 Feb 2018
Does it make sense to you in your case to calculate metrics for each row? if so, then there is nothing wrong with what you did.
Do you have some metric that has more than 2 possible values, so you need to find an optimal threshold to call something abnormal? If so, use that metric to make an ROC curve, if not, you can't make one.
Accuracy in the sense that we are using now has a very specific meaning that may or may not be useful for you to calculate. If this is a project where you can ask a supervisor for useful metrics, I advise you to do so.
Answers (0)
See Also
Categories
Find more on Detection in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!