Documents

DOI

Feature location is a fundamental step in software evolution tasks such as debugging, understanding, and reuse. Numerous automated and semi-automated feature location techniques (FLTs) have been proposed, but the question remains: How do we objectively determine which FLT is most effective? Existing evaluations frequently use bug fix data, which includes the location of the fix, but not what other code needs to be understood to make the fix. Existing evaluation measures such as precision, recall, effectiveness, mean average precision (MAP), and mean reciprocal rank (MRR) will not differentiate between a FLT that ranks higher these related elements over completely irrelevant ones. We propose an alternative measure of relevance based on the likelihood of a developer finding the bug fix locations from a ranked list of results. Our initial evaluation shows that by modeling user behavior, our proposed evaluation methodology can compare and evaluate FLTs fairly. © 2013 IEEE.

Original languageEnglish
Title of host publicationProceedings of the 2013 IEEE International Conference on Software Maintenance
PublisherIEEE
Pages408-411
Number of pages4
DOIs
StatePublished - 2013
Event29th IEEE International Conference on Software Maintenance, ICSM 2013 - Eindhoven, Netherlands

Conference

Conference29th IEEE International Conference on Software Maintenance, ICSM 2013
CountryNetherlands
CityEindhoven
Period22/09/1328/09/13

    Research areas

  • Concern location, Empirical studies, Feature location, Relevance measures

ID: 9302883