[Review] Evaluation of Static Vulnerability Detection Tools with Java Cryptographic API Benchmarks
The paper assesses the performance of the current static vulnerability detection tools in the era of Java cryptographic API misuse.
Main contributions:
- provide two benchmarks: CryptoAPI-Bench, ApacheCryptoAPI-Bench.
- CryptoAPI-Bench consists of 181 test cases covering 16 types of Cryptographic and SSL/TLS API misuse vulnerabilities, with basic level and advanced level.
- ApacheCryptoAPI-Bench documents the API misuse vulnerabilities from 10 real-world Apache projects. This benchmark is for checking the scalability(the ability to induce low computational overhead to analyze large code-bases) of the detection tool.
- evaluate four static analysis tools based on the two proposed benchmarks: specialized tools(CryptoGuard, CrySL), general purpose tools(SpotBugs, Coverity).