- Jignesh C Doshi
- Bhushan Trivedi
ABSTRACT
Business using internet has grown drastically in past decade. Attacks on web application have increased. Web application security is a big challenge for any organizations as result of increasing attacks. There exists different approaches to mitigate various security risks are defensive coding, hardening (Firewall), Monitoring and auditing. This solutions found more towards prevention of attacks or of monitoring types of. Vulnerability assessment and Penetration testing are two approaches widely used by organizations to assess web application security. Both solutions are different and complimentary to each other. In this paper comparison of these two approaches are provided. Authors found that penetration testing is better compare to vulnerability assessment as it exploits vulnerability, while vulnerability assessment is superior in terms of coverage over penetration testing.
General Terms
Vulnerability Measurement, Penetration Testing
Keywords
Attack, Vulnerability, Security Risk, VAPT,
1. INTRODUCTION
Web application usage has increased as more and more services are available on web. Business using Web applications is also increasing day by day. On other side, web application based attacks have increased. Web application have become main target of attackers. Major impact of attacks is data loss or financial loss or reputation loss.
Various types of countermeasures exists to protect system against attacks like defensive coding, firewall, Intrusion detection system etc. [15]. The solution exists in two categories: proactive and reactive. To secure web applications, thorough study of vulnerabilities is required. Study will help in taking effective actions. Vulnerability measurement and Penetration testing are widely used approaches by organizations for web application security assessment.
In this paper, authors have compared vulnerability assessment and penetration testing.
The rest of the paper is organized as follows. Vulnerability assessment is discussed in section 2, Penetration testing is discussed in Section 3. Section 4 describes comparison between vulnerability assessment and penetration testing. Conclusion is described in section 5.
2. Current Web Application Security Trends
The number of internet users and websites are increasing rapidly in recent years [9]. Approximately 66% of web applications have problem as per Gartner. According to sophisticated vulnerability assessment tools 60% vulnerabilities can be found in most of web applications [12].
Security measures most commonly applied for web application security are firewalls, Intrusion Detection System (IDS), Anti-virus System and defensive coding [14][15]. This solution either requires developer skills or efforts in common [15]. These solutions provide a way to assess system, while organizations need a way to assess security countermeasure assessment. It is also necessary to assess web application periodically against security risks in order to take effective actions.
3. Vulnerability Assessment
Vulnerability is a weakness or flaw in a system. Reasons for vulnerability existence are weak password, coding, input validation, misconfiguration etc. Attacker tries to discover vulnerability and then exploit it.
Vulnerability assessment is a proactive and systematic strategy to discover vulnerability. It is used to discover unknown problems in the system. It is also required by industry standard like DSS PCI from compliance point of view.
Vulnerability assessment is achieved using scanners. It is a hybrid solution, which combines automated testing with expert analysis.
Figure 1: Vulnerability Assessment Process
|
Vulnerability assessment is a one step process ( Refer to figure 1). We will learn more details about vulnerability assessment in section 5.
4. Penetration Testing
A penetration testing evaluates the security of a computer system or network by simulating an attack. It is a proactive and systematic approach for security assessment.
Figure 1: Penetration Testing Process
|
Penetration testing is a two steps process (refer to figure 2). We will learn more details about penetration in next section.
5. Comparison
5.1 Generic
Vulnerability Assessment |
Penetration Testing |
|
Working |
Discover vulnerabilities |
Discover and exploit vulnerabilities |
Alerts pre-existing flaws found in code |
Shows how damaging flaws pose a threat to application |
|
Do not differentiate between flaws that can cause damage or not |
Gives detail picture of flaws found in application with risk associated with it |
|
Mechanism |
Discovery & Scanning |
Simulation |
Process |
One step : Find vulnerability |
Two step process: Find and exploit vulnerability |
Focus |
Breadth over depth |
Depth over breadth |
Type |
Hybrid solution |
One solution for multiple vulnerabilities testing |
Coverage of completeness |
High |
Low |
Defend ability |
Medium |
High |
Control |
Detective control, used to detect when equipment is compromised. |
Preventative control used to reduce exposures |
Cost |
Low to moderate |
High |
Performed by |
In house staff |
Attacker, Pen tester |
5.2 Resource Requirements
Vulnerability Measurement |
Penetration Testing |
|
Internal Resource Requirement |
Medium |
Low |
External Resource Requirement |
High |
High |
Tester Knowledge |
High |
Low |
5.3 Testing
Vulnerability Measurement |
Penetration Testing |
|
Testing of other security Investments |
Not possible |
Determine whether other security investments are functioning properly or not |
Security Risk Assessment |
Not possible |
Provide security risk assessment as mimics attacks just like attacker |
Testing |
Does not simulate attacks |
Simulates real world attacks |
How often to run |
Continuously, especially after new equipment is loaded |
Periodically |
5.4 Results
Vulnerability Assessment |
Penetration Testing |
|
Reports |
Comprehensive baseline of what vulnerabilities exist and changes from the last report |
Short and to the point, identifies what data was actually compromised |
Metrics |
Lists known software vulnerabilities that may be exploited |
Discovers unknown and exploitable exposures to normal business processes |
Results |
Provides partial evaluation of vulnerabilities |
Provides complete evaluation of vulnerabilities |
5.5 Limitations
Major limitations of Vulnerability Assessments are:
ï‚· Cannot identify potential access path
ï‚· Provides false positive
ï‚· Requires high technical skills for tester
ï‚· Hybrid solution
ï‚· Cannot exploit flaws
Major limitations of Penetration testing are:
ï‚· Identifies potential access paths
ï‚· Identifies only those which poses threats
ï‚· May not identify obvious vulnerability
ï‚· Cannot provide information about new vulnerabilities
ï‚· Cannot identify server side vulnerabilities
6. Conclusion
With the exception of coverage, penetration testing is superior to vulnerability management.
Key benefits of penetration testing over vulnerability assessment are:
- Technical capability required in penetration testing is low compare to vulnerability assessment
- Can be used runtime
- With penetration testing we can detect, confirm and exploit vulnerability.
- With penetration testing can determine the resulting impact on the organisation.
For effective security, it is important to understand vulnerability in details.
Both are complimentary strategies to each other and proactive. We suggest to use both together.
7. REFERENCES
- Vulnerability Assessment and Penetration Testing: http://www.veracode.com/ security/vulnerability-assessment-and-penetration-testing
- John Barchie, Triware Net world Systems, Penetration Testing vs. Vulnerability Scanning: http://www.tns.com/PenTestvsVScan.asp
- Penetration Testing Limits http:// www.praetorian.com/blog/penetration-testing-limits
- Vulnerability Analysis, http://www.pentest-standard.org/index.php/ Vulnerability Analysis
- Open Web Application Security Project, https://www.owasp.org/index.php/Category: Vulnerability
- Penetration Testing: http://searchsoftwarequality .techtarget.com/definition/penetration-testing
- Vulnerability Assessment and Penetration Testing: http://www.aretecon.com/aretesoftwares
- Ankita Gupta, Kavita, Kirandeep Kaur: Vulnerability Assessment and Penetration Testing,
- International Journal of Engineering Trends and Technology- Volume4 Issue3- 2013, ISSN: 2231-5381 Page 328-330
- Konstantinos Xynos, Iain Sutherland, Huw Read, Emlyn Everitt and Andrew J.C. Blyth: PENETRATION TESTING AND VULNERABILITY ASSESSMENTS: A PROFESSIONAL APPROACH, Originally published in the Proceedings of the 1st International Cyber Resilience Conference, Edith Cowan University, Perth Western Australia, 23rd August 2010 available at : http://ro.ecu.edu.au/icr/16
- You Yu, Yuanyuan Yang, Jian Gu, and Liang Shen, Analysis and Suggestions for the Security of Web Applications,, International Conference on Computer Science and Network Technology, 2011, 978-1-4577-1587-7/111, IEEE
- Andrey Petukhov, Dmitry Kozlov, Detecting Security Vulnerabilities in Web Applications Using Dynamic Analysis with Penetration Testing, https://www.owasp.org/images/3/3e/OWASP-AppSecEU08-Petukhov.pdf accessed on 31st January 2015
- Parvin Ami, Ashikali Hasan: Seven Phrase Penetration Testing Model,International Journal of Computer Applications (0975 – 8887),Volume 59– No.5, December 2012
- Aileen G. Bacudio, Xiaohong Yuan, Bei-Tseng Bill Chu, Monique Jones,an overview of penetration testing, International Journal of Network Security & Its Applications (IJNSA), Vol.3, No.6, November 2011 DOI :10.5121/ijnsa.2011.3602
- Jignesh Doshi, Bhushan Trivedi, Assessment of SQL Injection Solution Approaches, International Journal of Advanced Research in Computer Science and Software Engineering, Volume 4, Issue 10, October 2014 ISSN: 2277 128X
1
Cite This Work
To export a reference to this article please select a referencing style below: