Non-intrusive process-based monitoring system to mitigate and prevent VM vulnerability explorations

Chun Jen Chung, Jingsong Cui, Pankaj Khatkar, Dijiang Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

Cloud is gaining momentum but its true potential is hampered by the security concerns it has raised. Having vulnerable virtual machines in a virtualized environment is one such concern. Vulnerable virtual machines are an easy target and existence of such weak nodes in a network jeopardizes its entire security structure. Resource sharing nature of cloud favors the attacker, in that, compromised machines can be used to launch further devastating attacks. First line of defense in such case is to prevent vulnerabilities of a cloud network from being compromised and if not, to prevent propagation of the attack. To create this line of defense, we propose a hybrid intrusion detection framework to detect vulnerabilities, attacks, and their carriers, i.e. malicious processes in the virtual network and virtual machines. This framework is built on attack graph based analytical models, VMM-based malicious process detection, and reconfigurable virtual network-based countermeasures. The proposed framework leverages Software Defined Networking to build a monitor and control plane over distributed programmable virtual switches in order to significantly improve the attack detection and mitigate the attack consequences. The system and security evaluations demonstrate the efficiency and effectiveness of the proposed solution.

Original languageEnglish (US)
Title of host publicationProceedings of the 9th IEEE International Conference on Collaborative Computing
Subtitle of host publicationNetworking, Applications and Worksharing, COLLABORATECOM 2013
Pages21-30
Number of pages10
DOIs
StatePublished - Dec 1 2013
Event9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, COLLABORATECOM 2013 - Austin, TX, United States
Duration: Oct 20 2013Oct 23 2013

Publication series

NameProceedings of the 9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, COLLABORATECOM 2013

Other

Other9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, COLLABORATECOM 2013
CountryUnited States
CityAustin, TX
Period10/20/1310/23/13

Keywords

  • Attack Graph
  • Countermeasure Selection
  • Intrusion Detection
  • Software Defined Networking
  • Virtual Machine Introspection

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Non-intrusive process-based monitoring system to mitigate and prevent VM vulnerability explorations'. Together they form a unique fingerprint.

  • Cite this

    Chung, C. J., Cui, J., Khatkar, P., & Huang, D. (2013). Non-intrusive process-based monitoring system to mitigate and prevent VM vulnerability explorations. In Proceedings of the 9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, COLLABORATECOM 2013 (pp. 21-30). [6679966] (Proceedings of the 9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, COLLABORATECOM 2013). https://doi.org/10.4108/icst.collaboratecom.2013.254107