Abstract
Despite its continuous improvement, cloud computing system is still vulnerable to malicious activities. This has necessitated in constructing an anomaly detection component for discovering anomalies in cloud environment. In this paper, an anomaly detection system at hypervisor layer named hypervisor detector is developed and evaluated to detect the malicious activities in cloud environment. Deployment of fuzzy systems in intrusion detection systems has the ability to detect the presence of uncertain and imprecise nature of anomalies in cloud environment. But they fail in constructing models based on target data. One of the successful approaches based on target data is integration of fuzzy systems with adaptation and learning proficiencies of neural network called adaptive neuro-fuzzy inference system (ANFIS) model. The hypervisor detector is designed and developed with ANFIS and is practiced with a hybrid algorithm, which is a combination of back propagation gradient descent technique with least square method. For experiments, DARPA's KDD cup dataset is used. The performance analysis and results show that the proposed hypervisor detector based on ANFIS is well designed to detect the anomalies in cloud environment with minimum false negative rate and high detection accuracy.