303COM_project_code

Description

Code used during 303COM project to analyse unsupervised anomaly detection algorithms on Splunk and Elastic.

Three key files were used during development of this project. All files pertaining to either Elastic (es) or Splunk (sp) begin with es/sp.

Contents

• es_add_integers.py - Add all necessary string-to-integer conversions to raw OpTC file for use in Elastic X-pack outlier detection; also adds ground_truth field to help extract results of model

• sp_ml_statistics_calc.py - contains calculation class to determine performance of Splunk MLTK anomaly detection algorithms. Requires a CSV file in the format: _time, pid, hostname, outlier_prediction

• utils.py - contains necessary data to determine whether an event is a true positive and key dictionaries used for string-to-integer conversions.