Sign up for our newsletter and get the latest big data news and analysis.

Research Highlights: MIDAS – Real-time Anomaly/Fake News/Intrusion Detection

In the insideBIGDATA Research Highlights column we take a look at new and upcoming results from the research community for data science, machine learning, AI and deep learning. Our readers need to get a glimpse for technology coming down the pipeline that will make their efforts more strategic and competitive. In this installment we review MIDAS – Real-time Anomaly/Fake News/Intrusion Detection developed by Ph.D. candidate Siddharth Bhatia and his team at the National University of Singapore.

MIDAS finds anomalies or malicious entities in time-evolving graphs. MIDAS can be used to detect intrusions, Denial of Service (DoS), and Distributed Denial of Service (DDoS) attacks. MIDAS is a new approach to anomaly detection that outperforms baseline approaches both in speed and accuracy. It can also be used to detect fake profiles in Social Networks like Twitter, Facebook, Amazon reviews, and Financial Frauds. MIDAS requires constant memory to detect these anomalies in real-time so as to minimize the harm caused by them. Also, MIDAS is up to 48% more accurate while being up to 644 times faster than the state of the art approaches.

MIDAS is currently being deployed in real-world systems to improve their performance. Different cybersecurity firms are seeking specially tuned versions of MIDAS according to their requirements. Different developers have implemented MIDAS in Python, Ruby, Rust, R, and Golang in addition to the C++ version that was originally released. MIDAS source code and different implementations are open source, and available on the Github Project Page.

At the National University of Singapore, Ph.D. candidate Siddharth Bhatia and his team have developed MIDAS. The MIDAS research paper can be found HERE. The video below summarizes work with MIDAS: Microcluster-Based Detector of Anomalies in Edge Streams.

Sign up for the free insideBIGDATA newsletter.

Leave a Comment

*

Resource Links: