Skip to content

Research at St Andrews

KDD 1999 generation faults: a review and analysis

Research output: Contribution to journalArticle

Open Access Status

  • Embargoed (until 21/09/19)

Author(s)

Amjad M. Al Tobi, Ishbel Duncan

School/Research organisations

Abstract

DARPA 1998 was one of the first Intrusion Detection datasets that was made publicly available. The KDD 1999 dataset was derived from DARPA 1998 to be used by researchers in developing machine learning (ML), classification and clustering algorithms with a security focus. DARPA 1998 has been criticised in literature due to raised concerns of problems in the dataset. Many researchers have accused KDD 1999 of having similar concerns but no evidence was ever published. In this paper, we review the KDD 1999 generation process and present new proofs of existing inconsistencies in KDD 1999. We then present the process used to link some of the KDD 1999 (TELNET) records back to their origins in DARPA 1998 and discuss the interesting results and findings of this experiment.
Close

Details

Original languageEnglish
Pages (from-to)164-200
Number of pages37
JournalJournal of Cyber Security Technology
Volume2
Issue number3-4
Early online date21 Sep 2018
DOIs
Publication statusPublished - 2018

    Research areas

  • DARPA 1998 dataset, KDD Cup 1999 dataset, KDD review, KDD generation process, KDD generation faults

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. A novel method to prevent phishing by using OCR technology

    Wang, Y. & Duncan, I. M. M., 5 Jun 2019. 5 p.

    Research output: Contribution to conferencePaper

  2. Improving intrusion detection model prediction by threshold adaptation

    Al Tobi, A. M. H. & Duncan, I. M. M., 30 Apr 2019, In : Information. 10, 5, 41 p., 159.

    Research output: Contribution to journalArticle

  3. Human visual based perception of steganographic images

    Fyffe, B., Wang, Y. & Duncan, I., 2019, In : Journal of Cyber Security Technology. 3, 2, p. 61-107 47 p.

    Research output: Contribution to journalArticle

  4. Aerial Virtual Reality: Remote Tourism With Drones

    Fabola, A. E., Miller, A. & Duncan, I. M. M., Nov 2017.

    Research output: Contribution to conferencePaper

  5. Aerial Virtual Reality: remote tourism with drones

    Fabola, A. E., Miller, A. H. D. & Duncan, I. M. M., 16 Oct 2017, Journal of Immersive Education: E-iED 2017, Proceedings. Immersive Education Initiative, 13 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

Related by journal

  1. Journal of Cyber Security Technology (Journal)

    Ishbel Mary Macdonald Duncan (Member of editorial board)
    2018

    Activity: Publication peer-review and editorial work typesPeer review of manuscripts

Related by journal

  1. Human visual based perception of steganographic images

    Fyffe, B., Wang, Y. & Duncan, I., 2019, In : Journal of Cyber Security Technology. 3, 2, p. 61-107 47 p.

    Research output: Contribution to journalArticle

ID: 252027683