The Data Science Lab
since 2005
  • Home
  • Research
      • Research grants
      • Research interests
      • Research leadership
      • Student theses
      • Humanoid Ameca
      • AI Server
        • GPU
        • Request
        • Allocation
  • Consultancy
      • Consulting projects
      • Cooperate training
      • Enterprise innovation
      • Impact cases
      • Our clients
      • Partnership
  • People
      • Awards and honors
      • Staff
      • Team members
  • Activities
      • Events and services
      • Talks
      • Tutorials
      • Workshops
  • Publications
  • Communities
      • ACM ANZKDD Chapter
      • Big data summit
      • Data Analytics book series
      • DSAA conferences
      • IEEE TF-DSAA
      • IEEE TF-BESC
      • JDSA Springer
      • DataSciences.Info
      • MQ's DSAI
  • Resources
      • Actionable knowledge discovery
      • Agent mining
      • AI: Artificial-intelligence
      • AI4Tech: AI enabling technologies
      • AI4Finance: AI for FinTech
      • AI robots & humanoid AI
      • Algorithmic trading
      • Banking analytics
      • Behavior analytics, computing, informatics
      • Coupling and interaction learning
      • COVID-19 global research and modeling
      • Data science knowledge map
      • Data science dictionary
      • Data science terms
      • Data science tools
      • Data science thinking
      • Domain driven data mining
      • Educational data mining
      • Large-scale statistical learning
      • Metasynthetic engineering
      • Market surveillance
      • Negative Sequence Analysis
      • Non-IID Learning
      • Pattern relation analysis
      • Recommender systems
      • Smart beach analytics
      • Social security analytics
      • Tax analytics
  • About us
Zhigang Zheng. Negative Sequential Pattern Mining, PhD thesis, Mar 2012

Sequential pattern mining provides an important way to obtain special patterns from sequence data. Different from traditional positive sequential pattern (PSP) mining, negative sequential pattern (NSP) mining takes negative itemsets into account besides positive ones. It is more interesting in applications where non-occurring itemsets need to be considered.
A comprehensive literature of negative frequent pattern mining is described in this thesis. After that, formal definitions of the NSP mining problem are stated to make the following descriptions of methodology to be clear and accurate.

Three algorithms of NSP mining are then proposed in this thesis.
(1) The first algorithm, Neg-GSP, is based on a PSP mining algorithm GSP (Srikant & Agrawal 1996), and then extended to deal with negative cases by introducing new methods of joining and generating candidates. And also, an effective pruning method to reduce the number of candidates is introduced as well.
(2) The second one is a Genetic Algorithm (GA)-based NSP mining algorithm (Zheng, Zhao, Zuo & Cao 2010), which is called GA-NSP. The proposed method is to find NSP with novel crossover and mutation operations, which are efficient at passing good genes on to next generations. An effective dynamic fitness function and a pruning method are also provided to improve performance.
(3) The third algorithm, e-NSP, is based on the Set Theory, and mines for NSP by only involving the identified PSP, without re-scanning a database. In this way, mining NSP does not require additional database scans, and it facilitates that the existing PSP mining algorithms can mine NSP. It offers a new strategy for efficient mining of NSP.

The results of extensive experiments about the three algorithms show that the proposed methods can find NSP efficiently and have good performance compared with some other algorithms of mining NSP. Comparing the NSP definitions of the above three methods, Neg-GSP and GA-NSP share the same definitions, e-NSP uses stronger constraints since it requires clear boundary to follow the Set Theory. When we compare their efficiency, GA-NSP algorithm slightly outperforms Neg-GSP in terms of the running time, but it misses some of patterns in the complete result sets due to limitations of GA. Apparently, e-NSP is the most efficient and effective one since it doesn¡¯t need to scan datasets to calculate the support of NSP. Although adding stronger constraints makes the NSP set much smaller than what it is under the normal definitions, it is still very practicable while being used in some real-life applications.

Following that, NSP mining case studies coming from health insurance industry are introduced. Based on real-life industry datasets, we use the proposed NSP mining methods to find PSP and NSP in ancillary service over-service analysis and fraud claim detection, which show the applicability and benefits gained from mining NSP.

About us
School of Computing, Faculty of Science and Engineering, Macquarie University, Australia
Level 3, 4 Research Park Drive, Macquarie University, NSW 2109, Australia
Tel: +61-2-9850 9583
Staff: firstname.surname(a)mq.edu.au
Students: firstname.surname(a)student.mq.edu.au
Contacts@datasciences.org