Attention Based LSTM with Multi Tasks Learning for Predictive Process Monitoring
Abstract— Today, in the artificial intelligence research field, Deep Learning (DL) is one of the fastestgrowing techniques because of the power of learning features, that gives a higher level of abstraction of the raw attributes; and related research in Recurrent Neural Networks (RNN) and Long Short -Term Memory Networks (LSTM) have shown exemplary results in neural machine translation, neural image caption generation, NLP and so on. For our research, in order to detect potential problems and to facilitate proactive management, we focus on predictive process monitoring (PPM) as domain area, by predict ing business behaviour from historical event logs. Recent research works, LSTM networks have gained attention in PPM and have been proved that they can highly improve prediction accuracy in PPM. According to the literature, we have learned that PPM resembles to an early sequence classificat ion problem in NLP. And, recent trends in DL based NLP, attention mechanism is mostly embedded in neural networks. Inspired by these results, this paper proposes to firstly use Attention Based LSTM with Multi Tasks Learning for PPM.
Index Terms— LSTM, Attention, Predictive Process Monitoring
Thuzar Hnin, Khine Khine Oo
University of Computer Studies, MYANMAR
Cite: Thuzar Hnin, Khine Khine Oo, "Attention Based LSTM with Multi Tasks Learning for Predictive Process Monitoring," Proceedings of 2019 the 9th International Workshop on Computer Science and Engineering WCSE_2019_SPRING, pp. 165-170, Yangon, Myanmar, February 27-March 1, 2019.