Evaluating the Effectiveness of Mobile Precision Push Services A User-Centric Behavioral Framework
Downloads
Background: As precision push services (PPS) become increasingly embedded in mobile communication ecosystems, understanding how users perceive and respond to these services has become a pressing research concern. While prior studies have focused on technical accuracy and personalization algorithms, limited attention has been paid to how experiential and perceptual factors collectively influence user engagement and behavioral outcomes.
Objective: This study aims to construct and empirically validate a comprehensive user-centered evaluation model for precision push services. It seeks to identify which experiential dimensions most significantly influence user perception, and how these perceptions translate into behavioral responses.
Methods: A conceptual framework was developed integrating five experiential predictors—message validity and quality, non-interference with user experience, operability, user choice, and information transparency—alongside two perceptual mediators (effect and impact) and one behavioral outcome. A structured questionnaire using an eight-dimensional Likert scale was administered to 279 university students across multiple institutions. Data analysis involved reliability and validity testing, correlation analysis, ANOVA, and multiple regression to examine causal relationships and demographic influences.
Results: The results indicate that user choice is the most influential factor affecting both perceived effect and impact of PPS. Information transparency and message quality also significantly predict perceptual outcomes, while non-interference showed strong correlations but no direct causal influence. The impact of push services emerged as a stronger determinant of user behavior than perceived effectiveness. Gender and geographic differences were statistically controlled and found to have minimal effect on the primary causal pathways.
Conclusion: The study highlights the importance of user autonomy, transparency, and meaningful content delivery in designing effective PPS systems. By validating a full causal model and identifying critical user-centered variables, the research provides actionable insights for improving user engagement, trust, and behavioral response in personalized mobile push environments.
Keywords: Precision Push Service, User Perception, Causal Modeling, Personalization, Personalization
Z. Zhang, Y. Li, and M. Zhao, “Big data and IoT applications in precision push services under 5G networks,” IEEE Access, vol. 9, pp. 45678–45691, 2021.
A. Kumar and S. Gupta, “Personalized content delivery and user behavior: A review of mobile push strategies,” Information Technology & People, vol. 33, no. 4, pp. 1145–1162, 2020.
G. Taber, “The use of Cronbach’s alpha when developing and reporting research instruments in science education,” Research in Science Education, vol. 48, no. 6, pp. 1273–1296, 2018.
L. Chen, R. Zhao, and T. Wu, “User privacy perceptions in mobile push services: The role of transparency,” Computers in Human Behavior, vol. 128, pp. 193–203, 2022. doi:10.1016/j.chb.2021.106146
R. Hinton, I. McMurray, and D. Brownlow, SPSS Explained, 3rd ed., London, UK: Routledge, 2021.
X. Li and Y. Zhang, “User-centered design strategies for mobile notification systems,” International Journal of Human–Computer Interaction, vol. 37, no. 5, pp. 421–435, 2021.
J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson, Multivariate Data Analysis, 8th ed., Cengage, 2019.
R. B. Kline, Principles and Practice of Structural Equation Modeling, 4th ed., New York, NY: Guilford Press, 2016.
LogRocket, “A UX designer's guide to implementing push notifications,” 2021. [Online]. Available: https://blog.logrocket.com/ux-design/ux-designers-guide-implementing-push-notifications/
Taplytics, “Push Notification Guide,” 2020. [Online]. Available: https://taplytics.com/wp-content/uploads/2020/02/Taplytics-Push-Notification-Guide-2020.pdf
L. Cohen, L. Manion, and K. Morrison, Research Methods in Education, 8th ed., London, UK: Routledge, 2018.
D. Gavilan and G. Martinez-Navarro, “Exploring user’s experience of push notifications: a grounded theory approach,” Qualitative Market Research: An International Journal, vol. 25, no. 4, pp. 567–586, 2022. doi:10.1108/QMR-05-2021-0061
Tencent Research Institute, “Digital behavior and mobile application survey in China,” Annual User Insight Report, 2022. [Online]. Available: https://research.tencent.com
A. Field, Discovering Statistics Using SPSS, 5th ed., London, UK: SAGE, 2018.
J. Bell, S. O’Connor, et al., “How notifications affect engagement with a behavior: Evidence from a mobile health app,” JMIR mHealth and uHealth, vol. 11, no. 6, e40531, 2023. doi:10.2196/40531
B. J. Fogg, Persuasive Technology: Using Computers to Change What We Think and Do, San Francisco, CA: Morgan Kaufmann, 2003.
A. S. Nurqamarani, S. Fadilla, and A. Juliana, “Revolutionizing Payment Systems: The Integration of TRAM and Trust in QRIS Adoption for Micro, Small, and Medium Enterprises in Indonesia,” Journal of Information Systems Engineering and Business Intelligence, vol. 10, no. 3, pp. 314–327, 2024.
Yuan, Z., Zhang, C., Chatterjee, S., et al., “A state transition model for mobile notifications via survival analysis,” Proceedings of the ACM Web Conference (WWW), pp. 250–259, 2022. doi:10.1145/3485447.3512165V. Venkatesh, M. G. Morris, G. B. Davis, and F. D. Davis, “User acceptance of information technology: Toward a unified view,” MIS Quarterly, vol. 27, no. 3, pp. 425–478, 2003.
Graben, L., Stock, A., & Mandl, H., “Receiving push-notifications from smartphone games reduces students’ learning performance: An experimental study,” Computers and Education: Artificial Intelligence, vol. 3, p. 100070, 2022. doi:10.1016/j.caeai.2022.100070
Q. Hu, X. Qian, Y. Cheng, and J. C. Cheung, “Personalized policy learning using longitudinal mobile health data,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 4, pp. 6125–6132, 2020. doi:10.1609/aaai.v34i04.6001
Copyright (c) 2025 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
