Proactive Monitoring for SMEs with AppInsight
Proactive Monitoring for SMEs with AppInsight
6901
Volume 13, No. 5, September-October 2022 ISSN No. 0976-5697
Abstract: Data Security is a worldwide concern mostly for small medium enterprise (SMEs) and frameworks, approaches, methods are
constantly evolving that has a connection with cloud computing, information systems, artificial intelligence, blockchain. Many developers,
administrators or product teams running blind. Those are not knowing of problems with their application or do not have the information to fix
the problems. The things which can go wrong with web and mobile applications or services is unlimited like dependency failures, resources, and
crashes. Main argument is an evaluation of benefits by using Cloud as infrastructure and application on proactive monitoring called Azure
Application Insights (AppInsight) towards target like web application, web API, PKI etc. The findings, demonstration of the study should reveal
and support our main hypothesis that there is direct link between the proactive monitoring and the main factors that affects utilizing the cloud
services. To address this need, in this paper, we introduce AppInsight, the best practice and a model of proactive approach to monitor different
targets using Microsoft technology on Azure Cloud services. AppInsight – a model of proactive monitoring includes several functionalities: (1)
identifying availability, (2) failures dependencies, (3) performance and (4) using telemetry data generates ad-hoc solution to fix potential failure
of web application, web API etc. AppInsight a feature of Azure Monitor used to monitor live applications. AppInsight will aut omatically detect
performance anomalies, and includes powerful analytics tools to help you diagnose issues. You will get a range of telemetry data of analytics of
your target which is monitored by AppInsight. To evaluate this tool, we conduct an empirical evaluation by comparing data from actual live
monitoring of Y target.
Demo Video: https://www.youtube.com/watch?v=q7R8-c0ge7M
Keywords: cloud proactive, microsoft azure, appinsight, monitoring evaluation, government gateway
process. The current techniques assist in analyzing, but they
I. INTRODUCTION are mostly focusing on static analyzing. IT people mostly
developers, administrators need to shorten the time and
As H. James Harrington said “If you can’t measure produce solutions or insight for the issue, and this can be
something, you can’t understand it. If you can’t understand done by using Realtime Telemetry – AppInsight.
it, you can’t control it. If you can’t control it, you can’t
improve it.”, has been a big engagement of this time to
modernize lifecycle management of development and
operations. Proactive monitoring plays an important role in
software, hardware development. Since the emergence of the
Covid-19 pandemic worldwide, the need for monitoring,
information security has increased more than ever. The trend
of technological developments, the demands went beyond the
expectations of the time. It serves as an essential source
channel of telemetry data between app and users, resources
used.
AppInsight in a fast and powerful way helps to
diagnostics and solve real world problems, of two levels
Service Level impact (Availability, Reliability), Operational
Level impact (Responsiveness, Latency). Despite its benefits,
analyzing monitored data called logs often is a challenge to
IT professionals. Digitization, the advancement of
applications has brought a new era for SMEs. SMEs are
Figure 1. Realtime telemetry process of collection, analyzing, report
facing the security and availability of services in the face of
cyber threats and various IT risks. The distribution, Microsoft Azure is a cloud computing platform, and
expansion of infrastructure and IT in general with the various
serves for building, deploying and managing applications and
services of SMEs has an urgent need for a different approach services [1] by providing PaaS and IaaS services.
so far in terms of monitoring. European agency for Transformation toward cloud services is important IT
cybersecurity (ENISA) their analyses of SMEs shows how to capability building action to improve an organization in this
deal with the cybersecurity issues triggered by pandemic
digital world [2]. As within those Coronavirus disease time
through a report advice action [21].
Cloud computing can be used to rapidly enhance the
More the time goes and monitoring, collection of the logs
prediction process using high-speed computations and
etc., the more challenges bring on high number of such logs. predictions [3].
To solve this challenge, Realtime Telemetry feature at
AppInsight were presented by detecting, triage, and diagnose
© 2020-2022, IJARCS All Rights Reserved 1
Atdhe Buja et al, International Journal of Advanced Research in Computer Science, 13 (5), September-October 2022,1-8
The rest of the paper is organized as following: Section 2 (QoS) such as reliability, availability and performance [4].
AppInsight background and architecture. Our research how Many services exhibit dynamic QoS variations that result in
should be implementation are describing in Section 3. frequent changes in their behaviors, leading to SLA
Section 4 describes comparative analysis of different violations [4]. To avoid this a proactive monitoring can
monitoring tools, with the main results presented in Section prevent violations. The importance indication, the existing
5. Success stories to respective government countries are literature provides a large amount of work in this area.
showed in Section 6. Conclusions can be found in Section 7.
A. Implementations details
II. APPINSIGHTS In this paper, we propose AppInsight, a best practice and
a model of proactive approach to monitor different targets
In this section, we briefly illustrate AppInsight and its using Microsoft technology on Azure Cloud services for
architecture. The purposes of AppInsight is to identify the SMEs improving service availability and operations by
anomalies or problems and in very shorten process of time predicting component failure in a cloud or on-premises
give a solution by monitoring its dependencies and roles, service. AppInsight can be used in combination with SCOM
including powerful analytics tools which supports you in System Center Operation Manager simultaneously or
diagnose issues and behaviors actual users is doing with your separately for monitoring and are tools providing monitoring
app. National Institute of Standards Technology (NIST) see that is flexible and cost-effective.
cloud computing as a model for enabling convenient, on-
demand network access to a shared pool [1].
A. Architecture
failing requests
Live Stream new release ☒ ☐
deploy, degradation
Assess how many users ☒ ☐
are affected
Correlate failures with ☒ ☐
exceptions, dependency
calls, and traces
Examine profiler, ☒ ☐
snapshots, stack dumps,
and trace logs
Usage demographics ☒ ☐
and statistics
Figure 5. Selected component with recorded error
Retention - how many ☐ ☐
users come back?
There are different business models in the markets, such as
Funnels ☒ ☐
B2C, B2B, B2G. These types of business models very rarely
are in demand worldwide but now with pandemic Covid-19 User Flows ☒ ☐
has unexpectedly increased the use of technology and cloud Workbooks ☒ ☐
services [6]. As mentioned above, the increase in demand for Smart Detection ☒ ☐
digitization, use of advanced technologies such as Cloud are Transaction diagnostics ☒ ☐
the top choices of SMEs. The choice of methods, techniques Availability Free/Paid Free/Paid
in Cloud technologies such as proactive monitoring, includes
the adequate solution of the right approach for SMEs. Such
an approach gives results in the operational phases, that is, V. EVALUATION
after the final implementation of the service, be it web
application, API or other.
A. Research Questions
IV. TYPES OF PROACTIVE MONITORING METHODS a) In this section, we evaluate our approach using real-
world data. We aim to answering the following research
A considerable number of monitoring tools, were questions:
launched on the market in the last few years, but not all of
them established solution of proactive monitoring [6]. Not all b) RQ1: How does proactive monitoring through Cloud
tools or solutions are intended to provide a dynamic, application helps in terms of security on-site infrastructure,
proactive approach to presenting data, first collecting it. operation support for SMEs?
Proactive monitoring approach, shows the constant way of c) RQ2: Can proactive monitoring on Cloud
identification, assessment of likely event to occur or being an applications impact in time to reveal potential gaps, problems
issue, which creates and obstacles for the SMEs. Proactive and providing a solution to it?
countermeasures are those of prevention that stop or reduce
the development or occurrence of an incident, i.e. the B. Evaluation setup
likelihood. Usually this approach offers an advantage of Target. To evaluate the proposed proactive approach, we
identifying problems before the user sees and recognizes collect data from a production interoperability platform Y on
them and impact the business. Proactive monitoring through premises. For this experiment, we select dataset over two
the tools also enables the evaluation of the team's capacities months and each dataset covers one month and two-month
to react to cases when they happen or have happened. This period in 2020, 2021. The data are from part of the
approach can be used in many cases including business interoperability platform monitoring performance,
models and operations, IT, production, incident prevention, availability, and failures, containing over ten million
etc. Such an approach would help the SME team in changing monitored data.
the mindset, the work culture from the traditional one where
you wait for things to happen and then take preventive
measures, while proactive monitoring helps prevent the Table II. Summarizes the dataused in this experiment
event.
Comparative analysis of different monitoring tools as Period No.
shown in TABLE 1: transactions
Data 1 30 days 17/12/2020 – 16/01/2021 4.15 million
Table I. Comparative analysis of different Monitoring tools Data 2 60 days 17/11/2020 – 16/01/2021 8.41 million
resources in the Azure subscription. The following figure following figure for the Data 1. The problems detected with
shows the example of the application map, which has been Smart Detection includes a variety of issues: Failure
created based on the telemetry data from Web Application Anomalies, Performance Anomalies, Trace degradation,
Weather Service components. Azure AppInsight offers Memory leak, Security anti patterns.
different data views and connects to different data sources by
creating dashboards. Cloud technology has changed the way
SMEs operate by enabling expandable infrastructure with
service capabilities. It is a similar model as with utilities, that
is, using resources as much as you need and when you need
them. The benefits of SMEs from using Cloud technology, in
this case Azure, are obvious, including security, speed,
integration, disaster recovery, etc.
Figure 7. Detection analysis for security & behaviour
Figure 10. Failures analysis on Operation name, type, count and timeline
The following figure 11 on the right, you will see the most
useful distribution specific to the selected failing operation,
including top three responses code, top three exception
types, and top three failing dependency types.
Figure 12. Failures analysis on Operation name by Login using username
drill into Telemetry Data
16/01/2021
the tremendous generation of data today is appearing to be to monitoring brings benefits to SMEs, including the aspect
an issue that requires quick and wise solutions. of security. The security built on the basis of such an
As shown by our experimental results, the proactive approach raises its level in infrastructure, whether it is in
monitoring model in Azure AppInsight can better capture Cloud technology. It is based on the adaptation and
and diagnostic the characteristics of request, transaction establishment of controls or protective mechanisms in order
producing better results. to prevent the event from happening, for example. cyber-
attack. Something that protects the security of information
VI. SUCCESS STORIES and maintains the level of security to prevent, and within
SMEs, a culture of entrepreneurship is created that acts
This solution Azure AppInsight proactive monitoring was more in prevention than in remediation or reaction after the
successfully applied to the Interoperability Platform of event has occurred.
Government of Kosovo, which is a large scale on premises Much research is being done in terms of providing solutions
infrastructure build on Microsoft technology. to the challenges of the Industry 4.0 era [22], because every
Interoperability Platform allows developers and IT day it is becoming difficult for SMEs to deal with security
professionals to build, deploy, and manage web API that problems. Industry 4.0 revolution is ongoing process of
integrates system-to-system for data exchange. transforming every sector of the industry towards smartnes,
for more, the Industry 4.0 concept should go beyond large
companies with a personalized strategy approach and see the
possibility of implementation in SMEs [23]. Moreover,
digitalization depends directly on new technology, from the
concepts of CPS, IoT, physical internet (PI) [24]. Among
the big challenges for SMEs remains the transit or transfer
to Industry 4.0 in terms of competence and technology in
their premises. In addition to these, the organizational and
managerial aspect remains a challenge. Here, different
Figure 15. The operations performed in one month period Jan 1-23, 2021 frameworks and models can contribute to be useful in
determining the direction of the organization in achieving
strategic goals. Innovation should be part of the strategy of
SMEs, to increase the chances of success in this time of
great technological development. Changes in the culture, the
mindset of SMEs takes its own time, because people often
embrace new operating concepts, but there are also
influences that emerge for treatment from this challenge.
Figure 16. Time processing over 90% of transactions performed Up to 1
Industry 4.0 helps in the advancement of IT in terms of
sec vs. in one month period Jan 1-23, 2021 infrastructure, IT systems. The purpose of Industry 4.0 is to
integrate the connection of intelligent systems, self-control
Azure AppInsight proactive monitoring hosted on Azure in different processes of the industry and its sectors. This
Cloud is currently used by Interoperability Platform to will be a work that requires further research as future work,
monitor and alert for potential anomalies and healthier and the provision of solutions to have an easier transfer for
integrations between information systems. It’s scheduled SMEs in Industry 4.0. Monitoring of information systems,
agent (called robot app) job on every 15 minutes to perform web applications, or web services is important because it
such proactive monitoring steps across the entire enables a 360-degree view of the situation, and possible
Interoperability Platform to diagnose anomalies and incidents in terms of information security. Such solutions,
potential issues report back to IT administrator’s team. providers of Cloud technology services have several types
After deploying Azure AppInsight proactive monitoring, the of tools and applications, which with an access from the
IT administrator’s team computes a lot of percentages and web, that is, the Internet, enable the best operation of IT
having prediction of performance, dependencies, and structures within SMEs. Manual or traditional monitoring
operations for each component. The results are shown in takes a lot of time and is very worthless. Notifications play a
Figure 15,16. The results show that Azure AppInsight is key role in proactively monitoring various channels and
able to intelligently diagnose, predict every operation cloud services. Azure AppInsights helps increase the
happens on entire platform and has shorten the response availability and performance of systems and services. Cloud
time, diagnosis service problems of the team to the failures. technology is advancing further Azure has further integrated
Kubernetes services. Monitoring in Azure comes in three
VII. CONCLUSIONS ways: platform as a service (PaaS), software as a service
(SaaS), and infrastructure as a service (IaaS). The greatest
In this paper we presented APPINSIGHTS, a proactive strength in Azure AppInsight is the integration and
approach monitoring solution for any application, web API. presentation of telemetry data where through Azure Stack
To maintain SLA and improve service availability of IS, Hub it collects data with the aim of optimizing customer
Web app, Interoperability Platform, we propose Azure usage.
AppInsight proactive monitoring approach. We have We believe that with this approach giving importance of
evaluated such proposed approach using real-data and have service availability, failure prediction we have contributed
successfully applied Azure AppInsight to the maintenance in the design and maintenance of services.
of a production service system. Using a proactive approach