24. 12. 2023
Development, DevOps, Log-SIEM, NetEye
The use case of this blog is about monitoring COVID-19 in Italy. The data used is public, and the source is the Protezione Civile (Italian Civil Protection Office), which updates the data every day after 18:00 on GitHub at the following link:
https://github.com/pcm-dpc/COVID-19/tree/master/
I found the data in various formats and I chose to analyze the CSV files. I then installed the NetEye SIEM module in order to use the power of analytics.
I used Logstash to load the data into Elasticsearch, and the plug-in input File and CSV filter. After that I designed and created visualization maps and dashboard objects using Kibana.
Below are the resulting two dashboards I created:
By clicking on “Esplora”, you can then view the relative maps update to 10th March 2020:
Here you can see that the most complicated situation is in the north of Italy, but COVID-19 is spreading very quickly to many other cities throughout Italy.
Scrolling down the dashboard, you can see another view of Italy with the same date, but with a different visualization.
Here it’s possible to analyze and change focus, passing from total cases to total deaths, total numbers of people in the hospital, etc.
I hope that this blog will help make it understood that COVID-19 spreads quite quickly, and we can all stop it together, if we all follow the suggestions of the central government.
It’s possible to configure NetEye’s Tornado component to create alerts in NetEye, however since the data is not in real or near-real time, in my opinion it is not necessary.
I’ve tried to use Elastic Stack’s machine learning feature, but there is not yet enough data. Next, I will try to visualize public data of COVID-19 from all over the world, which I found here:
https://github.com/CSSEGISandData/COVID-19
Franco Federico
Hi, I’m Franco and I was born in Monza. For 20 years I worked for IBM in various roles. I started as a customer service representative (help desk operator), then I was promoted to Windows expert. In 2004 I changed again and was promoted to consultant, business analyst, then Java developer, and finally technical support and system integrator for Enterprise Content Management (FileNet). Several years ago I became fascinated by the Open Source world, the GNU\Linux operating system, and security in general. So for 4 years during my free time I studied security systems and computer networks in order to extend my knowledge. I came across several open source technologies including the Elastic stack (formerly ELK), and started to explore them and other similar ones like Grafana, Greylog, Snort, Grok, etc. I like to script in Python, too. Then I started to work in Würth Phoenix like consultant. Two years ago I moved with my family in Berlin to work for a startup in fintech(Nuri), but the startup went bankrupt due to insolvency. No problem, Berlin offered many other opportunities and I started working for Helios IT Service as an infrastructure monitoring expert with Icinga and Elastic, but after another year I preferred to return to Italy for various reasons that we can go into in person 🙂 In my free time I continue to dedicate myself to my family(especially my daughter) and I like walking, reading, dancing and making pizza for friends and relatives.
Author
Latest posts by Franco Federico
25. 03. 2024
APM, NetEye, Visual Synthetic Monitoring
Migration from Alyvix Server to Alyvix Service
10. 12. 2021
APM, NetEye, Real User Experience, Visual Synthetic Monitoring
NEP Alyvix – Ready for Use