Facebook Google Plus Twitter LinkedIn YouTube RSS Menu Search Resource - BlogResource - WebinarResource - ReportResource - Eventicons_066 icons_067icons_068icons_069icons_070

Tenable Blog

Subscribe

Security Metrics - Common Mistakes in Vulnerability and Compliance Reporting

I get the chance to speak with many different types of customers and potential customers. I am particularly interested in how they want to monitor and report on their network activity. I am frequently asked what type of metrics can be tracked for upper management. Trending charts are very popular, but what goes in them can be deceiving. Let’s consider some examples.

A very common requirement in enterprise networks is to patch all systems every 30 days. That is, no system should ever have a major vulnerability for more than 30 days. With this in mind, consider this trend graph of my laptop’s vulnerabilities over time:

My-laptop

Even though I had some vulnerabilities back in November and October, my system was always patched within a few days, which is in compliance with our patch policy. To a security analyst, it might be interesting to note that my laptop was known to have vulnerabilities on a certain date, but to a compliance officer, this data may be misleading.

In addition, keep in mind that reporting on vulnerabilities ends up graphically demonstrating how effective your scanner is and not how effective your IT organization is. Consider this fictitious vulnerability scan of a host that is scanned every day, but only patched once a week:

Vuln-trend-patch-7-days

I purposely chose the graph “trending downward”. A senior manager might look at this graph and conclude things were getting better, when in actuality, things are great! All of the hosts’ vulnerabilities were patched every 7 days.

If your organizational policy is to patch within 30 days, showing a graph like the one from above can be very confusing.

Another error in vulnerability reporting is related to scanning frequency. I’ve spoken to some organizations that scan their network once every 30 days and some even once every 90 days. During this type of time period, there can be a tremendous amount of new vulnerabilities that have been disclosed. In the graph below, if you sampled on April 8th, you would have a very negative impression of the patching activities and on April 25, you might think your scanner was not working because it didn’t report anything. Likewise if you sampled when a smaller amount of vulnerabilities were reported, you might think things were great all of the time.

Vuln-trend-OK-not-OK

Last, consider this report on the trend of vulnerable web browsers for a major university:

Univ

This graph comes from the Passive Vulnerability Scanner (PVS) and shows just how chaotic tracking vulnerabilities can be. This particular graph is of any vulnerable web browser that can be observed by the PVS. Since the PVS works in real time with continuous monitoring, the graph has many trend lines related to vulnerabilities in various web browsers.

Conclusion

When reporting on vulnerabilities within a compliance framework, be sure to provide the information asked for. Otherwise, the information you do provide may be misleading or even alarming.

We’ve blogged several times about reporting on vulnerabilities in the past. These following links list several popular topics.

Related Articles

Cybersecurity News You Can Use

Enter your email and never miss timely alerts and security guidance from the experts at Tenable.

Tenable Vulnerability Management

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy.

Your Tenable Vulnerability Management trial also includes Tenable Lumin and Tenable Web App Scanning.

Tenable Vulnerability Management

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Purchase your annual subscription today.

100 assets

Choose Your Subscription Option:

Buy Now

Tenable Vulnerability Management

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy.

Your Tenable Vulnerability Management trial also includes Tenable Lumin and Tenable Web App Scanning.

Tenable Vulnerability Management

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Purchase your annual subscription today.

100 assets

Choose Your Subscription Option:

Buy Now

Tenable Vulnerability Management

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy.

Your Tenable Vulnerability Management trial also includes Tenable Lumin and Tenable Web App Scanning.

Tenable Vulnerability Management

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Purchase your annual subscription today.

100 assets

Choose Your Subscription Option:

Buy Now

Try Tenable Web App Scanning

Enjoy full access to our latest web application scanning offering designed for modern applications as part of the Tenable One Exposure Management platform. Safely scan your entire online portfolio for vulnerabilities with a high degree of accuracy without heavy manual effort or disruption to critical web applications. Sign up now.

Your Tenable Web App Scanning trial also includes Tenable Vulnerability Management and Tenable Lumin.

Buy Tenable Web App Scanning

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Purchase your annual subscription today.

5 FQDNs

$3,578

Buy Now

Try Tenable Lumin

Visualize and explore your exposure management, track risk reduction over time and benchmark against your peers with Tenable Lumin.

Your Tenable Lumin trial also includes Tenable Vulnerability Management and Tenable Web App Scanning.

Buy Tenable Lumin

Contact a Sales Representative to see how Tenable Lumin can help you gain insight across your entire organization and manage cyber risk.

Try Tenable Nessus Professional Free

FREE FOR 7 DAYS

Tenable Nessus is the most comprehensive vulnerability scanner on the market today.

NEW - Tenable Nessus Expert
Now Available

Nessus Expert adds even more features, including external attack surface scanning, and the ability to add domains and scan cloud infrastructure. Click here to Try Nessus Expert.

Fill out the form below to continue with a Nessus Pro Trial.

Buy Tenable Nessus Professional

Tenable Nessus is the most comprehensive vulnerability scanner on the market today. Tenable Nessus Professional will help automate the vulnerability scanning process, save time in your compliance cycles and allow you to engage your IT team.

Buy a multi-year license and save. Add Advanced Support for access to phone, community and chat support 24 hours a day, 365 days a year.

Select Your License

Buy a multi-year license and save.

Add Support and Training

Try Tenable Nessus Expert Free

FREE FOR 7 DAYS

Built for the modern attack surface, Nessus Expert enables you to see more and protect your organization from vulnerabilities from IT to the cloud.

Already have Tenable Nessus Professional?
Upgrade to Nessus Expert free for 7 days.

Buy Tenable Nessus Expert

Built for the modern attack surface, Nessus Expert enables you to see more and protect your organization from vulnerabilities from IT to the cloud.

Select Your License

Buy a multi-year license and save more.

Add Support and Training