Facebook Google Plus Twitter LinkedIn YouTube RSS Menu Search Resource - BlogResource - WebinarResource - ReportResource - Eventicons_066 icons_067icons_068icons_069icons_070

Security Metrics - Common Mistakes in Vulnerability and Compliance Reporting

I get the chance to speak with many different types of customers and potential customers. I am particularly interested in how they want to monitor and report on their network activity. I am frequently asked what type of metrics can be tracked for upper management. Trending charts are very popular, but what goes in them can be deceiving. Let’s consider some examples.

A very common requirement in enterprise networks is to patch all systems every 30 days. That is, no system should ever have a major vulnerability for more than 30 days. With this in mind, consider this trend graph of my laptop’s vulnerabilities over time:

My-laptop

Even though I had some vulnerabilities back in November and October, my system was always patched within a few days, which is in compliance with our patch policy. To a security analyst, it might be interesting to note that my laptop was known to have vulnerabilities on a certain date, but to a compliance officer, this data may be misleading.

In addition, keep in mind that reporting on vulnerabilities ends up graphically demonstrating how effective your scanner is and not how effective your IT organization is. Consider this fictitious vulnerability scan of a host that is scanned every day, but only patched once a week:

Vuln-trend-patch-7-days

I purposely chose the graph “trending downward”. A senior manager might look at this graph and conclude things were getting better, when in actuality, things are great! All of the hosts’ vulnerabilities were patched every 7 days.

If your organizational policy is to patch within 30 days, showing a graph like the one from above can be very confusing.

Another error in vulnerability reporting is related to scanning frequency. I’ve spoken to some organizations that scan their network once every 30 days and some even once every 90 days. During this type of time period, there can be a tremendous amount of new vulnerabilities that have been disclosed. In the graph below, if you sampled on April 8th, you would have a very negative impression of the patching activities and on April 25, you might think your scanner was not working because it didn’t report anything. Likewise if you sampled when a smaller amount of vulnerabilities were reported, you might think things were great all of the time.

Vuln-trend-OK-not-OK

Last, consider this report on the trend of vulnerable web browsers for a major university:

Univ

This graph comes from the Passive Vulnerability Scanner (PVS) and shows just how chaotic tracking vulnerabilities can be. This particular graph is of any vulnerable web browser that can be observed by the PVS. Since the PVS works in real time with continuous monitoring, the graph has many trend lines related to vulnerabilities in various web browsers.

Conclusion

When reporting on vulnerabilities within a compliance framework, be sure to provide the information asked for. Otherwise, the information you do provide may be misleading or even alarming.

We’ve blogged several times about reporting on vulnerabilities in the past. These following links list several popular topics.

Related Posts

Subscribe to the Tenable Blog

Subscribe
Try for Free Buy Now

Try Tenable.io

FREE FOR 30 DAYS

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Sign up now.

Buy Tenable.io

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Purchase your annual subscription today.

65 assets

$2,275

Buy Now

Try for Free Buy Now

Try Nessus Professional Free

FREE FOR 7 DAYS

Nessus® is the most comprehensive vulnerability scanner on the market today. Nessus Professional will help automate the vulnerability scanning process, save time in your compliance cycles and allow you to engage your IT team.

Buy Nessus Professional

Nessus® is the most comprehensive vulnerability scanner on the market today. Nessus Professional will help automate the vulnerability scanning process, save time in your compliance cycles and allow you to engage your IT team.

Buy a multi-year license and save. Add Advanced Support for access to phone, email, community and chat support 24 hours a day, 365 days a year. Full details here.

Try for Free Buy Now

Try Tenable.io Web Application Scanning

FREE FOR 30 DAYS

Enjoy full access to our latest web application scanning offering designed for modern applications as part of the Tenable.io platform. Safely scan your entire online portfolio for vulnerabilities with a high degree of accuracy without heavy manual effort or disruption to critical web applications. Sign up now.

Buy Tenable.io Web Application Scanning

Enjoy full access to a modern, cloud-based vulnerability management platform that enables you to see and track all of your assets with unmatched accuracy. Purchase your annual subscription today.

5 FQDNs

$3,578

Buy Now

Try for Free Contact Sales

Try Tenable.io Container Security

FREE FOR 30 DAYS

Enjoy full access to the only container security offering integrated into a vulnerability management platform. Monitor container images for vulnerabilities, malware and policy violations. Integrate with continuous integration and continuous deployment (CI/CD) systems to support DevOps practices, strengthen security and support enterprise policy compliance.

Buy Tenable.io Container Security

Tenable.io Container Security seamlessly and securely enables DevOps processes by providing visibility into the security of container images – including vulnerabilities, malware and policy violations – through integration with the build process.

Learn More about Industrial Security

Get a Demo of Tenable.sc

Please fill out the form below with your contact information and a sales representative will contact you shortly to schedule a demo. You may also include a short comment (limited to 255 characters). Please note that fields with asterisks (*) are mandatory.

Try for Free Contact Sales

Try Tenable Lumin

FREE FOR 30 DAYS

Visualize and explore your Cyber Exposure, track risk reduction over time and benchmark against your peers with Tenable Lumin.

Buy Tenable Lumin

Contact a Sales Representative to see how Lumin can help you gain insight across your entire organization and manage cyber risk.