US Platform 2: Performance Degradation in CS, PM, IOC, and FIM (IM-4149)
Incident Report for Qualys, Inc.
Resolved
This incident has been resolved.
Posted Aug 07, 2020 - 06:12 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers.

Patch Management (PM): Qualys Cloud Platform Operations is implementing a fix for issues causing a delay in the PM module.
The events for activating/deactivating/uninstalling cloud agents will get processed in the PM module with a delay.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 06, 2020 - 03:44 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images.

Patch Management (PM): Qualys Cloud Platform Operations is implementing a fix for issue causing a delay in PM module.
The events for activating/deactivating/uninstalling cloud agents will get processed in the PM module with a delay.

CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 05, 2020 - 17:33 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM): Qualys Cloud Platform Operations is implementing a fix for issue causing delay in PM module.
The events for activating/deactivating/uninstalling cloud agents will get processed in the PM module with a delay.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 05, 2020 - 00:05 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM) issues have been resolved.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 04, 2020 - 22:08 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM): Users may experience below issues:
1. User may not be able to view old assessment profiles on PM UI
2. Users may not be able to perform create, update and delete operation on older patch jobs

CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 04, 2020 - 17:43 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM): Users may experience below issues:
1. User may not be able to view old assessment profiles on PM UI
2. Users may not be able to perform create, update and delete operation on older patch jobs

CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 04, 2020 - 00:54 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM) issues have been resolved.
CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 03, 2020 - 18:29 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM) issues have been resolved.
CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.
Posted Aug 03, 2020 - 10:53 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM) issues have been resolved.
CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 03, 2020 - 02:05 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images and a delay in container/image inventory information from Cloud Agent and Remote Scans being available in the Host tab.

Patch Management (PM) issues have been resolved.
CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Aug 02, 2020 - 00:24 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in scan processing for containers and images.

Patch Management (PM) issues have been resolved.
CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Jul 31, 2020 - 17:35 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience the following issues:
1. A delay in scan processing for containers and images.
2. A delay in container/image inventory information from Cloud Agent and Remote Scans becoming available in the Host tab.

Patch Management (PM) issues have been resolved.
CertView (CERT) issues have been resolved.
Indication of Compromise (IOC) issues have been resolved.
File Integrity Monitoring (FIM) issues have been resolved.

Further updates will be shared as they become available.
Posted Jul 31, 2020 - 13:44 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in container and image scanning and delay in processing for container/docker images from Cloud Agent hosts.
Patch Management (PM) issues have been resolved.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM) issues have been resolved. Further updates will be shared as they become available.
Posted Jul 31, 2020 - 02:14 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in processing for container/docker images from Cloud Agent hosts.

Patch Management (PM) issues have been resolved.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM) issues have been resolved.
Posted Jul 30, 2020 - 11:25 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in processing for container/docker images from Cloud Agent hosts. The issue for the delay in Image Scanning and Sensor Provisioning has been resolved.

Patch Management (PM) issues have been resolved.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM) issues have been resolved.
Posted Jul 29, 2020 - 20:24 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in processing for container/docker images from Cloud Agent hosts. The issue for the delay in Image Scanning and Sensor Provisioning has been resolved.

Patch Management (PM) issues have been resolved.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 29, 2020 - 01:31 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in processing for container/docker images from Cloud Agent hosts. The issue for the delay in Image Scanning and Sensor Provisioning has been resolved.

Patch Management (PM): Qualys Cloud Platform Operations are making configuration changes to fix the performance issues due to which Patch Management module may not be available for the next 2 hours.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 28, 2020 - 21:59 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in processing for container/docker images from Cloud Agent hosts. The issue for the delay in Image Scanning and Sensor Provisioning has been resolved.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) issues have been resolved.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 28, 2020 - 12:30 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in processing for container/docker images from Cloud Agent hosts. The issue for the delay in Image Scanning and Sensor Provisioning has been resolved.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 28, 2020 - 01:11 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in Image Scanning and Sensor Provisioning.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 27, 2020 - 05:07 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in Image Scanning and Sensor Provisioning.

Patch Management (PM) issues have been resolved.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 27, 2020 - 01:09 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in Image Scanning and Sensor Provisioning.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 26, 2020 - 19:00 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in Image Scanning and Sensor Provisioning.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) issues have been resolved.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 25, 2020 - 21:38 PDT
Identified
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in Image Scanning and Sensor Provisioning. The issue with Vulnerability Reporting has been resolved.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) Users may experience below issues:
1. Cert View scan results may become on UI with a delay.
2. Users may experience intermittent issues while adding external sites, launching Scans or viewing Asset/Certificate details.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM): Users may experience issues on UI during asset listing and receive errors while creating Autocorrelation rules.
Posted Jul 24, 2020 - 23:29 PDT
Update
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may continue to experience a delay in Image Scanning and Sensor Provisioning. Vulnerability Reporting is impacted, Reports may need to be re-launched.

Patch Management (PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected.
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

CertView (CERT) Users may experience below issues:
1. Users may expect a delay in scan results becoming available.
2. Users may experience intermittent impact to the ability to add external sites, launch Scans or view Asset/Certificate details.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing.

File Integrity Monitoring (FIM) Users may experience issues on UI side like asset listing, getting an error while creating the autocorrelation rule.

Further updates will be shared as they become available.
Posted Jul 24, 2020 - 11:47 PDT
Investigating
Qualys Cloud Platform Operations is currently investigating an issue causing various intermittent impacts across several microservices:

Container Security (CS) Users may experience a delay in Image Scanning, Vulnerability processing, and Sensor Provisioning.

Patch Management(PM) Users may experience below issues:
1. The latest scan result will not be available on the asset tab.
2. Job result will not be populated in job progress, there may be a delay.
3. Tag changes will not be reflected
4. PM activation/deactivation may fail.
5. The latest patches may not be available on PMUI or agents may not be able to detect/deploy the latest patches.

Indication of Compromise (IOC) backend services are experiencing slow processing, Users will experience a delay in Event processing

File Integrity Monitoring (FIM) Users may experience issues on UI side like asset listing, getting an error while creating the autocorrelation rule.

Further updates will be shared as they become available.
Posted Jul 24, 2020 - 05:08 PDT
This incident affected: US Platform 2 (CertView (CERT), Container Security (CS), File Integrity Monitoring (FIM), Indication of Compromise (IOC), Patch Management (PM)).