AWS Storage Gateway Monitoring Integration
AWS Storage Gateway service seamlessly provides a secure integration between an organization's on-premises applications and the AWS cloud. AWS Storage Gateway comes in three different types, as a File Gateway, Volume Gateway, and a Tape Gateway, each designed to suit specific needs and requirements.
With Site24x7's integration, you can now easily monitor the storage gateway service at File Gateway, Volume Gateway, and a Tape Gateway level.
Setup and configuration
1. If you haven't already, enable access to your AWS resources between your AWS account and Site24x7's AWS account by either:
- Creating Site24x7 as an IAM user.
- Creating a cross-account IAM role. Learn more
2. On the Integrate AWS Account page, check the appropriate box for AWS Storage Gateway to monitor. We offer you with 3 different monitors; Storage Gateway, Storage Gateway File Share, and Storage Gateway Volume to choose from. Learn more
Policy and permissions
Site24x7 uses various AWS Storage Gateway APIs to collect information about your storage gateway. Assign the AWS managed policy ReadOnlyAccess to the Site24x7 entity (IAM user or IAM role) to help Site24x7 collect metrics and metadata. If you want to assign a custom policy, please make sure the following read-level actions are present in the policy JSON. Learn more
- "storagegateway:DescribeGatewayInformation",
- "storagegateway:ListGateways",
- "storagegateway:ListTagsForResource",
- "storagegateway:ListTapes",
- "storagegateway:ListFileShares",
- "storagegateway:ListVolumes",
- "storagegateway:DescribeAvailabilityMonitorTest",
- "storagegateway:DescribeBandwidthRateLimit",
- "storagegateway:DescribeCache",
- "storagegateway:DescribeCachediSCSIVolumes",
- "storagegateway:DescribeNFSFileShares",
- "storagegateway:DescribeSMBFileShares",
- "storagegateway:DescribeStorediSCSIVolumes",
- "storagegateway:DescribeTapeArchives",
- "storagegateway:DescribeTapes",
- "storagegateway:DescribeUploadBuffer",
- "storagegateway:ListLocalDisks",
- "storagegateway:DescribeVTLDevices",
- "logs:DescribeLogStreams",
- "logs:GetLogEvents"
Polling Frequency
Site24x7 queries AWS to collect Storage Gateway performance metrics according to the configured poll frequency. The minimum poll interval supported is one minute and the maximum is 24 hours. Learn more
Storage Gateway Performace Metrics
| Attribute | Description | Statistic | Data Type |
|---|---|---|---|
| Cache Hit Percent | Percent of application reads served from the cache. The sample is taken at the end of the reporting period. | Average | Percentage |
| Upload Buffer Percent Used | Percent use of the gateway's upload buffer. The sample is taken at the end of the reporting period. | Average | Percentage |
| Upload Buffer Used | The total number of bytes being used in the gateway's upload buffer. The sample is taken at the end of the reporting period. | Average | MB |
| Cache Used | The total number of bytes being used in the gateway's cache storage. The sample is taken at the end of the reporting period. | Average | MB |
| Queued Writes | The number of bytes waiting to be written to AWS, sampled at the end of the reporting period for all volumes in the gateway. These bytes are kept in your gateway's working storage. | Sum | MB |
| Read Bytes | The total number of bytes read from your on-premises applications. | Sum,Sample count | MB |
| Read Time | The total number of milliseconds spent to do read operations from your on-premises applications. | Average | Milliseconds |
| Total Cache Size | The total size of the cache in bytes. The sample is taken at the end of the reporting period. | Average | MB |
| Write Bytes | The total number of bytes written to your on-premises applications. | Sum,Sample count | MB |
| Write Time | The total number of milliseconds spent to do write operations from your on-premises applications. | Sum | Milliseconds |
| Time Since Last Recovery Point | The time since the last available recovery point. | Sum | Seconds |
| Working Storage Free | The total amount of unused space in the gateway's working storage. The sample is taken at the end of the reporting period. | Sum | MB |
| Working Storage Percent Used | Percent use of the gateway's upload buffer. The sample is taken at the end of the reporting period. | Sum | Percent |
| Working Storage Used | The total number of bytes being used in the gateway's upload buffer. The sample is taken at the end of the reporting period. | Sum | MB |
| Index Evictions | The number of files whose metadata was evicted from the cached index of file metadata to make room for new entries. The gateway maintains this metadata index, which is populated from the AWS Cloud on demand. | Sum,Sample count, Average | Number |
| Index Fetches | The number of files for which metadata was fetched. The gateway maintains a cached index of file metadata, which is populated from the AWS Cloud on demand. | Sum,Sample count, Average | Number |
| Cloud Bytes Downloaded | The total number of bytes that the gateway downloaded from AWS during the reporting period. | Sum | MB |
| Cloud Bytes Uploaded | The total number of bytes that the gateway uploaded to AWS during the reporting period. | Sum | MB |
| Cloud Download Latency | The latency while downloading bytes from the cloud. | Maximum | Milliseconds |
| Cache Percent Dirty | The volume's contribution to the overall percentage of the gateway's cache that isn't persisted to AWS. The sample is taken at the end of the reporting period. | Average | Percent |
| Cache Free | The amount of cache that is not used. | Average | MB |
| Upload Buffer Free | The amount of upload buffer that is not used. | Average | MB |
| User CPU Percent | Percent of CPU time spent on gateway processing, averaged across all cores. | Average | Percent |
| IO Wait Percent | Percent of time that the gateway is waiting on a response from the local disk. | Average | Percent |
| Mem Total Bytes | Amount of RAM provisioned to the gateway VM, in bytes. | Average | MB |
| Mem Used Bytes | Amount of RAM currently in use by the gateway VM, in bytes. | Average | MB |
| Availabilty Notifications | Number of availability-related health notifications generated by the gateway. | Sum | Number |
| Health Notifications | The number of health notifications. | Sum | Number |
| SmbV1 Sessions | The number of Server Message Block (SMB) version 1 sessions that are active on the gateway. | Sum | Number |
| SmbV2 Sessions | The number of Server Message Block (SMB) version 2 sessions that are active on the gateway. | Sum | Number |
| SmbV3 Sessions | The number of Server Message Block (SMB) version 3 sessions that are active on the gateway. | Sum | Number |
Storage Gateway File Share Metrics
| Attribute | Description | Statistic | Data Type |
|---|---|---|---|
| Cache Hit Percent | Percent of application read operations from the file shares that are served from cache. The sample is taken at the end of the reporting period. | Sum | Percent |
| Read Bytes | The total number of bytes read from your on-premises applications in the reporting period for a file share. | Sum,Sample Count | MB |
| Write Bytes | The total number of bytes written to your on-premises applications in the reporting period. | Average | Percentage |
| Cloud Bytes Uploaded | The total number of bytes that the gateway uploaded to AWS during the reporting period. | Sum | MB |
| Cloud Bytes Downloaded | The total number of bytes that the gateway downloaded from AWS during the reporting period. | Sum | Bytes |
| Index Fetches | The number of files for which metadata was fetched. The gateway maintains a cached index of file metadata, which is populated from the AWS Cloud on demand. | Sum | Number |
| Cache Percent Used | The file share's contribution to the overall percent use of the gateway's cache storage. The sample is taken at the end of the reporting period. | Average | Percent |
| Cache Percent Dirty | The file share's contribution to the overall percentage of the gateway's cache that has not been persisted to AWS. The sample is taken at the end of the reporting period. | Sum | Percent |
Storage Gateway Volume Metrics
| Attribute | Description | Statistic | Data Type |
|---|---|---|---|
| Cache Hit Percent | Percent of application read operations from the volume that are served from cache. The sample is taken at the end of the reporting period. | Average | Percent |
| Cache Percent Dirty | The volume's contribution to the overall percentage of the gateway's cache that isn't persisted to AWS. The sample is taken at the end of the reporting period. | Average | Percent |
| Cache Percent Used | The volume's contribution to the overall percent use of the gateway's cache storage. The sample is taken at the end of the reporting period. | Average | Percent |
| Client Traffic | The number of bytes that the tape sent and received from on-premises clients. That is, the total amount of ReadBytes and WriteBytes from client applications. | Sum | MB |
| Cloud Traffic | The number of bytes uploaded and downloaded from the cloud to the volume. | Sum | MB |
| CPU Usage | The percentage of allocated CPU compute units that are currently used by the volume. | Average | Percent |
| Health Notification Count | The number of health notifications sent by the volume. | Sum | Count |
| Memory Usage | The percentage of allocated memory that is currently used by the volume. | Average | Percent |
| Read Bytes | The total number of bytes read from your on-premises applications in the reporting period. | Sum,Sample count | MB |
| Read Time | The total number of milliseconds spent on read operations from your on-premises applications in the reporting period. | Average | Milliseconds |
| Write Bytes | The total number of milliseconds spent on read operations from your on-premises applications in the reporting period. | Sum,Sample count | MB |
| Write Time | The total number of milliseconds spent on write operations from your on-premises applications in the reporting period. | Average | Milliseconds |
| Queued Writes | The number of bytes waiting to be written to AWS, sampled at the end of the reporting period. | Sum | MB |
Forecast
Estimate future values of the following performance metrics and make informed decisions about adding capacity or scaling your AWS infrastructure.
- Cache Hit Percent
- Upload Buffer Percent Used
- Working Storage Percent Used
- User CPU Percent
- IO Wait Percent
- Cache Percent Dirty
- Cache Percent Used
Site24x7's Storage Gateway monitoring interface
Summary
Gain an overview of different events occurring within each resource with time series charts. This section provides you with operational details on read bytes per second, write bytes per second, cloud download bytes per second, cloud upload bytes per second, and many more metrics.
Configuration
The configuration details of a storage gateway are provided under this tab. Details on the storage gateway, like the name, ID, time zone, and type of gateway are provided in this section.
Monitored Resources
On the Monitored Resources tab, you can view a list of file shares, volumes, and names of the resources associated with your storage gateway environment. Click on an individual listing to see performance and resource usage stats associated with that resource. You can also set thresholds and be notified when any of these services fail by clicking the pencil icon under Action.
Tapes
The tapes section will be available only for Tape Gateway. In this section you get a consolidated view of the tape barcode, type of tape, its size, status and created date.
VTL Device
The VTL Device tab will be available only for Tape Gateway. Here, a list of Tape device ID, VTL Device name, VTL device type, target name, and port will be displayed.
Recent Logs
Here, you can view the audit log data of a storage gateway along with the timestamp, published by CloudWatch logs.