Google Cloud Storage Intelligence Advisor Is GA, With 24-Hour Anomaly Findings and Batch Jobs Across 1,000 Buckets

retained text

Google Cloud has made its Storage Intelligence advisor generally available and expanded batch operations for Google Cloud Storage. The advisor monitors storage environments for operational anomalies, while the enhanced batch engine applies policy changes to up to 1,000 buckets per project in a single managed job. Both features are now available to all Storage Intelligence subscribers.
Automated Anomaly Detection and Baseline Analytics
Storage Intelligence advisor eliminates the need for manual inventory extraction and custom log-joining pipelines by generating findings directly from daily usage snapshots and project activity baselines. Google says the advisor flags Class A or Class B request spikes on the Coldline and Archive tiers, detects surging 429 rate-limit errors, catches cross-region egress spikes, and reports aggregate consumption that runs above long-term trends within 24 hours. The vendor reports that over 6,000 findings were generated across hundreds of customer environments during the last 30 days.
When access deviations occur, the advisor links anomalies directly to the responsible bucket, prefix, and service account. For unexpected read volumes against cold data tiers, the platform outlines specific remediation paths: bulk-transitioning objects to Standard storage to eliminate retrieval fees, enabling Autoclass for automated access-based tiering, or applying Managed Folders to restrict unauthorized service accounts. Charley King, DataOps-DevOps Engineer at Shipt, a Target subsidiary, said: “Before Storage Intelligence advisor, tracking critical usage metrics and catching anomalies required heavy engineering and complex data pipelines. Now, with native, out-of-the-box dashboards, we can instantly identify usage spikes and drill down into the details. Having the visibility to immediately remediate unintended usage, without any configuration, has turned what used to be a major effort into a simple, self-service task.”
Serverless Batch Remediation Across Multi-Bucket Environments
Remediation operates through a serverless, managed execution engine that handles throttling, retries, and progress tracking across billions of objects. The vendor’s enhanced batch engine expands processing boundaries, allowing a single job submission to span up to 1,000 buckets per project rather than requiring sequential, per-bucket passes. Kurtis Nusbaum, Senior Principal Software Engineer at Palo Alto Networks, said: “Object retention locks were essential for our security guardrails, but managing them across billions of objects was once a non-starter. Storage Intelligence changed that. Today, our team uses storage batch operations to seamlessly update retention policies on demand across our entire fleet.” Google positions the pairing around three jobs: bulk-transitioning high-traffic Archive or Coldline objects to Standard as soon as a spike is detected, mass-deleting stale or temporary data under specific prefixes when growth runs above trend, and applying metadata, tagging, retention, or encryption changes uniformly across large object sets with no compute to provision.
Administrators can validate mass updates through a native dry-run simulation mode before altering production data. The dry-run execution reports affected object counts, aggregate capacity, and potential failure points. Targeting relies on Common Expression Language (CEL) queries evaluated against Storage Insights datasets, allowing administrators to filter target scopes by storage class, object size, creation date, or custom metadata tags.
Here is a CLI example that illustrates how to create a batch operations job using advanced filters. This job deletes all temporary objects in the Standard storage class from a user’s “analytics” buckets.
gcloud storage batch-operations jobs create bulk-delete-temp-objects \
    --description="Bulk delete temporary objects in analytics buckets" \
    --target-project="my-project-id" \
    --insights-dataset-config="projects/my-project-id/locations/us-central1/datasetConfigs/my-dataset" \
    --bucket-filters="name.startsWith('analytics-')" \
    --object-filters="storageClass == 'STANDARD' && name.endsWith('.temp')" \
    --delete-object
Feature Availability and Specifications
The advisor and batch tooling are packaged together under the Storage Intelligence subscription, and both are generally available now. Enabling Storage Intelligence on an organization, folder, or project turns the advisor on for every bucket in that scope with no schema, pipeline, or dashboard to build. Google says the number of customers using Storage Intelligence to analyze datasets of more than 1 billion objects has more than doubled this year, and first-time users get a 30-day trial at no cost.

document fetched 2026-09-30 03:00 · canonical https://storagereview.com/news/google-cloud-storage-intelligence-advisor-ga-24-hour-anomaly-findings-batch-jobs-1000-buckets