Sure! Here’s the translated text into American English:
AWS has announced the general availability of Amazon S3 Metadata, an innovative solution that promises to transform the way organizations manage, discover, and analyze data stored in Amazon S3. This new feature offers automated and queryable metadata that is updated in near real-time, facilitating business analytics, real-time inference, and many other applications.
What is Amazon S3 Metadata?
Amazon S3 Metadata allows for the automatic capture and querying of metadata from objects stored in S3. The metadata includes system-defined details, such as the object size and its origin, as well as user-defined custom metadata, like tags related to product SKUs, transaction IDs, or content ratings.
The metadata is stored in Amazon S3 Tables, an optimized storage format for tabular data that enables fast and efficient queries. Additionally, these tables are integrated with analytical tools like Amazon Athena, Amazon QuickSight, and Amazon Redshift, allowing for direct access and visualization of the S3 Metadata data.
Key Features
- Real-time metadata: Data is automatically updated within minutes when objects are added, deleted, or modified in an S3 bucket.
- Enhanced analytical capabilities: Metadata can be used for advanced queries via tools like AWS Glue Data Catalog, facilitating integration with analytical and machine learning systems.
- Integration with Amazon Bedrock: Allows for annotating AI-generated content with key information, such as the model that generated it, the timestamp, and its origin.
- Advanced queries: Users can perform complex queries using tools compatible with Apache Iceberg to quickly identify objects of interest in large S3 buckets.
How It Works
Enabling S3 Metadata is simple:
- Initial setup: Users create an S3 table bucket to store metadata and configure data buckets to capture this information.
- Real-time updates: Each update generates a new row in the table, making it easy to track historical changes of an object.
- Queries with analytical tools: Users can use Amazon Athena or Apache Spark to perform quick queries on the captured metadata.
Use Cases
- Business analytics: Efficiently identify trends in data, optimizing business processes.
- Machine learning applications: Use metadata to train AI models and run more accurate inferences.
- Managing large volumes of data: Locate specific objects in buckets containing billions of files without the need for complex additional systems.
- Data quality monitoring: Ensure data integrity and consistency by tracking real-time changes.
Availability and Pricing
S3 Metadata is available in the AWS regions of US East (N. Virginia and Ohio) and US West (Oregon). The feature is priced based on the number of updates made to objects (creates, deletes, and modifies) and the storage of the metadata table. For more information, please see the S3 pricing page.
Conclusion
Amazon S3 Metadata represents a significant step in the evolution of cloud storage, providing an efficient and automated solution for metadata management. With this feature, AWS not only simplifies data analytics but also empowers organizations to make faster and more informed decisions in an increasingly data-driven environment.
via: Amazon news