AWS S3
S3
Amazon Simple Storage Service (S3) is a cloud storage service offered by Amazon Web Services (AWS) that provides object storage through a web service interface. It’s designed for storing and retrieving large amounts of data from anywhere on the web, offering scalability, availability, security and performance.
Benefits
Turn cloud storage into orchestrated infrastructure
Add scheduling, monitoring and process control to your Amazon S3 environment — on AWS or OCI.
Control buckets
Create, update or delete S3 buckets programmatically.
Move data
Copy, rename or transfer objects with event-driven orchestration.
Enforce policies
Apply advanced scheduling logic, permissions and encryption.
Centralized S3 job automation
The Tidal adapter for S3 enables centralized management of S3 job scheduling. With this integration, you can seamlessly manage S3 storage buckets and objects in end-to-end enterprise processes. Whether you’re organizing data, applying permissions or moving files, Tidal helps you schedule and manage S3 jobs with precision.
This API-level integration uses the AWS SDK and supports both AWS and Oracle Cloud Infrastructure (OCI) S3-compatible storage. It runs platform-independently wherever the Tidal Master is deployed.
What the adapter enables
Manage cloud storage with the same level of control as other enterprise systems, using the following functionality:
- Connection/availability: Report connectivity status.
- Data organization: Create a bucket, move/copy/rename/restore objects from one bucket to another or within the same bucket.
- Data protection: Specify server-side encryption while uploading/downloading objects to and from the S3 bucket service.
- Data security: Configure ACL permission to a bucket or object.
- Data storage and retrieval: Integrate with a Data Mover job to upload/download objects.
- Data storage cleanup: Delete objects and buckets to free up space.
- Event-based scheduling: Trigger actions in your schedule based on an S3 event.
How it works
The Tidal adapter uses the AWS SDK to interact with Amazon S3 via its APIs. Tidal can read and write data objects, create and delete buckets, configure metadata, encryption and permissions, monitor object availability, trigger downstream tasks and update bucket and object properties during runtime.
With native support for S3 storage and lifecycle management, Tidal transforms your object storage into an integrated part of your automation fabric.
More Tidal integrations
Stay efficient and innovative
Use Tidal to build your automation fabric.
Tidal and Amazon S3 integration FAQs
-
What does S3 mean?
S3 is an acronym for Amazon’s Simple Storage Service. The Tidal by Redwood adapter for Amazon S3 enables users to manage S3 storage buckets and objects in larger enterprise processes. This integration allows for centralized scheduling of S3 jobs, including data storage and retrieval, and provides functionalities for managing S3 objects, like creating buckets.
-
What is AWS S3 used for?
Amazon S3 is a cloud storage service that stores data as objects within "buckets," offering scalability, security and low-cost storage. It's used for various applications, including storing and retrieving data from anywhere on the web, hosting websites, archiving, data backups and supporting data lakes.
-
What's the difference between S3 and EC2?
Amazon Simple Storage Service (S3) and Elastic Compute Cloud (EC2) are both core services in the AWS ecosystem, but they serve distinct purposes. S3 is primarily a storage service for storing data objects, while EC2 provides compute capacity for running applications and services.