Is there parity for aws s3 sync?

[csuhta]

The AWS CLI has the the amazing aws s3 sync command which I use frequently. It's super fast because in some cases it only copies the delta between the buckets.

There doesn't seem to be a similar way to invoke that API from this library. Is it here and I'm just missing it?

[trevorrowe]

The aws-sdk gem does not provide this functionality. As far as I know, none of the AWS SDKs, except the CLI have a filesystem to S3 sync function.

[jufemaiz]

:(

[davidcpell]

As far as I know, none of the AWS SDKs, except the CLI have a filesystem to S3 sync function.

Hi, just wanted to stop by and add my :( to this. Sync functionality has been available in the PHP SDK since 2013. The Java SDK also has this/something similar.

[shaunakv1]

Same here.. just stopping by again to add my :(

This is a really useful feature to have in sdk, so we don't have to install cli dependency on hosting, and our background jobs can run purely on gem dependency.

Adding this feature will make it whole lot easier to do PaaS deployments on system like Heroku.

[pparamalingam]

Bumping for 2019. Any chance of having this function added to the Ruby SDK?

[george-viaud]

Looking for SDK equivalent SDK method for aws s3 sync [SOURCE] s3://[BUCKET]/[KEYPREFIX] --exact-timestamps

Does this exist?

[mullermp]

Reopening as a feature request. Happy to take an PRs.

[krysgian]

Need the ability to run:
aws s3 sync s3://accountOne/sourceBucket/etc s3://accountTwo/targetBucket/etc --delete --include="*"

Using the API, you can create a TransferManager object, but it assumes a single S3 AWS connection. An API change would hopefully accommodate this use case.

[sudodevnull]

Any update on this?

[VitalyTarasiu]

We are in 2021, any updates?

[aymenbuu]

^ @VitalyTarasiu I can second this. We are in 2021.

Still waiting for this feature to drop :(

[dig12345]

+1

[ghost]

Just do the loop yourself, the SDK only contains the actual API calls, not some utility that goes on top.
It's not very hard. CS102, recurse through directories.

[shaunakv1]

@pviet-cohere it's not "just a loop". May be read up on the documentation for the original utility?

https://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

[JVerma205]

Hi guys, I also am looking for SDK equivalent of CLI aws sync; I found this really helpful article that served my purpose. The code is easy to run as well.
https://blog.bitsrc.io/a-practical-guide-to-building-a-node-js-service-on-an-aws-s3-bucket-aff19105ba83

Nevertheless, I do request aws-sdk to include the sync feature to standardize the algo.

[midnight-wonderer]

I know my comment will be unpopular; I braced for ☹️.
But, what's wrong with installing the AWS CLI? If you don't want it on the host, you can also install it inside a container.

I personally will choose neither SDK nor CLI for sync. Because, IMO, there is an economy behind software.
Old programmers are starting to die, literally; software, although still young on average, can live much longer than humans.
We are heading in the direction where there are not enough humans to maintain software; we are outnumbered.
If not enough people are using it, it is potentially not viable.

You'll get better priority, support, and maintenance by switching to something more specific, like Rclone.
And posix-spawn isn't too much of a pain, is it?

Anyway, it seems the AWS team is still open for the PR; if you really want this, you should go for it.