Skip to content

Releases: EMCECS/ecs-sync

v3.5.5

30 Sep 06:26
4fbfe84

Choose a tag to compare

  • ECS Sync UI Security Enhancement:
    • Implemented security headers in server-side response configuration.
    • Introduced account lockout mechanism: users are locked for 5 minutes after 5 consecutive failed login attempts.
    • Avoided reuse of Session ID/token
    • Implemented session timeout.
File Checksum (SHA-512)
ecs-sync-3.5.5.zip 3bfd0eae0bd57fddd80802301b30e73702d3973bd7cf494ccf8455e19b9b881e5c9efbdfe864e6657559cb4aebb284ec9ec63bbebe6f4003b4fb032e6d2ce22c
ecs-sync-ui-3.5.5.jar 56791a41950328ca153f793777dcac5a7127eb385bc145953300b507fadbb25cdfd4d365427fbf91dfb44c3158804e4231f4e9725ed4e103a424f6230972ba85

v3.5.4

14 Mar 14:16

Choose a tag to compare

  • Added OS configuration script for SLES and RHEL.
    • For installation on SLES 12 or later, use the script ova/configure-sles.sh.
    • For installation on RHEL 8 or later, use the script ova/configure-rhel.sh.
  • Added support of Remote Copy when MPU is enabled.
  • Fixed a bug where Sync Job could enter an infinite loop due to a race condition when paused.
  • Fixed a bug where amazonaws.com could not connect using ECS S3 plugin because virtual-hosted style could not be enabled by the Enable V Hosts option.
  • Minor bug fixes.
  • Minor dependency version updates.
File Checksum (SHA-512)
ecs-sync-3.5.4.zip ef82accb06249e3876ef8b22a76a5bb1af179f5554e2f07a4e9b4c4b0c90e7e64fceb8100fc5f7464d2c613faa3c9ee8f8879398b7291bd581dd9f0cdbb72e80
ecs-sync-ui-3.5.4.jar cbc94eff148cc582772e1eef2c06821cbde7bd7e1c3c83b00f212fc0ef03c152b02c813a5f6fbd9cbb75f3bef55c3fd0869e117867fe00d3415eb007a6f9f737

ecs-sync 3.5.3

29 Jun 10:56

Choose a tag to compare

  • Added support to migrate S3 Object Lock Retention to ECS S3 buckets.
    • ECS Classic Retention will be converted to S3 Object Lock Retention with configurable default Retention Mode.
    • Object Lock Retention is not supported to convert back to ECS Classic Retention.
  • ECS Infinite Retention is now supported to migrate between ECS S3 buckets.
  • Minor dependency version updates.
File Checksum (SHA-512)
ecs-sync-3.5.3.zip e28b3fa721e5e6d4762e44c9ec92cf3a66e7b5215cc31e1985834a6fa636271c3918a5b8aa0e67067562aac1dc3ab6d4111a054d07641379d009e16abf07d6c7
ecs-sync-ui-3.5.3.jar 916f8e72faeaf07bc6eeb216dfcfbe2b510eeb1af8f1b66eb0fb952960cdf250646c7430958ed85a465d059fb5b3a13c4201fab34478b09427b2bea6fb6a4e38

ecs-sync 3.5.2

03 Oct 15:30

Choose a tag to compare

  • Note: the lifecycle of a storage plugin instance is within a single job
    • After that job completes, the storage plugin is close()d and can no longer be used
    • This was not previously enforced, which allowed calling code to abuse this contract by reusing plugins
    • Now it is strictly enforced - if you try to reuse plugins, they will fail
  • Fixed throttle enforcement with S3 MPU
  • Fixed bug where DB connections were not closed properly after a job completes
    • Could lead to DB connection leak / exhaustion
  • Fixed forceSync option when used with database
  • Minor bug fixes
  • Minor dependency version updates
File Checksum (SHA-512)
ecs-sync-3.5.2.zip fc96bb8ec3696c2639f508cefc8ba7bd9676689805e1f3bbb09aa85317f0dc0495885123d633947866b98d018f3ff83ef03b0902ea080865ed3f8f2da111de20
ecs-sync-ui-3.5.2.jar fc630128b83247ac3763d436f9eca27ed2da77a8143f91ab30b0ca82cb51bfffdaa4be31060064da56ba9ac8c63caf02b5c229e6fceaaf5c17183173c7fbd7f8

ecs-sync 3.5.1

08 Aug 04:09

Choose a tag to compare

  • Many dependency version updates, including:
    • Gradle 7.4.2
    • Grails 5.2.1
    • Spring 5.3.22
  • Build: Dependency versions for all modules are now specified in platform/build.gradle
  • Packaging: New option to exclude plugins from a manually built package - only include the plugins you need:
    • -Pfilter.excludes="cas-extractors,cifs-ecs-ingester"
    • -Pstorage.excludes="cas,nfs"
    • works for both the distribution zip and the UI jar (more info in readme.txt)
  • Options: New job-level throttles for objects-per-second and bytes-per-second
    • SyncOptions.throughputLimit and SyncOptions.bandwidthLimit
  • S3: New option for endpoint TLS cert
    • you can provide the base64-encoded server (or CA) cert directly in the job config without modifying the JVM keystore
  • S3: MPU transfers now use a shared thread pool, sized the same as the main sync thread pool, making them more efficient
  • S3: New option to "pause" MPUs (leave existing parts) when a sync job is terminated early by a command (mpuResumeEnabled)
    • MPUs will resume if the same batch of objects is copied again
  • S3: New option to enable SSE-S3 for all writes to the target bucket
  • New PathMappingFilter - maps paths between source and target based on CSV, metadata value, or regex
  • New OperationListener for EcsSync instances (when used as a library)
    • register a listener and receive events for all operations executed against a storage system
    • currently only supported in S3 plugins
File Checksum (SHA-512)
ecs-sync-3.5.1.zip c731ef2087637810ea1cc776e43516708f91905df1e0d7136aba3a97af73b8684b69defb14c9cee3704ca12ddadb1fcebab6db73a15fca938affe31551810eb2
ecs-sync-ui-3.5.1.jar 54a8a8a8e33ef10b2d97d6463a3a7c6ea80db0e1b0db1a7ee4161fe39c4267e8321fc611e5d2a0d949169a8de2f8c6739afea66586aecb2599e85a2ef8728862

ecs-sync 3.5.0

31 Jan 20:09

Choose a tag to compare

  • Major refactor of code repository
    • The model, core logic, CLI, and All plugins are now separate publishable components
  • Updated versions of many (most) dependencies, including:
    • Gradle 6.9.1
    • Grails 4.0.6
    • Log4j 2.17.1
      • Note: previous versions use Log4j 1.2, which is not impacted by CVE-2021-44228
    • Spring 5.3.10
  • New useMetadataChecksumForVerification option uses storage system checksum for verification instead of reading back data from the target
    • Currently, only S3 plugins support this (via ETag) - other plugins will fall back to reading back the data
  • Added sourceList option to directly insert object lists into job configs (intended for micro-batching)
    • Supports CSV lines so it can be used with multiple plugins
    • Note this is a CDATA element in XML
  • Sensitive info (like passwords, secret keys) are now scrubbed in the logs

Checksum values (SHA-512):

  • ecs-sync-3.5.0.zip (541e8e4bd50ce0e20ffccd1bc4ac01448b6f1e4c9282091e9dfe6b27d1e4eef4770d603653af95f315d533e232d5a7f7d68599c698c2acf91e1de1d2d2ae8ed8)
  • ecs-sync-ui-3.5.0.jar (fbf274b755704d681729d42c3564cb62f7e33bb70a0d56d8e72c3c07b0ceeb79fe95cdf6068ef98cc71bb3ab006f44162c4aaaf6bf3126180a08ee4c41c39775)

ecs-sync 3.4.2

06 Jul 16:34

Choose a tag to compare

  • Added an option for the following additional "extended" fields in the status DB (these are not enabled by default):
    • Source MD5
      • This was removed from the default status tracking table
    • Source Retention End-time
    • Target Modification Time
    • Target MD5
    • Target Retention End-time
    • First Error Seen
      • Only the very first error seen for an object will be recorded and never touched after that
  • Corrected syncRetention behavior for ECS S3 to apply remaining retention periods to copied objects
    • Prior versions would reset object-level retention periods to their original duration
    • NOTE: migrating infinite retention is not supported
  • Client timeouts are now disabled by default for ECS S3
  • Fixed sourceListFileRawValues option so it does not parse as CSV (allowing for commas in raw identifiers)
    • Also fixed a bug where a hash (#) in a quoted value would truncate the entire CSV line

ecs-sync 3.4.1 (DEPRECATED - use 3.4.2 or above)

05 May 19:16

Choose a tag to compare

  • Enhancements to support in-line virus scanning (via shell script)

DEPRECATED

  • This version has an issue when syncing retention using the ECS S3 plugin - please use v3.4.2 or above

ecs-sync 3.4.0 (DEPRECATED - use 3.4.2 or above)

16 Nov 07:34

Choose a tag to compare

  • New Azure blob storage plugin (read-only)
  • STS and alternative credential support in AWS S3 plugin (many thanks to @theronl)
  • Raw values option for source list file (allows for leading/trailing spaces in object names)
  • Fixed some signature errors in ECS S3 plugin with plus (+) and double-slash (//) object names

DEPRECATED

  • This version has an issue when syncing retention using the ECS S3 plugin - please use v3.4.2 or above

ecs-sync 3.3.1 (DEPRECATED - use 3.4.2 or above)

20 May 16:14

Choose a tag to compare

  • Fixed errors in UI when job names contain spaces
  • Fixed large object (MPU) write failures in AWS S3 plugin
  • Added support for syncing object-level retention in ECS S3
  • Upgraded gradle to 4.10.3

DEPRECATED

  • This version has an issue when syncing retention using the ECS S3 plugin - please use v3.4.2 or above