Skip to content
This repository has been archived by the owner on Jan 3, 2023. It is now read-only.

Merge SSM Compression to trunk #1873

Merged
merged 133 commits into from
Jan 28, 2019
Merged

Merge SSM Compression to trunk #1873

merged 133 commits into from
Jan 28, 2019

Commits on Oct 30, 2017

  1. init version

    timmyyao committed Oct 30, 2017
    Configuration menu
    Copy the full SHA
    57a0591 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2017

  1. Configuration menu
    Copy the full SHA
    09e5198 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2017

  1. Configuration menu
    Copy the full SHA
    8b7a0ca View commit details
    Browse the repository at this point in the history
  2. CompressionAction

    timmyyao committed Nov 1, 2017
    Configuration menu
    Copy the full SHA
    a64c2d1 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2017

  1. Configuration menu
    Copy the full SHA
    4448237 View commit details
    Browse the repository at this point in the history
  2. UT for CompressionAction

    hadoop committed Nov 2, 2017
    Configuration menu
    Copy the full SHA
    d14c620 View commit details
    Browse the repository at this point in the history
  3. CompressionScheduler

    timmyyao committed Nov 2, 2017
    Configuration menu
    Copy the full SHA
    6dce6ac View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1abd3e8 View commit details
    Browse the repository at this point in the history
  5. init SmartDFSInputStream

    timmyyao committed Nov 2, 2017
    Configuration menu
    Copy the full SHA
    f7e1e25 View commit details
    Browse the repository at this point in the history
  6. refomat TestCompressionAction.java

    hadoop committed Nov 2, 2017
    Configuration menu
    Copy the full SHA
    87bab0f View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2017

  1. checkstyle

    timmyyao committed Nov 3, 2017
    Configuration menu
    Copy the full SHA
    ba8a96a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    43be281 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    926ea4f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0b60685 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2017

  1. Configuration menu
    Copy the full SHA
    3648e3e View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2017

  1. Configuration menu
    Copy the full SHA
    10aa7d2 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2017

  1. Configuration menu
    Copy the full SHA
    e48f002 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2017

  1. Configuration menu
    Copy the full SHA
    0c4f250 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    427333b View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2017

  1. Configuration menu
    Copy the full SHA
    2428480 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2017

  1. UT for CompressionFileDao

    ypang2017 committed Nov 15, 2017
    Configuration menu
    Copy the full SHA
    8135907 View commit details
    Browse the repository at this point in the history
  2. UT for CompressionFileDao

    ypang2017 committed Nov 15, 2017
    Configuration menu
    Copy the full SHA
    74f00f1 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2017

  1. Configuration menu
    Copy the full SHA
    afc3995 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2017

  1. Configuration menu
    Copy the full SHA
    d583084 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2017

  1. Configuration menu
    Copy the full SHA
    8c51d90 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2017

  1. Configuration menu
    Copy the full SHA
    89c4a7e View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2017

  1. Configuration menu
    Copy the full SHA
    9e14756 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    15960fc View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2017

  1. testListLocatedStatus

    timmyyao committed Dec 8, 2017
    Configuration menu
    Copy the full SHA
    f8f1b86 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2017

  1. change the tmp generated compressionfile path

    “ypang2017” committed Dec 12, 2017
    Configuration menu
    Copy the full SHA
    a381a1a View commit details
    Browse the repository at this point in the history
  2. change the TestSmartFileCompressionInfo long tpyp l to L

    “ypang2017” committed Dec 12, 2017
    Configuration menu
    Copy the full SHA
    37501d3 View commit details
    Browse the repository at this point in the history
  3. Save SmartFileCompressionInfo checkstyle change

    “ypang2017” committed Dec 12, 2017
    Configuration menu
    Copy the full SHA
    805ae6b View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2017

  1. Configuration menu
    Copy the full SHA
    1bae0be View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2017

  1. Clear unused code

    timmyyao committed Dec 26, 2017
    Configuration menu
    Copy the full SHA
    8762244 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2018

  1. Configuration menu
    Copy the full SHA
    f0dd8fb View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2018

  1. Configuration menu
    Copy the full SHA
    ab13bc4 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2018

  1. Release of v1.3.2

    PHILO-HE committed Feb 9, 2018
    Configuration menu
    Copy the full SHA
    f64823f View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2018

  1. Add trouble shooting for performance and dependencies (#1599)

    * Add more details for performance issue.
    * Add solution for dependencies on Hadoop-2.7.3.
    qiyuangong authored and littlezhou committed Mar 2, 2018
    Configuration menu
    Copy the full SHA
    51cc1f1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b75a92f View commit details
    Browse the repository at this point in the history
  3. Fix bufSize parameter in Copy2S3Action (#1600)

    * Fix bufSize usage in Copy2S3Action.
    * Reorder parameters in WriteFileAction.
    qiyuangong authored and littlezhou committed Mar 2, 2018
    Configuration menu
    Copy the full SHA
    26f7b2a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    780f06d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7d50cb8 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2018

  1. Fix typos and style problem in ssm-deployment-guide.md etc (#1597)

    Fix typos and style problem in `admin-user-guide.md`, `client-user-guide.md`, `ssm-deployment-guide.md` and `support-new-action-guide.md`. Add anchors.
    
    Thanks to @aurorahunter and @mkbhanda .
    aurorahunter authored and qiyuangong committed Mar 13, 2018
    Configuration menu
    Copy the full SHA
    463e52d View commit details
    Browse the repository at this point in the history
  2. Solve #1621, fix duplicate action issue for Copy2S3Action

    * Add TestCopy2S3Scheduler.
    * Fix Copy2S3Scheduler not registered issue in SmartConstants.
    * Enhance duplication and fileState check in Copy2S3Scheduler.
    
    Thanks @aurorahunter
    qiyuangong committed Mar 13, 2018
    Configuration menu
    Copy the full SHA
    6ccd20e View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2018

  1. Configuration menu
    Copy the full SHA
    b42eb16 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2018

  1. Trunk with compression (#1672)

    * Upate CompressionCodec to create Decompressor
    
    * add a new field compression_impl in metastore
    
    * reformat some code
    
    * update metastore in onSubmit stage
    
    * Refactor CompressionAction and CompressionScheduler for fault tolerance and optimize empty file compression
    timmyyao authored Apr 4, 2018
    Configuration menu
    Copy the full SHA
    3f1878c View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2018

  1. Configuration menu
    Copy the full SHA
    1e98834 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0dcce34 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c379d57 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2018

  1. Configuration menu
    Copy the full SHA
    fedf50f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5603db2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    63609e4 View commit details
    Browse the repository at this point in the history
  4. Update httpclient version

    littlezhou authored and qiyuangong committed May 4, 2018
    Configuration menu
    Copy the full SHA
    0e9971d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    fbadfea View commit details
    Browse the repository at this point in the history
  6. Remove aws in zeppelin

    fztfztfztfzt authored and qiyuangong committed May 4, 2018
    Configuration menu
    Copy the full SHA
    a47c3f6 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    f358b5f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    3b14dda View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    3f9fd56 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    c7a2c59 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    d28b1d1 View commit details
    Browse the repository at this point in the history
  12. Fix dispatch sync bug (#1671)

    PHILO-HE authored and qiyuangong committed May 4, 2018
    Configuration menu
    Copy the full SHA
    e9cc55c View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    dbc5d9e View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    d571dcd View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    9dfd6cb View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    859ecc3 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    a943778 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    c583f3f View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    9786abd View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    b9f4d6a View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    c39c73b View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    e703991 View commit details
    Browse the repository at this point in the history
  23. Solve #1721, fix namespace mismatch caused by unlink (#1717)

    Fix an issue in InotifyEventApplier.getUnlinkSql, which may cause namespace not mismatch in file table.
    qiyuangong committed May 4, 2018
    Configuration menu
    Copy the full SHA
    42782f6 View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    447bc5f View commit details
    Browse the repository at this point in the history
  25. Update admin-user-guide

    littlezhou authored and qiyuangong committed May 4, 2018
    Configuration menu
    Copy the full SHA
    16d03ee View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    a443608 View commit details
    Browse the repository at this point in the history
  27. Update admin-user-guide

    littlezhou authored and qiyuangong committed May 4, 2018
    Configuration menu
    Copy the full SHA
    e97583d View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    7815e7b View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    31bcc31 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2018

  1. Solve #1732, fix YARN and MapReduce fails caused by getFileState (#1733)

    * Ensure that YARN and MapReduce work well even if SSM is shutdown. 
    * Suppress unnecessary error logs caused by reportFileAccessEvent.
    qiyuangong authored May 13, 2018
    Configuration menu
    Copy the full SHA
    5f85bc6 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2018

  1. Configuration menu
    Copy the full SHA
    0926e98 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    885f666 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d25cfb9 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cbfa62f View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2018

  1. Modify compression UT

    qiyuangong committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    2e78958 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2018

  1. Configuration menu
    Copy the full SHA
    9b90d9a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e068408 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2fdc653 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2018

  1. Configuration menu
    Copy the full SHA
    6446719 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2f95c6a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7958108 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2018

  1. Fix code style

    qiyuangong committed Aug 1, 2018
    Configuration menu
    Copy the full SHA
    1b0b791 View commit details
    Browse the repository at this point in the history
  2. Fix metastore related UT

    qiyuangong committed Aug 1, 2018
    Configuration menu
    Copy the full SHA
    a748b07 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    03f59bc View commit details
    Browse the repository at this point in the history
  4. Add Xattr support

    qiyuangong committed Aug 1, 2018
    Configuration menu
    Copy the full SHA
    d2fcd94 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2018

  1. Fix CDH build failure

    qiyuangong committed Aug 2, 2018
    Configuration menu
    Copy the full SHA
    a9c6bf0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8f3f426 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5544978 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ceb8ab0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    db92e8d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    97770d9 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2018

  1. Fix code style

    qiyuangong committed Aug 3, 2018
    Configuration menu
    Copy the full SHA
    af2e56b View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2018

  1. Refactor smartfilesystem

    qiyuangong committed Aug 13, 2018
    Configuration menu
    Copy the full SHA
    95a2ff2 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2018

  1. Fix testCompressEmptyFile

    qiyuangong committed Aug 14, 2018
    Configuration menu
    Copy the full SHA
    5a9c4bc View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2018

  1. Configuration menu
    Copy the full SHA
    dd4752a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    91446cc View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2018

  1. Configuration menu
    Copy the full SHA
    e09af36 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2018

  1. Configuration menu
    Copy the full SHA
    a7754e8 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2018

  1. Add CompressionType

    qiyuangong committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    682cf0d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    01f9054 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2018

  1. Configuration menu
    Copy the full SHA
    a694dbb View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2018

  1. Configuration menu
    Copy the full SHA
    166a154 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    95931ee View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2018

  1. Configuration menu
    Copy the full SHA
    86654b4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f8980b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2018

  1. Configuration menu
    Copy the full SHA
    2f9fe0d View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2018

  1. Configuration menu
    Copy the full SHA
    81ca366 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2018

  1. Configuration menu
    Copy the full SHA
    e38c6d2 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2018

  1. Fix a bug in compresssionscheduler

    	Caused by appending error log in action result log,
    	which is used by compressionfileinfo.
    qiyuangong committed Sep 19, 2018
    Configuration menu
    Copy the full SHA
    9d14e74 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2018

  1. Modify log

    qiyuangong committed Sep 21, 2018
    Configuration menu
    Copy the full SHA
    a13ae80 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2018

  1. Fix snappy buffer problem

    qiyuangong committed Sep 27, 2018
    Configuration menu
    Copy the full SHA
    17e4b86 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2018

  1. Configuration menu
    Copy the full SHA
    fd01240 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2019

  1. Configuration menu
    Copy the full SHA
    daad2e7 View commit details
    Browse the repository at this point in the history
  2. Fix building issue in 2.7

    qiyuangong committed Jan 15, 2019
    Configuration menu
    Copy the full SHA
    d35325a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f69a99b View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2019

  1. Configuration menu
    Copy the full SHA
    d1543f4 View commit details
    Browse the repository at this point in the history
  2. Fix code style

    qiyuangong committed Jan 16, 2019
    Configuration menu
    Copy the full SHA
    cce231f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0deec10 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2019

  1. Configuration menu
    Copy the full SHA
    a7dbdaa View commit details
    Browse the repository at this point in the history
  2. Add 3.1 support

    qiyuangong committed Jan 21, 2019
    Configuration menu
    Copy the full SHA
    5d5ef07 View commit details
    Browse the repository at this point in the history
  3. Add CDH-2.6 support

    qiyuangong committed Jan 21, 2019
    Configuration menu
    Copy the full SHA
    97fefcc View commit details
    Browse the repository at this point in the history
  4. Fix open in CDH-2.6

    qiyuangong committed Jan 21, 2019
    Configuration menu
    Copy the full SHA
    2dc3d75 View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2019

  1. Configuration menu
    Copy the full SHA
    f18dfee View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d217f7e View commit details
    Browse the repository at this point in the history