Skip to content
This repository has been archived by the owner on Dec 20, 2018. It is now read-only.

Close #169 and add support for DataSet of Avro records #217

Open
wants to merge 27 commits into
base: master
Choose a base branch
from
Open

Close #169 and add support for DataSet of Avro records #217

wants to merge 27 commits into from

Commits on Nov 28, 2016

  1. Change version to 3.1.1-SNAPSHOT

    @JoshRosen
    JoshRosen committed Nov 28, 2016
    Configuration menu
    Copy the full SHA
    39bc512 View commit details
    Browse the repository at this point in the history

  2. Remove Spark 1.x documentation from README; add links to older READMEs 

    To avoid confusion, we should remove the documentation / linking instructions for the 2.x line of releases since the current README describes features which don't apply there. Instead, we should link to the older docs.

Author: Josh Rosen <joshrosen@databricks.com>

Closes databricks#199 from JoshRosen/readme-fixes.

(cherry picked from commit b01a034)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>
    @JoshRosen
    JoshRosen committed Nov 28, 2016
    Configuration menu
    Copy the full SHA
    62c3c53 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2017

  1. WIP - allow creation of Dataset from RDD[SpecificRecord] 

    There is still an issue with ExternalMapToCatalyst to be resolved
    Ian Hummel committed Jan 26, 2017
    Configuration menu
    Copy the full SHA
    29ef5f6 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2017

  1. Fix imports so that we can redeclare LambdaVariable, make unit tests … 

    …pass
    Ian Hummel committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    fd777c6 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2017

  1. Update SBT for Spark-version-dependent code

    Ian Hummel committed Feb 3, 2017
    Configuration menu
    Copy the full SHA
    e4c7a42 View commit details
    Browse the repository at this point in the history

  2. Keep spark version at 2.0.0

    Ian Hummel committed Feb 3, 2017
    Configuration menu
    Copy the full SHA
    f661f61 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2017

  1. Ensures all unit tests pass on Windows

    Ian Hummel committed Feb 6, 2017
    Configuration menu
    Copy the full SHA
    cdba653 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2017

  1. Unit tests pass with different versions, but build.sbt is messy and i… 

    …t will fail under pacakaging
    Ian Hummel committed Feb 7, 2017
    Configuration menu
    Copy the full SHA
    f9ef636 View commit details
    Browse the repository at this point in the history

  2. Add support for Spark 2.1.x (while retaining Spark 2.0.x support) 

    This patch builds on databricks#206 in order to restore support for Spark 2.0.x. This means that a single binary artifact can be used with both Spark 2.0.x and 2.1.x, simplifying the builds of downstream projects which are compatible with both Spark versions.

Author: Josh Rosen <joshrosen@databricks.com>

Closes databricks#212 from JoshRosen/add-spark-2.1.
    @JoshRosen
    JoshRosen committed Feb 7, 2017
    Configuration menu
    Copy the full SHA
    5c3c116 View commit details
    Browse the repository at this point in the history

  3. Update README in preparation for 3.2.0 release 

    Author: Josh Rosen <joshrosen@databricks.com>

Closes databricks#213 from JoshRosen/prepare-for-3.2-release.
    @JoshRosen
    JoshRosen committed Feb 7, 2017
    Configuration menu
    Copy the full SHA
    762f7a1 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2017

  1. Setting version to 3.2.0

    @liancheng
    liancheng committed Feb 8, 2017
    Configuration menu
    Copy the full SHA
    e28e456 View commit details
    Browse the repository at this point in the history

  2. Setting version to 3.2.1-SNAPSHOT

    @liancheng
    liancheng committed Feb 8, 2017
    Configuration menu
    Copy the full SHA
    1bfe421 View commit details
    Browse the repository at this point in the history

  3. 3.1.0 -> 3.2.0 in README

    @JoshRosen
    JoshRosen committed Feb 8, 2017
    Configuration menu
    Copy the full SHA
    51eb883 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2017

  1. Build is now working and including the classfiles in the final artifact

    Ian Hummel committed Feb 9, 2017
    Configuration menu
    Copy the full SHA
    69a0570 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2017

  1. build.sbt is looking better!

    Ian Hummel committed Feb 10, 2017
    Configuration menu
    Copy the full SHA
    ce47906 View commit details
    Browse the repository at this point in the history

  2. Much tighter way to include the spark version-specific modules into t… 

    …he final jar
    Ian Hummel committed Feb 10, 2017
    Configuration menu
    Copy the full SHA
    0934452 View commit details
    Browse the repository at this point in the history

  3. Merge upstream (3.2.1)

    Ian Hummel committed Feb 10, 2017
    Configuration menu
    Copy the full SHA
    3ee8ccd View commit details
    Browse the repository at this point in the history

  4. Update create table to avoid deprecration warnings

    Ian Hummel committed Feb 10, 2017
    Configuration menu
    Copy the full SHA
    73fc4d8 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2017

  1. Make unit test for GenericData.Record pass

    Ian Hummel committed Feb 15, 2017
    Configuration menu
    Copy the full SHA
    0e99d72 View commit details
    Browse the repository at this point in the history

  2. Make tests pass with ENUM and FIXED

    Ian Hummel committed Feb 15, 2017
    Configuration menu
    Copy the full SHA
    3a1fd20 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2017

  1. add support for DateType 

    Hi,
based on this issue databricks#67
I create this pull request

Author: Nihed MBAREK <nihedmm@gmail.com>
Author: vlyubin <vlyubin@gmail.com>
Author: nihed <nihedmm@gmail.com>

Closes databricks#124 from nihed/master.

(cherry picked from commit c19f01a)
Signed-off-by: vlyubin <vlyubin@gmail.com>
    @nihed @vlyubin
    nihed authored and vlyubin committed Feb 16, 2017
    Configuration menu
    Copy the full SHA
    d5c0329 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2017

  1. Merge master

    Ian Hummel committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    5de3574 View commit details
    Browse the repository at this point in the history

  2. Revert "Merge master" 

    This reverts commit 5de3574, reversing
changes made to 3a1fd20.
    Ian Hummel committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    909edcd View commit details
    Browse the repository at this point in the history

  3. Fix bad merge and merge branch-3.2 properly

    Ian Hummel committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    d9df990 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2017

  1. Merge master

    Ian Hummel committed Oct 27, 2017
    Configuration menu
    Copy the full SHA
    e15c5bd View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2017

  1. Merge master

    Ian Hummel committed Oct 30, 2017
    Configuration menu
    Copy the full SHA
    8300332 View commit details
    Browse the repository at this point in the history

  2. Flakey tests?

    Ian Hummel committed Oct 30, 2017
    Configuration menu
    Copy the full SHA
    7869c11 View commit details
    Browse the repository at this point in the history