Bugfix release

Fixed bugs:

• #53 null and None literals fail to deserialize
• #57 Child datatypes are missing for certain lineages

Maintenance release

    Release Notes - Spline - Data Lineage for Spark - Version 0.3.2

Bug

• [SL-141] - Still hitting 16Mb MongoDB's document size limit after the lineage monolith doc split
• [SL-145] - Spline UI times out on building lineage overview
• [SL-148] - ERROR TypeError: Cannot read property '_typeHint' of undefined
• [SL-149] - UI: Infinite scrolling works wrong
• [SL-150] - Lineage overview loading time improvements

Story

• [SL-137] - Improve filter predicate visualization #6h

Task

• [SL-140] - Check Spark configuration for MongoDB connection string
• [SL-146] - Update License info + sanitizing

MongoDB script fix, Spark compat fix, attribute highlighting fix

    Release Notes - Spline - Data Lineage for Spark - Version 0.3.1

Bug

• [SL-117] - Fix MongoDB migration script
• [SL-116] - Fix Spark 2.3 compatibility
• [SL-133] - Operation details attribute not highlighted on node change

APPEND write mode support. Various performance improvements.

    Release Notes - Spline - Data Lineage for Spark - Version 0.3.0

Bug

• [SL-93] - ParallelCompositeDataLineageReader semantic is confusing
• [SL-95] - HDFS persistence layer not working
• [SL-103] - Only capture successful lineages
• [SL-115] - Timeout error on dataset descriptors request
• [SL-130] - TypeError: Cannot read property 'schema' of undefined
• [SL-131] - E11000 duplicate key error collection: spline-dev.attributes index: _id_ dup key

Story

• [SL-21] - Search
• [SL-38] - Mongo: Split lineage document
• [SL-72] - Investigation whether support of structured streaming would be possible
• [SL-91] - Listener for Stream Processing
• [SL-92] - Mongo 3.6 support
• [SL-97] - Support APPEND operation
• [SL-99] - UI: Dataset list infinite scrolling
• [SL-106] - Harvester for Strectured Streming Nodes

Task

• [SL-116] - Upgrade to Spark 2.3
• [SL-117] - Persistent model migration

UI performance improvements. Mongo storage fixes.

    Release Notes - Spline - Data Lineage for Spark - Version 0.2.7

Bug

• [SL-126] - When persisting to Mongo keys contain "."

Story

• [SL-100] - Optimize UI to handle wide datasets
• [SL-108] - Authentication to Secured Mongo Instances

Mongo 3.6 + HDFS fix

    Release Notes - Spark Lineage - Version 0.2.6

Story

• [SL-112] - Quick fix for SL-92 (#12) and SL-95 (#14)

release/0.2.5

    Release Notes - Spark Lineage - Version 0.2.5

Bug

• [SL-90] - UI: LIneage DAG is refreshed on every click

release/0.2.4

    Release Notes - Spark Lineage - Version 0.2.4

Bug

• [SL-80] - Show proper 404 page when missing resource is requested
• [SL-82] - Show more specific operation details first
• [SL-83] - Shouldn't we manage MongoDB connections?
• [SL-84] - UI: Navigation in-progress indicator is not showing or showing too late
• [SL-85] - Dataset scrolling on left hand side works incorrectly - last few items are hidden
• [SL-89] - Missing support for the JDBC spark sql data source

Story

• [SL-47] - Filtering of Specific Node Types
• [SL-74] - Better logging
• [SL-78] - Non-blocking source lineages resolving
• [SL-79] - Samples runner
• [SL-81] - Configurable Spline error handling policy
• [SL-86] - Add support for "Sort" operation
• [SL-87] - Add support for "Aggregate" operation
• [SL-88] - Add support for "Union" operation

release/0.2.3

    Release Notes - Spark Lineage - Version 0.2.3

Bug

• [SL-73] - Delays on shutdown

Story

• [SL-70] - New sample jobs for high-level lineage overview
• [SL-75] - Async servlet support
• [SL-76] - Check Spark version on startup
• [SL-77] - Prepare project for publishing to Maven central

release/0.2.2

    Release Notes - Spark Lineage - Version 0.2.2

Sub-task

• [SL-33] - Spline logo
• [SL-57] - Update harvester according to the new data model
• [SL-58] - Update Mongo persistence layer according to the new data model
• [SL-59] - Update Atlas persistence layer according to the new data model
• [SL-60] - Update HDFS persistence layer according to the new data model
• [SL-61] - Update Web UI layer according to the new data model
• [SL-62] - Update REST layer according to the new data model
• [SL-63] - Merging lineage graphs from connected jobs together
• [SL-65] - High level lineage overview - UI
• [SL-66] - High level lineage overview - Service
• [SL-67] - Update the logic of merging lineages according to the new references to meta datasets
• [SL-68] - Extend MongoLoader with a method for getting application node

Bug

• [SL-29] - Selected job descriptor doesn't match the DAG shown
• [SL-37] - Improve css style of node details to visualize decimal types properly
• [SL-64] - No attributes on final dataset

Story

• [SL-2] - Create readme.md
• [SL-3] - ScalaDoc
• [SL-4] - Add a help link to a wiki
• [SL-5] - Old browser warning
• [SL-6] - Configurable environment properties
• [SL-7] - Clean up
• [SL-8] - Project dependencies and licenses
• [SL-9] - License
• [SL-17] - Lineage Merge
• [SL-27] - Name the project
• [SL-28] - UI: Loading progress indicator
• [SL-35] - Integration with Apache Atlas
• [SL-39] - Collapsing of operation nodes within the same branch
• [SL-40] - Transformation over the lineage graph that merges compatible projections together
• [SL-41] - Redefinition of insertions of attribute removal logic
• [SL-43] - Data Set Oriented Data Model
• [SL-44] - Job Execution Level Overview
• [SL-46] - File-based Storage
• [SL-49] - Provide execution level lineage with unique IDs
• [SL-56] - Absolute Path in Destination Nodes

Task

• [SL-31] - Upgrade to Spark 2.2.0
• [SL-32] - Automated release script (Maven + TC)