Skip to content

release/0.2.2

Choose a tag to compare

@wajda wajda released this 05 Dec 16:47
· 1476 commits to develop since this release
    Release Notes - Spark Lineage - Version 0.2.2

Sub-task

  • [SL-33] - Spline logo
  • [SL-57] - Update harvester according to the new data model
  • [SL-58] - Update Mongo persistence layer according to the new data model
  • [SL-59] - Update Atlas persistence layer according to the new data model
  • [SL-60] - Update HDFS persistence layer according to the new data model
  • [SL-61] - Update Web UI layer according to the new data model
  • [SL-62] - Update REST layer according to the new data model
  • [SL-63] - Merging lineage graphs from connected jobs together
  • [SL-65] - High level lineage overview - UI
  • [SL-66] - High level lineage overview - Service
  • [SL-67] - Update the logic of merging lineages according to the new references to meta datasets
  • [SL-68] - Extend MongoLoader with a method for getting application node

Bug

  • [SL-29] - Selected job descriptor doesn't match the DAG shown
  • [SL-37] - Improve css style of node details to visualize decimal types properly
  • [SL-64] - No attributes on final dataset

Story

  • [SL-2] - Create readme.md
  • [SL-3] - ScalaDoc
  • [SL-4] - Add a help link to a wiki
  • [SL-5] - Old browser warning
  • [SL-6] - Configurable environment properties
  • [SL-7] - Clean up
  • [SL-8] - Project dependencies and licenses
  • [SL-9] - License
  • [SL-17] - Lineage Merge
  • [SL-27] - Name the project
  • [SL-28] - UI: Loading progress indicator
  • [SL-35] - Integration with Apache Atlas
  • [SL-39] - Collapsing of operation nodes within the same branch
  • [SL-40] - Transformation over the lineage graph that merges compatible projections together
  • [SL-41] - Redefinition of insertions of attribute removal logic
  • [SL-43] - Data Set Oriented Data Model
  • [SL-44] - Job Execution Level Overview
  • [SL-46] - File-based Storage
  • [SL-49] - Provide execution level lineage with unique IDs
  • [SL-56] - Absolute Path in Destination Nodes

Task

  • [SL-31] - Upgrade to Spark 2.2.0
  • [SL-32] - Automated release script (Maven + TC)