Pega Data Scientist Tools V3.0

[StijnKas]

This new major version brings major changes!

Highlights:

• Pdstools now uses Polars as the backend, replacing Pandas. See this article for a summary of the changes
• The crowd favorite ADM Healthcheck has been fully ported over to Python, alongside a streamlit app. Simply call pdstools run in your terminal to get started!
• The matplotlib plots have been deprecated, and only plotly is supported. Plots that were matplotlib only have been removed.
• Added data anonymization tools, see this article for more information

Other changes

• Minimum Python version is now bumped to 3.8
• The new Polars backend touched almost all areas of the codebase. All plot functions, backend functions and aggregations have been ported over.
• cdh_utils & ADMDatamart imports return pl.LazyFrames by default
• Overwrite mapping functionality is removed. If you need the legacy functionality, you can manually read in the data as pl.lazyFrames, and then call .rename()
• ModelName is renamed to Name for consistency
• ADMDatamart keyword arguments have been added to the main class signature, making them easier to find & use
• query arguments should now use pl.Expr for querying, keeping the lazy execution path alive
• extract_treatment has been renamed to extract_keys, and is now just boolean. If True, will extract all extra keys in pyName
• Added last_ResponseCount and last_Positives columns, indicating the last timestamp either of these columns increased. This is useful for estimating wether an action has stopped getting responses, therefore being turned to inactive
• Added a save_data() method to the ADMDatamart class, that will save the modelData and predictorData to local files
• Updated docstrings & tests to be consistent and up-to-date
• Added a FeatureImportance function, closing Add admVarImp to Python tools #49

New Contributors

• @shaniyahassanali made their first contribution in Add HDS anonymization utility #70
• @yusufuyanik1 made their first contribution in pdstools V3: Polars backend, Python healthcheck #73

Full Changelog: V2.2...V3.0

---

This discussion was created from the release Pega Data Scientist Tools V3.0.