CHANGELOG

v1.4.6 (2023-07-18)

Ci

Fix

  • fix: breaking plot when feature contains extreme values

Closes https://github.com/ing-bank/popmon/issues/281 (93553b2)

Style

Unknown

  • Merge pull request #282 from ing-bank/develop

Release (2ae6247)

v1.4.5 (2023-07-06)

Chore

Ci

  • ci: pytest should fail on warnings (95364e0)

  • ci: replace google addlicense with ruff (ad1ce20)

  • ci: dependency update (cd51696)

  • ci: dependency update (a44e85f)

  • ci: dependency update (ec4e410)

Fix

  • fix: upgrade to pydantic 2

Closes #274 (6c19baa)

  • fix: jinja safe html

Closes #275 (ecfd7c5)

Refactor

  • refactor: future annotations (bb2968e)

  • refactor: basic type hints

mostly with auto-typer (2105991)

  • refactor: fix timedelta warning (6331dea)

  • refactor: prevent pandas deprecation warning (3cd224e)

Unknown

  • Merge pull request #279 from ing-bank/develop

Release v1.4.5 (bf09e1d)

v1.4.4 (2023-05-26)

Fix

  • fix: static listing of extension requirements (1152598)

v1.4.3 (2023-05-25)

Fix

  • fix: semantic-release build command (4ba57e3)

  • fix: ci build command (7d8eced)

Unknown

  • Merge branch ‘master’ of https://github.com/ing-bank/popmon (ff84777)

v1.4.2 (2023-05-25)

Chore

  • chore: remove version comment (b9eff7a)

  • chore: dynamic version (b8f54c3)

  • chore: dynamic version (db30b88)

Fix

Unknown

  • Merge branch ‘master’ of https://github.com/ing-bank/popmon (2c90fcc)

v1.4.1 (2023-05-25)

Chore

  • chore: invert version bump (6cb4b23)

  • chore: update pyproject.toml for semantic release (adff3ec)

  • chore: version bump (323354c)

  • chore: apply linting changes (7e9fd57)

  • chore: update copyright (34fc676)

  • chore: enable ruff (5db76ec)

Ci

  • ci: upgrading packages (75a4e17)

  • ci: update ruff (86cb407)

  • ci: increase python versions in matrix (d9650ea)

Documentation

  • docs: update grafana logo link (88bd19d)

  • docs(readme): article by Pradyot Patil (5496f8e)

Fix

  • fix: reference type in metric pipeline (99f8687)

  • fix: ci (#269)

  • chore: pin ruff

  • refactor: linting facelift

  • refactor: migrate to pyproject.toml

  • ci: bump spark versions

  • refactor: extensions ditch extras.json

  • ci: drop pyspark 2.4 testing (f3a34d1)

Refactor

  • refactor: use builtin python type

np.float is removed (d687d10)

Unknown

  • Merge pull request #261 from ing-bank/develop

Release (4a53e85)

v1.4.0 (2022-10-19)

Build

  • build: remove unnecessary dependency (c71b0cd)

Ci

Feature

  • feat(report): summary table (a5b9a30)

Unknown

  • Merge pull request #257 from ing-bank/develop

Release v1.4 (7f03178)

v1.3.0 (2022-09-09)

Build

  • build: upgrade histogrammar for decimal support (a82d729)

  • build: fix dependencies for readthedocs bullets

See https://github.com/readthedocs/sphinx_rtd_theme/issues/1115 (76e85b6)

Chore

  • chore: merge master back to develop (b03c583)

Ci

  • ci: dependency update (2be4fb8)

  • ci(release): use right branch for auto-merge (b2f3947)

Documentation

  • docs(readme): fix table formatting (d6958c6)

  • docs(readme): include scipy presentation (695ee17)

Feature

  • feat: remove skip_empty_plots

Default behaviour is now to skip the plots if they only contain NaN or Inf values. Unlike before, for all zeros, the plots are now retained. (bd3ea29)

Fix

  • fix(comparisons): unknown labels correct label axis (e0bbf04)

  • fix(report): show zero value in bar plots (6a350d4)

Unknown

  • Merge pull request #254 from ing-bank/develop

Release (f8633aa)

v1.2.0 (2022-09-01)

Build

  • build: upgrade histogrammar to fix #244 (1d5e26d)

  • build: upgrade python-semantic-release (78c217b)

  • build: docs include theme extension

Possible fix for bullet list https://stackoverflow.com/a/67977753 (0ef32f0)

Chore

Ci

  • ci(release): pin python-semantic-release to master (559f0eb)

Documentation

  • docs(readme): include histogram inspector in readme (3e68508)

Feature

  • feat(report): histogram inspector

See #230

Co-authored-by: Pradyot Patil <pradyotpatil@gmail.com> (5e78f98)

  • feat: remove time of day from label when midnight or noon (1615bed)

  • feat(config): deprecate skip_empty_plots (#249) (372ef85)

Fix

  • fix: show heatmap descriptions (64a4952)

Refactor

  • refactor: pass settings object to report

Co-authored-by: Pradyot Patil <pradyotpatil@gmail.com> (29b9e73)

Unknown

  • Merge pull request #251 from ing-bank/develop

Release (82319b3)

  • Merge pull request #247 from ing-bank/develop

Release (e2b52f2)

v1.1.0 (2022-08-19)

Ci

  • ci: auto-merge master back to develop on release (6aa0249)

  • ci: pre-commit updates (7d3a973)

  • ci: update dependencies (2a20e3e)

  • ci: upgrading packages (683b356)

  • ci: pre-commit updates (3d52005)

  • ci: pre-commit updates (14778ef)

  • ci: pre-commit updates (8532cf8)

  • ci: upgrading packages (d8e326f)

  • ci: dependency update (c013271)

  • ci: pre-commit updates (2d3566b)

Documentation

  • docs(config): extend settings documentation (fa4d2fc)

  • docs(api): restructure api documentation for clarity

  • Remove duplicate entries

  • Unnest navigation

  • Remove empty section (affdd75)

  • docs(profiles): profile extension (e859530)

  • docs(comparisons): comparison extensions section (581e63c)

  • docs: extensions in index (6c87fcb)

  • docs(readme): add section about profile integrations and diptest (aa860a7)

  • docs(readme): include citation information (#241) (3a29135)

Feature

  • feat: extension functionality + diptest implementation @RUrlus (8487991)

Refactor

  • refactor: improve code for docs generation

e.g. type hinting, docstrings and private functions (709baa5)

Test

  • test(config): basic tests for settings (f0d242d)

Unknown

  • Merge pull request #246 from ing-bank/develop

Release (65125c3)

  • Merge pull request #243 from ing-bank/master

Merge master into develop (e8c4310)

v1.0.0 (2022-07-08)

Breaking

  • feat: plotly express

The histograms, heatmaps and comparisons have been replaced with interactive Plotly graphs. Plotly.js is used to build the graphs on the go from JSON. Initial tests show that plotly reports are smaller in size compared to matplotlib and the takes way less time for report generation compared to matplotlib. use parameter ‘online_report’ to use plotly.js from CDN server and use report online. Else, plotly.js is embedded in the report and can be used offline too.

BREAKING CHANGE: matplotlib-related config is removed (2c2395c)

  • feat: introduce self start reference type

New reference type that splits the provided dataset into a reference and uses the remainder to compare against. Datasets can be split on number of instances (integer value), fraction (float) or condition.

BREAKING CHANGE: Configuration of time_axis, features etc. is moved to the Settings class. (ca22268)

  • feat(config): structured config using pydantic

Hierarchical configuration in config.py provides context to options This setup prevents code duplication (functions with many arguments, various places to set defaults, docstrings…) Introducing new parameters is simplified Documentation is updated to reflect the new syntax

BREAKING CHANGE: new configuration syntax (bc52aeb)

  • refactor: removed outdated plots for TL/alerts

The overview plots obviate the need for the individual (unintuitive) plots

BREAKING CHANGE: the plot_metrics and plot_overview settings are no longer available for Tl/alerts (1c4f072)

  • refactor: remove worst traffic light

BREAKING CHANGE: the worst entry will no long be present in the datastore (e2b9ef7)

Chore

  • chore: update example syntax to new reference and config (e4df434)

  • chore: bump copyright year docs (ba45ab4)

  • chore: remove outdated and redundant tree (dd6e9fe)

  • chore: update example syntax (523001b)

  • chore: update notebooks (d73b621)

Ci

  • ci: improved handling of docautogenerate (run only once) (a6fb3dc)

  • ci: spark path (a1ed9eb)

  • ci: cache pip and spark dependencies (f394a63)

  • ci: add pyspark 3.3 to test matrix (d5ccba6)

  • ci: include assets for synthetic datasets

sine1 and hyperplane datasets (7c82fa5)

  • ci: enable qa on jupyter notebooks (77fab29)

  • ci: ensure that api docs are up-to-date (fb65494)

  • ci: also run tests on PR to feature branches (e36bd30)

  • ci: dependency update (546b6ef)

Documentation

  • docs(profiles): add entropy (8e8ac00)

  • docs: registry snippet to list available profiles/comparisons (7760047)

  • docs(comparisons): overview in table (cde48c4)

  • docs: profiles in table (65459af)

  • docs: description for mean trend score

Co-authored-by: pradyot-09 <pradyotpatil@gmail.com> (b5b7626)

  • docs: update api structure

Co-authored-by: pradyot-09 <pradyotpatil@gmail.com> (c6c53ba)

  • docs: documentation for reference types (9cf8117)

  • docs: update api documentation (74eb223)

  • docs(config): configuration parameter docstrings (9eec883)

  • docs(registry): instructions on comparison parameter setting (2e3b134)

  • docs(config): update configuration examples (daccc36)

Feature

  • feat(report): group comparisons by reference key (#237)

Co-authored-by: Patil <pradyot.patil@ing.com> Co-authored-by: Simon Brugman <sfbbrugman@gmail.com> (e813534)

  • feat: entropy profile (96dd7d1)

  • feat: configurable title and colors

The report title, primary color and traffic light colors are now configurable.

Co-authored-by: pradyot-09 <pradyotpatil@gmail.com> (37fcd0e)

  • feat: online report CDN for bootstrap, jquery

When the online_report config parameter is set to True, bootstrap and jquery are loaded from a CDN as ploty.js. This results in a much smaller report.

Co-authored-by: pradyot-09 <pradyotpatil@gmail.com> (72df86d)

  • feat: string representation for base classes (bd480a6)

  • feat: keep section when changing features (7b12d06)

  • feat(config): settings required parameter (47d6b17)

  • feat(registry): generalize registry

Generalized the registry pattern from profiles and comparisons to a single class (d01c68a)

  • feat(registry): add ks, pearson, chi2 to registry

Allow for changing parameters of comparison functions (4f8126d)

Fix

  • fix: prevent plot name collision that stops rendering (#238)

Co-authored-by: Patil <pradyot.patil@ing.com> (32c7ef4)

  • fix: set time_width in synthetic data example (fbf7e41)

  • fix: guaranteed ordering of traffic light metrics

Based on lexicographical ordering (88c3f4a)

  • fix(plot): plot_heatmap_b64 top argument is now supported (8be8115)

Performance

  • perf: reduce file size of reports (329564f)

Refactor

  • refactor: make test robust against floating point (41ea553)

  • refactor(config): update configuration in pipelines (78bae81)

  • refactor: prevent warnings dtype (f3b9214)

  • refactor: use defaultdict in utils (a6b7c52)

  • refactor: various minor cleanups (9df1788)

  • refactor: replace eval with callable (4c99fa1)

Test

  • test: fail rather than skip spark-specific tests

if dependencies not available (6fafbf2)

  • test: update test syntax to new config (da7b6d8)

  • test: dataset split functionality tests (25c0301)

  • test: string representation base classes (84d8485)

  • test(config): update configuration in tests (2f5a4a0)

  • test(registry): profiles and comparisons (797aeac)

Unknown

  • Merge pull request #236 from ing-bank/develop

v1.0.0 release (543e574)

  • Merge pull request #223 from ing-bank/master

Merge master into develop (31e32c3)

v0.10.2 (2022-06-21)

Fix

  • fix: patched histogrammar bin_edges call for Bin histograms (590d266)

Unknown

  • Merge pull request #222 from ing-bank/develop

Release (88924d1)

v0.10.1 (2022-06-15)

Fix

  • fix: patched histogrammar num_bins call for Bin histograms (b34fe70)

Unknown

  • Merge pull request #221 from ing-bank/develop

Release (f7d87b6)

  • Merge pull request #219 from ing-bank/master

chore: merge master into develop (7666ef4)

v0.10.0 (2022-06-14)

Ci

Documentation

  • docs(synthetic): update synthetic examples (#212)

  • update SEA description

  • full and partial reference for synthetic data streams

  • hyperplane logistic regression example (84a9331)

  • docs(readme): link profiles and comparisons page (17ac6d8)

  • docs(profiles): list the available profiles (#173) (15f78ec)

Feature

  • feat(profiles): custom profiles via registry pattern (d0eb98b)

Fix

  • fix: protection against outliers in sparse histograms (#215)

  • Performance speedup in histogram summation o Replace for loop with np.sum

  • Protection against outliers in sparse histograms o Protect against extreme outliers in sparse histograms by avoiding the use of its dense representation where possible.

  • Working analysis function unit tests o update of test_report_generator o section_generator now passes np arrays to plot_bars_b64, no longer pd.Series.

  • Added crop_range option to get_consistent_numpy_1dhists function o return a cropped range version of the histogram, between 5-95% quantiles. o Plot cropped histograms in histogram section of report.

  • Bump up versions of histogrammar (10c3449)

  • fix(report): traffic light flexbox on small screens (2faa7da)

Refactor

  • refactor: robust dictionary access (f438394)

Unknown

  • Merge pull request #217 from ing-bank/develop

Release (4ceee95)

v0.9.0 (2022-05-27)

Build

  • build(histogrammar): upgrade dependency to 1.0.27 (33450dc)

Ci

  • ci: commitlint config allow urls (3ddf194)

  • ci(release): workaround python-semantic-release

Issue github.com/relekang/python-semantic-release/issues/442 (06ab7d8)

Documentation

  • docs(readme): replace report image (8d363d5)

  • docs(synthetic): add dataset overview table (8654347)

  • docs(datasets): reference implementations for widely-used publicly available synthetic data streams (9988a13)

Feature

  • feat(report): enable the overview section by default (22b9cb6)

  • feat(report): overview section for quickly navigating reports

aggregate alerts per feature (ordered from descending) click the feature name to directly switch to that feature closes #202 (f5736d4)

  • feat(report): allow section without feature toggle (2484569)

Fix

  • fix(report): consistent use of color red

Explicitly choose the rgb values for red, as matplotlib’s “r” does not coincide with css “red”

[link]: https://matplotlib.org/3.5.0/tutorials/colors/colors.html#comparison-between-x11-css4-and-xkcd-colors (453f3fe)

  • fix(report): text contrast and consistent yellow traffic light (5d5c43c)

Refactor

  • refactor: only set cmap once (14aa226)

  • refactor: rename dataset loading function (4d42e55)

v0.8.0 (2022-05-20)

Documentation

  • docs(config): global configuration for ing_matplotlib_theme (6f4f20d)

Feature

  • feat(report): heatmap time-series for categoricals (#194)

Heatmap time-series visualization for categorical variables

Co-authored-by: Patil <pradyot.patil@ing.com> Co-authored-by: Simon Brugman <sfbbrugman@gmail.com> (21c4ad1)

  • feat: nd histogram comparisons and profiles

Generalize to n-dimensional for comparison (chi2, pearson etc.) and profiles (count) (d572f7f)

  • feat: dashboarding integration for Kibana (83b8869)

  • feat: dashboarding integration for Kibana (4a9284f)

  • feat(config): global configuration for ing_matplotlib_theme (c81e28f)

Fix

  • fix: import histogrammar specialized (d70ab80)

Performance

  • perf: directly use bin keys (9440897)

  • perf: disable parallel processing by default (85d4407)

  • perf: chi2 max residual using numpy (8596387)

  • perf: performant data structure

avoid pandas Series where dict suffices (ff72d6e)

  • perf: short circuit any/all

see https://stackoverflow.com/a/53600865 (63c2704)

  • perf: optimize pull computation (ddf2e35)

  • perf: postpone formatting (expensive for DataFrames) (7feaaae)

  • perf: compute metrics without report (254564c)

Refactor

  • refactor: get_consistent_numpy_entries (df79ffd)

  • refactor: flake8 ignore rather than select (25887dd)

Style

Unknown

  • Merge pull request #204 from ing-bank/develop

Release (036ddbf)

v0.7.0 (2022-05-09)

Chore

  • chore: enable automatic releases (10a0830)

Ci

Documentation

  • docs(config): document global configuration (e546994)

  • docs(readme): extend articles section

Include articles written by Nagelkerke and Schoonemann (0ec0273)

Feature

  • feat: global configuration of joblib Parallel backend (3431cad)

Fix

  • fix: prevent numpy warnings (9ec3b66)

Unknown

  • Merge pull request #196 from ing-bank/develop

Release (beb008e)

  • Merge pull request #192 from ing-bank/master

Backmerge master into develop (f926309)

v0.6.1 (2022-04-30)

Chore

  • chore: remove poc files (43467c1)

  • chore: update changelog v0.6.1 (0c43258)

  • chore: bump copyright (40d5450)

Ci

  • ci: temporarily disable automatic release (fec8c16)

  • ci: python 3.6 end of life, include py 3.9 for tests (#187) (fcc18fa)

  • ci: fix go installation (8cd2049)

  • ci: pre-commit updates (a6883aa)

  • ci: update dependencies (373f627)

  • ci: upgrading packages (149954e)

  • ci: pre-commit updates (64efb8d)

  • ci: update dependencies (532d1a6)

  • ci: dependency update (532fc63)

  • ci: pre-commit updates (061db80)

  • ci: dependency update (abe8a59)

Documentation

  • docs: include link to kedro-popmon (aff68b7)

  • docs: include link to kedro-popmon (78073fe)

  • docs: spark troubleshooting (1dc0319)

Fix

  • fix(plot): memory leak matplotlib (cc6c4e1)

Unknown

  • Merge pull request #190 from ing-bank/develop

Release (2759f38)

v0.6.0 (2021-12-13)

Ci

Documentation

  • docs(comparisons): add comparisons page (60967c9)

  • docs: fix broken link (2b38fc6)

  • docs(rtd): install popmon (e9c4610)

Feature

  • feat(comparisons): introduce psi and jsd (c6a1ca7)

  • feat(comparisons): introduce comparison registry (031c146)

Refactor

  • refactor: move max_prob_diff to comparisons registry (47336bc)

Test

  • test(comparisons): unit tests for JSD, KL and PSI (9e3a846)

Unknown

  • Merge pull request #182 from ing-bank/develop

Release (1f0c144)

v0.5.0 (2021-11-24)

Chore

Ci

  • ci: migrate from standard-version to python-semantic-release

automates larger parts of the release process (9a6c4c0)

Documentation

  • docs(rtd): migrate config to v2 (a8d9f76)

  • docs: refresh notebooks (#151)

  • docs: improve flow of basic tutorial

  • docs: improve flow of advanced tutorial

  • docs: improve flow of incremental tutorial

  • docs: reorder advanced tutorial (0bccc7e)

  • docs: pipeline visualizations in docs and notebooks (913bfb0)

  • docs: changelog md syntax (b187d36)

  • docs: specify requirements (e3f6b0a)

Feature

  • feat: improve pipeline visualization

better handling of subgraphs standalone (bb09d73)

Fix

  • fix: ensure uniqueness of apply_funcs_key (ba98c97)

Refactor

  • refactor: module transform rather than _transform

Refactor using metaclass (c3bffb0)

  • refactor: move visualization code (8efc072)

  • refactor: remove dead code (6781459)

  • refactor: the StabilityReport is not a module

It does not transform. Rather it allows rendering to notebook/html. (b141965)

  • refactor: remove unused imports (21b1e96)

  • refactor: pipeline abstract class

Refactor the code in order for the Pipeline class to be abstract This ensures that each pipeline is named and improves the code quality in general (540d8a5)

  • refactor: simplification (98acf68)

  • refactor: remove unused imports (66141b2)

  • refactor: pipeline transformation structure (2534cea)

  • refactor: move parallel processing to utils

centralize configuration less duplicate code (add2936)

Style

  • style: various code style improvements (1f6c648)

  • style: lint (c9d861f)

Test

  • test: remove boilerplate code (871d2c6)

Unknown

  • Merge pull request #179 from ing-bank/develop

Semantic release CI (70be1f8)

  • Merge branch ‘master’ into develop (840ea18)

  • Merge pull request #177 from ing-bank/develop

v0.5.0 (70917d2)

  • Merge branch ‘master’ into develop (92eee2b)

  • lint: try-except best practices (4ee8c52)

  • Merge pull request #146 from ing-bank/feat/pipeline-refactor

Pipeline refactor (2732dd5)

  • Merge pull request #169 from ing-bank/fix/docs-build

Fix docs build (611cd58)

  • Merge pull request #168 from ing-bank/develop

ci: auto draft release on tag (729d61a)

  • Merge branch ‘master’ into develop (c0bfb61)

v0.4.4 (2021-10-22)

Chore

  • chore: version bump (f100595)

  • chore: update docs copyright (21588a9)

  • chore: release notes (44aaaa8)

  • chore: cleanup

correct exceptions unused import syntactic sugar dict (ba7bac1)

Ci

Documentation

  • docs: update cross-reference in changelogs (5ccbf75)

  • docs: consistent version naming CHANGELOG.md (5c859a2)

  • docs: rtd python 3.8 (937a0b0)

  • docs: enable markdown and use new CHANGELOG.md (08d5a67)

  • docs: use new version property (32e9d4d)

Feature

  • feat: notebook on report interpretation (dd3be73)

Fix

  • fix: distinct incorrect result (constant) (3c47cde)

  • fix: uu-chi2 incorrect return (e259d3e)

  • fix: prevent division by zero (bacf8dd)

Style

Test

  • test: add test case for report notebook (5252a5b)

Unknown

  • Merge pull request #167 from ing-bank/develop

v0.4.4 (37842c9)

  • Merge pull request #147 from ing-bank/notebooks

notebook on report interpretation (2d6781b)

  • Merge branch ‘master’ into develop (7c305af)

  • Merge branch ‘develop’ of https://github.com/ing-bank/popmon into develop (6d0850e)

v0.4.3 (2021-10-04)

Chore

Fix

  • fix: fix too restrictive numpy integer check in hist_stitcher

This fixes issue 143: https://github.com/ing-bank/popmon/issues/143 (c162f11)

Unknown

  • Merge pull request #145 from ing-bank/develop

Develop (b82ed51)

  • Merge branch ‘master’ into develop (b0f7506)

  • Merge pull request #144 from ing-bank/integer_type_check_fix

Fix numpy integer type check in hist_stitcher (da76d49)

  • Merge pull request #137 from ing-bank/pre-commit-ci-update-config

ci: pre-commit-config update (b34df69)

  • Merge pull request #134 from ing-bank/pre-commit-ci-update-config

ci: pre-commit-config update (84bb4c0)

v0.4.2 (2021-08-25)

Chore

Ci

  • ci: fix notebook tests

see https://github.com/jupyter/jupyter_client/issues/637 (0ee5019)

  • ci: fix addlicense

see https://github.com/google/go-licenses/issues/75 (2597a07)

Unknown

  • Merge pull request #135 from ing-bank/develop

v0.4.2 (c5f21ac)

  • Merge branch ‘master’ into develop (c692ebc)

v0.4.1 (2021-06-23)

Build

  • build: pre-commit autoupdate (dd7f541)

  • build: pre-commit update (47c4126)

Chore

Ci

  • ci: automate generation of release notes

via standard-version to CHANGELOG.md. (9fb3c08)

  • ci: python build matrix (#132)

  • ci: python build matrix

  • fix: latest ing_theme_matplotlib from source

installing this extension from source until a new release is available

  • fix: callable test (8b43e22)

  • ci: rename commit msg precommit.ci (a632a35)

  • ci: dependabot Github-native setup (f026069)

  • ci: openjdk-8 requires apt-get update (7dc61db)

  • ci: bump + flake8 + isort args

  • bump black, pyupgrade

  • flake8 comprehensions

  • remove isort args that are no longer needed (3a8be31)

Documentation

  • docs: codemotion article (c6fa32e)

  • docs: add explanation for hiding green TLs by default (36120a9)

  • docs: fix typo (dee8a21)

  • docs: include changelog in docs (a2237d0)

Feature

  • feat: tabular traffic light/alerts overviews (7e0d479)

  • feat: turn off alert metric plots by default in config

they do not provide additional information to the overview (70551ab)

Fix

  • fix: extend TL config (494fc56)

  • fix: consistency between tl and comparisons

mismatch between stats displayed in the traffic lights section and comparisons due to pattern matching bug. (c8cc8b0)

Refactor

  • refactor: convert dict constructor to dict literal (a5c4cae)

  • refactor: replace dict() with {} outside src (f61fbdb)

  • refactor: add utils to prevent code repetition (8066bc3)

  • refactor: series from dict (8299110)

  • refactor: directly pass arguments (47411ff)

  • refactor: replace dict() with {} (a51fabf)

Style

  • style: build.yml name missing step (af2a5e7)

Test

  • test: add filter_metrics test for TL/default stats (06dcdd9)

Unknown

  • Merge pull request #133 from ing-bank/develop

v0.4.1 (8ffbb32)

  • Merge branch ‘master’ into develop (c5dc64c)

v0.4.0 (2021-04-16)

Build

  • build: update pyupgrade to v2.12.0 (e02adf1)

  • build(histogrammar): popmon working with hgr v1.0.23 (#101)

  • popmon working with hgr v1.0.23

  • removal of all HistogramContainer code

  • In readme.rst switch example and documentation sections

  • bump up version to 0.3.15

  • chore(flake8): remove redundant noqa statements

  • added two spark unit tests

  • refactor: pythonic code (dict/list comprehension) and replace RuntimeErrors where ValueError or TypeError is more appropriate

Co-authored-by: sbrugman <sfbbrugman@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> (d4a986e)

Chore

  • chore: v0.4.0 release bump and changelog (c12783b)

Ci

  • ci: commitlint for enforcing conventional commits (fc90b15)

Unknown

  • Merge pull request #116 from ing-bank/develop

v0.4.0 (6bab922)

  • Merge pull request #113 from ing-bank/sync-master-develop

Sync master & develop (37abd71)

  • Merge branch ‘develop’ into sync-master-develop (d0cf1ac)

  • Migrate to version 1.0.25 of histogrammar (#104)

  • Migrate to version 1.0.25 of histogrammar

  • More flexible handling of nans / nulls in fraction_of_true() profiling function.

  • Pluggy requirement fix

  • spark binding ip

Co-authored-by: Simon Brugman <sbrugman@users.noreply.github.com> (50ec4d4)

  • [pre-commit.ci] pre-commit autoupdate (#100)

  • [pre-commit.ci] pre-commit autoupdate (7f5219a)

  • [pre-commit.ci] pre-commit autoupdate (#98)

  • v0.3.11 release (#74)

v0.3.11 release

Features:

  • Traffic light overview (#62)

Documentation:

  • Downloads badge readme

  • List talks and articles in readme (#66)

  • Add image to README.rst (#64)

Other improvements:

  • Change notebook testing to pytest-notebook (previously these tests were skipped in CI). Add try-except ImportError for pyspark code. (#67)

  • Fix a few typo’s

  • suppress “matplotlib backend” verbose warning

  • click on “popmon report” also scrolls to top

  • Update HTML reports using Github Actions (#63)

  • Bugfix in hist.py that broke the advanced tutorial.

Notebooks:

  • Add %%capture to pip install inside of notebooks.

  • Make package install in notebooks work with paths with spaces.

  • Pickle doesn’t work with tests (not really a popmon-specific feature anyway). Changed the notebook to fix the issue, left the code for reference.

  • Version bump

  • Release/0.3.14 (#92)

  • Pin histogram version

  • Docs update (#96)

  • Initialize spark with both histogrammar jar files

Co-authored-by: Max Baak <maxbaak@gmail.com>

  • [pre-commit.ci] pre-commit autoupdate

Co-authored-by: Simon Brugman <sbrugman@users.noreply.github.com> Co-authored-by: Tomas Sostak <shostakas@gmail.com> Co-authored-by: Max Baak <maxbaak@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> (ce16a27)

  • docs (#97)

  • clarify that time_axis should be date or numeric

  • add latest presentation (3236311)

  • Docs update (#96)

  • Initialize spark with both histogrammar jar files

Co-authored-by: Max Baak <maxbaak@gmail.com> (e661970)

  • Initialize spark with both histogrammar jar files (b7e0100)

  • [pre-commit.ci] pre-commit autoupdate (#93) (4a73486)

v0.3.14 (2021-02-08)

Unknown

  • Release/0.3.14 (#92)

  • Pin histogram version (68f53fa)

  • Version bump (5d00b64)

  • Update CHANGES.rst (dbd5aa5)

  • Version bump (12dffd0)

  • Pin histogram version (3cae15f)

  • Merge branch ‘release/0.3.13’ into develop (aa5704b)

v0.3.13 (2021-02-04)

Unknown

  • Merge branch ‘release/0.3.13’ (830b436)

  • Version bump (dfb1a51)

  • Configuration update (#91)

  • Small cleanup of spark histogrammar

  • Small update of configuration section of docs

  • Update configuration.rst (4ebca5b)

  • [pre-commit.ci] pre-commit autoupdate (#90) (2823025)

  • added some more explanation to reference types and couple of notes (db6b2aa)

  • Added manifest.in to ensure requirements.txt are picked up in sdist (04e1ff6)

  • histogrammar update for spark 3.0 (#87) (4a59d17)

v0.3.12 (2021-01-21)

Unknown

  • Merge pull request #84 from ing-bank/release/0.3.12

v0.3.12 release (89add7f)

  • Merge branch ‘master’ into release/0.3.12 (73efc3c)

  • Version bump (6e8d8fb)

  • Remove nbconvert dependency (#83)

Remove nbconvert (69429bf)

  • Support spark date type (#82)

Support for the Spark date type (treated as a timestamp).

Extending the unit tests for this type Install Spark on Github Actions to be able to include spark tests in our CI/CD pipeline Upgrade linting to use pre-commit (including pyupgrade for python3.6 syntax upgrades) Document how to run popmon using spark on Google Colab (minimal example from scratch) (841bdbd)

  • bugfix: check of covariance matrix invertibility in relative_chi_squared func

Added proper check of matrix invertibility of covariance matrix in the function relative_chi_squared() in stats/numpy.py

Apparently this check is not propely done by default by numpy.linalg.inv(), see: https://stackoverflow.com/questions/13249108/efficient-pythonic-check-for-singular-matrix/13264934#13264934

In one of our unit tests we were inverting a non-invertible covariance matrix, causing maching precision problems (differences) between different systems, causing the test to fail on some systems, but passing on others.

With a strict invertibility check in place, this test is now fixed and consistent b/n various systems. (31f3dfb)

v0.3.11 (2020-12-07)

Unknown

  • v0.3.11 release (#74)

v0.3.11 release

Features:

  • Traffic light overview (#62)

Documentation:

  • Downloads badge readme

  • List talks and articles in readme (#66)

  • Add image to README.rst (#64)

Other improvements:

  • Change notebook testing to pytest-notebook (previously these tests were skipped in CI). Add try-except ImportError for pyspark code. (#67)

  • Fix a few typo’s

  • suppress “matplotlib backend” verbose warning

  • click on “popmon report” also scrolls to top

  • Update HTML reports using Github Actions (#63)

  • Bugfix in hist.py that broke the advanced tutorial.

Notebooks:

  • Add %%capture to pip install inside of notebooks.

  • Make package install in notebooks work with paths with spaces.

  • Pickle doesn’t work with tests (not really a popmon-specific feature anyway). Changed the notebook to fix the issue, left the code for reference.

  • Version bump (b8d94a0)

  • merge (042ce33)

  • Merge pull request #75 from ing-bank/merge-master

merge master in develop (6a85fa5)

  • Merge branch ‘develop’ into merge-master (c3d038d)

  • Version bump (7efc66d)

  • Update README.rst (475e659)

  • Update README.rst (5d36a65)

  • List talks and articles (#66)

  • List talks and articles

  • Add Data Lunch (828a2ec)

  • Add notebook testing + fixes accordingly (#67)

  • Testing: Change notebook testing to pytest-notebook (current tests were skipped). Add try-except ImportError for pyspark code.

Bugfix in hist.py that broke the advanced tutorial.

Enhancement: Add %%capture to pip install inside of notebooks.

Enhancement: Make package install in notebooks work with paths with spaces.

  • Update requirements-test.txt

  • Update test_notebooks.py

  • Pickle doesn’t work with tests (not really a popmon-specific feature anyway). Changed the notebook to fix the issue, left the code for reference.

  • Increase timeout (84709fb)

  • Revert “Bump numpy from 1.18.0 to 1.19.4”

This reverts commit 518fb377d00973d7087628c66431b26d003b067d. (d4e82e7)

  • Bump numpy from 1.18.0 to 1.19.4

Bumps numpy from 1.18.0 to 1.19.4.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com> (32f7d73)

  • Version bump (6424d27)

  • Update README.rst (c9f0954)

  • Update README.rst (8dce537)

  • List talks and articles (#66)

  • List talks and articles

  • Add Data Lunch (756868f)

  • Add notebook testing + fixes accordingly (#67)

  • Testing: Change notebook testing to pytest-notebook (current tests were skipped). Add try-except ImportError for pyspark code.

Bugfix in hist.py that broke the advanced tutorial.

Enhancement: Add %%capture to pip install inside of notebooks.

Enhancement: Make package install in notebooks work with paths with spaces.

  • Update requirements-test.txt

  • Update test_notebooks.py

  • Pickle doesn’t work with tests (not really a popmon-specific feature anyway). Changed the notebook to fix the issue, left the code for reference.

  • Increase timeout (703f680)

  • Revert “Bump numpy from 1.18.0 to 1.19.4”

This reverts commit 518fb377d00973d7087628c66431b26d003b067d. (8ffe8f1)

  • Bump numpy from 1.18.0 to 1.19.4

Bumps numpy from 1.18.0 to 1.19.4.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com> (518fb37)

v0.3.10 (2020-10-28)

Unknown

  • Version bump (fabbb36)

  • Update HTML reports using Github Actions (#63)

  • Github Actions for building examples as artifacts (5b1a6af)

  • Traffic light overview (#62)

  • Traffic light overview plot

Other changes:

  • suppress “matplotlib backend” verbose warning

  • click on “popmon report” also scrolls to top

  • fix example comment (1f6c45e)

  • Add image to README.rst (#64)

Add image to README.rst (0aa004a)

  • Merge branch ‘master’ into develop (d018a12)

  • Version bump (3033abe)

  • Update HTML reports using Github Actions (#63)

  • Github Actions for building examples as artifacts (0282428)

  • Traffic light overview (#62)

  • Traffic light overview plot

Other changes:

  • suppress “matplotlib backend” verbose warning

  • click on “popmon report” also scrolls to top

  • fix example comment (9e95fac)

  • Add image to README.rst (#64)

Add image to README.rst (5c44fbd)

v0.3.9 (2020-09-29)

Unknown

  • Merge pull request #59 from ing-bank/develop

v0.3.9 (a2ede6b)

  • Merge branch ‘master’ into develop (23c69ba)

  • Update readme.rst (65c8df9)

  • Update readme.rst (63de8b5)

  • Version bump (735c6f0)

  • Merge pull request #58 from stephanecollot/develop

refactorize Bin creation and fix scipy version for pytestDevelop (31b205d)

  • Fix black linting (74c95f7)

  • Add test for bin_specs num/low/high (2df943d)

  • refactorize Bin creation + fix scipy version for pytest (9321626)

  • Merge pull request #54 from ing-bank/feature/numpy-stats-average

Slight simplification of mean/std (c5367f9)

  • Slight simplification of mean/std (5074f3d)

  • Merge pull request #53 from ing-bank/feature/isort-upgrade

Upgrade to isort 5 (e1d7f1a)

  • Upgrade to isort 5 (bad5168)

  • Merge branch ‘feature/tutorial_datasets’ into develop (869779e)

  • updating the advanced tutorial notebook to get data from popmon resources (478fd7c)

  • moving tutorial datasets to test_data dir (5020718)

  • Merge branch ‘release/v0.3.8’ into develop (8e0642f)

v0.3.8 (2020-07-09)

Unknown

  • Merge branch ‘release/v0.3.8’ (7bd287a)

  • Version bump and changelog (0c916f7)

  • Merge pull request #49 from ing-bank/feature/remove_nb_extensions

Remove enabling of unnecessary notebook extensions (f736acb)

  • Merge pull request #50 from ing-bank/feature/fix_column_case

Consistent column case (fix) (c7de2d8)

  • Consistent column case (fix) (0a883c2)

  • Remove enabling of unnecessary notebook extensions (fe896e3)

  • Merge pull request #48 from ing-bank/features/pypi-wheel-fix

Fix automated PyPi deployment (fdc5f77)

  • Fix automated PyPi deployment

The automated PyPi deployment Github Action is broken:

usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
   or: setup.py --help [cmd1 cmd2 ...]
   or: setup.py --help-commands
   or: setup.py cmd --help

error: invalid command &#39;bdist_wheel&#39;

This PR resolves this by installing the wheel dependency. (bc37bfc)

  • Merge branch ‘release/v0.3.7’ into develop (36cf573)

v0.3.7 (2020-07-08)

Unknown

  • Merge branch ‘release/v0.3.7’ (4f7b33e)

  • Version bump and changelog (ab266ce)

  • Merge pull request #47 from ing-bank/feature/install_popmon_in_nbs

Install popmon at the beginning of notebooks (4bafb72)

  • Add pip install popmon command at the beginning of nbs (464a8d8)

  • Merge pull request #46 from ing-bank/feature/matplotlib_ing_style

Use matplotlib ING style (729ffd9)

  • Update matplotlib style to ING theme (e933f16)

  • Merge branch ‘release/v0.3.6’ into develop (6187707)

v0.3.6 (2020-07-02)

Unknown

  • Merge branch ‘release/v0.3.6’ (c924751)

  • Version bump and changelog (b6ee935)

  • Merge pull request #41 from ing-bank/feature/docs-badges

Badges were missing from the tutorials page (d02633d)

  • Add table structure (6de0fa5)

  • Badges were missing from the tutorials page. (8b6ded4)

  • Merge pull request #40 from ing-bank/feature/makefiles

Extend make commands (1469fd1)

  • Extending make.bat and Makefile to support make install (all platforms) and make lint on Windows consistent with others. (49702ec)

  • Merge pull request #43 from ing-bank/numpy-version

Fixed numpy version (def2ca0)

  • Fixed version (f063e48)

  • Merge pull request #31 from ing-bank/feature/docs-spark

Provide spark usage example in docs (e5f2880)

  • Add a snippet on how to use spark to the docs. (08151ce)

  • Migrate to standard MIT license header and update CI accordingly (#38). (#39) (5013208)

  • The .gitignore syntax requires a slash at the end of directory names (https://git-scm.com/docs/gitignore#_examples) (#37) (2c91fde)

v0.3.5 (2020-06-16)

Unknown

  • Merge pull request #36 from ing-bank/release/v0.3.5

Release v0.3.5 (e6aec37)

  • Version bump and changelog (c293410)

  • Fix makefile third party modules + move lint check to Makefile (#30)

  • Enforce pybase64 and histogrammar to be formatted as third party modules

  • CI: Move lint check to Makefile, move dependencies to requirements-test.txt

  • Deduplicate code with a make lint check=1 argument (b956a3c)

  • Add licence headers, make.bat and CI workflow (#29) (d93f94b)

  • Introduces the make install command (which is used by pypi.yml). (c7973d3)

v0.3.4 (2020-06-10)

Unknown

  • Update changelog and bump version (689515b)

  • Consistent exception types (#27)

  • Informative exception types

  • Import fix (aa20de7)

  • IO improvements (#23)

  • IO

  • Platform agnostic

  • Use appropriate exception (TypeError instead of AssertionError)

  • Type hints

  • Update test to changes

  • Apply isort reordering

Co-authored-by: Tomas <shostakas@gmail.com> (06e4c60)

  • Weighted quantiles shared prework (~7.5 times speedup) (#22) (51dea92)

  • Fix failing hist_stitcher test when type is np.in32 (d6c1729)

  • Add setup version fix (quotes) (7c90c9f)

  • Make version available to package (090533b)

  • Include generator version and url (2de9587)

  • Consistent column case, settings gear icon (010b7e8)

  • Landing page improvements (#18)

  • Update landing page

  • Provide more overview by showing meta data as badges

  • Emphasize key functionality

  • Link directly to the tutorials form the landing page and include Colab links

  • Add docs readme

  • Notebook badge alignment (RST table) (fd084e8)

  • Add small import fix (037c51e)

  • Update CI build (1ec9a0a)

  • Fix circular import (d8892d7)

  • Post peer-review fixes (031b659)

  • Consistent code formatting using black, isort (#17) (4ed726d)

  • Update docs

  • Few textual changes

  • Add color coding to traffic lights

  • Lowercase API package name

  • Fix changelog (68a1d27)

  • Automatic release to PyPi on Github Release (ae735b1)

  • pypi classifiers (2d4f6d6)

  • Notebook changes (#13)

  • TQDM width fixed to fit in screen

  • prevent < objects > from being printed

  • simplify date parsing

  • textual changes (8f90a78)

  • Add references to past contributors - fixes #12 (5058746)

  • Update TL explanation plot (#11) (b563a7d)

  • Add limit for features in basic example (#10) (9f54ad5)

  • Update README links (#9) (cd56a73)

  • Merge pull request #8 from ing-bank/new_logo

Add new logo (dd8e315)

  • Add logo (da7b262)

  • Merge pull request #7 from ing-bank/update_docs_4_pypi

Update README to be compatible w/ pypi (385138d)

  • Update README to be compatible w/ pypi (35e668f)

v0.3.3 (2020-05-01)

Unknown

  • Update of python version in readme (22453e0)

  • Merge pull request #6 from ing-bank/pypi_docs_update

Updated description of popmon for pypi project (48c2ab6)

  • Updated description of popmon for pypi project (cea7c6f)

  • Merge pull request #4 from ing-bank/update_documentation

Add a working URL to an example report (0f1f229)

  • Add a working URL to an example report (9d3b8cd)

  • Merge pull request #5 from ing-bank/updated_setup

Updated setup.py for pypi project description (e1698c6)

  • Updated setup.py for pypi project description (728d527)

  • Merge pull request #1 from ing-bank/github-actions-ci

Add Github Actions (b79574c)

  • Add Github Actions (ecfce62)

  • Merge pull request #3 from ing-bank/doc_updates

Minor updates to documentation (ea53c04)

  • Small updates to documentation (d94d890)

  • Merge pull request #2 from ing-bank/basic_tutorial_speedup

Update to a faster version of the basic tutorial notebook (9a35133)

  • Faster version of the basic tutorial notebook (39b9e1b)

  • Initial commit (33ac752)